Real-time Neuroplasticity: Giving Pre-trained LLMs Real-time Learning
This experimental technique, called "Neural Graffiti," uses a plug-in called the "Spray Layer" to inject memory traces directly into the final inference stage of pre-trained large language models (LLMs) without fine-tuning or retraining. Mimicking the neuroplasticity of the brain, it subtly alters the model's "thinking" by modifying vector embeddings, influencing its generative token predictions. Through interaction, the model gradually learns and evolves. While not forcing specific word outputs, it biases the model towards associated concepts with repeated interaction. The aim is to give AI models more proactive behavior, focused personality, and enhanced curiosity, ultimately helping them achieve a form of self-awareness at the neuron level.
Read more
