One Model, Many Minds
How several distinct identities are trained into a single network — and how the right one is produced at the moment of use.
Feature · Machine Learning · Published by Elanza AI
1. Introduction
Every organisation that puts an AI assistant to work soon finds it needs to play more than one part. For most of their history, large language models worked as general-purpose text predictors. That is changing fast. The systems now being put to work in the real world are expected to be someone in particular: one user's personal assistant, a consistent character in a game, a support agent that speaks in a single steady voice and never breaks role. And whichever part it is playing, the model has to remember which one it is — turn after turn, and often session after session. Serving all of them from one network means several stable identities have to coexist on a single base model without contaminating one another, whether they are written into its weights or supplied to it at run time.
Researchers usually split the ambition into two goals. A 2024 survey names them role-playing, where a model is assigned a persona to play, and personalisation, where it acts on behalf of a user's persona [1].
The answer has two halves, and the rest of this paper follows them in turn — how a persona is written into a model during training, and how it is selected and applied during inference. The distinction sounds procedural. It turns out to shape almost everything about how far the arrangement scales.
This is not just a research question. Most companies that use AI assistants want the same thing: one system that can be a brand voice for customers, a private assistant for staff, and a fixed character in a training tool — instead of building and maintaining a separate one for each job.
2. From a Few Sentences to a Graph of Facts
The field began with something deliberately simple. An early benchmark, published in 2018, handed each speaker a handful of short sentences — "I am a nurse. I love hiking. I have two dogs." — and asked crowdworkers to converse in character from them [2]. It became a widely used test for persona-based dialogue, and a short written profile is still the most common way a persona is handed to a model today. Richer formats followed quickly: a large dialogue dataset whose speakers carry attribute–value traits such as age, gender, location and interest tags, published in 2019 [3], and long multi-session dialogues in which partners refer back to what they learned in earlier sessions, built to test whether models can carry that context across separate conversations, published in 2022 [4].
Plain text is easy to write, and it carries a persona only so far. It does not record how facts relate to one another, gives the model no structure to reason over, and takes more of the context window with every sentence added — precisely as personas become detailed enough to be worth having. A knowledge graph addresses all three. It holds a persona as a set of labelled facts, called triples, each in entity–relation–entity form: (persona, works_as, pharmacist). Knowledge graphs are valued for their symbolic reasoning ability and because new facts can be continuously added to them, as set out in a 2024 roadmap [5]; applied to a persona, a graph gives multi-step reasoning methods explicit links to follow, and a single fact can be added or changed without rewriting the profile. The design question, on this view, shifts from what the persona says to how its facts reach the model: written into its weights, or supplied to it at the moment of use.
| Format | Relations | Update | As personas multiply |
|---|---|---|---|
| Written profile | none | rewrite | carried in full each time |
| Attribute–value | none | per field | moderate |
| Graph triples | multi-step | add / remove one fact | high |
| Interaction history | implied | append | high |
| Layered profile | multi-step | level by level | high |
Structured formats let a model hold many personas without carrying them all at once. Author's synthesis, drawing on the formats introduced in [2] (2018), [3] (2019) and [5] (2024).
3. Where an Identity Is Written
3.1 Feed-Forward Layers as Fact Memory
Nearly every method can be characterised by two questions; [5] surveys many of the techniques involved. First, how is the persona represented when it enters the model — flattened into ordinary tokens, encoded as dense vectors, passed through a graph network, or retrieved and placed in the prompt. Second, where in the transformer does that representation arrive: at the input embeddings, in the attention layers, in the feed-forward block, in the residual stream, or at the final output.
Answering the second question well rests on one of the field's most consequential findings. Feed-forward layers behave like key–value memories — the first weight matrix detects a pattern in the input, the second promotes the output tokens associated with it, a result published in 2021 [6]. Causal tracing in 2022 then found that, in GPT-style models, middle-layer feed-forward modules play a decisive role in mediating factual predictions, and showed their weights could be edited directly to plant a new fact [7], an approach later scaled up in 2023 to insert thousands at once [8]. For weight-based methods, that makes persona injection look more like writing to memory at a particular address, though these studies concern factual associations in general, not persona knowledge specifically. One study found that injecting knowledge into the feed-forward block outperformed adding it at the input [9].
3.2 The Graph-Based Camp
A graph-based camp sits right beside the weight-editing one. Hybrid architectures pair a language model with a graph neural network so that structure and text reason together, exchanging information through multiple dedicated fusion layers and outperforming models eight times larger on commonsense and medical question-answering benchmarks (CommonsenseQA, OpenbookQA and MedQA-USMLE), an approach published in 2022 [10]. Work in the same spirit fuses entity representations into the encoder itself, published in 2019 [11], or attaches triples to the input as small trees of tokens, published in 2020 [12]. Each answers the same "where" question with a different address.
4. Trained In, or Served Out
Here the two halves separate. A persona can be placed in the model before it runs, by changing something in the weights, or supplied while it runs, by changing what the model is given to work with.
4.1 Editing the Weights
On the training side, editing weights writes a fact into the parameters themselves, so it persists across sessions and adds no inference-time overhead, although later training or further edits can still disturb it; an approach introduced in 2022 and extended in 2023 [7], [8]. A complementary approach, published in 2022, leaves the base model frozen and trains a small low-rank adapter instead, so one shared base model can serve many small task-specific adapters, switched by swapping them in and out [13]. Applying that pattern to personas, which is our extension rather than a result of the original work, would give one model a roster of identities, though keeping them isolated from one another remains a design problem in its own right. A related adapter-based approach uses the model's internal states to decide when to add new knowledge, reducing forgetting of what it already knows, as shown in 2024 [14].
4.2 Retrieval Without Touching the Weights
On the inference side, a newer line works without touching the weights at all. It keeps a per-user knowledge graph outside the model, retrieving and optimising it from feedback, and improves personalisation without changing model parameters, published in 2024 [15]. A related method, also from 2024, encodes a user's interaction history into embeddings that the model attends to through cross-attention, rather than describing the user in text [16]. A graph-based retrieval method built on user-centric knowledge graphs, published in 2025, was designed for, and evaluated in, settings where a user's own history is sparse or missing, and outperformed prior personalisation methods there [17].
5. What the Arrangement Is Worth in Practice
None of this has stayed in the lab, and the appeal is not only technical. One model, properly arranged, can do the work of a whole shelf of separately built and separately maintained systems.
Where the Value Shows Up
- One system, many roles. We argue that several role-personas on one model could let roles that differ in vocabulary, responsibility and tone share a single deployment, rather than each being served by a separately built system.
- Continuity on the other side of the screen. We argue that persona stability is what makes an assistant feel like the same assistant tomorrow as today, and that its value grows as more people come to rely on it.
- Cost that grows more slowly than headcount. Interchangeable adapters, or graphs held outside the model, mean adding a role need not mean funding another full model, per the 2022 adapter work [13], though storage, retrieval, inference and upkeep still grow with each role added.
- Separation you can inspect. Keeping each persona in its own graph makes what each role knows explicit and inspectable, and makes revising a fact a matter of editing a record, per the 2024 retrieval work [15]. Enforcing the boundary between roles still needs access controls on top.
- Knowledge that stays put. We argue that the facts and decisions recorded in a persona graph become an asset that outlasts whoever first supplied them, and can be handed on rather than rebuilt.
The significance of this work extends well beyond language models themselves. As organisations increasingly rely on AI to support employees, customers and specialised workflows, they need systems that can adopt different responsibilities without becoming separate systems altogether. Training and serving multiple personas from a single model offers a way to provide specialised behaviour while sharing the same base model and infrastructure, with each persona's own knowledge kept separate. Instead of maintaining many independent models, organisations can adapt one foundation model to different roles, making AI systems easier to deploy, update and scale as new requirements emerge.
The pragmatic argument reinforces the technical one. Retrieval-based persona systems leave the base model unchanged, which sidesteps the cost of retraining the base model and keeps an existing deployment usable exactly as it stands, as reported in 2024 and 2025 [15], [17] — a property that may make them easier to deploy.
6. Below the Layer, and Off the Server
Two threads are redrawing the map again. The first drops below the layer, down to the circuit — a particular combination of attention heads and feed-forward sub-layers that together perform one function. Interpretability research published in 2024 identified knowledge circuits in GPT-2 and TinyLlama that work together to express particular facts [18]. A steering method proposed in a 2026 conference submission, not yet an established result, targets circuits it identifies for personal facts and combines adapters with steering-based activation injection there; evaluated on synthetic personal knowledge graphs, it reports updating a user's facts without degrading existing knowledge [19]. If such results hold up more broadly, the choice of where to write could rest less on intuition and more on measurement.
The second thread concerns where the data sits. A federated design for personalised recommendation, published in 2026, keeps each user's personal knowledge graph on their own device and shares only small low-rank adapter updates, letting a lightweight model complete a private graph without centralising anyone's data [20] — an approach with obvious appeal wherever privacy regulation or plain trust is at stake.
7. In Short
Step back and the through-line is hard to miss. In under a decade the options have multiplied: describing a persona in a few sentences, writing facts into particular weights and layers, probing the circuits that express them, and keeping each identity in a graph outside the model, drawn on as needed rather than absorbed whole. These approaches coexist rather than replace one another, and each offers a different answer to how one network can serve many stable identities at once.
The momentum is what makes this such a rewarding area to follow. Active work is refining how personas are kept distinct from one another, how a new role can be brought up to strength from a small amount of history, and how the division of labour between layers can be measured rather than assumed — while the boundary between what is trained in and what is served out keeps moving as both sides advance. The question running through this work, should an identity live in the model's weights or alongside it?, is proving to be one of the more quietly profound problems in machine learning, and the answers are arriving fast.
And the answer will matter far past the page it's studied on — it decides whether one assistant can safely stand in for many different roles across a business.
References
- [1]Y.-M. Tseng et al., “Two tales of persona in LLMs: A survey of role-playing and personalization,” in Findings Assoc. Comput. Linguistics: EMNLP 2024, Miami, FL, USA, 2024, pp. 16612–16631. [Online]. Available: https://aclanthology.org/2024.findings-emnlp.969/
- [2]S. Zhang, E. Dinan, J. Urbanek, A. Szlam, D. Kiela, and J. Weston, “Personalizing dialogue agents: I have a dog, do you have pets too?” in Proc. 56th Annu. Meeting Assoc. Comput. Linguistics (Vol. 1: Long Papers), Melbourne, VIC, Australia, 2018, pp. 2204–2213. [Online]. Available: https://aclanthology.org/P18-1205/
- [3]Y. Zheng, G. Chen, M. Huang, S. Liu, and X. Zhu, “Personalized dialogue generation with diversified traits,” arXiv:1901.09672 [cs.CL], Jan. 2019, doi: 10.48550/arXiv.1901.09672.
- [4]J. Xu, A. Szlam, and J. Weston, “Beyond goldfish memory: Long-term open-domain conversation,” in Proc. 60th Annu. Meeting Assoc. Comput. Linguistics (Vol. 1: Long Papers), Dublin, Ireland, 2022, pp. 5180–5197. [Online]. Available: https://aclanthology.org/2022.acl-long.356/
- [5]S. Pan, L. Luo, Y. Wang, C. Chen, J. Wang, and X. Wu, “Unifying large language models and knowledge graphs: A roadmap,” IEEE Trans. Knowl. Data Eng., vol. 36, no. 7, pp. 3580–3599, Jul. 2024, doi: 10.1109/TKDE.2024.3352100.
- [6]M. Geva, R. Schuster, J. Berant, and O. Levy, “Transformer feed-forward layers are key-value memories,” in Proc. Conf. Empirical Methods Natural Lang. Process. (EMNLP), Punta Cana, Dominican Republic, 2021, pp. 5484–5495. [Online]. Available: https://aclanthology.org/2021.emnlp-main.446/
- [7]K. Meng, D. Bau, A. Andonian, and Y. Belinkov, “Locating and editing factual associations in GPT,” arXiv:2202.05262 [cs.CL], Feb. 2022, doi: 10.48550/arXiv.2202.05262.
- [8]K. Meng, A. Sen Sharma, A. Andonian, Y. Belinkov, and D. Bau, “Mass-editing memory in a transformer,” in Proc. Int. Conf. Learn. Represent. (ICLR), 2023, doi: 10.48550/arXiv.2210.07229.
- [9]Y. Yao, S. Huang, L. Dong, F. Wei, H. Chen, and N. Zhang, “Kformer: Knowledge injection in transformer feed-forward layers,” in Natural Language Processing and Chinese Computing (NLPCC 2022) (Lecture Notes in Computer Science, vol. 13551), W. Lu, S. Huang, Y. Hong, and X. Zhou, Eds. Cham, Switzerland: Springer, 2022, doi: 10.1007/978-3-031-17120-8_11.
- [10]X. Zhang et al., “GreaseLM: Graph reasoning enhanced language models for question answering,” arXiv:2201.08860 [cs.CL], Jan. 2022, doi: 10.48550/arXiv.2201.08860.
- [11]Z. Zhang, X. Han, Z. Liu, X. Jiang, M. Sun, and Q. Liu, “ERNIE: Enhanced language representation with informative entities,” in Proc. 57th Annu. Meeting Assoc. Comput. Linguistics, Florence, Italy, 2019, pp. 1441–1451. [Online]. Available: https://aclanthology.org/P19-1139/
- [12]W. Liu et al., “K-BERT: Enabling language representation with knowledge graph,” in Proc. AAAI Conf. Artif. Intell., 2020, vol. 34, no. 3, pp. 2901–2908, doi: 10.1609/aaai.v34i03.5681.
- [13]E. J. Hu et al., “LoRA: Low-rank adaptation of large language models,” in Proc. Int. Conf. Learn. Represent. (ICLR), 2022, doi: 10.48550/arXiv.2106.09685.
- [14]F. Wang et al., “InfuserKI: Enhancing large language models with knowledge graphs via infuser-guided knowledge integration,” in Findings Assoc. Comput. Linguistics: EMNLP 2024, Miami, FL, USA, 2024, pp. 3675–3688. [Online]. Available: https://aclanthology.org/2024.findings-emnlp.209/
- [15]J. Sun, Z. Du, and Y. Chen, “Knowledge graph tuning: Real-time large language model personalization based on human feedback,” arXiv:2405.19686 [cs.AI], May 2024, doi: 10.48550/arXiv.2405.19686.
- [16]L. Ning et al., “User-LLM: Efficient LLM contextualization with user embeddings,” arXiv:2402.13598 [cs.CL], Feb. 2024, doi: 10.48550/arXiv.2402.13598.
- [17]S. Au et al., “Personalized graph-based retrieval for large language models,” arXiv:2501.02157 [cs.CL], Jan. 2025, doi: 10.48550/arXiv.2501.02157.
- [18]Y. Yao et al., “Knowledge circuits in pretrained transformers,” in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS), vol. 37, Dec. 2024, pp. 118571–118602, doi: 10.52202/079017-3765.
- [19]J. Kim, H. Jung, C. Kim, and H. Park, “Circuit-level steering for personalized knowledge injection in language models,” submitted to Int. Conf. Learn. Represent. (ICLR), 2026. [Online]. Available: https://openreview.net/forum?id=Txf9GLUo1l
- [20]F. Spadea and O. Seneviratne, “Federated personal knowledge graph completion with lightweight large language models for personalized recommendations,” in The Semantic Web (ESWC 2026) (Lecture Notes in Computer Science, vol. 16549), M. Acosta et al., Eds. Cham, Switzerland: Springer, 2026, doi: 10.1007/978-3-032-25156-5_8.