How Metal Works
AI Memory
Metal Memory enables you to give your users LLM session history.
Overview
LLM Memory is the process of giving your AI the ability to remember and learn over time. This is done by storing the history of your AI’s interactions with your users, and then using that data to improve your AI’s performance.
Use Cases
| Title | Description | Demo |
|---|---|---|
| Contextual Chat | Give your users a contextual chat experience | CLI Chat with Memory |
| Personalized Chat | Give your users a personalized chat experience by managing multiple conversations and remembering messages | Chat Memory Server |
| Conversational Agent | Enable memory for your conversational agent | Conversational Agent with Memory |
Usage
Add Session Memory
Add memory to your session by calling the Add Session Memory endpoint. This will add the memory to your session, and then index it.
Get Session Memory
Get memory from your session by calling the Get Session Memory endpoint. This will return the memory from your session.
Definitions
| Term | Definition |
|---|---|
| Context | Auto-generated summary of previous historical interactions |
| Memory | An array of interactions between the AI & Human |
| Session | A single grouping of interactions |