Question: database size about memgpt HOT 3 CLOSED

Nice question @tytung2020

Giving my cents on this topic,

The function that loads the database get all the data from all the found tables and put it into memory, so you'll likely need to have as much RAM as the data you want with some added value that I can't tell how big I'll need to be

references

from memgpt.

MemGPT has access to data you give it in databases. When it wants to read the contents of this data, it has to page it in via function calls. These function calls are paginated (in the functions we give provide in this repo), so data gets pulled into LLM context in chunks.

from memgpt.

I found this answer and the documentation a bit unclear - say my DB dump file is 1 TB. Is that too large / ineffective at its size? 200 GB? 500 GB? Does it depend on how much computer RAM is available? GPU VRAM?

from memgpt.