You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hey, Thanks for your work on mem0. I was wondering what is the vision towards increasing the support for multi-model input/message. At the moment I am running into a few issues, namely:
List-based content can not be added/indexed by the mem0 (with redis backing). An example of list based content is shown here:
These fail with error TypeError: list indices must be integers or slices, not str but the entirely correct format for multi-modal OpenAI message format.
I can see that json/dict content is processed fine, however. i.e. the following is okay:
The image descriptor method get_image_description assumes a call to OpenAI. Can we make this method configurable for base_url, api_key and model i.e., in general, BaseLlmConfig to point it to any LLM?
To make mem0 more usable in a multi-modal setting where custom image descriptors can be more valuable for cost and domain fit purposes.
The text was updated successfully, but these errors were encountered:
suneeta-mall
changed the title
Configurable image descriptor
Configurable image descriptor fn get_image_description and support for list type content in messages
Mar 3, 2025
Hey @suneeta-mall I'm working on this issue, so can you please elaborate on why there is a need to pass the text field in the content key? Want to understand the use-case here. Thanks!
🚀 The feature
Hey, Thanks for your work on mem0. I was wondering what is the vision towards increasing the support for multi-model input/message. At the moment I am running into a few issues, namely:
content
can not be added/indexed by the mem0 (with redis backing). An example of list based content is shown here:These fail with error
TypeError: list indices must be integers or slices, not str
but the entirely correct format for multi-modal OpenAI message format.I can see that json/dict content is processed fine, however. i.e. the following is okay:
get_image_description
assumes a call to OpenAI. Can we make this method configurable for base_url, api_key and model i.e., in general, BaseLlmConfig to point it to any LLM?mem0/mem0/memory/utils.py
Line 48 in f4dc5f6
Motivation, pitch
To make mem0 more usable in a multi-modal setting where custom image descriptors can be more valuable for cost and domain fit purposes.
The text was updated successfully, but these errors were encountered: