You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
LMMs integrate images into the conversation. We should generalise this, and let future models / agents pass other objects (like text files, sound, video, camera feeds) into the conversation.
The text was updated successfully, but these errors were encountered:
davidschlangen
changed the title
[framework] future proof: allow any kind of data in conversation
[framework] future-proof: allow any kind of data in conversation
Feb 21, 2024
I guess this entails expanding the Player ABC to handle any kind of data in addition to the messages list, and - depending on what the data is used for - the GameMaster ABCs as well.
I think a clear delineation between game-side (non-clem Player/GameMaster use) and model-side data would be good as well, as the latter needs backend support for handling the extra data. If there's no clear guidance/examples from the framework for these, I suspect that game creation using arbitrary data could get more messy than it already is...
LMMs integrate images into the conversation. We should generalise this, and let future models / agents pass other objects (like text files, sound, video, camera feeds) into the conversation.
The text was updated successfully, but these errors were encountered: