-
Notifications
You must be signed in to change notification settings - Fork 236
Open
Description
In the context of vLLM usage, when we try to serialize messages for sending it out as a SSE event, the serialization doesn't work. We wrote a workaround in vllm-project/vllm#26185 but it would be nice to fix it in this library.
parser.messages[0]
Message(author=Author(role=<Role.ASSISTANT: 'assistant'>, name=None), content=[TextContent(text='We need to respond as ChatGPT. The user says "Hello." We respond politely. Possibly ask how can help.')], channel='analysis', recipient=None, content_type=None)
parser.messages[0].model_dump_json()
'{"author":{"role":"assistant","name":null},"content":[{}],"channel":"analysis","recipient":null,"content_type":null}'
bmillwood
Metadata
Metadata
Assignees
Labels
No labels