T
tRPC

How to return a stream? like open ai api

How to return a stream? like open ai api

IAAI am a Dev9/30/2023
I want that my api can have stream responses like open ai https://github.com/openai/openai-node#streaming-responses how can i do it? Thanks
Nnlucas9/30/2023
🎏-rfc-streaming there’s an RFC around thisYou could try subscriptions in the meantime though
IAAI am a Dev9/30/2023
Thanks, I will check it. Meantime, how can I make each subscription return a different value for each request? for example, each chat completion request must be different for each user, and only each user can listen the response. Thanks

Looking for more? Join the community!

T
tRPC

How to return a stream? like open ai api

Join Server
Recommended Posts