Streaming Mode

Streaming mode allows the text chat model to deliver responses as they are generated, rather than waiting for the entire response to be completed. This provides faster feedback and a more fluid interaction. The stream parameter is used to enable/disable this mode.

You can also use this functionality when programming Assistants, though tracking and handling all necessary events is the responsibility of the developer. An example can be found in one of our use cases related to Assistant creation.

All our available text models support this feature.