Text Generation
Streaming Output
On this page
Python Example
from openai import OpenAI
client = OpenAI(
base_url="https://api.apertis.ai/v1",
api_key="<APERTIS_API_KEY>"
)
stream = client.chat.completions.create(
model="<MODEL>",
messages=[{"role": "user", "content": "Say this is a test"}],
stream=True,
)
for chunk in stream:
if chunk.choices[0].delta.content is not None:
print(chunk.choices[0].delta.content, end="")Parameters
<MODEL>: The model to use, see Model List.stream: Whether to enable streaming output, currently only supportsTrue.APERTIS_API_KEY: Your API key.