Providers | Min (tokens/s) | Max (tokens/s) | Avg (tokens/s) |
---|---|---|---|
OpenAI | 8.52 | 81.41 | 21.22 |
Azure | 5.89 | 103.03 | 29.66 |
Providers | Min (ms) | Max (ms) | Avg (ms) |
---|---|---|---|
OpenAI | 584 | 1158 | 718.90 |
Azure | 1154 | 2052 | 1342.69 |
pythonfrom openai import OpenAI client = OpenAI( base_url="https://zenmux.ai/api/v1", api_key="<ZenMux_API_KEY>", ) completion = client.chat.completions.create( model="openai/gpt-4.1-mini", messages=[ { "role": "user", "content": [ { "type": "text", "text": "What is in this image?" } ] } ] ) print(completion.choices[0].message.content)