Providers | Min (tokens/s) | Max (tokens/s) | Avg (tokens/s) |
---|---|---|---|
Anthropic | 22.74 | 41.57 | 30.66 |
Vertex AI | 11.61 | 48.95 | 37.03 |
Amazon Bedrock | 30.47 | 67.2 | 53.06 |
Providers | Min (ms) | Max (ms) | Avg (ms) |
---|---|---|---|
Anthropic | 2125 | 3055 | 2763.24 |
Vertex AI | 1003 | 47249 | 7280.65 |
Amazon Bedrock | 1674 | 9852 | 3240.29 |
pythonfrom openai import OpenAI client = OpenAI( base_url="https://zenmux.ai/api/v1", api_key="<ZenMux_API_KEY>", ) completion = client.chat.completions.create( model="anthropic/claude-sonnet-4", messages=[ { "role": "user", "content": [ { "type": "text", "text": "What is in this image?" } ] } ] ) print(completion.choices[0].message.content)