Providers | Min (tokens/s) | Max (tokens/s) | Avg (tokens/s) |
---|---|---|---|
Anthropic | 1.01 | 35.89 | 7.90 |
Vertex AI | 0.75 | 30.13 | 12.73 |
Amazon Bedrock | 0.22 | 17.95 | 14.10 |
Providers | Min (ms) | Max (ms) | Avg (ms) |
---|---|---|---|
Anthropic | 1470 | 2259 | 1805.41 |
Vertex AI | 1788 | 8835 | 4887.91 |
Amazon Bedrock | 3755 | 4769 | 4155.00 |
pythonfrom openai import OpenAI client = OpenAI( base_url="https://zenmux.ai/api/v1", api_key="<ZenMux_API_KEY>", ) completion = client.chat.completions.create( model="anthropic/claude-opus-4", messages=[ { "role": "user", "content": [ { "type": "text", "text": "What is in this image?" } ] } ] ) print(completion.choices[0].message.content)