Oracle/Mixtral 8x7B

Mixtral 8x7B

Healthy
mixtral-8x7b-32768
Region
us-east-1
Uptime (24h)
99.99%
p50 latency
48ms
p99 latency
310ms
Error rate
0.01%
Cost / 1k tokens
$0.0003
Latency (24h)
p50p95p99
017535001:1304:1307:1310:13
p99
p95
p50
last 12h (UTC)
Failure breakdown
429Rate limited
80%
timeoutTimeout
20%
SDK usageFull docs →
import { OracleClient } from "@inferenceflow/oracle";

const oracle = new OracleClient({ apiKey: process.env.ORACLE_API_KEY });

// One-shot health check before spending
const health = await oracle.check("groq-mixtral");

if (health.state === "green") {
  // Safe to call — circuit breaker is closed
  await callProvider("groq-mixtral", prompt);
} else {
  // Fall back to next healthy provider
  const alt = await oracle.nextHealthy({ exclude: ["groq-mixtral"] });
  await callProvider(alt.id, prompt);
}