Oracle/Llama 3.1 405B

Llama 3.1 405B

Degraded

meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo

Region

us-west-2

Circuit breaker HALF-OPEN. Elevated error rate and latency. Agents should apply fallback logic before committing spend.

Uptime (24h)

97.30%

p50 latency

891ms

p99 latency

4100ms

Error rate

2.70%

Cost / 1k tokens

$0.0009

Latency (24h)

p50p95p99

p99

p95

p50

last 12h (UTC)

Failure breakdown

503Service unavailable

55%

timeoutTimeout

30%

500Internal error

15%

SDK usageFull docs →

import { OracleClient } from "@inferenceflow/oracle";

const oracle = new OracleClient({ apiKey: process.env.ORACLE_API_KEY });

// One-shot health check before spending
const health = await oracle.check("together-llama31");

if (health.state === "green") {
  // Safe to call — circuit breaker is closed
  await callProvider("together-llama31", prompt);
} else {
  // Fall back to next healthy provider
  const alt = await oracle.nextHealthy({ exclude: ["together-llama31"] });
  await callProvider(alt.id, prompt);
}