system status
accurate as of: 2025-08-20 08:36:37
LLM Availability
Availability of the following third-party LLMs is largely outside of our control. Note these do not include our fine tuned models or our own models running on our infrastructure. Our routing system operates on a best-effort basis to offer consistently relevant responses in real-time and maintain a high level of throughput, agnostic to the availability of any particular model.
Total LLMs: 116 with 198 endpointsOPENAI_CHATGPT_4O
operational (2 providers )
OPENAI_GPT_4O
operational (2 providers )
OPENAI_GPT_4_1
operational (2 providers )
OPENAI_GPT_4_1_MINI
operational (2 providers )
OPENAI_GPT_5
operational (1 provider )
OPENAI_GPT_5_NANO
operational (2 providers )
OPENAI_GPT_O3
operational (1 provider )
OPENAI_GPT_O4_MINI
operational (2 providers )
OPENAI_IMAGE_GPT
operational (1 provider )
ANTHROPIC_CLAUDE_3_5_HAIKU
operational (2 providers )
ANTHROPIC_CLAUDE_4_SONNET
operational (2 providers )
GOOGLE_GEMINI_2_0_FLASH
operational (2 providers )
GOOGLE_GEMINI_2_0_FLASH_LITE
operational (2 providers )
GOOGLE_GEMINI_2_5_FLASH
operational (2 providers )
GOOGLE_GEMINI_2_5_FLASH_LITE
operational (1 provider )
GOOGLE_GEMINI_2_5_PRO
operational (1 provider )
COHERE_C4AI_AYA_VISION_32B
operational (1 provider )
COHERE_C4AI_AYA_VISION_8B
operational (1 provider )
COHERE_C4AI_EXPANSE_32B
operational (1 provider )
COHERE_COMMAND_A
operational (1 provider )
COHERE_COMMAND_R
operational (1 provider )
COHERE_COMMAND_R_7B
operational (1 provider )
COHERE_COMMAND_R_PLUS
operational (1 provider )
XAI_GROK_2_VISION
operational (1 provider )
XAI_GROK_3
operational (1 provider )
XAI_GROK_3_MINI
operational (1 provider )
XAI_GROK_4
operational (1 provider )
MERCURY
operational (1 provider )
MERCURY_CODER_SMALL
operational (1 provider )
DEEPSEEK_V3_671B
operational (4 providers )
META_LLAMA_3_1_8B
operational (7 providers )
META_LLAMA_3_3_70B
operational (9 providers )
META_LLAMA_4_MAVERICK_17B_128E
operational (7 providers )
DEEPSEEK_R1
operational (2 providers )
GOOGLE_GEMMA_3_12B
operational (2 providers )
GOOGLE_GEMMA_3_27B
operational (5 providers )
GRYPHE_MYTHOMAX_L2_13B
operational (1 provider )
META_LLAMA_4_SCOUT_17B_16E
operational (7 providers )
MICROSOFT_PHI_4
operational (3 providers )
MICROSOFT_WIZARDLM_2_8_22B
operational (2 providers )
MISTRAL_7B
operational (1 provider )
MISTRAL_NEMO_12B
operational (3 providers )
MISTRAL_SMALL_24B
operational (4 providers )
MOONSHOT_KIMI_K2
operational (2 providers )
NOUS_HERMES_3_LLAMA_3_1_405B
operational (2 providers )
NOVASKY_SKY_T1_QWEN_2_5_32B
operational (1 provider )
QWEN_2_5_7B
operational (1 provider )
QWEN_2_5_CODER_32B
operational (5 providers )
QWEN_3_14B
operational (2 providers )
QWEN_3_32B
operational (4 providers )
QWEN_3_A3B_30B
operational (2 providers )
QWEN_3_CODER
operational (1 provider )
ZAI_GLM_4_5
operational (1 provider )
ZAI_GLM_4_5_AIR
operational (1 provider )
COMPOUND_META_LLAMA
operational (1 provider )
COMPOUND_META_LLAMA_MINI
operational (1 provider )
DEEPSEEK_R1_DISTILL_META_LLAMA_70B
operational (6 providers )
ARCEE_BLITZ_24B
operational (1 provider )
ARCEE_CALLER_32B
operational (1 provider )
ARCEE_SPOTLIGHT_8B
operational (1 provider )
ARCEE_VIRTUOSO_32B
operational (1 provider )
ARCEE_VIRTUOSO_72B
operational (1 provider )
LGAI_EXAONE_DEEP_REASONING_32B
operational (1 provider )
MARIN_LLAMA_3_8B
operational (1 provider )
META_LLAMA_3_1_405B
operational (1 provider )
META_LLAMA_3_1_70B
operational (1 provider )
PERPLEXITY_DEEPSEEK_R1_1776
operational (2 providers )
QWEN_2_72B_INSTRUCT
operational (1 provider )
REFUEL_2_8B
operational (1 provider )
TYPHOON_2_70B
operational (1 provider )
BAIDU_ERNIE_300B
operational (1 provider )
BAIDU_ERNIE_424B
operational (1 provider )
DEEPSEEK_R1_QWEN_3_8B
operational (2 providers )
DEEPSEEK_V3_TURBO_671B
operational (1 provider )
DOLPHIN_MIXTRAL_22B_8E
operational (1 provider )
MIDNIGHT_ROSE_70B
operational (1 provider )
MINIMAX_M1
operational (1 provider )
NOUS_HERMES_2_PRO_LLAMA_3_8B
operational (1 provider )
QWEN_2_5_72B
operational (2 providers )
QWEN_3_A3B_32B
operational (1 provider )
SAO_LLAMA_EURYALE_70B
operational (1 provider )
SAO_LLAMA_STHENO_8B
operational (1 provider )
OPENAI_GPT_OSS_120B
operational (2 providers )
DEEPSEEK_R1_DISTILL_META_LLAMA_8B
operational (1 provider )
MISTRAL_DEVSTRAL_SMALL_24B
operational (2 providers )
QWEN_2_5_CODER_3B
operational (1 provider )
QWEN_2_5_CODER_7B
operational (1 provider )
QWEN_3_A22B_235B
operational (2 providers )
GOOGLE_GEMMA_2_2B
operational (1 provider )
NVIDIA_META_LLAMA_3_1_253B
operational (1 provider )
QWEN_3_4B
operational (1 provider )
AION_1_0
operational (1 provider )
AION_1_0_8B
operational (1 provider )
AION_1_0_MINI_DEEPSEEK_R1_32B
operational (1 provider )
AMAZON_NOVA_PRO_1_0
operational (1 provider )
ANUBIS_META_LLAMA_3_3_70B
operational (1 provider )
ANUBIS_META_LLAMA_3_3_70B_PRO_105B
operational (1 provider )
DEEPSEEK_R1_DISTILL_QWEN_7B
operational (1 provider )
GOOGLE_GEMMA_3_4B
operational (1 provider )
MAGNUM_72B
operational (1 provider )
MINIMAXAI_MINIMAX_456B
operational (1 provider )
MISTRAL_CODESTRAL_2508
operational (1 provider )
MISTRAL_LARGE
operational (1 provider )
MISTRAL_MAGISTRAL_24B
operational (1 provider )
MISTRAL_MEDIUM_3
operational (1 provider )
MISTRAL_SABA_24B
operational (1 provider )
NOUS_HERMES_3_LLAMA_3_1_70B
operational (1 provider )
NVIDIA_META_LLAMA_3_3_49B
operational (1 provider )
OPENAI_GPT_OSS_20B
operational (1 provider )
PERPLEXITY_SONAR_PRO
operational (1 provider )
PERPLEXITY_SONAR_REASONING_PRO
operational (1 provider )
QWEN_2_5_MAX
operational (1 provider )
QWEN_2_5_PLUS
operational (1 provider )
QWEN_2_5_TURBO
operational (1 provider )
SENTIENTAGI_DOBBY_LLAMA_3_1_8B
operational (1 provider )
THEDRUMMER_VALKYRIE_49B
operational (1 provider )
If you're experiencing issues, please contact support