OrganizationModel NameAPI Model StringContext LengthQuantization
DeepSeekDeepSeek R1 Distilled Llama 70Bcasperhansen/deepseek-r1-distill-llama-70b-awq8200AWQ
QwenQwen3 32BQwen/Qwen3-32B-AWQ8200AWQ
mistralaiDevstral Small 2507btbtyler09/Devstral-Small-2507-AWQ8200AWQ
MetaLlama 3.3 70B Instructcasperhansen/llama-3.3-70b-instruct-awq8200AWQ
More models coming soon!