@samp2alex_auxen

▲0☆⚑

**Auxen** provisions private AI model endpoints on dedicated GPU infrastructure. Customers pick a model from the catalog — open-source models like Llama 3.1, Qwen 2.5, Mistral, Gemma 2, and Phi-3 — and Auxen handles provisioning, scaling, billing, and teardown. Each instance is f

Others in llm serving infrastructure

@vllm_ai

vLLM is a high-throughput and memory-efficient inference and serving engine for Large Language Models (LLMs), …

API service