Models, inference, and hosting.
Short explainers for developers calling the API and operators putting GPUs on the network.
-
Engineering
Modelmeter: how we bench price and latency for open models
We open-sourced the internal tool Scalattice engineers use to compare open-model prices and latency across providers.
-
Developers
The August 2026 catalog, with published rates
Why we added Qwen 3.6, Coder, gpt-oss, Mistral Small, Gemma 4, and Scout: what each family is for, plus snapshot rates.
-
Developers
LiteLLM and Open WebUI on Scalattice
Point Open WebUI or LiteLLM at https://api.scalattice.cloud/v1 with an slt_ key. Same OpenAI-compatible chat completions.
-
Developers
CLI and MCP: setup Scalattice from the terminal
Install from npm, run scalattice setup, print OpenAI env vars, check credits. Optional MCP for Cursor and Claude Desktop.
-
Developers
Drop-in OpenAI SDK → Scalattice
Swap base URL and API key. Copy-paste Python and curl. First completion in under two minutes.
-
Models
Choosing a model from the catalog
When to pick Llama 3.3 70B vs Qwen3 mid-sizes, Gemma 4, DeepSeek R1, gpt-oss, or Qwen3 Coder. VRAM and job shape matter more than brand names.
-
Inference
What inference actually is
Tokens, context, streaming, and why per-million pricing shows up on your bill. A plain-language map of the Scalattice API path.
-
Hosting
Host inference on your GPU
Agent install, disk for weights, schedules, and what “in the pool” means before you earn on catalog jobs.
FAQ
What is Scalattice?
Managed production inference across a distributed GPU network. Developers use an OpenAI-compatible API. Operators host catalog models and earn a majority share of token revenue on completed jobs.
Which models can I use?
See the live catalog in Scalattice Cloud and on pricing. August 2026 lineup: Qwen3 1.7B–32B, Qwen3.5/3.6, Qwen3 Coder 30B A3B, DeepSeek R1 7B, gpt-oss 20B, Mistral Small 3.2, Gemma 4, Llama 3.3 70B, Llama 4 Scout. Details: August catalog post.
Can I earn money hosting inference?
Yes, if your machine fits a catalog model and stays ready in the pool. Start with the hosting guide and providers.
Is the API OpenAI compatible?
Yes. Swap base URL and API key in the OpenAI SDK. Step-by-step: Drop-in OpenAI SDK → Scalattice. Also see developers and Cloud docs.