Skip to main content

Serverless Inference

Use serverless inference to interact with supported models through Crusoe's Intelligence Foundry APIs. Models are served on Crusoe's proprietary inference engine with MemoryAlloy, a cluster-wide memory fabric with cache-aware routing that maximizes cache hits, improving TTFT and throughput.

Use Serverless Inference when:

  • Traffic is variable or unpredictable
  • You're prototyping or in early development
  • Per-token pricing is preferable to reserved capacity

OpenAI-compatible API​

Crusoe's Serverless Inference is accessible through an OpenAI-compatible API, so you can point any existing OpenAI client at Crusoe by changing the base URL and API key.