Umbra

Most useful open-weight models still don’t have a hosted API. You either rent a GPU, leave a Mac running overnight, or send prompts somewhere that can read them. Umbra is my experiment: an OpenAI-compatible endpoint (Anthropic-compatible too) where Apple Silicon owners host public Hugging Face GGUFs they approve. You swap base_url, keep your existing client, pay per token. Try it: https://tryumbra.dev Quickstart: https://tryumbra.dev/docs/quickstart Host a Mac: https://tryumbra.dev/setup