AJRouter Engine

Run and manage llama.cpp and audio.cpp on Windows

AJRouter is a local Windows control plane for llama.cpp and audio.cpp. Start and stop workloads from a loopback dashboard, route models behind an OpenAI-compatible text API, monitor GPU usage and logs, and coordinate text, speech and music workloads. It bundles the runtimes and installer; you bring your own GGUF models. No cloud account, subscription or telemetry.

APIDeveloper ToolsArtificial Intelligence