Skip to main content

Overview

Akio is invoked via the akio binary. Every feature is exposed through a subcommand.

akio pull

Download a model repository from Hugging Face.
Examples
Files are stored in Akio’s local model directory. Use akio list to see what’s downloaded.

akio run

Start an interactive autonomous agent session with a model.
Examples
The --ngl flag requires Akio to be compiled with CUDA or Metal support. If built for CPU only, this flag has no effect.

akio rm

Remove a previously downloaded model repository.
Example

akio list

List downloaded models. Aliased as akio ls.
Examples

akio image

Generate an image from a text prompt using a local diffusion model. Aliased as akio img.
Examples
Width and height must both be divisible by 16. GPU is used by default when available (Metal on macOS, CUDA on Linux/Windows). Pass --cpu to override.

akio embedding

Generate L2-normalized vector embeddings from one or more input texts using a local GGUF embedding model. Aliased as akio embed.
The command prints a JSON array of float vectors — one vector per input — each L2-normalized. Examples
Use a model specifically trained for embeddings. The supported model is Fastiraz/Qwen3-Embedding-0.6B-GGUF. Pull it with akio pull Fastiraz/Qwen3-Embedding-0.6B-GGUF.

akio mcp

Manage MCP (Model Context Protocol) servers that extend Akio’s tool set.

akio mcp list

List all registered MCP servers and the tools they expose.

akio mcp add

Register a new MCP server.
Example

akio mcp remove

Unregister an MCP server.
Example