Complete reference for every xreduce command, grouped by workflow phase. For walkthroughs and worked examples, see the sidebar pages under Set up a model and Run XReduce.
| Phase | Command | Description |
|---|---|---|
| Authentication | xreduce login | Authenticate and store credentials locally. |
xreduce logout | Remove stored credentials. | |
| Model management | xreduce model create | Register a new model and write its config.yaml. |
xreduce model list | List models registered under the current account. | |
xreduce model show | Show details for a single model. | |
| Project setup | xreduce init | Scaffold a model folder with config templates. |
xreduce remap | Re-infer benchmarks/config.yaml from the benchmark JSONL. | |
| Run | xreduce profile | Run a single-prompt telemetry pass. |
xreduce evaluate | Evaluate a model against benchmark data. | |
xreduce compare | Compare models from the cost-quality matrix. |
Authenticate and store credentials at ~/.xreduce/credentials. Required before any model command.
# Interactive
xreduce login
# Use an existing API key (non-interactive)
xreduce login --api-key xr-1234-5678-9abc
# Named profile (multiple accounts)
xreduce login --profile staging| Flag | Description |
|---|---|
--api-key | Use an existing API key directly. Skips the email/password prompt. |
--email | Email address for interactive login (otherwise prompted). |
--profile | Profile name to store credentials under. Default: default. |
--api-base | Override API base URL. Used for staging or local dev. |
--force | Overwrite existing credentials for this profile without prompting. |
Remove stored credentials.
xreduce logout # default profile
xreduce logout --profile staging # specific profile
xreduce logout --all # remove all profiles| Flag | Description |
|---|---|
--profile | Profile to log out of. Default: default. |
--all | Remove all stored profiles entirely. |
Register a new model and write its config.yaml. See Register a model for the full flag list and walkthrough - there are roughly 20 optional flags covering architecture, hardware, task settings, and version metadata.
xreduce model create \
--name my-org/my-model \
--task-type text-to-sql| Flag | Description |
|---|---|
--name (required) | Model name as org/model-name. |
--task-type (required) | Task type slug, e.g. text-to-sql. |
--output / -o | Where to write config.yaml. Defaults to ./<name>/config.yaml. |
--profile | Credentials profile to use. |
| Plus ~20 optional flags - see Register a model. |
List all models registered under the current account.
xreduce model list # formatted table
xreduce model list --json # machine-readable JSON| Flag | Description |
|---|---|
--profile | Credentials profile to use. |
--json | Output JSON instead of a formatted table. |
Show details for a single model. --yaml emits a config.yaml suitable for profile and evaluate; --json emits the raw API response.
xreduce model show <model-id>
# Re-generate config.yaml for an existing model
xreduce model show <model-id> --yaml -o config.yaml
# Raw API response
xreduce model show <model-id> --json| Flag | Description |
|---|---|
model_id (positional) | Model UUID from xreduce model list. |
--profile | Credentials profile to use. |
--output / -o | Write output to this path instead of stdout. |
--yaml | Emit config.yaml ready for profile/evaluate. |
--json | Emit the raw API response as JSON. Mutually exclusive with --yaml. |
xreduce models (plural) is supported as a deprecated alias for one release. Use xreduce model going forward.
Scaffold a model folder with config.yaml and benchmarks/config.yaml. If a benchmark JSONL is already present, the field-mapping is inferred automatically. See Initialize a project for the full walkthrough.
xreduce init my-org/my-model
# Add a system_prompt placeholder
xreduce init my-org/my-model --with-system-prompt
# Pre-fill the system_prompt
xreduce init my-org/my-model --system-prompt "You are a SQL expert."| Flag | Description |
|---|---|
path (positional) | Target folder path. |
--force / -f | Overwrite existing config files. |
--with-system-prompt | Add a system_prompt placeholder. Mutually exclusive with --system-prompt. |
--system-prompt TEXT | Set system_prompt directly. |
Re-infer benchmarks/config.yaml from the benchmark JSONL without touching the model config.yaml. Use it when you add or change benchmark data after running init. User-owned keys in benchmarks/config.yaml are preserved; only field_map, input_serializer, and the task-default system_prompt are owned by remap.
xreduce remap my-org/my-model| Flag | Description |
|---|---|
path (positional) | Model folder path. |
Run a single-prompt telemetry pass. Sanity check before a full evaluation. See Profile for the full walkthrough.
xreduce profile --config my-org/my-model/config.yaml
# Override the prompt
xreduce profile --config my-org/my-model/config.yaml --prompt "Translate this..."
# Show full telemetry
xreduce profile --config my-org/my-model/config.yaml --verbose| Flag | Description |
|---|---|
--config / -c (required) | Path to config.yaml. |
--prompt / -p | Override the profiling prompt. |
--verbose / -v | Show full logging and raw telemetry payload. |
Evaluate a model against benchmark data. --config is repeatable for multi-model runs against a shared benchmark. See Evaluate for the full walkthrough.
# Single model, all benchmarks in benchmarks/
xreduce evaluate --config my-org/my-model/config.yaml
# Multiple models against a shared benchmark
xreduce evaluate \
--config models/a/config.yaml \
--config models/b/config.yaml \
--benchmark shared/benchmarks/text2sql.jsonl
# With a baseline for delta reporting
xreduce evaluate --config my-org/my-model/config.yaml --baseline <run-uuid>| Flag | Description |
|---|---|
--config / -c (required, repeatable) | Path to config.yaml. Repeat for multi-model. |
--benchmark | Filename, all, or shared/external path. |
--optimization-config / -o | Strategy. Default: baseline. |
--baseline / -b | UUID for delta calculation. |
--show-outputs | Print per-sample predictions and misses. |
--show-errors | Print only failed samples with error breakdown. |
--verbose / -v | Show detailed logging. |
--fail-fast | Stop on first config failure. |
Compare models on accuracy, latency, energy, and cost from the cost-quality matrix. Two modes: explicit head-to-head with positional model identifiers, or fleet-wide via --task-type. See Compare for the full walkthrough.
# Head-to-head - model names or UUIDs, plus --benchmark
xreduce compare qwen3-4b qwen2.5-coder-7b --benchmark text2sql.jsonl
# Fleet-wide by task type
xreduce compare --task-type text-to-sql| Flag | Description |
|---|---|
models (positional) | Two or more UUIDs or name substrings. |
--task-type | Compare all account models with this task type. Mutually exclusive with positional models. |
--benchmark | Benchmark filename (basename match). Required positional mode; optional in --task-type mode. |
--profile | Credentials profile to use. |
--json | Emit raw matrix rows as JSON. |