Skip to main content

​
Usage

anaconda ai download <MODEL> [OPTIONS]

​
Description

Downloads a quantized model file or safetensors collection from the backend. If the file is already downloaded, the command exits immediately unless --force is specified. A progress bar displays during the download.

​
Download types

​
Quantized models

A quantized model is a compressed GGUF file optimized for local inference. To download a quantized model, provide the model name and quantization type as ModelName/QuantizationType.

​
Safetensors collections

Safetensors collection downloads require the ai-catalyst backend.
You cannot launch a server or run inference on safetensors files directly from anaconda ai. Use a third-party framework to load and run the model after downloading.
A safetensors collection contains all the files needed to run a model with a third-party inference framework, such as Hugging Face transformers. You can download a safetensors collection using the --safetensors flag. A collection typically includes:

​
Arguments

​
Options

​
Examples

Download a model 
anaconda ai download OpenHermes-2.5-Mistral-7B/Q4_K_M
Force re-download of an existing model 
anaconda ai download OpenHermes-2.5-Mistral-7B/Q4_K_M --force
Download and hard-link to a custom path 
anaconda ai download OpenHermes-2.5-Mistral-7B/Q4_K_M -o ./models/openhermes.gguf
Download a safetensors collection 
anaconda ai download --safetensors Qwen3-4B-Thinking-2507
Download a safetensors collection to a specific directory 
anaconda ai download --safetensors Qwen3-4B-Thinking-2507 --output ./my-model