> ## Documentation Index
> Fetch the complete documentation index at: https://docs.agentsystems.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# GPU Acceleration

> Enable NVIDIA GPU acceleration for Ollama

## Prerequisites

* Linux with NVIDIA GPU
* [NVIDIA drivers and nvidia-container-toolkit](https://hub.docker.com/r/ollama/ollama) installed

## Configuration

After running `agentsystems init`, edit `compose/local/docker-compose.yml` and add this to the `ollama` service:

```yaml theme={null}
ollama:
  image: ollama/ollama:latest
  # ... existing configuration ...
  deploy:
    resources:
      reservations:
        devices:
          - driver: nvidia
            count: all
            capabilities: [gpu]
```

Then run:

```bash theme={null}
agentsystems up
```

## Verify

Check GPU usage while running a model:

```bash theme={null}
nvidia-smi
```

<Note>
  macOS does not support NVIDIA GPUs in Docker. AMD/Intel GPU support is not currently available.
</Note>
