Ollama · Server and deployment
Run in Docker with NVIDIA GPUs
Give the container access to all GPUs. Needs the NVIDIA Container Toolkit.
docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama
Ollama · Server and deployment
Give the container access to all GPUs. Needs the NVIDIA Container Toolkit.
docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama
Was this page helpful?