Posts

Showing posts with the label linux

Podman Quadlet vs Docker Compose for Linux Services

Compare Podman Quadlet and Docker Compose for Linux services: systemd integration, rootless containers, updates, logs, and migration. Podman Quadlet vs Docker Compose for Linux Services
Post a Comment
Read more

Move Ollama Models to different location

After installing ollama better to reconfigure ollama to store them in new place right away. So after we pull a new model, it doesn’t get downloaded to the old location. Ollama is a text-based frontend to LLM AI Models and an API that can host those too. Install Ollama Goto https://ollama.com/download To install Ollama on linux: curl -fsSL https://ollama.com/install.sh | sh Ollama on Windows is on page: https://ollama.com/download/windows Ollama for Mac is there too: https://ollama.com/download/macOllamaSetup.exe Download, List and Remove Ollama models To download some Ollama models: Go to Ollama Library (https://ollama.com/library) and find the model you need, there you can also find model tags and sizes. Then run: ollama pull gemma2:latest # Or get slightly smarter one still nicely fitting into 16GB VRAM: ollama pull gemma2:27b-instruct-q3_K_S # Or: ollama pull llama3.1:latest ollama pull llama3.1:8b-instruct-q8_0 ollama pull mistral-nemo:12b-instruct-2407-q6_K ollama ...
Post a Comment
Read more