llama.cpp Quickstart with CLI and Server

Install llama.cpp, run GGUF models with llama-cli, and serve OpenAI-compatible APIs using llama-server. Key flags, examples, and tuning tips with a short commands cheatsheet

llama.cpp Quickstart with CLI and Server

Comments

Post a Comment

Popular posts from this blog

Gitflow Workflow overview

Another Gitflow Workflow overview: Steps, Alternatives, Pros & Cons https://dasroot.net/posts/2025/06/gitflow-overview-and-alternatives #Gitflow #git #devops Gitflow is a structured Git branching model designed to manage software development workflows with dedicated branches for features, releases, and hotfixes. It emphasizes **stable code in production**, **parallel development**, and **controlled release cycles**. While it offers robust version control and collaboration, its complexity and rigidity make it less suitable for agile or continuous deployment environments. Alternatives like **GitHub Flow** and **Trunk-Based Development** provide simpler, more flexible workflows.
Read more