vLLM Quickstart: High-Performance LLM Serving.

Complete vLLM setup guide with Docker, OpenAI API compatibility, PagedAttention optimization. Compare vLLM vs Ollama vs Docker Model Runner for production. https://www.glukhov.org/post/2026/01/vllm-quickstart/ #LLM #AI #Python #Docker #API #Ollama #DevOps #SelfHosting #NVidia #Hardware #PyTorch #DeepLearning #OpenSource #bash #Linux #Cloud #K8S

Comments

Post a Comment

Popular posts from this blog

Argumentum Ad Baculum - Definition and Examples

In the pursuit of truth and sound reasoning, fallacies present themselves as deceptive snares that can ensnare even the most critical thinker. Among these is the ad baculum fallacy, or appeal to force, a fallacious argumentative tactic that employs coercion or threats to support a conclusion. This article provides an in-depth exploration of the ad baculum fallacy, unveiling its subtleties, historical roots, and the impact it has on discourse and decision-making. Definition and Origins The phrase argumentum ad baculum is derived from Latin, meaning “argument to the stick,” or “appeal to the force” symbolizing the use of force or threat. This fallacy occurs when an argument is supported by a threat of negative consequences rather than by legitimate evidence or reasoning. It is a persuasive strategy that relies on fear to compel acceptance of a claim.
Read more

UV - a New Python Package Project and Environment Manager. Here we provide it's short description, performance statistics, how to install it and it's main commands

https://www.glukhov.org/post/2025/06/uv-new-python-package-project-and-environment-manager/ Python uv (pronounced “you-vee”) is a modern, high-performance Python package and project manager written in Rust. It is designed as a drop-in replacement for traditional Python package management tools such as pip, pip-tools, virtualenv, pipx, and pyenv, aiming to simplify and accelerate Python development workflows uv is developed by Astral, the team behind the popular Python linter Ruff, and is designed to address common pain points in the Python ecosystem—such as slow installations, dependency conflicts, and complex environment management—by leveraging Rust’s performance and modern software architecture.
Read more