Articles by Tag #llamacpp
Browse our collection of articles on various topics related to IT technologies. Dive in and explore something new!
🎯 Run Qwen2-VL on CPU Using GGUF model & llama.cpp
Table of Contents: Key Takeaways Introduction Why GGUF and llama.cpp? Step 1:...
Engineer's Guide to Local LLMs with LLaMA.cpp on Linux
Introduction In this write up I will share my local AI setup on Ubuntu that I use for my...
Run a LLM Locally on an Intel Mac with an eGPU
Originally published on https://www.ankitbabber.com I have a Mac with Intel silicon. I also have...
# Building Production-Ready LLM Applications: Introducing llama-app-generator
From Prototype to Production in Minutes If you've worked with llama.cpp, you know the...
Running LLM llama.cpp Bare Metal on Raspberry Pi
For developers and hackers who enjoy squeezing maximum potential out of compact machines, getting a...
Jan v0.5.15: More control over llama.cpp settings, advanced hardware control, and more
If you're hearing about Jan for the first time: Jan is a desktop app that runs models locally. It's...
Running llama.cpp in Docker on Raspberry Pi
Running large language models on a Raspberry Pi isn’t just possible—it’s fun. Whether you're a...