Tag
llama.cpp
4 results tagged "llama.cpp"
Articles
Edge Intelligence
llamafu vs llama.rn: On-Device LLMs for Flutter and React Native
A practical comparison of llamafu, llama.rn and llama_cpp_dart for running llama.cpp models in mobile apps: what each binding covers and how to choose.
LLM Cognition
mullama vs Ollama vs vLLM: Choosing a Local LLM Server in 2026
Comparing mullama, Ollama, vLLM, LocalAI and LM Studio for local LLM serving: when to use which, and when in-process inference beats a daemon.
LLM Cognition
Building mullama: What We Learned Replacing Ollama from Scratch
Why mullama is a Rust runtime on llama.cpp with native bindings for six languages and an Ollama-compatible CLI, and what in-process inference changes.
Edge Intelligence
Running Language Models on Your Phone: The llamafu Experiment
What it takes to run an LLM on a phone with no cloud dependency: the memory arithmetic, quantisation trade-offs, and how llamafu brings llama.cpp to Flutter.