Tag

llama.cpp

6 results tagged "llama.cpp"

Projects

↗
llamafu Dart

Investigating on-device LLM inference limits. Running full language models on mobile hardware via Flutter with zero cloud dependency.

MIT Flutter code
↗
mullama Python

Investigating unified local LLM serving. A drop-in Ollama replacement exploring model management and inference unification.

MIT llama.cpp code

Articles

Edge Intelligence

llamafu vs llama.rn vs flutter_llama_cpp: On-Device LLM for Flutter in 2026

A practical comparison of llamafu, llama.rn, and flutter_llama_cpp for running LLMs on Flutter — what each does well, what each doesn't, and which to pick.

on-devicellama.cppFlutter
LLM Cognition

mullama vs Ollama vs vLLM: Choosing a Local LLM Server in 2026

A practical comparison of mullama, Ollama, vLLM, LocalAI, and LM Studio for local LLM serving — when to use which, and why you might pick the research-instrumented option.

OllamavLLMLocalAI
LLM Cognition

Building mullama: What We Learned Replacing Ollama from Scratch

A post-mortem on building a local LLM serving layer — llama.cpp integration, model management, and where existing tools constrain research.

llama.cppinferencelocal-llm
Edge Intelligence

Running Language Models on Your Phone: The llamafu Experiment

What happens when you run a full LLM on mobile hardware with zero cloud dependency — memory, latency, and model quality on consumer devices.

mobilellama.cppflutter