mullama Python
Investigating unified local LLM serving. A drop-in Ollama replacement exploring model management and inference unification.
Tag
3 results tagged "local-llm"
A practical comparison of mullama, Ollama, vLLM, LocalAI, and LM Studio for local LLM serving — when to use which, and why you might pick the research-instrumented option.
A post-mortem on building a local LLM serving layer — llama.cpp integration, model management, and where existing tools constrain research.