Inference Frameworks
llama.cpp
C/C++ LLM inference engine using GGUF-quantized weights, running efficiently on CPU and GPU
Editorial compatibility: these components can be used together in representative deployments. That's not a requirement or a validated implementation. For real deployments, see the sourced reference architectures.