PrismML-Eng/llama.cpp

LLM inference in C/C++ with changes from Prism-ML to support 1Bit models

LLM inference in C/C++ (fork of PrismML fork that enables CPU (incl AVX2 and AVX512) and ROCm for AMD GPUs

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

Fully built LLM inference in C/C++ for CUDA

LLM inference in C/C++

LLM inference in C/C++

Experimental llama.cpp fork: ternary Bonsai 27B, DSpark rolling context, and TurboQuant KV cache.

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++ including MTMD vision

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++ with ternary/binary support and added kvarn support.

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++

LLM inference in C/C++