LostRuins/koboldcpp

AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading

Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compatible with most of Ikawrakow's quants except Bitnet.

Esobold - A fork of KoboldCPP with agent schenanigans and server side saving!

My personal fork of koboldcpp where I hack in experimental samplers.

Port of Facebook's LLaMA model in C/C++

A simple one-file way to run various GGML models with KoboldAI's UI

Port of Facebook's LLaMA model in C/C++

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

A simple one-file way to run various GGML models with KoboldAI's UI

A simple one-file way to run various GGML models with KoboldAI's UI

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI with experimental extensions.

A simple one-file way to run various GGML models with KoboldAI's UI

A simple one-file way to run various GGML models with KoboldAI's UI

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

A range of GGML and GGUF models through KoboldAI's intuitive UI.

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

A simple one-file way to run various GGML models with KoboldAI's UI

A simple one-file way to run various GGML models with KoboldAI's UI

A simple one-file way to run various GGML models with KoboldAI's UI

A simple one-file way to run various GGML models with KoboldAI's UI

fork of koboldcpp

A simple one-file way to run various GGML models with KoboldAI's UI

Port of Facebook's LLaMA model in C/C++

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.