invisiofficial/rk-llama.cpp

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend, run on Orange Pi 5

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

3588NPU Llama.cpp with the Rockchip NPU integration as a GGML backend.

llama.cpp on the Rockchip RK3588 NPU - RKNPU2 backend by @invisiofficial, rebased onto current upstream, with MoE experts on the NPU, cross-board tensor parallelism and a measurement study

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Llama.cpp with Rockchip NPU integration as GGML backend.