Tensor library for machine learning

★ 16,035⑂ 2,064👁 150⑃ 952● 587▤ 45
C++MITCreated 2022-09-18github.com/ggml-org
下载:v1.0.0v1.0.0 ↓1.0.02026-11-13
+255
日增长
+455
周增长
+548
月增长
16,035
stars
2,064
forks
150
watchers
952
prs
587
issues
45
releases

README

ggml





Tensor library for machine learning







 Quick start

Build from source:

bash
git clone https://github.com/ggml-org/ggml
cd ggml

mkdir build && cd build
cmake ..
cmake --build . --config Release -j 8


For a minimal, fully commented example (matrix multiplication), see examples/simple.

 Description

The main goal of ggml is to be a simple, portable, and efficient tensor library for machine learning with minimal setup.

- Plain C/C++ implementation without any dependencies
- Cross-platform - x86, ARM, RISC-V, LoongArch, PowerPC, s390x, and WebAssembly
- SIMD-optimized kernels for x86, ARM, and RISC-V
- Broad backend support - CPU, GPU, NPU, and browser
- 2- to 8-bit integer quantization, plus MXFP4 and NVFP4 microscaling formats
- Zero memory allocations during runtime

 Documentation

- The GGUF file format
- Introduction to ggml
- GGML tips & tricks

 Contributing

- For changes to the core ggml library (including to the CMake build system), please open a PR in llama.cpp - doing so will make your PR more visible, better tested, and more likely to be reviewed

Top issues

Discussions

Latest release

v1.0.0 v1.0.0 2026-11-13
Overview

ggml 1.0.0 prunes the deprecated public API and the legacy DIAG_MASK ops, adds configurable YaRN truncation and FP8 support, and brings broad performance work across backends: few-row quantized matmuls and MoE fusion on CUDA/Metal, a Vulkan prefill FlashAttention path, a device-side MoE scheduler on SYCL, decomposed Adreno FlashAttention in OpenCL, new WebGPU kernels, expanded Hexagon op coverage, and scheduler improvements that avoid uploading unused inputs.

 API changes

- Pruned deprecated API and removed the legacy DIAG_MASK_INF/DIAG_MASK_ZERO ops, bumping the RPC protocol

Snapshot: 2026-11-16T09:23:14Z · Data license Apache-2.0 · JSON