tensorchord /Awesome-LLMOps

An awesome & curated list of best LLMOps tools for developers

★ 5,977⑂ 1,341👁 68⑃ 1,101● 35▤ 0
ShellCC0-1.0Created 2022-04-15
+0
日增长
5,977
stars
1,341
forks
68
watchers
1,101
prs
35
issues
0
releases

README

Awesome LLMOps




An awesome & curated list of the best LLMOps tools for developers.

 [!NOTE]
 Contributions are most welcome, please adhere to the contribution guidelines.

 Table of Contents

- Awesome LLMOps
  - Table of Contents
  - Model
    - Large Language Model
    - CV Foundation Model
    - Audio Foundation Model
    - Robotics Foundation Model
  - Serving
    - Large Model Serving
    - Frameworks/Servers for Serving
  - Security
    - Frameworks for LLM security
    - Observability
  - LLMOps
  - Search
    - Vector search
  - Code AI
  - Training
    - IDEs and Workspaces
    - Foundation Model Fine Tuning
    - Frameworks for Training
    - Experiment Tracking
    - Visualization
    - Model Editing
  - Data
    - Data Management
    - Data Storage
    - Data Tracking
    - Feature Engineering
    - Data/Feature enrichment
  - Large Scale Deployment
    - ML Platforms
    - Workflow
    - Scheduling
    - Model Management
  - Performance
    - ML Compiler
    - Profiling
  - AutoML
  - Optimizations
  - Federated ML
  - Awesome Lists



 Model

 Large Language Model

| Project                                                                 | Details                                                                                                                                                                                    | Repository                                                                                                |
| ----------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | --------------------------------------------------------------------------------------------------------- |
| Alpaca                  | Code and documentation to train Stanford's Alpaca models, and generate the data.                                                                                                           | !GitHub Badge      |
| BELLE                           | A 7B Large Language Model fine-tune by 34B Chinese Character Corpus, based on LLaMA and Alpaca.                                                                                            | !GitHub Badge              |
| Bloom              | BigScience Large Open-science Open-access Multilingual Language Model                                                                                                                      | !GitHub Badge |
| dolly                        | Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform                                                                                              | !GitHub Badge           |
| Falcon 40B         | Falcon-40B-Instruct is a 40B parameters causal decoder-only model built by TII based on Falcon-40B and finetuned on a mixture of Baize. It is made available under 

Top issues

Snapshot: 2026-11-16T09:23:14Z · Data license Apache-2.0 · JSON