nlpxucan /WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

★ 9,471⑂ 742👁 106⑃ 71● 194▤ 6
PythonCreated 2023-04-23
下载:Release v1.6Release-1.6 ↓1.62023-08-27
+2
日增长
9,471
stars
742
forks
106
watchers
71
prs
194
issues
6
releases

README

WizardLM: Empowering Large Pre-Trained Language Models to Follow Complex Instructions


🏠 Home Page 

    

🤗 HF Repo • 🐦 Twitter • 📃 [WizardLM] @ICLR2024  • 📃 [WizardCoder] @ICLR2024    • 📃 [WizardMath] 


    👋 Join our Discord










Unofficial Video Introductions

Thanks to the enthusiastic friends, their video introductions are more lively and interesting.
1. NEW WizardLM 70b 🔥 Giant Model...Insane Performance
2. GET WizardLM NOW! 7B LLM KING That Can Beat ChatGPT! I'm IMPRESSED!
3. WizardLM: Enhancing Large Language Models to Follow Complex Instructions
4. WizardCoder AI Is The NEW ChatGPT's Coding TWIN!

 News

- 🔥🔥🔥[2024/01/04] We released WizardCoder-33B-V1.1  trained from deepseek-coder-33b-base, the SOTA OSS Code LLM on EvalPlus Leaderboard, achieves 79.9 pass@1 on HumanEval, 73.2 pass@1 on HumanEval-Plus, 78.9 pass@1 on MBPP, and 66.9 pass@1 on MBPP-Plus. WizardCoder-33B-V1.1 outperforms ChatGPT 3.5, Gemini Pro, and DeepSeek-Coder-33B-instruct on HumanEval and HumanEval-Plus pass@1. WizardCoder-33B-V1.1 is comparable with ChatGPT 3.5, and surpasses Gemini Pro on MBPP and MBPP-Plus pass@1.
- [2023/08/26] We released WizardCoder-Python-34B-V1.0 , which achieves the 73.2 pass@1 and surpasses GPT4 (2023/03/15), ChatGPT-3.5, and Claude2 on the HumanEval Benchmarks. For more details, please refer to WizardCoder.
- [2023/06/16] We released WizardCoder-15B-V1.0 , which surpasses Claude-Plus (+6.8), Bard (+15.3) and InstructCodeT5+ (+22.3) on the HumanEval Benchmarks. For more details, please refer to WizardCoder.


|  Model  |  Checkpoint  | Paper    | HumanEval  |   HumanEval+ | MBPP | MBPP+ |
| ----- |------| ---- |------|-------| ----- |  ----- |
|  GPT-4-Turbo (Nov 2023)  | - | - | 85.4  | 81.7 | 83.0 | 70.7 |
|  GPT-4 (May 2023)  | - | - | 88.4  | 76.8 | - | - |
|  GPT-3.5-Turbo (Nov 2023)  | - | - | 72.6  | 65.9 | 81.7 | 69.4 |
|  Gemini Pro  | - | - | 63.4  | 55.5 | 72.9 | 57.9 |
|  DeepSeek-Coder-33B-instruct | - | - |  78.7 | 72.6 | 78.7 | 66.7 |
|  WizardCoder-33B-V1.1  |   🤗 HF Link   |  📃 [WizardCoder]  |  79.9  | 73.2 | 78.9 | 66.9 |
|  WizardCoder-Python-34B-V1.0  |   🤗 HF Link   |  📃 [WizardCoder]  |  73.2   | 64.6 | 73.2 | 59.9 |
|  WizardCoder-15B-V1.0  |   🤗 HF Link   |  📃 [WizardCoder]  |  59.8   | 52.4 | -- | -- |
|  WizardCoder-Python-13B-V1.0  |   🤗 HF Link   |  📃 [WizardCoder]  |  64.0   | -- | -- | -- |
|  WizardCoder-Python-7B-V1.0  |   🤗 HF Link   |  📃 [WizardCoder]  |  55.5   | -- | -- | -- |
|  WizardCoder-3B-V1.0  |   🤗 HF Link   |  📃 [WizardCoder]  |  34.8   | -- | -- | -- |
|  WizardCoder-1B-V1.0  |   🤗 HF Link   |  📃 [WizardCoder]  |  23.8   | -- | -- | -- |




- [12/19/2023] 🔥 We released WizardMath-7B-V1.1 trained from Mistral-7B, the SOTA 7B math LLM, achieves 83.2 pass@1 on GSM8k, and 33.0 pass@1 on MATH.

- [12/19/2023] 🔥 WizardMath-7B-V1.1 outperforms ChatGPT 3.5, Gemini Pro, Mixtral MOE, and Claude Instant on GSM8K pass@1.

- [12/19/2023] 🔥 WizardMath-7B-V1.1 is comparable with ChatGPT 3.5, Gemini Pr

Top issues

Latest release

Release v1.6 v1.6 2023-08-27
🚀Major Update: Introducing WizardCoder 34B trained from Code Llama


WizardCoder-34B surpasses GPT-4, ChatGPT-3.5 and Claude-2 on HumanEval with 73.2% pass@1

- 🖥️Demo: http://47.103.63.15:50085/

- 🏇Model Weights: https://huggingface.co/WizardLM/WizardCoder-Python-34B-V1.0

Snapshot: 2026-11-16T09:23:14Z · Data license Apache-2.0 · JSON