jjang-ai /mlxstudio

MLX Studio - Easiest way to run LLM's on your Mac. All in one engine.

★ 991⑂ 64👁 15⑃ 1● 143▤ 243
Created 2026-03-05mlx.studio
下载:vMLX 1.6.84vMLX-1.6.84 ↓1.6.842026-11-07
+0
日增长
991
stars
64
forks
15
watchers
1
prs
143
issues
243
releases

README

Native macOS app for the vMLX inference server on Apple Silicon



  Looking for a native Swift macOS app or Swift inference engine? See osaurus.ai.



  
  
  
  


---

MLX Studio is a full-featured macOS app that wraps the vMLX inference server — large language models, vision models, and image generation served via an OpenAI-compatible HTTP API on Apple Silicon. Built on Apple's MLX framework for GPU-accelerated inference, self-hosted on the user's machine.

 Screenshots


  
    Chat Interface
    Image Generation
  
  
    Developer Tools
    Menu Bar Tray
  


 Download

 Download the latest DMG from Releases

1. Download vMLX-X.Y.Z-tahoe-arm64.dmg for macOS Tahoe (recommended), or
   vMLX-X.Y.Z-sequoia-arm64.dmg for macOS Sequoia
2. Open the DMG and drag vMLX to your Applications folder
3. Launch from Applications or Spotlight

All releases are signed and notarized by Apple for Gatekeeper compatibility.

 Quick Start

1. Launch MLX Studio from Applications
2. Pick a model -- browse and download from Hugging Face directly in the app
3. Chat -- start a conversation, attach images, or use tool calling
4. That's it. No Python setup, no terminal, no configuration files.

 Features

- Chat -- Multi-turn conversations with streaming, markdown rendering, and code highlighting
- Vision -- Send images to multimodal models (Qwen-VL, LLaVA, Pixtral, and more)
- Reasoning -- Native support for thinking/reasoning models (DeepSeek-R1, QwQ, GLM-Z1)
- Tool Calling -- Function calling with structured output for agent workflows
- Image Generation -- Text-to-image with MLX-powered diffusion models
- Text-to-Speech -- TTS via Kokoro with multiple voices
- Speech-to-Text -- Whisper-based transcription
- OpenAI-Compatible API -- HTTP server on localhost for any compatible client
- Menu Bar Mode -- Runs in the tray for quick access
- Developer Tools -- Model inspection, conversion, quantization, and diagnostics
- Session Management -- Save, restore, and organize conversations with SQLite persistence
- JANG Quantization -- First-class support for JANG mixed-precision quantization formats

 Engine Highlights

- Continuous Batching with PagedAttention for efficient memory use
- Speculative Decoding for faster generation on supported models
- KV Cache Quantization to fit larger contexts in limited memory
- Prefix Caching for faster repeated prompts
- Hybrid Model Support (Mamba/SSM + Transformer architectures)

 System Requirements

| Requirement | Minimum |
|---|---|
| macOS | 14.0 Sonoma or later |
| Chip | Apple Silicon (M1, M2, M3, M4 -- any variant) |
| RAM | 8 GB (16 GB+ recommended for larger models) |
| Disk | ~500 MB for the app; models vary (1--50 GB each) |

 What's Included

MLX Studio bundles everything needed to run the inference server:

| Mode | Description |
|---|---|
| Chat | Conversational UI with vision, reasoning, and tool support |
| Server | OpenAI-compatible API server (/v1/chat/completions, /v1/responses) |
| Image | Text-to-image generation 

Top issues

Latest release

vMLX 1.6.84 v1.6.84 2026-11-07
vMLX 1.6.84

 Changes

- Publish vMLX 1.6.83 updater manifest (b20e7513)
- feat(ricursive): Ripple-65B runtime and DFlash2 text lane (f6bd17ff)
- fix(dflash2): text lane parity, rotating snapshot aliasing, drafter window (0b33f432)
- fix(ripple): lane-owned max_tokens, history reasoning separators, launch test (abdfeec3)
- perf(dflash2): lane matmul on text targets, exact Ripple verify attention (aff7cfeb)
- perf(ripple): sliding-window SSD deltas; no thinking/effort controls (9b6d00ad)
- test(dflash2): pin the lane matmul on text-only DFlash2 targets (3e5a51d9)
- perf(dflash2): keep the finis

Snapshot: 2026-11-16T09:23:14Z · Data license Apache-2.0 · JSON