activeloopai /deeplake
Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.
★ 9,270⑂ 724👁 96⑃ 2,661● 559▤ 260
+2
日增长
9,270
stars
724
forks
96
watchers
2,661
prs
559
issues
260
releases
README
Deep Lake: Database for AI
Docs •
Get Started •
API Reference •
LangChain & VectorDBs Course •
Blog •
Whitepaper •
Slack •
Twitter
What is Deep Lake?
Deep Lake is a Database for AI powered by a storage format optimized for deep-learning applications. Deep Lake can be used for:
1. Storing and searching data plus vectors while building LLM applications
2. Managing datasets while training deep learning models
Deep Lake simplifies the deployment of enterprise-grade LLM-based products by offering storage for all data types (embeddings, audio, text, videos, images, dicom, pdfs, annotations, and more), querying and vector search, data streaming while training models at scale, data versioning and lineage, and integrations with popular tools such as LangChain, LlamaIndex, Weights & Biases, and many more. Deep Lake works with data of any size, it is serverless, and it enables you to store all of your data in your own cloud and in one place. Deep Lake is used by Intel, Bayer Radiology, Matterport, ZERO Systems, Red Cross, Yale, & Oxford.
Deep Lake includes the following features:
Multi-Cloud Support (S3, GCP, Azure)
Use one API to upload, download, and stream datasets to/from S3, Azure, GCP, Activeloop cloud, local storage, or in-memory storage. Compatible with any S3-compatible storage such as MinIO.
Native Compression with Lazy NumPy-like Indexing
Store images, audio, and videos in their native compression. Slice, index, iterate, and interact with your data like a collection of NumPy arrays in your system's memory. Deep Lake lazily loads data only when needed, e.g., when training a model or running queries.
Dataloaders for Popular Deep Learning Frameworks
Deep Lake comes with built-in dataloaders for Pytorch and TensorFlow. Train your model with a few lines of code - we even take care of dataset shuffling. :)
Integrations with Powerful Tools
Deep Lake has integrations with Langchain and LLamaIndex as a vector store for LLM apps, Weights & Biases for data lineage during model training, MMDetection for training object detection models, and MMSegmentation for training semantic segmentation models.
100+ most-popular image, video, and audio datasets available in seconds
Deep Lake community has uploaded 100+ image, video and audio datasets like MNIST, COCO, ImageNet, CIFAR, GTZAN and others.
Instant Visualization Support in the Deep Lake App
Deep Lake datasets are instantly visualized with bounding boxes, masks, annotations, etc. in Deep Lake Visualizer (see below).
🚀 How to install Deep Lake
Deep Lake can be installed using pip:
sh
pip install deeplake
To access all of Deep Lake's features, please register in the Deep Lake App.
🧠 Deep Lake Code Examples by Application
Vector Store Applications
Using Deep Lake as a Vector Store for building LLM applications:
- Vector Store Quickstart
- Vector Store Tutorials
- LangChain IntegratioTop issues
#1172[FEATURE] Tutorial notebooks for popular datasets35 comments · 2021-09-12#1168[FEATURE] Redis storage provider17 comments · 2021-09-12#1784How to add custom compression / decompression?15 comments · 2022-07-15#1556[FEATURE] hub.auto for audio and video htypes13 comments · 2022-03-19#1757[FEATURE] Detect duplicate samples when adding new data to tensors (images)12 comments · 2022-06-25#127Create conda distribution10 comments · 2020-10-22#2622[BUG] ds.visualize not working in jupyter notebook for local dataset9 comments · 2023-09-27#1560[Improvement] Make index errors while accessing Dataset and Tensor easier to understand.9 comments · 2022-03-22
Discussions
#3074Data storage and usage in Multimodal data scenarios1 comments · 2025-08-21#3052Unable to load FER2013 dataset anymore0 comments · 2025-05-08#3051Unable to Get Current Version of Deeplake0 comments · 2025-05-02#2866I can't include deeplake[enterprise] in the requirements.txt file1 comments · 2024-05-29#2839Error with VectorStore.search()1 comments · 2024-05-02#2837SampleDecompressionError:2 comments · 2024-04-28#2736Loading Chunked Data Error6 comments · 2024-01-06#2716How do I update or delete a record? Are there any CRUD examples out there?1 comments · 2023-12-04
Latest release
v4.5.2 v4.5.2 2026-02-11Deeplake v4.5.2 Release Notes - Support binary data in dataset and column metadata. - Remove dependency on libatomic