IDEA-Research /Grounded-Segment-Anything
Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything
★ 17,796⑂ 1,598👁 120⑃ 132● 416▤ 0
+0
日增长
17,796
stars
1,598
forks
120
watchers
132
prs
416
issues
0
releases
README
!
Grounded-Segment-Anything
We plan to create a very interesting demo by combining Grounding DINO and Segment Anything which aims to detect and segment anything with text inputs! And we will continue to improve it and create more interesting demos based on this foundation. And we have already released an overall technical report about our project on arXiv, please check Grounded SAM: Assembling Open-World Models for Diverse Visual Tasks for more details.
- 🔥 Grounded SAM 2 is released now, which combines Grounding DINO with SAM 2 for any object tracking in open-world scenarios.
- 🔥 Grounding DINO 1.5 is released now, which is IDEA Research's Most Capable Open-World Object Detection Model!
- 🔥 Grounding DINO and Grounded SAM are now supported in Huggingface. For more convenient use, you can refer to this documentation
We are very willing to help everyone share and promote new projects based on Segment-Anything, Please check out here for more amazing demos and works in the community: Highlight Extension Projects. You can submit a new issue (with project tag) or a new pull request to add new project's links.
!
!
🍄 Why Building this Project?
The core idea behind this project is to combine the strengths of different models in order to build a very powerful pipeline for solving complex problems. And it's worth mentioning that this is a workflow for combining strong expert models, where all parts can be used separately or in combination, and can be replaced with any similar but different models (like replacing Grounding DINO with GLIP or other detectors / replacing Stable-Diffusion with ControlNet or GLIGEN/ Combining with ChatGPT).
🍇 Updates
- 2024/01/26 We have released a comprehensive technical report about our project on arXiv, please check Grounded SAM: Assembling Open-World Models for Diverse Visual Tasks for more details. And we are profoundly grateful for the contributions of all the contributors in this project.
- 2023/12/17 Support Grounded-RepViT-SAM demo, thanks a lot for their great work!
- 2023/12/16 Support Grounded-Edge-SAM demo, thanks a lot for their great work!
- 2023/12/10 Support Grounded-Efficient-SAM demo, thanks a lot for their great work!
- 2023/11/24 Release RAM++, which is the next generation of RAM. RAM++ can recognize any category with high accuracy, including both predefined common categories and diverse open-set categories.
- 2023/11/23 Release our newly proposed visual prompt counting model T-Rex. The introduction Video and Demo is available in DDS now.
- 2023/07/25 Support Light-HQ-SAM in EfficientSAM, credits to Mingqiao Ye and Lei Ke, thanks a lot for their great work!
- 2023/07/14 Combining Grounding-DINO-B with SAM-HQ achieves 49.6 mean AP in Segmentation in the Wild competition zero-shot track, surpassing Grounded-SAM by 3.6 mean AP, thanks for their great work!
- 2023/06/28 Combining Grounding-DINO with Efficient SAM variants including FastSAM and MobileSAM in EfficientSAM for faster annotatTop issues
#15NameError: name '_C' is not defined35 comments · 2023-04-08#88ModuleNotFoundError: No module named 'groundingdino'24 comments · 2023-04-12#295Can‘t install GroundingDINO19 comments · 2023-06-07#179questions on VISAM: how to fill --mot_path your_data_path?18 comments · 2023-04-20#84ImportError: cannot import name '_C' from 'groundingdino'18 comments · 2023-04-12#229Error: name '_C' is not defined , UserWarning: Failed to load custom C++ ops. Running on CPU mode Only!13 comments · 2023-05-07#224I have been successfully installed groundingDINO, but ms still appears" during runtime_ deform_ attn.py:33: UserWarning: Failed to load custom C++ ops. Running on CPU mode Only! warnings.warn("Failed to load custom C++ ops. Running on CPU mode Only!")"13 comments · 2023-05-05#152Failed to load custom C++ ops. Running on CPU mode Only!12 comments · 2023-04-17
Discussions
#551Should we add feature to download image from internet as input ?0 comments · 2025-03-28#523How to get best segmentation results from the model by giving best classes name0 comments · 2024-08-27#514Running Grounded SAM on CPU?0 comments · 2024-07-18#501Detect a single 'main' object for cropping0 comments · 2024-05-17#481[error] 'SAMWrapper' object has no attribute 'image_encoder'0 comments · 2024-04-08#451NameError: name '_C' is not defined2 comments · 2024-02-14#427negative maske0 comments · 2023-12-28#393Instance segmentation output misses objects further away1 comments · 2023-11-16