Sd-Webui-Segment-Anything

Visit Tool

sd-webui-segment-anything is an extension for Stable Diffusion WebUI that enhances inpainting, semantic segmentation, and automates image matting. It also helps create LoRA/LyCORIS training sets.

Claim this tool

3Views

At a glance

Pricing

Open Source

Free tier

Yes

API

Yes

Skill level

Technical

About

What is sd-webui-segment-anything?

sd-webui-segment-anything is an extension designed to integrate Segment Anything and GroundingDINO with AUTOMATIC1111 Stable Diffusion WebUI and Mikubill ControlNet Extension. This integration significantly enhances Stable Diffusion/ControlNet inpainting capabilities, improves semantic segmentation, and automates image matting processes. It also provides tools for generating LoRA/LyCORIS training sets. The extension supports various segmentation models including SAM, SAM-HQ, and MobileSAM, allowing users to choose based on performance and VRAM requirements. It also offers features like text-prompted bounding box generation, mask expansion, and automatic segmentation for diverse image manipulation tasks.

Best used for

Ideal for graphic designers and photographers who need to precisely segment objects in images, enhance inpainting with ControlNet, and automate image matting. Especially valuable for creating high-quality LoRA/LyCORIS training sets and improving semantic segmentation for various creative projects.

Common actions

segment images

enhance inpainting

automate matting

create training sets

generate masks

collaborationworkflowsopen-sourcegithub copilotlow-code/no-codedeepfakeautomated workflowface swapping"AI Agents"

Capabilities

Key features

Text-prompted bounding boxes
Generate segmentation masks
Mask expansion
ControlNet inpainting support
Automatic segmentation
Image matting
LoRA/LyCORIS training set creation

Target Audience

graphic designerphotographer

Integrations

stable-diffusion-webuicontrolnet

Pricing & Plans

Open Source

Free

FAQs

What are the system requirements for sd-webui-segment-anything?

To use this extension, you must have gradio>=3.23.0 and WebUI>=22bcc7be. It is recommended to update your WebUI to the latest version for compatibility and access to all features. Some features may also require the ControlNet extension to be installed.

Which segmentation models are supported by this extension?

The extension supports several segmentation models, including SAM (vit_h, vit_l, vit_b), SAM-HQ (vit_h, vit_l, vit_b), and MobileSAM. Users can choose a model based on their hardware capabilities and desired performance, with MobileSAM being a tiny version for lower VRAM usage.

How does sd-webui-segment-anything handle GroundingDINO installation issues?

Starting from v1.5.0, you can choose to use a local GroundingDINO to bypass common C++ compilation problems. If not specified, the script will first attempt to install the official GroundingDINO and fall back to the local version if installation fails, addressing issues with ninja, pycocotools, and _C.

Trending

Subcategories trending in Content & Design

AI Writing Assistants Audio & Music Video Generation Photo Editing Graphic Design Video Editing

Trending

Explore

Browse AI tools by category

Content & Design Productivity & Business Coding & Development AI Agents & Automation Research & Education Wellness & Lifestyle Career Development Marketing & Growth Data & Analytics Customer Support & CX Finance E-commerce