SAM 3

Overview

The One-Click Segmentation plugin allows you to create complex and detailed segmentations of an object starting with one point or one bounding box.

The SAM 3 Plugin uses the Segment Anything Model 3 to automatically generate segmentation masks from input prompts and convert them into segmentation or polygon annotations.

SAM 3

Plugin Functionality

The SAM 3 plugin enables automatic segmentation generation using the Segment Anything Model. It produces high-quality segmentation annotations from a text prompt, dramatically speeding up the annotation process for image and video assets.

Supported Data Types

• Image

• Video [Limited Support]

Supported Annotation Tools

• Segmentation

• Polygon

Plugin Configuration

The Overwrite setting in model plugins controls whether existing annotations are replaced or kept. When enabled, the plugin replaces all existing annotations with new model predictions; when disabled, it simply adds the new results without deleting what’s already there.

You may vary a number of settings related to the model plugin from the Config JSON field. Each option is detailed below:

{
  "prompt": "",
  "threshold": 0.8,
  "polygon_simplification_tolerance": 0.9
}

• "prompt": Specifies the object, class, or region that should be segmented in the image. The model uses this text prompt to identify and generate segmentation masks for matching objects. Providing a clear and specific prompt typically improves segmentation accuracy.

  • Example:

    • "prompt": "red apple"

    • "prompt": "penguin"

• "threshold": Sets the confidence threshold for accepting segmentation predictions. Predictions with a confidence score below this value are filtered out.

  • Example:

    • "threshold": 0.8

• "polygon_simplification_tolerance": Controls how much the output polygons are simplified to reduce complexity. Higher values produce simpler polygons with fewer vertices, while lower values preserve more detail.

  • Example:

    • "polygon_simplification_tolerance": 0.9