One-Click Segmentation

The One-Click Segmentation plugin allows you to create complex and detailed segmentations of an object starting with nothing, one point, or one bounding box.

Installing the Plugin

From the Plugin Directory, search for the the name of the plugin and install the plugin to your organization. More information on installing plugins can be found in the Installing Plugins page.

The name of the plugin is One-Click Segmentation. The plugin author is onur (at) imerit.net.

What the plugin does

The plugin will take as input one of the following:

• A point

• A bounding box

• No annotations (will work as detector)

and will output either:

• a polygon object

• a segmentation object

Project Prerequisites

Your project's category schema should contain your segmentation or polygon classes paired with a point or bounding box class. The paired classes must have the exact same name.

For example, if you wish to draw a segmentation around dogs starting from points, you must create, in your project, a segmentation class named "Dogs" (or any other name of your choice), and a point class with the same exact name (in our case "Dogs").

This will tell the plugin that we want to use the points created with the point "Dogs" class to create segmentations with the segmentation class "Dogs".

Plugin Usage

Through Workflow

A suggested workflow usage is the following:

where in the first labeling stage ("Point Labeling") annotators create the points (or bounding boxes) which will be used by the plugin, and in the second labeling stage annotators fix the results created by the plugin.

When using the plugin through the workflow's Plugin stage, please do not forget to configure the plugin through its Config JSON in its stage settings, following the config JSON as detailed in the section below.

Through the Labeling Editor

In the labeling editor, draw a rough bounding box or a point on the element:

Click on "Save" or press S on your keyboard to save.

Open the Plugin dropdown.

If you have saved a configuration preset for the plugin, click on the plugin name. The plugin will run. If you have not saved a configuration preset, click on the three dots to its right, configure the plugin as necessary (see section below), and click on Run. The plugin will create the polygon/segmentation, which you can now fix and edit as necessary.

Configuration JSON Settings

Default Configuration:

{
  "model_name": "mobile_sam",
  "prompt_mode": "bounding-box",
  "threshold": 0.8,
  "polygon_simplification_tolerance": 0.9,
  "use_same_object_id_in_video": true
}

model_name: Pick here the model you would like to use to create the segmentations, from: "mobile_sam" "sam_base" "sam_large".

prompt_mode: Pick whether the plugin should create segmentations/polygons starting from points, bounding boxes, or if it should detect them itself. Options: "point" "bounding-box" "segment-anything"

threshold and polygon_simplification_tolerance: adjust these values to modify the appearance of the resulting annotations.

use_same_object_id_in_video: If true, if run on videos, the plugin will attempt to give the same object the same object ID through frames.