> For the complete documentation index, see [llms.txt](https://docs.imerit.net/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.imerit.net/plugins/first-party-ango-plugins/open-world-object-detection.md).

# Open World Object Detection

## Overview

The Open World Object Detection plugin allows you to detect a great variety of objects on image files in your project. The plugin will draw a bounding box around each object type it can find, and it will write the type of object in a nested text classification in the box itself.

<figure><img src="https://lh7-rt.googleusercontent.com/docsz/AD_4nXdBYU78DfXu4chZqMp7FibBsJ7mDfVYBUe18h9Z0BFuugvkipCe9HdBDNBgzU6k999AWmewne6quh82trV0XkuJpJ1gzhvwMcvL8qmnToGHWcE8EfWxQvhEkpz9aDtCaiLVVmaF8w?key=cpQYlDRel4R0-nVf-0AtAQ" alt=""><figcaption></figcaption></figure>

## Plugin Functionality

The Open World Object Detection Plugin automatically detects objects in images using a open world object detection model. It draws bounding boxes, and provides confidence scores, making it easy to annotate existing categories while flagging new or unexpected objects for review.

{% hint style="info" %}
The plugin will create unknown bounding boxes not belonging to any class.
{% endhint %}

<figure><img src="/files/am7ibeG9aao8dql0u8fQ" alt=""><figcaption></figcaption></figure>

### Supported Data Types <a href="#supported-data-types" id="supported-data-types"></a>

* Image

### Supported Annotation Tools <a href="#supported-annotation-tools" id="supported-annotation-tools"></a>

* Bounding Box

## Plugin Configuration <a href="#plugin-configuration" id="plugin-configuration"></a>

The **Overwrite** setting in model plugins controls whether existing annotations are replaced or kept. When enabled, the plugin replaces all existing annotations with new model predictions; when disabled, it simply adds the new results without deleting what’s already there.

<figure><img src="/files/5CTzdJVX6zBroIyJSE5S" alt=""><figcaption><p>YOLO | Open World Object Detection plugin integration to the workflow</p></figcaption></figure>

You may vary a number of settings related to the model plugin from the **Config JSON** field. Each option is detailed below:

```json
{
  "threshold": 0.3
}
```

* **"threshold":** The confidence score threshold for object detection. Detections with a confidence score below this value will be filtered out. A higher threshold reduces false positives but may miss low-confidence detections.
  * Example:
    * <kbd>"threshold": 0.3</kbd>

### Detection Classes <a href="#detection-classes" id="detection-classes"></a>

The following are the classes of objects this plugin will detect:

{% file src="/files/oOMDLZvLoO1u9bhDnnTG" %}