Skip to content

odi-fixedClass-commercial (Object Detection Image)

Version Changelog

Plugin Version Change
v1.0.0 Initial plugin, released with OLIVE 6.1.0

Description

Object Detection Image plugins process an input image and attempt to localize one or more instances of known object classes within the frame. If an object is detected, a 'bounding box' highlighting the object is output, along with an associated confidence score informing how likely this box is to be an instance of the respective object.

Domains

  • 80objects-v1
    • A general purpose image object detection domain capable of detecting 80 object classes: 'aeroplane', 'apple', 'backpack', 'banana', 'baseball bat', 'baseball glove', 'bear', 'bed', 'bench', 'bicycle', 'bird', 'boat', 'book', 'bottle', 'bowl', 'broccoli', 'bus', 'cake', 'car', 'carrot', 'cat', 'cell phone', 'chair', 'clock', 'cow', 'cup', 'diningtable', 'dog', 'donut', 'elephant', 'fire hydrant', 'fork', 'frisbee', 'giraffe', 'hair drier', 'handbag', 'horse', 'hot dog', 'keyboard', 'kite', 'knife', 'laptop', 'microwave', 'motorbike', 'mouse', 'orange', 'oven', 'parking meter', 'person', 'pizza', 'pottedplant', 'refrigerator', 'remote', 'sandwich', 'scissors', 'sheep', 'sink', 'skateboard', 'skis', 'snowboard', 'sofa', 'spoon', 'sports ball', 'stop sign', 'suitcase', 'surfboard', 'teddy bear', 'tennis racket', 'tie', 'toaster', 'toilet', 'toothbrush', 'traffic light', 'train', 'truck', 'tvmonitor', 'umbrella', 'vase', 'wine glass', 'zebra'.

Inputs

An image file to process.

Outputs

Object Detection Image plugins are 'bounding box' scorers - the output of a bounding box scorer is an object class, a corresponding score, and 4 points associated with this class and score that attempt to localize the detected object class within the image frame.

That output looks like this:

    <file> <obj class> <score> (<x1>, <y1>, <x2>, <y2>)

Where the bounding box itself is defined by the four coordinates in parentheses:

    (Upper Left: x1, y1    |    Lower Right: x2, y2)

An example output could look like this:

    input_image.png cat 0.9974257349967957 (154, 78, 657, 745)

Functionality (Traits)

The functions of this plugin are defined by its Traits and implemented API messages. A list of these Traits is below, along with the corresponding API messages for each. Click the message name below to go to additional implementation details below.

  • BOUNDING_BOX_SCORER – Score all submitted images or videos, returning labeled bounding box regions within the image frames, or labeled bounding box regions with an associated start and end time region if scoring video files.

Compatibility

OLIVE 6.1+

Limitations

The plugin currently does not support enrollment of new object classes.

Comments

GPU Support

Please refer to the OLIVE GPU Installation and Support documentation page for instructions on how to enable and configure GPU capability in supported plugins. By default this plugin will run on CPU only.

Bounding Box Options

The following region scoring options are available to this plugin, adjustable in the plugin's configuration file; plugin_config.py.

Option Name Description Default Expected Range
threshold Threshold for image object detection. The higher the threshold is, the fewer objects will be returned 0.0 0.0 - 1.0

If you find this plugin to not perform adequately for your data conditions, or have a specific use case, please get in touch with SRI to discuss how the plugin can be tuned for optimal performance on your data.