RegionIoU

Compute pairwise Intersection over Union (IoU) values between two sets of ROIs, or between a set of ROIs and an arbitrary shape. For more information, check this article.

Parameters

• roi_1: Reference to bounding box or polygon within the transaction
• [optional] roi_2 Reference to bounding box or polygon within the transaction
• [optional] rectangle: The coordinates of a bounding box RoI
• [optional] polygons: The vertices of a polygon RoI

Details

Exactly one of roi_2, rectangle, or polygons must be specified.

Examples

Within in a specific image, find bounding boxes labeled "skateboard" and polygons labeled "dog", and then return the IoU matrix between those sets of regions. Nonzero IoU values indicate pairs that overlap:

    [ {
        "FindImage": {
            "_ref": 1,
            "blobs": false,
            "constraints": {
                "id": ["==", 1234]
            }
        }
    }, {
        "FindBoundingBox": {
            "_ref": 2,
            "image_ref": 1,
            "with_label" : "skateboard",
            "uniqueids": True
        }
    }, {
        "FindPolygon": {
            "_ref": 3,
            "image_ref": 1,
            "with_label" : "dog",
            "uniqueids": True
        }
    }, {
        "RegionIoU": {
            "roi_1": 2
            "roi_2": 3
        }
    }]

    # Response:

    [ {
        "FindImage": {
            "status": 0,
        }
    }, {
        "FindPolygon": {
            "entities": [{"_uniqueid": 11}, {"_uniqueid": 12}],
            "returned": 2,
            "status": 0,
        }
    }, {
        "FindPolygon": {
            "entities": [{"_uniqueid": 21}, {"_uniqueid": 22}, {"_uniqueid": 23}],
            "returned": 3,
            "status": 0,
        }
    }, {
        "RegionIoU": {
            "status": 0,
            "IoU": [
                [0.0, 0.1875, 0.0],
                [0.2012, 0.0, 0.0]
            ]
        }
    }]

    # skateboard w/ uid 11 intersects dog w/ uid 22
    # skateboard w/ uid 12 intersects dog w/ uid 21
    # dog w/ uid 23 is not riding a skateboard

Find a Polygon with "id" property equal to 2342 and compute the Intersection Over Union (IoU) with a custom polygon:

    [ {
        "FindPolygon": {
            "_ref": 1,
            "constraints" : {
                "id" : ["==", 2342],
            }
        }
    }, {
        "RegionIoU": {
            "roi_1": 1,
            "polygons": [
                [
                    [387.99, 176.5],
                    [398.34, 164.68],
                    [405.73, 156.55],
                    [412.38, 141.77],
                    ...
                ]
            ]
        }
    }]

    # Response:

    [ {
        "FindPolygon": {
            "status": 0,
        }
    }, {
        "RegionIoU": {
            "status": 0,
            "IoU": [[0.985432]],
        }
    }]