Skip to content

AOTU Public

The capsules that AOTU publishes for BrainFrame. Capsules marked with ✨ are recommended as production-ready. Download them from the VisionCapsules® AI Marketplace by choosing AOTU Public in its source menu, as described in Download Capsules.

Name Description Hardware Required Input Output
Calculator Object Speed ✨ Measure pixel-per-second speed on tracked detections, and puts the information in the extra_data field. CPU Type: Single Detection
Tracked: True
Type: Single Detection
Extra data: pixels_per_second_speed, pixel_travel, time_elapsed
Classification Detections Filter v0.1 The capsule takes detections from other capsules, filter the detections based on the options setting and present the filtered results. CPU Type: List of Detections
Type: List of Detections
Detections: filter_confirmed
Extra data: filter_confirmed
Classifier Age Determine a persons approximate age by analyzing their face. CPU
GPU
Type: Single Detection
Detections: face
ExpandType: Single Detection
Classifies:
Age: 45-59 years old, 0-2 years old, 25-33 years old, 14-24 years old, 7-13 years old, 34-37 years old, 38-44 years old, 3-6 years old, 60-100 years old
Extra data: age_confidence
Classifier Behavior Closeup v3 Determine several behaviors for compliance use cases. CPU
GPU
Type: Single Detection
Detections: person
ExpandType: Single Detection
Classifies:
behavior: drinking, phoning, smoking, unknown
Extra data: behavior_confidence
Classifier Behavior Closeup Openvino v1.1 Determine several behaviors for compliance use cases. CPU
HDDL
iGPU
Type: Single Detection
Detections: person
ExpandType: Single Detection
Classifies:
behavior: true_drinking, true_phoning, true_smoking, unknown
Extra data: confidence
Classifier Eyewear Closeup ✨ Determine what type of eyewear a person is wearing. CPU
GPU
Type: Single Detection
Detections: face
ExpandType: Single Detection
Classifies:
Glasses: sun_glasses, no_glasses, glasses, unknown
Extra data: glasses_confidence
Classifier Face Age Gender Openvino v1.1 OpenVINO face age/gender classifier. CPU
HDDL
iGPU
Type: Single Detection
Detections: face
ExpandType: Single Detection
Classifies:
gender: feminine, masculine
age: Under 12 years, 12 - 17 years, 18 - 24 years, 25 - 34 years, 35 - 44 years, 45 - 54 years, 55 - 64 years, 65+ years
Extra data: age, gender_confidence
Classifier Face Emotion Openvino v1.1 OpenVINO face emotion classifier. CPU
HDDL
iGPU
Type: Single Detection
Detections: face
ExpandType: Single Detection
Classifies:
emotion: neutral, happy, sad, surprise, anger
Extra data: emotion_confidence
Classifier Gender Closeup ✨ Determine the gender of people based on their faces. CPU
GPU
Type: Single Detection
Detections: face
Type: Single Detection
Classifies:
gender: masculine, feminine, unknown
Extra data: gender_confidence
Classifier Hat Administration Determine if a person is wearing a hat. CPU
GPU
Type: Single Detection
Detections: face
Type: Single Detection
Classifies:
Hat: hat, no_hat, unknown
Extra data: hat_confidence
Classifier Mask Closeup Openvino v1.1 OpenVINO face mask classifier. CPU
HDDL
iGPU
Type: Single Detection
Detections: face
Type: Single Detection
Classifies:
mask: not_wearing_mask, wearing_mask
Extra data: mask_confidence
Classifier Person Attributes Openvino v1.1 OpenVINO powered person classifier, for general person appearance attributes. CPU
HDDL
iGPU
Type: Single Detection
Detections: person
ExpandType: Single Detection
Classifies:
gender: masculine, feminine, unknown
bag: has_bag, no_bag, unknown
backpack: has_backpack, no_backpack, unknown
hat: has_hat, no_hat, unknown
sleeves: has_long_sleeves, has_short_sleeves, unknown
pants: has_long_pants, has_short_pants, unknown
hair: has_long_hair, has_short_hair, unknown
coat_jacket: has_coat_jacket, no_coat_jacket, unknown
Classifier Pose Closeup ✨ Roughly identify the current pose of a person. CPU
GPU
Type: List of Detections
Detections: person
ExpandType: List of Detections
Classifies:
Pose: fall down, get up, crawl, bend/bow (at the waist), lie/sleep, sit, crouch/kneel, run/jog, stand, walk, jump/leap, unknown
Extra data: pose_confidence, pose_iou
Classifier Safety Gear Openvino Roughly identify if person is wearing safety hat and safety vest. CPU
HDDL
iGPU
Type: List of Detections
Detections: person
ExpandType: List of Detections
Classifies:
safety_hat: without_safety_hat, with_safety_hat
safety_vest: without_safety_vest, with_safety_vest
Extra data: safety_hat_iou, safety_hat_confidence, safety_vest_iou, safety_vest_confidence
Classifier Vehicle Color GPU capable vehicle color classifier. Trained with a private dataset. CPU
GPU
Type: Single Detection
Detections: vehicle, bus, car, motorcycle, truck
ExpandType: Single Detection
Classifies:
Color: Green, White, Black, Blue, Grey, Red, Brown, Yellow
Extra data: color_confidence
Classifier Vehicle Color Openvino v1.1 OpenVINO vehicle color classifier. CPU
HDDL
iGPU
Type: Single Detection
Detections: car, bus, truck, van, vehicle
ExpandType: Single Detection
Classifies:
color: white, gray, yellow, red, green, blue, black
vehicle_type: car, bus, truck, van
Detector Barcode ✨ v0.1 it performs detection and recognition (i.e., decoding the data) and fully supports Code 128, Code 39, GS1-128, and QR Codes. CPU
GPU
Type: List of Detections
Detections: barcode
Extra data: codetype, code
Dtag ✨ Find DTags including pose information and distance. CPU
ExpandType: List of Detections
Detections: dtag
Extra data: dtag_id, dtag_angle, dtag_distance, dtag_inverted
Encoded: True
Tracked: True
Detector Face Fast ✨ Efficiently detect faces in most environments. CPU
GPU
Type: List of Detections
Detections: face
Extra data: confidence
Detector Face Openvino ✨ OpenVINO fast face detector. CPU
HDDL
iGPU
Type: List of Detections
Detections: face
Detector Fire Fast Classifies if there is fire in the videostream or not. It currently does not localize the fire. CPU
GPU
Type: List of Detections
Detections: fire
Detector License Plates A low-quality license plate detector that can very well detect close-up plates, but has trouble reading them. CPU
GPU
ExpandType: List of Detections
Detections: license_plate, a, b, c, d, e, f, g, h, i, j, k, l, m, n, o, p, q, r, s, t, u, v, w, x, y, z, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9
Extra data: confidence
Detector Ocr Cn ✨ v1.2.4 OCR text detector and recognition: support over 6000 Chinese charactors. CPU Type: List of Detections
Detections: text
Extra data: confidence, ocr, serial_no
Detector Person Administration Detect people in a low-resolution well lit environment where the camera is typically far from the person, and there are 3-10 people, some behind desks. CPU
GPU
Type: List of Detections
Detections: person
Detector Person And Vehicle Fast ✨ v1.1 Find people and vehicles in most environments. CPU
GPU
ExpandType: List of Detections
Detections: person, bike, car, motorcycle, bus, train, truck, boat, vehicle, bird, cat, dog, horse, sheep, cow, elephant, bear, zebra, giraffe
Extra data: confidence
Detector Person Openvino ✨ v1.1 OpenVINO generic person detector. CPU
HDDL
iGPU
Type: List of Detections
Detections: person
Detector Person Overhead Openvino OpenVINO fast person detector. Works best in surveillance perspectives from a downwards facing point of view. CPU
HDDL
iGPU
Type: List of Detections
Detections: person
Detector Person Vehicle Bike Openvino OpenVINO person, vehicle, and bike detector. Optimized for outdoor street crosswalk scenarios. CPU
HDDL
iGPU
Type: List of Detections
Detections: vehicle, person, bike
Detector Safety Gear Openvino OpenVino's safety gear detector (safety vest and safety hat) CPU
HDDL
iGPU
Type: List of Detections
Detections: safety vest, safety hat
Detector Text Openvino ✨ v1.1 OpenVINO text detector and reader. CPU
HDDL
iGPU
Type: List of Detections
Detections: text
Extra data: confidence, text
Detector Vehicle License Plate Openvino OpenVINO license plate detector. Not capable of reading the plate. Vehicle detection is disabled by default, but can be enabled via the capsule options. This capsule is best used in close-up scenarios. CPU
HDDL
iGPU
Type: List of Detections
Detections: vehicle, license_plate
Extra data: confidence
Detector Yolov5 Mo Torch
ExpandTemplate for YOLOv5-style object detectors (OpenVINO). It contains NO model, so it detects nothing until you add one: package your own OpenVINO model (model.xml + model.bin) with the BrainFrame Marketplace (Package Model, or Download & Package for Ultralytics models), or add the two files to this capsule and repackage it. Input: the video frame. Output: a list of detections, each with a class name, a box and a confidence (80 COCO classes by default, see labels.py). YOLO models from Ultralytics are licensed under AGPL-3.0: see README.md.
CPU
HDDL
iGPU
ExpandType: List of Detections
Detections: person, bike, car, motorcycle, airplane, bus, train, truck, boat, traffic light, fire hydrant, stop sign, parking meter, bench, bird, cat, dog, horse, sheep, cow, elephant, bear, zebra, giraffe, backpack, umbrella, handbag, tie, suitcase, frisbee, skis, snowboard, sports ball, kite, baseball bat, baseball glove, skateboard, surfboard, tennis racket, bottle, wine glass, cup, fork, knife, spoon, bowl, banana, apple, sandwich, orange, broccoli, carrot, hot dog, pizza, donut, cake, chair, couch, potted plant, bed, dining table, toilet, tv, laptop, mouse, remote, keyboard, cell phone, microwave, oven, toaster, sink, refrigerator, book, clock, vase, scissors, teddy bear, hair drier, toothbrush
Encoder License Plate Openvino v1.1 An OpenVINO license plate reader from the OpenVINO model zoo. It is trained on chinese license plates, and works well only when the plate is very close to the camera. CPU
HDDL
iGPU
Type: Single Detection
Detections: license_plate
Type: Single Detection
Extra data: license_plate_string
Encoded: True
Encoder Person ✨ Recognize people based on clothing and general appearance. CPU
GPU
Type: Single Detection
Detections: person
Type: Single Detection
Encoded: True
Encoder Person Openvino v1.1 OpenVINO powered people encoder. CPU
HDDL
iGPU
Type: Single Detection
Detections: person
Type: Single Detection
Encoded: True
Landmarks Face Openvino Simple v1.1 OpenVINO capable. Outputs simple face landmarks in the detections extra_data CPU
HDDL
iGPU
Type: Single Detection
Detections: face
Type: Single Detection
Detections: face_landmarks
Recognizer Face ✨ Recognize faces. Works best close-up. CPU
GPU
Type: Single Detection
Detections: face
Type: Single Detection
Encoded: True
Recognizer Face Landmarks Openvino v1.1 OpenVINO powered face recognizer. Requires 'Landmarks Face Openvino Simple' capsule to be loaded + any face detector. This capsule aligns faces before feeding them into the encoder, thus allowing higher accuracy recognition. CPU
HDDL
iGPU
Type: Single Detection
Detections: face_landmarks
Type: Single Detection
Encoded: True
Recognizer Handwritten Text Openvino ✨ v1.1 OpenVINO handwritten simplified chinese text (only one line) recognition. CPU Type: List of Detections
Detections: text
Extra data: confidence, ocr
Recognizer Identitycard Face ✨ v1.1 Recognize and compare identity card face and the other face. Works best close-up. CPU
GPU
Type: List of Detections
Detections: face
Type: List of Detections
Detections: face_compare
Extra data: face_compare_confidence
Tracker Person ✨ v1.0 Track people using state of the art techniques. CPU
ExpandType: List of Detections
Detections: person, car, motorcycle, bus, truck, vehicle
Extra data: confidence
Encoded: True
Type: List of Detections
Tracked: True
Tracker Vehicle Iou ✨ v1.2 Efficient vehicle, person tracker using IOU. CPU
ExpandType: List of Detections
Detections: car, motorcycle, bus, train, truck, boat, vehicle, license_plate, bike, special vehicle, person, book, tv
Extra data: confidence
Type: List of Detections
Tracked: True