AOTU Public¶
The capsules that AOTU publishes for BrainFrame. Capsules marked with ✨ are recommended as production-ready. Download them from the VisionCapsules® AI Marketplace by choosing AOTU Public in its source menu, as described in Download Capsules.
| Name | Description | Hardware | Required Input | Output |
|---|---|---|---|---|
| Calculator Object Speed | ✨ Measure pixel-per-second speed on tracked detections, and puts the information in the extra_data field. | CPU | Type: Single Detection Tracked: True |
Type: Single Detection Extra data: pixels_per_second_speed, pixel_travel, time_elapsed |
| Classification Detections Filter | v0.1 The capsule takes detections from other capsules, filter the detections based on the options setting and present the filtered results. | CPU | Type: List of Detections |
Type: List of Detections Detections: filter_confirmed Extra data: filter_confirmed |
| Classifier Age | Determine a persons approximate age by analyzing their face. | CPU GPU |
Type: Single Detection Detections: face |
ExpandType: Single DetectionClassifies: Age: 45-59 years old, 0-2 years old, 25-33 years old, 14-24 years old, 7-13 years old, 34-37 years old, 38-44 years old, 3-6 years old, 60-100 years old Extra data: age_confidence |
| Classifier Behavior Closeup | v3 Determine several behaviors for compliance use cases. | CPU GPU |
Type: Single Detection Detections: person |
ExpandType: Single DetectionClassifies: behavior: drinking, phoning, smoking, unknown Extra data: behavior_confidence |
| Classifier Behavior Closeup Openvino | v1.1 Determine several behaviors for compliance use cases. | CPU HDDL iGPU |
Type: Single Detection Detections: person |
ExpandType: Single DetectionClassifies: behavior: true_drinking, true_phoning, true_smoking, unknown Extra data: confidence |
| Classifier Eyewear Closeup | ✨ Determine what type of eyewear a person is wearing. | CPU GPU |
Type: Single Detection Detections: face |
ExpandType: Single DetectionClassifies: Glasses: sun_glasses, no_glasses, glasses, unknown Extra data: glasses_confidence |
| Classifier Face Age Gender Openvino | v1.1 OpenVINO face age/gender classifier. | CPU HDDL iGPU |
Type: Single Detection Detections: face |
ExpandType: Single DetectionClassifies: gender: feminine, masculine age: Under 12 years, 12 - 17 years, 18 - 24 years, 25 - 34 years, 35 - 44 years, 45 - 54 years, 55 - 64 years, 65+ years Extra data: age, gender_confidence |
| Classifier Face Emotion Openvino | v1.1 OpenVINO face emotion classifier. | CPU HDDL iGPU |
Type: Single Detection Detections: face |
ExpandType: Single DetectionClassifies: emotion: neutral, happy, sad, surprise, anger Extra data: emotion_confidence |
| Classifier Gender Closeup | ✨ Determine the gender of people based on their faces. | CPU GPU |
Type: Single Detection Detections: face |
Type: Single Detection Classifies: gender: masculine, feminine, unknown Extra data: gender_confidence |
| Classifier Hat Administration | Determine if a person is wearing a hat. | CPU GPU |
Type: Single Detection Detections: face |
Type: Single Detection Classifies: Hat: hat, no_hat, unknown Extra data: hat_confidence |
| Classifier Mask Closeup Openvino | v1.1 OpenVINO face mask classifier. | CPU HDDL iGPU |
Type: Single Detection Detections: face |
Type: Single Detection Classifies: mask: not_wearing_mask, wearing_mask Extra data: mask_confidence |
| Classifier Person Attributes Openvino | v1.1 OpenVINO powered person classifier, for general person appearance attributes. | CPU HDDL iGPU |
Type: Single Detection Detections: person |
ExpandType: Single DetectionClassifies: gender: masculine, feminine, unknown bag: has_bag, no_bag, unknown backpack: has_backpack, no_backpack, unknown hat: has_hat, no_hat, unknown sleeves: has_long_sleeves, has_short_sleeves, unknown pants: has_long_pants, has_short_pants, unknown hair: has_long_hair, has_short_hair, unknown coat_jacket: has_coat_jacket, no_coat_jacket, unknown |
| Classifier Pose Closeup | ✨ Roughly identify the current pose of a person. | CPU GPU |
Type: List of Detections Detections: person |
ExpandType: List of DetectionsClassifies: Pose: fall down, get up, crawl, bend/bow (at the waist), lie/sleep, sit, crouch/kneel, run/jog, stand, walk, jump/leap, unknown Extra data: pose_confidence, pose_iou |
| Classifier Safety Gear Openvino | Roughly identify if person is wearing safety hat and safety vest. | CPU HDDL iGPU |
Type: List of Detections Detections: person |
ExpandType: List of DetectionsClassifies: safety_hat: without_safety_hat, with_safety_hat safety_vest: without_safety_vest, with_safety_vest Extra data: safety_hat_iou, safety_hat_confidence, safety_vest_iou, safety_vest_confidence |
| Classifier Vehicle Color | GPU capable vehicle color classifier. Trained with a private dataset. | CPU GPU |
Type: Single Detection Detections: vehicle, bus, car, motorcycle, truck |
ExpandType: Single DetectionClassifies: Color: Green, White, Black, Blue, Grey, Red, Brown, Yellow Extra data: color_confidence |
| Classifier Vehicle Color Openvino | v1.1 OpenVINO vehicle color classifier. | CPU HDDL iGPU |
Type: Single Detection Detections: car, bus, truck, van, vehicle |
ExpandType: Single DetectionClassifies: color: white, gray, yellow, red, green, blue, black vehicle_type: car, bus, truck, van |
| Detector Barcode | ✨ v0.1 it performs detection and recognition (i.e., decoding the data) and fully supports Code 128, Code 39, GS1-128, and QR Codes. | CPU GPU |
Type: List of Detections Detections: barcode Extra data: codetype, code |
|
| Dtag | ✨ Find DTags including pose information and distance. | CPU | ExpandType: List of DetectionsDetections: dtag Extra data: dtag_id, dtag_angle, dtag_distance, dtag_inverted Encoded: True Tracked: True |
|
| Detector Face Fast | ✨ Efficiently detect faces in most environments. | CPU GPU |
Type: List of Detections Detections: face Extra data: confidence |
|
| Detector Face Openvino | ✨ OpenVINO fast face detector. | CPU HDDL iGPU |
Type: List of Detections Detections: face |
|
| Detector Fire Fast | Classifies if there is fire in the videostream or not. It currently does not localize the fire. | CPU GPU |
Type: List of Detections Detections: fire |
|
| Detector License Plates | A low-quality license plate detector that can very well detect close-up plates, but has trouble reading them. | CPU GPU |
ExpandType: List of DetectionsDetections: license_plate, a, b, c, d, e, f, g, h, i, j, k, l, m, n, o, p, q, r, s, t, u, v, w, x, y, z, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9 Extra data: confidence |
|
| Detector Ocr Cn | ✨ v1.2.4 OCR text detector and recognition: support over 6000 Chinese charactors. | CPU | Type: List of Detections Detections: text Extra data: confidence, ocr, serial_no |
|
| Detector Person Administration | Detect people in a low-resolution well lit environment where the camera is typically far from the person, and there are 3-10 people, some behind desks. | CPU GPU |
Type: List of Detections Detections: person |
|
| Detector Person And Vehicle Fast | ✨ v1.1 Find people and vehicles in most environments. | CPU GPU |
ExpandType: List of DetectionsDetections: person, bike, car, motorcycle, bus, train, truck, boat, vehicle, bird, cat, dog, horse, sheep, cow, elephant, bear, zebra, giraffe Extra data: confidence |
|
| Detector Person Openvino | ✨ v1.1 OpenVINO generic person detector. | CPU HDDL iGPU |
Type: List of Detections Detections: person |
|
| Detector Person Overhead Openvino | OpenVINO fast person detector. Works best in surveillance perspectives from a downwards facing point of view. | CPU HDDL iGPU |
Type: List of Detections Detections: person |
|
| Detector Person Vehicle Bike Openvino | OpenVINO person, vehicle, and bike detector. Optimized for outdoor street crosswalk scenarios. | CPU HDDL iGPU |
Type: List of Detections Detections: vehicle, person, bike |
|
| Detector Safety Gear Openvino | OpenVino's safety gear detector (safety vest and safety hat) | CPU HDDL iGPU |
Type: List of Detections Detections: safety vest, safety hat |
|
| Detector Text Openvino | ✨ v1.1 OpenVINO text detector and reader. | CPU HDDL iGPU |
Type: List of Detections Detections: text Extra data: confidence, text |
|
| Detector Vehicle License Plate Openvino | OpenVINO license plate detector. Not capable of reading the plate. Vehicle detection is disabled by default, but can be enabled via the capsule options. This capsule is best used in close-up scenarios. | CPU HDDL iGPU |
Type: List of Detections Detections: vehicle, license_plate Extra data: confidence |
|
| Detector Yolov5 Mo Torch | ExpandTemplate for YOLOv5-style object detectors (OpenVINO). It contains NO model, so it detects nothing until you add one: package your own OpenVINO model (model.xml + model.bin) with the BrainFrame Marketplace (Package Model, or Download & Package for Ultralytics models), or add the two files to this capsule and repackage it. Input: the video frame. Output: a list of detections, each with a class name, a box and a confidence (80 COCO classes by default, see labels.py). YOLO models from Ultralytics are licensed under AGPL-3.0: see README.md. |
CPU HDDL iGPU |
ExpandType: List of DetectionsDetections: person, bike, car, motorcycle, airplane, bus, train, truck, boat, traffic light, fire hydrant, stop sign, parking meter, bench, bird, cat, dog, horse, sheep, cow, elephant, bear, zebra, giraffe, backpack, umbrella, handbag, tie, suitcase, frisbee, skis, snowboard, sports ball, kite, baseball bat, baseball glove, skateboard, surfboard, tennis racket, bottle, wine glass, cup, fork, knife, spoon, bowl, banana, apple, sandwich, orange, broccoli, carrot, hot dog, pizza, donut, cake, chair, couch, potted plant, bed, dining table, toilet, tv, laptop, mouse, remote, keyboard, cell phone, microwave, oven, toaster, sink, refrigerator, book, clock, vase, scissors, teddy bear, hair drier, toothbrush |
|
| Encoder License Plate Openvino | v1.1 An OpenVINO license plate reader from the OpenVINO model zoo. It is trained on chinese license plates, and works well only when the plate is very close to the camera. | CPU HDDL iGPU |
Type: Single Detection Detections: license_plate |
Type: Single Detection Extra data: license_plate_string Encoded: True |
| Encoder Person | ✨ Recognize people based on clothing and general appearance. | CPU GPU |
Type: Single Detection Detections: person |
Type: Single Detection Encoded: True |
| Encoder Person Openvino | v1.1 OpenVINO powered people encoder. | CPU HDDL iGPU |
Type: Single Detection Detections: person |
Type: Single Detection Encoded: True |
| Landmarks Face Openvino Simple | v1.1 OpenVINO capable. Outputs simple face landmarks in the detections extra_data | CPU HDDL iGPU |
Type: Single Detection Detections: face |
Type: Single Detection Detections: face_landmarks |
| Recognizer Face | ✨ Recognize faces. Works best close-up. | CPU GPU |
Type: Single Detection Detections: face |
Type: Single Detection Encoded: True |
| Recognizer Face Landmarks Openvino | v1.1 OpenVINO powered face recognizer. Requires 'Landmarks Face Openvino Simple' capsule to be loaded + any face detector. This capsule aligns faces before feeding them into the encoder, thus allowing higher accuracy recognition. | CPU HDDL iGPU |
Type: Single Detection Detections: face_landmarks |
Type: Single Detection Encoded: True |
| Recognizer Handwritten Text Openvino | ✨ v1.1 OpenVINO handwritten simplified chinese text (only one line) recognition. | CPU | Type: List of Detections Detections: text Extra data: confidence, ocr |
|
| Recognizer Identitycard Face | ✨ v1.1 Recognize and compare identity card face and the other face. Works best close-up. | CPU GPU |
Type: List of Detections Detections: face |
Type: List of Detections Detections: face_compare Extra data: face_compare_confidence |
| Tracker Person | ✨ v1.0 Track people using state of the art techniques. | CPU | ExpandType: List of DetectionsDetections: person, car, motorcycle, bus, truck, vehicle Extra data: confidence Encoded: True |
Type: List of Detections Tracked: True |
| Tracker Vehicle Iou | ✨ v1.2 Efficient vehicle, person tracker using IOU. | CPU | ExpandType: List of DetectionsDetections: car, motorcycle, bus, train, truck, boat, vehicle, license_plate, bike, special vehicle, person, book, tv Extra data: confidence |
Type: List of Detections Tracked: True |