Building an Integrated Computer-Vision System: Detection, Segmentation, Keypoints, Tracking, Class & Part Hierarchies, Scene Graphs, 3D Primitives & Voxels, and Incremental Learning — Served Live to Mobile Browsers with YOLO26 · PyTorch · FastAPI · WebRTC

This book builds a system instead of a demo. From a single camera frame, you'll produce a structured, queryable description of the entire scene — a world model you can interrogate like a small database: the same object keeps its identity across frames, its parts, its properties, its place on the ground, and its relationships to everything else.

Working in Python with today's open-source stack, you'll wire together more than a dozen capabilities into one coherent pipeline:

- Detection, segmentation, keypoints, and tracking with the latest end-to-end, NMS-free YOLO26

- Open-vocabulary detection with YOLOE — find anything you can name, no retraining, from a 4,585-class vocabulary

- Class and part hierarchies, properties, states, and a queryable scene graph

- Ground-plane estimation, geometric primitives, monocular depth, and voxel reconstruction to lift flat pixels into 3D — including a trainable 6-DoF pose head

- Facial recognition, OCR, and gait as second-stage, box-confined capabilities

- A two-phase cascade that stays broad at the top and sharp at the bottom

- A browser-based annotation studio, custom-model training, incremental and active learning

- A real FastAPI inference server, live video streaming, and the profiling, packaging, securing, and scaling needed to ship it

Every chapter is grounded in real, runnable open-source code, not pseudocode — with a companion repository, original diagrams, and an architecture designed so you can add a new capability or teach a new class after deployment, without forgetting what the system already knew.

Who it's for: developers, ML engineers, robotics and AR builders, and serious learners who are done running other people's demos and want to construct a perception system of their own — one frame, one world model, fully under your control.