Robotics & Physical AI
Robotic Vision and Digital Twins
R03 · Specialist
Entry requirements
R02 and M02
What 48 hours means
- Lessons
- 36 h
- Capstone
- 8 h
- Assessment
- 2 h
- Remediation
- 2 h
Syllabus
Four modules, twelve lessons. Every lesson states what it covers and the evidence you produce for it.
1Perception and geometry3 lessons · 9 h
- R03.01
Digital twin scope
180 minDefine which physical properties a simulation represents and omits.
Evidence: A fidelity statement prevents unsupported real-world claims.
- R03.02
Camera geometry
180 minRelate pixels, camera coordinates and robot frames.
Evidence: A worked projection matches supplied calibration fixtures.
- R03.03
Camera calibration
180 minEstimate intrinsic parameters from approved calibration images.
Evidence: A reprojection-error report identifies unacceptable samples.
2Manipulation3 lessons · 9 h
- R03.04
Perception pipeline
180 minConnect object detections to robot-frame estimates.
Evidence: A trace shows transforms and associated uncertainty.
- R03.05
Depth and pose
180 minEstimate object location using simulated depth data.
Evidence: Error is measured against simulation ground truth.
- R03.06
Manipulation planning
180 minPlan a bounded reach or grasp in a simulated workspace.
Evidence: The path respects joint limits and defined obstacles.
3Twin fidelity3 lessons · 9 h
- R03.07
Collision and safety checks
180 minTest collisions, missing detections and uncertain poses.
Evidence: Unsafe or uncertain plans are rejected before execution.
- R03.08
Closed-loop behaviour
180 minUse feedback to adjust a simulated action.
Evidence: The controller handles an induced position error predictably.
- R03.09
Domain variation
180 minVary lighting, texture and object location.
Evidence: Results quantify the performance drop under changed conditions.
4Deployment review3 lessons · 9 h
- R03.10
Sim to real validation plan
180 minDefine staged bench tests and supervision requirements.
Evidence: A plan separates simulation evidence from physical qualification.
- R03.11
Performance and traceability
180 minMeasure cycle time, success rate and failure causes.
Evidence: Logs connect each attempt to its model and scenario version.
- R03.12
Engineering review
180 minDefend the cell design and its limitations.
Evidence: A final review includes a stop mechanism, residual risks and next tests.
Capstone
Build a simulated visual inspection or pick-and-place cell with calibrated sensing, uncertainty checks and a comparison between simulated and real-world assumptions.
Lab environment
GPU ROS desktop sandbox; supervised hardware optional
Lab infrastructure is not yet provisioned, so this describes the environment the course is designed for rather than one you can launch today.