Augmented Reality robotics design and simulation for students
Students learning robotics struggle to prototype and test mechanisms before building with expensive physical hardware. Debugging gear ratios, torque issues, or mechanism stalls requires multiple physical build iterations — time-consuming and frustrating for learners and educators.
Built a native SwiftUI app that lets students prototype, test, and troubleshoot physical mechanisms in augmented reality before building them. Combines Vision and Core ML for part recognition, ARKit and RealityKit for physics simulation. Students can snap virtual gears and motors together, run physics simulations with real torque and collision detection, and export generated code directly to their robot.
App Store-ready iOS app with on-device Machine Learning inference, augmented reality physics simulation, and Siri Intents integration. Supports VEX V5 and VEX IQ part libraries.