Skip to the content.

Back

Ancelotti Robot: Real-Time Facial Gesture Animatronic

We built a robotic head, AnimaTRON 1.0, that imitated human facial movements in real time. A webcam fed MediaPipe’s Face Mesh, which gave us the facial landmarks. We then mapped the normalised distances between those landmarks onto the eight servos in the head, covering eye movement, eyebrow position and mouth motion.

The servos were driven by a Pololu Mini Maestro controller. We first interfaced with it through an Arduino UNO, but the Maestro accepts serial commands directly, so we later removed the Arduino and drove it from Python alone.

The original plan was to use Botszy, a professional animatronic rigging platform, but we ran into compatibility problems and implemented the control ourselves instead.

The code is on GitHub, and the report has more detail.

lindu final

Tech Explored

Highlights

Lowlights

Lessons Learned