กลับไปหน้ารวมไฟล์
face-tracking-and-smile-detecting-halloween-robots-981b2e-en.md

About

Halloween is coming! We decided to build something cool. Meet Ghosty and Skully robots. They can follow your face and they know when you are smiling to laugh with you!

This project is another example of using the iRobbie App that converts iPhone into a powerful toolbox for Arduino projects.

The app is capable of capturing and processing video and then sending X and Y coordinates as well as the smile status to the Arduino through the HM-10 bluetooth module.

How to build

For this project we used cheap Halloween decorations that can be found in a dollar store and turned them into fully functioning robots.

For step one of making the skull a robot, we cut its head off from the stand with a small hacksaw.

We also used a pan/tilt kit with two servos, the Arduino Uno and the HM-10 bluetooth module.

For housing, we used a cardboard gift box with a wooden lid.

We attached a battery pack with a on/off switch inside the box using double sided tape and cut a hole on the side of the box so the switch can be accessed from the outside.

The finished product inside the box.

We drilled a small hole in the lid for the wires that connect the LEDs and the servo motors to go through, and attached the pan/tilt mechanism on the lid.

To attach Ghosty or Skully to the pan/tilt mechanism, we used disposable forks.

Skully's fork

Ghosty's fork

We made the red eyes using LEDs.

For Skully, we used another servo so he could move his mouth while he laughs, which looks awesome but requires a little bit more work that Ghosty.

EXPANDED TECHNICAL DETAILS

Computer Vision at the Edge

This project brings high-level interaction to Halloween props by detecting human expressions.

  • Vision Processing: Uses a camera module (either a USB webcam or a specialized vision sensor like iRobbie-A) to scan for faces. The software identifies facial landmarks to detect a "Smile" based on the curvature of the mouth.
  • Actuation: The Arduino controls two Servo Motors for the robot's neck (Pan and Tilt). When a face is detected, the robot "follows" the person. When a smile is detected, it triggers a specialized "Laugh" or "Jump" animation.

Interactive Narrative

  • Voice Synthesis: Includes a DFPlayer Mini to play spooky sound effects or verbal greetings.
  • Visual Feedback: RGB LED eyes change color from red (Searching) to green (Happy/Smiling) when the robot detects a friendly interaction, creating a dynamic and spooky participant for Halloween events.

ข้อมูล Frontmatter ดั้งเดิม 

title: "Face Tracking and Smile Detecting Halloween Robots"
description: "Ghosty and Skully can follow your face and they know when you are smiling to laugh with you!"
author: "KDPA"
category: "Gadgets, Games & Toys"
tags:
  - "halloween"
  - "face tracking"
  - "robot"
views: 12652
likes: 12
price: 2450
difficulty: "Intermediate"
components:
  - "4x LED (generic)"
  - "1x Breadboard (generic)"
  - "1x Pan/Tilt kit with servos"
  - "1x HM-10 Bluetooth module"
  - "1x Arduino UNO"
tools: []
apps:
  - "1x iRobbie-A"
downloadableFiles:
  - "https://projects.arduinocontent.cc/637f909a-c1d1-4934-9098-a4ef1d6cfc45.ino"
  - "https://projects.arduinocontent.cc/637f909a-c1d1-4934-9098-a4ef1d6cfc45.ino"
documentationLinks: []
passwordHash: "37735b319666b77e59dcfa8a79a8ffbcad5544ca82eb516298d21338d3ea9600"
encryptedPayload: "U2FsdGVkX19nCL9aXwIRoqD3DoAdc4PJzDrlukYhZsHqi1CTWw+PhyES0918cowMm2t5LCDtfzob2A0BGFu+jvcVvrT2DlKYAwe0fe/fJns="
seoDescription: "Face Tracking and Smile Detecting Halloween Robots. Create interactive Arduino projects that follow faces and respond to smiles."
videoLinks:
  - "https://www.youtube.com/embed/rRHO0C3mDew"
heroImage: "https://cdn.jsdelivr.net/gh/bigboxthailand/arduino-assets@main/images/projects/face-tracking-and-smile-detecting-halloween-robots-981b2e_cover.jpg"
lang: "en"