Project Overview

iRobbie is the revolutionary app that brings smartphone power to your Arduino project. It represents a sophisticated Distributed Intelligence Architecture. While 8-bit microcontrollers like the Arduino Uno lack the computational overhead for real-time computer vision, this project offloads the heavy neural-network processing to an iPhone's NPU. By establishing a high-speed BLE 4.0 Serial Bridge, iRobbie transforms a standard 4WD chassis into an autonomous object-tracking agent capable of recognizing over 60 distinct classes of objects and navigating via voice-command forensics.

iRobbie connects via Bluetooth to the Arduino board. Use the iPhone camera and play with object recognition, object tracking and more. Start learning computer vision and neural networks with iRobbie App! With iRobbie, your Arduino robot can recognize and track over 60 objects, get a responsive touchscreen joystick and even allow you to play music!

Technical Deep-Dive & Features

• BLE 4.0 GATT Profile Forensics:
  • The Transparent Data Pipeline: The HM-10 module utilizes the Bluetooth Low Energy (BLE) protocol to create a virtual serial port. The iRobbie-A app acts as the Central device, pushing decoded CV data (X/Y coordinates, Class IDs) into the Arduino's RX/TX buffer via the GATT (Generic Attribute Profile) characteristic.
  • Packet Parsing Logic: The Arduino firmware implements a robust serial parser to deconstruct incoming command strings. Whether it's a "Joystick Delta" or a "Tracking Coordinate," the MCU translates these digital packets into real-time PWM signals for the H-Bridge.
• Offloaded Neural Analytics:
  • The Coprocessor Model: By utilizing the smartphone as a "Vision Coprocessor," iRobbie achieves 30 FPS object tracking. The phone's camera captures visual data, identifies targets using optimized neural networks, and calculates the necessary steering vectors, which are then transmitted to the Arduino for kinetic execution.
• Kinematic Actuation & Power Forensics:
  • Differential Steering: The L298N H-Bridge handles the high-current requirements of the 4WD drive-train. The Arduino modulates the duty cycle of the motor pins to control speed and rotational bias, allowing the robot to "Pivot" or "Chase" targets identified by the vision system.
  • Voltage Stability: To prevent "MCU Resets" during peak motor surges, the system utilizes a 7.4V (2x18650) battery array, stepped down via the L298N's on-board regulator to provide a stable logic rail for the Uno and HM-10.

Engineering & Implementation

• CV Control Modes:

  • Object Tracker – Utilizes tap-to-drag ROI (Region of Interest) forensics for target following. Tap and drag over the object you want to track and your iRobbie robot will follow the object.
  • iFinder – Autonomous searching mode leveraging pre-trained weights for 60+ object classes. Just tell iRobbie what you want him to find. iRobbie is able to recognize over 60 objects and he will start tracking the object after recognizing it.
  • Voice Control – Translates natural language intent (e.g., "Find the coffee mug") into navigation goals. You can control your iRobbie robot by telling him here to go.
  • Remote Control – a responsive touchscreen joystick on your iPhone to control the iRobbie robot.
  • Xylophone – play music with your iRobbie Arduino robot.

• Assembly Logistics:

  • The Sensor Shield v5 is utilized as a centralized IO hub, simplifying the wiring of the BLE module, motor signals, and buzzer feedback. The iPhone is mounted securely on the chassis to ensure the camera's FOV (Field of View) is aligned with the robot's forward movement vector.

Download iRobbie-A on the AppStore

Full iRobbie-A demo

Conclusion

This is just an example that can inspire you to design and build your very own robot to play with the iRobbie App using Arduino compatible boards, parts or kits. HM-10 Bluetooth module connects to the Sensor Shield: RX to TX, TX to RX, GND to "-", VCC to "+" Visit https://www.robbie-app.com/ to check and download free Arduino programs.

iRobbie demonstrates the future of Hybrid Embedded Systems. By mastering BLE Data Bridging and Distributed Computing Forensics, developers can build world-class autonomous systems that leverage the immense power of modern smartphones to drive simple, reliable Arduino hardware.

For more information, please visit the iRobbie web site.

---

Distributed Intelligence: Mastering computer vision through BLE forensics.

Arduino compatible boards, parts and kits are sold separately. Arduino is trademark of Arduino AG, which does not sponsor, authorize or endorse this product.