This video presents the design, fabrication, and programming of a modular, responsive surface. The surface “shape-shifts” in response to the surrounding social conditions aiming at optimizing spatial interactions and improving the occupant experience within the architectural space.

The video is part of a study that aims to develop a Dynamic Modular Tessellation (DMT), which can be used as a repetitive building block to construct the building skin system. The design of the modular unit employs “minimum inventory/maximum diversity” strategies to cover various regular and irregular tessellations. Additionally, the paper discusses possible interaction modes of the structure including: preconfigured interactions, responsive interactions, and predictive interactions.

Project Perspective

reTESSELLATE is a sophisticated exploration of architectural technology and spatial interaction. By focusing on the essential building blocks—the Kinect vision sensor and your robotic modular mesh—you'll learn how to communicate and synchronize architectural forms using a specialized software logic and robust Rhino-integrated setup.

Technical Implementation: Computational Geometry and Dynamic Feedback

The project reveals the hidden layers of simple motion-to-structure interaction:

• Identification layer: The Microsoft Kinect acts as a high-resolution depth eye, measuring each point of the occupant's position in 3D space.
• Conversion layer: The Arduino Mega uses a high-speed Firmata protocol to receive high-speed movement vectors from Rhino Grasshopper.
• Interface layer: Firefly for Grasshopper acts as a high-definition data bridge for surface status checks (Mesh subdivision/Vertex position).
• Actuation layer: A Servo Motor Array provides high-resolution mechanical feedback for each dynamic surface change.
• Processing Logic layer: The system code follows a "reTesselate algorithms" (or modular-morph) strategy: it interprets the occupant's proximity and matches modular rotations to provide a safe and rhythmic architectural response.

Hardware-Architectural Infrastructure

• Arduino Mega 2560: The "brain" of the project, managing multi-directional servo sampling and coordinating Kinect data sync.
• Microsoft Kinect: Providing a high-speed and reliable "Sensing Link" for every point of the installation.
• Modular Units: Providing high-precision and reliable "Mechanical Fabric" for each responsive mission.
• Rhino Grasshopper: Essential for providing a clear and energy-efficient computational platform for geometry-logic.
• 12V 10A Power Supply: Provides a clear and professional physical interface for each servo mission.
• USB B Cable: Used to program the Arduino and provide the primary interface for the system controller.

[!IMPORTANT] The Arduino Mega is required instead of an Uno to ensure you have enough pins and memory to handle the hundreds of servo signals from Rhino Grasshopper!

Surface Automation and Interaction Step-by-Step

The reTESSELLATE simulation process is designed to be very efficient:

1. Initialize Workspace: Correctly set up your Kinect and Arduino Mega on your installation frame and connect the servos properly.
2. Setup Output Sync: In Rhino Grasshopper, initialize the Firefly components and define the Firmata port to coordinate the motion.
3. Internal Dialogue Loop: The mesh constantly performs high-performance depth checks and updates servo positions in real-time based on occupant movement.
4. Visual and Computational Feedback Integration: Watch your physical dashboard and the Rhino preview automatically become a rhythmic status signal, pulsing and following your spatial settings from a distance.

Future Expansion

• OLED Identity Dashboard Integration: Add a small OLED display on the control panel to show "Active Vertex Count" or "Frame Rate (FPS)."
• Multi-sensor Climate Sync Synchronization: Connect specialized "Ultrasonic Sensors" to perform higher-precision "Local Proximity" responses wirelessly via the cloud.
• Cloud Interface Registration Support Synchronization: Add a specialized web-dashboard on a smartphone over WiFi/BT to precisely track and log total motion history.
• Advanced Velocity Profile Customization Support: Add specialized "Machine Learning (vCore)" to the code to allow patterns to be automatically optimized for personalized interactions.

reTESSELLATE is a perfect project for any science enthusiast looking for a more interactive and engaging architectural tool!