atomsforagents.
About the directory & our standards

Buttons & controls / Device firmware

Handsy: a hardware bridge for an iPhone

Use a small ESP32-S3 board to connect an iPhone's screen and controls to a supervised AI agent.

Read the original build See shopping list
Handsy: a hardware bridge for an iPhone — v0.1.0 build photo from the creator’s source
Henry Yuan · v0.1.0 build photo

What the hardware does

A flashed XIAO ESP32-S3 receives an iPhone's mirrored screen and provides a physical input bridge. The current repository uses USB HID for input and Bluetooth for board-to-app communication.

How the agent helped

Henry Yuan's showcase explicitly credits Codex with ESP32 firmware, input handling and the agent loop. The repository has since moved from the earlier design to a phone-app architecture; check the current release rather than combining instructions from different versions.

Before you build

Flash the exact supported board and follow the current repository's version-specific instructions. The README specifies the plain Seeed Studio XIAO ESP32S3 with 8 MB PSRAM, not Sense or Plus. Current setup uses USB HID, iOS 18 or later, AssistiveTouch and an iPhone app; the showcase describes an earlier Bluetooth input design. The example photo is from v0.1.0. A compatible vision service, cellular data and an appropriate USB connection or adapter may be needed. Review permissions, supervise actions and automate only devices and accounts you are allowed to use.

Follow the build

youcanjustbuildthings.openai.chatgpt.site

Original build story

Creator showcase

github.com

Supporting source

Hardware

All hardware

Shopping list

Save as Markdown

Current README uses USB HID, not the older showcase’s Bluetooth-only input route. Follow only the current maintainer install instructions; review automation permissions and supervise actions.

Quantities are for one build. Unless marked source-specified, they are planning quantities; confirm kit contents and the chosen configuration before ordering.

  1. Qty. 1Plan / confirm
    Required

    Seeed Studio XIAO ESP32S3, plain 8 MB PSRAM version

    USB HID and screen-mirroring bridge.

    Repository explicitly says not Sense and not Plus.

    Sources & quantity basis

    Creator source. Planning quantity for one build; check the selected configuration.

    View product

    Exact product

  2. Qty. 1Plan / confirm
    Required

    iPhone with iOS 18 or later

    Phone being automated.

    Cellular data is needed while Wi-Fi is used by the board hotspot.

    Sources & quantity basis

    Creator source. Planning quantity for one build; check the selected configuration.

    No exact purchase link verified; confirm the model and requirements above before ordering.

  3. Qty. 1Plan / confirm
    Conditional

    USB-C to USB-C data cable

    Connect to the computer for programming or data.

    For USB-C iPhones; must support USB data. Phone powers the board.

    Sources & quantity basis

    Setup requirement — check against your configuration. Planning quantity for one build; check the selected configuration.

    Use existing equipment or match the specification above. No exact purchase link verified.

  4. Qty. 1Plan / confirm
    Conditional

    Lightning to USB Camera Adapter and matching USB cable

    Connection for Lightning iPhones.

    Alternative to the USB-C cable, not an extra required adapter for USB-C phones.

    Sources & quantity basis

    Creator source. Planning quantity for one build; check the selected configuration.

    No exact purchase link verified; confirm the model and requirements above before ordering.

  5. Qty. 1Plan / confirm
    Tool

    Computer with Chrome or Edge for flashing

    Build, configure or flash the software.

    Sources & quantity basis

    Setup requirement — check against your configuration. Planning quantity for one build; check the selected configuration.

    Use existing equipment or match the specification above. No exact purchase link verified.

Source reviewed, not assembled or hands-on tested. A working product page does not confirm stock, firmware compatibility or a complete build.

All projects

Built something with a coding agent?

Share your hardware project so others can try it.

Submit a project