Zum Inhalt springen
TakoAPI
Zurück zu den Skills

ESP32_Theremin

von FrancescoQ

Cline
—Noch nicht bewertet
Deine Bewertung

Kurzbeschreibung

A homemade Theremin, built with ESP32 and VL53L0X ToF sensors, built with the help of Claude/Cline AI in VSCode.

Beschreibung

# ESP32 Theremin

A gesture-controlled digital musical instrument built with ESP32 and Time-of-Flight sensors, creating theremin-like sounds through hand movements.

## Overview

This project transforms an ESP32 microcontroller into a playable theremin using laser distance sensors. Move your hands over two sensors to control pitch and volume independently, creating eerie, expressive electronic sounds in real-time.

**Key Features:**
- Dual sensor control: one hand for pitch, one for volume
- Real-time audio synthesis with minimal latency
- I2C sensor management with address conflict resolution
- Clean, modular architecture for future expansion

## Software

Built with PlatformIO and Arduino framework through an **AI-assisted development workflow**:

**Planning Phase (Claude AI):**
- Initial requirements definition and architecture design
- Technical specifications and problem-solving approach
- Comprehensive project brief and documentation structure

**Implementation Phase (Cline AI + Human Collaboration):**
- Code generation and implementation guided by Cline AI
- Active human review, refinement, and custom coding
- Hardware testing and real-world validation
- Iterative debugging and optimization

**Core Features:**
- Sensor input smoothing for stable control
- Real audio synthesis using PCM5102 external I2S DAC (16-bit stereo, professional quality)
- **Audio effects system** - Delay, Chorus, AND Reverb effects with excellent performance (14.5% CPU, 85% headroom!)
- **Multi-oscillator support** - 3 oscillators with 4 waveform types (Sine, Square, Triangle, Sawtooth)
- **Web control interface** - Modern Preact-based UI with real-time WebSocket communication (~30KB bundle)
- **Visual tuner** - Real-time frequency-to-note conversion with cents deviation (shared between OLED and Web UI)
- **Network features** - WiFi with captive portal, mDNS (theremin.local), OTA updates
- **OLED display** - SSD1306 with page navigation and notification overlays
- Modular component design (SensorManager, AudioEngine, EffectsChain, NetworkManager, WebUIManager, TunerManager)
- Multiple control methods: Physical switches (MCP23017), serial commands, and web interface
- Comprehensive debug logging

**Note on Simulation:** Wokwi simulator was useful for initial validation but has limited utility beyond basic proof-of-concept (Step 0).

*This was a true collaborative process - AI tools accelerated development and provided technical assistance, but all code was reviewed, tested, and refined through active human involvement and hardware validation.*

## Development Process

This project was developed through a **collaborative AI-assisted workflow**:

1. **Initial Planning**: Extensive discussion with Claude AI to define requirements, architecture, and development approach, resulting in the comprehensive project brief
2. **Iterative Refinement**: Multiple iterations with Claude to refine specifications, explore technical solutions, and plan implementation phases
3. **Code Implementation**: Cline AI agent used to write, test, and refine the actual codebase based on the Claude-generated brief
4. **Continuous Collaboration**: True human-AI partnership with the developer actively involved in code review, hardware testing, debugging, and implementation decisions - AI accelerated development while human expertise guided technical choices and validated real-world functionality

This approach demonstrates how modern AI tools can accelerate embedded systems development while maintaining human oversight and creative direction.

## Current Status

**🎉 MAJOR UPDATE - Complete Web Control Interface! 🎉**
- ✓ Dual sensor control working
- ✓ Real-time audio synthesis with PCM5102 I2S DAC (16-bit)
- ✓ **3 oscillators** with 4 waveform types
- ✓ **Delay, Chorus, AND Reverb effects** (14.5% CPU, 85% headroom!)
- ✓ **Web UI with real-time WebSocket control** (Preact + Tailwind)
- ✓ **Visual tuner** - frequency-to-note conversion (OLED + Web)
- ✓ **Network features** - WiFi, mDNS (theremin.local), captive portal
- ✓ Physical controls (MCP23017) + serial commands + web interface
- ✓ SSD1306 OLED display with page navigation
- ✓ OTA update support (with optional button activation)

**Next:** Phase 5 polish, LED meters, or advanced web features

See `productbrief.md` for v2.0 roadmap and `memory-bank/progress.md` for detailed status.

## Documentation

Comprehensive project documentation is maintained in the `memory-bank/` directory:
- **projectbrief.md**: Complete project requirements and vision
- **ARCHITECTURE.md**: System design and component details
- **OTA_SETUP.md**: Over-the-air update configuration
- **DEBUG_GUIDE.md**: Debugging and troubleshooting

## License

Open source project for educational and experimental use.

---

*Built with ESP32, powered by curiosity, developed with AI collaboration.*

Installation

Installiere den Skill von https://github.com/FrancescoQ/ESP32_Theremin

Dieser Skill ist nicht in der ClawHub-Registry veröffentlicht. Füge den Prompt in deinen Coding-Agenten ein — Claude Code, Cursor, Codex — und er installiert den Skill direkt aus dem Quell-Repository.

Repository öffnen

Links