स्किल्स पर वापस
ESP32_Theremin
FrancescoQ द्वारा
Cline—अभी तक कोई रेटिंग नहीं
आपकी रेटिंग
संक्षिप्त
A homemade Theremin, built with ESP32 and VL53L0X ToF sensors, built with the help of Claude/Cline AI in VSCode.
विवरण
# ESP32 Theremin A gesture-controlled digital musical instrument built with ESP32 and Time-of-Flight sensors, creating theremin-like sounds through hand movements. ## Overview This project transforms an ESP32 microcontroller into a playable theremin using laser distance sensors. Move your hands over two sensors to control pitch and volume independently, creating eerie, expressive electronic sounds in real-time. **Key Features:** - Dual sensor control: one hand for pitch, one for volume - Real-time audio synthesis with minimal latency - I2C sensor management with address conflict resolution - Clean, modular architecture for future expansion ## Software Built with PlatformIO and Arduino framework through an **AI-assisted development workflow**: **Planning Phase (Claude AI):** - Initial requirements definition and architecture design - Technical specifications and problem-solving approach - Comprehensive project brief and documentation structure **Implementation Phase (Cline AI + Human Collaboration):** - Code generation and implementation guided by Cline AI - Active human review, refinement, and custom coding - Hardware testing and real-world validation - Iterative debugging and optimization **Core Features:** - Sensor input smoothing for stable control - Real audio synthesis using PCM5102 external I2S DAC (16-bit stereo, professional quality) - **Audio effects system** - Delay, Chorus, AND Reverb effects with excellent performance (14.5% CPU, 85% headroom!) - **Multi-oscillator support** - 3 oscillators with 4 waveform types (Sine, Square, Triangle, Sawtooth) - **Web control interface** - Modern Preact-based UI with real-time WebSocket communication (~30KB bundle) - **Visual tuner** - Real-time frequency-to-note conversion with cents deviation (shared between OLED and Web UI) - **Network features** - WiFi with captive portal, mDNS (theremin.local), OTA updates - **OLED display** - SSD1306 with page navigation and notification overlays - Modular component design (SensorManager, AudioEngine, EffectsChain, NetworkManager, WebUIManager, TunerManager) - Multiple control methods: Physical switches (MCP23017), serial commands, and web interface - Comprehensive debug logging **Note on Simulation:** Wokwi simulator was useful for initial validation but has limited utility beyond basic proof-of-concept (Step 0). *This was a true collaborative process - AI tools accelerated development and provided technical assistance, but all code was reviewed, tested, and refined through active human involvement and hardware validation.* ## Development Process This project was developed through a **collaborative AI-assisted workflow**: 1. **Initial Planning**: Extensive discussion with Claude AI to define requirements, architecture, and development approach, resulting in the comprehensive project brief 2. **Iterative Refinement**: Multiple iterations with Claude to refine specifications, explore technical solutions, and plan implementation phases 3. **Code Implementation**: Cline AI agent used to write, test, and refine the actual codebase based on the Claude-generated brief 4. **Continuous Collaboration**: True human-AI partnership with the developer actively involved in code review, hardware testing, debugging, and implementation decisions - AI accelerated development while human expertise guided technical choices and validated real-world functionality This approach demonstrates how modern AI tools can accelerate embedded systems development while maintaining human oversight and creative direction. ## Current Status **🎉 MAJOR UPDATE - Complete Web Control Interface! 🎉** - ✓ Dual sensor control working - ✓ Real-time audio synthesis with PCM5102 I2S DAC (16-bit) - ✓ **3 oscillators** with 4 waveform types - ✓ **Delay, Chorus, AND Reverb effects** (14.5% CPU, 85% headroom!) - ✓ **Web UI with real-time WebSocket control** (Preact + Tailwind) - ✓ **Visual tuner** - frequency-to-note conversion (OLED + Web) - ✓ **Network features** - WiFi, mDNS (theremin.local), captive portal - ✓ Physical controls (MCP23017) + serial commands + web interface - ✓ SSD1306 OLED display with page navigation - ✓ OTA update support (with optional button activation) **Next:** Phase 5 polish, LED meters, or advanced web features See `productbrief.md` for v2.0 roadmap and `memory-bank/progress.md` for detailed status. ## Documentation Comprehensive project documentation is maintained in the `memory-bank/` directory: - **projectbrief.md**: Complete project requirements and vision - **ARCHITECTURE.md**: System design and component details - **OTA_SETUP.md**: Over-the-air update configuration - **DEBUG_GUIDE.md**: Debugging and troubleshooting ## License Open source project for educational and experimental use. --- *Built with ESP32, powered by curiosity, developed with AI collaboration.*
इंस्टॉलेशन
https://github.com/FrancescoQ/ESP32_Theremin से यह स्किल इंस्टॉल करोयह स्किल ClawHub रजिस्ट्री पर पब्लिश नहीं है। प्रॉम्प्ट को अपने कोडिंग एजेंट — Claude Code, Cursor, Codex — में पेस्ट करें, और वह स्किल को सीधे सोर्स रिपॉज़िटरी से इंस्टॉल कर देगा।
रिपॉज़िटरी खोलें