atl-mobile
bởi jordancoin
Browser & AutomationTóm tắt
Mobile browser and native app automation via ATL (iOS Simulator).
Mô tả
Kỹ năng này làm gì
ATL (Agent Touch Layer) is an HTTP-based automation layer for iOS Simulator. It runs two local servers: port 9222 for mobile Safari and port 9223 for native iOS app automation via XCTest. Agents interact with web and native UI through HTTP commands, using a numbered mark system to locate elements without vision API calls.
The mark system assigns numbered labels to interactive elements with exact pixel coordinates, so agents can tap precisely without paying for vision model API calls on every screenshot.
Khi nào nên dùng
- Automating checkout flows on mobile e-commerce sites in Safari
- Testing native iOS app navigation without a physical device
- Scraping web content as rendered in mobile Safari
- Capturing screenshots of mobile-specific UI layouts for QA
- Running scripts that configure iOS system app settings
Quy trình ví dụ
User asks: Open iOS Settings, navigate to Wi-Fi, and take a screenshot
- 1
Sends openApp command to port 9223 with bundleId com.apple.Preferences
- 2
Calls snapshot with interactiveOnly to retrieve the accessibility tree
- 3
Uses find command to locate and tap the Wi-Fi cell by label text
- 4
Sends screenshot command and decodes the base64 PNG response to a file
- 5
Calls closeApp to terminate Settings
PNG screenshot of the Wi-Fi settings screen saved to /tmp/wifi-settings.png
Yêu cầu
- Xcode installed on macOS (provides xcrun, xcodebuild, and iOS Simulator)
Cài đặt
clawhub install jordancoin/atl-mobileChạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.