कंटेंट पर जाएँ
TakoAPI
स्किल्स पर वापस

midscene-ios-automation

quanru द्वारा

Web & Frontend Development
853clawskills.sh द्वारा बताए गए डाउनलोड
0व्यूज़
0 लाइकइस स्किल को लाइक करने के लिए साइन इन करें
—अभी तक कोई रेटिंग नहीं
आपकी रेटिंग

संक्षिप्त

Vision-driven iOS device automation using Midscene CLI.

विवरण

यह स्किल क्या करती है

Vision-driven iOS automation that operates entirely from screenshots, requiring no DOM access or accessibility labels. Sends natural language commands to any iOS app via WebDriverAgent and a vision-capable LLM. Works with apps built on any technology stack.

Works on any iOS app regardless of how it was built, since it reads the screen visually instead of relying on accessibility labels or DOM structure.

इसे कब इस्तेमाल करें

  • Automating repetitive UI tasks in iOS apps during QA testing
  • Extracting data from iOS apps that lack a web or API interface
  • Navigating iOS settings programmatically for device configuration
  • Verifying iOS app UI flows without writing XCTest or UITest code
  • Capturing screen state during multi-step iOS app walkthroughs

उदाहरण वर्कफ़्लो

इनपुट

User asks: Open Settings, go to Wi-Fi, and tell me the name of the connected network

एजेंट
  1. 1

    Connect to the iOS device via WebDriverAgent

  2. 2

    Take a screenshot to confirm the current screen state

  3. 3

    Run act with prompt "open Settings and navigate to Wi-Fi, tell me the connected network name"

  4. 4

    Take a screenshot to capture the Wi-Fi screen

  5. 5

    Disconnect from the device and report the network name found

आउटपुट

Connected Wi-Fi network name extracted from the Settings > Wi-Fi screen

आवश्यकताएँ

  • MIDSCENE_MODEL_API_KEY environment variable (API key for a vision-capable LLM provider)
  • MIDSCENE_MODEL_NAME, MIDSCENE_MODEL_BASE_URL, and MIDSCENE_MODEL_FAMILY environment variables
  • WebDriverAgent installed and running on the target iOS device

इंस्टॉलेशन

clawhub install quanru/midscene-ios-automation

CLI कमांड चलाएँ, या प्रॉम्प्ट को Claude Code, Cursor, Codex या जो भी कोडिंग एजेंट आप इस्तेमाल करते हैं उसमें पेस्ट करें।

लिंक