Back to skills
desktop-assistant
by jrubiosainz
CopilotโNot yet rated
Your rating
Brief
Desktop Assistant built with GitHub Copilot SDK - AI-powered Windows control with 44 custom tools
Description
# Desktop Assistant
A powerful desktop assistant application built with the **GitHub Copilot SDK** and **Electron**. This app provides a chat interface to interact with GitHub Copilot, enhanced with 60+ custom tools for Windows system control and Microsoft 365 integration.
---
## โก <span style="color: gold; font-size: 1.5em;">๐ก NEW Release โ 11th Feb 2026!!</span>
> **๐ก Major update with 30+ new features and capabilities!**
### ๐ What's New in This Release:
**๐๏ธ Teams Meetings & Calendar**
- **Create Teams Meetings** โ Full meeting invitations with Teams link, attendees, duration, importance, and auto-send
- **Create Calendar Events** โ Personal appointments with all-day support, reminders, and custom location
- **Cancel Meetings** โ Search and cancel meetings by subject/date with automatic attendee notification
**๐ข Teams Presence Control**
- **Set Teams Status** โ Change your presence to Available, Busy, Do Not Disturb, Be Right Back, Away, or Offline via Microsoft Graph API
- **Get Teams Status** โ Query your current Teams presence and status message
- **Custom Status Messages** โ Set a custom status message with optional auto-expiration timer
**๐ผ๏ธ Image Attachments in Chat**
- **Inline image preview** โ Attached images now display directly inside chat message bubbles
- **Full-size image overlay** โ Click any chat image to view it at full resolution
- **Drag & drop support** โ Drop image files onto the chat area to attach them
- **Paste from clipboard** โ Ctrl+V to paste images directly from clipboard
- **Screenshot capture** โ Capture your screen and attach it to a message with one click
**๐ค Updated AI Models**
- **19 models available** including GPT-5, GPT-5.1, GPT-5.2, GPT-5.1 Codex/Codex-Max, Claude Opus 4.5/4.6, Claude Sonnet 4/4.5, Gemini 2.5 Pro, Gemini 3 Flash/Pro, and more
- **Live model switching** โ Change models on the fly without restarting
- **Reasoning effort selector** โ Low/Medium/High reasoning for O1/O3/GPT-5 models
**๐ค Voice Input (Azure AI Whisper)**
- **Speech-to-text** via Azure AI Foundry Whisper with Entra ID authentication (no API key needed)
- **One-click recording** with animated indicator and auto-send
- **In-app setup wizard** and microphone test
**๐จ Theme & UI Enhancements**
- **Dark / Light / System theme toggle** with persistence across sessions
- **Chat history panel** โ Browse, restore, and delete past conversations (persisted to disk)
- **Slash commands** โ Quick actions: `/meetings`, `/emails`, `/system`, `/screenshot`, `/windows`, `/apps`, `/files`, `/clipboard`, `/help` with auto-complete suggestions
- **Streaming responses** โ Real-time incremental rendering with markdown support
- **Tool execution indicators** โ Visual spinner with tool name during execution, checkmark on completion
- **User confirmation dialogs** โ Modal prompts for dangerous operations
**โจ๏ธ Keyboard Shortcuts & System Tray**
- `Ctrl+Shift+Space` โ Global activate from anywhere
- `Ctrl+Shift+N` โ New chat
- `Ctrl+H` โ Toggle history
- `Ctrl+,` โ Open settings
- **System tray** with quick commands menu (Meetings, Emails, System Info, Screenshot)
**๐ Session Resilience**
- Automatic session retry with escalating recovery (new session โ full client restart)
- Lazy session creation and reconnection on the fly
---
## ๐ Work IQ โ Microsoft 365 Integration



Learn more:
- [Bringing work context to your code in GitHub Copilot](https://developer.microsoft.com/blog/bringing-work-context-to-your-code-in-github-copilot)
- [Work IQ MCP Repository](https://github.com/microsoft/work-iq-mcp)
---




## Features
### ๐ผ Work IQ โ Microsoft 365 Integration
Query your Microsoft 365 data with natural language powered by [Work IQ MCP](https://github.com/microsoft/work-iq-mcp):
- **๐
Meetings** โ "What meetings do I have today?" / "Tell me about my 1:1 with manager"
- **๐ง Emails** โ "Show me emails from my manager" / "Summarize emails about the budget"
- **๐ Documents** โ "Find my recent PowerPoint presentations" / "Documents I edited yesterday"
- **๐ฌ Teams** โ "Summarize today's messages in the Engineering channel"
- **๐ฅ People** โ "Who is working on Project Alpha?" / "Find John Smith"
- **๐ Work Summary** โ "Give me a summary of my work activity this week"
### ๐๏ธ Teams Meetings & Calendar
- Create Teams meeting invitations with online link and attendees
- Create personal calendar events
- Cancel meetings with attendee notification
- Set and get your Teams presence status
- Custom status messages with auto-expiration
### ๐ช Window Management
- List all open windows
- Focus, minimize, maximize, restore windows
- Close windows by name
### ๐ File Management
- List directory contents
- Search for files by pattern
- Create, move, copy, delete, rename files and folders
- Read file contents
### ๐ Application Management
- List installed applications
- List running applications
- Launch applications by name
- Quit/close applications
### โ๏ธ System Controls
- Get/set system volume
- Mute/unmute audio
- Take screenshots
- Get system information (OS, CPU, memory, disk)
### ๐ Process Management
- List running processes with resource usage
- Kill processes by name or PID
- Get detailed process information
### ๐ Clipboard
- Read clipboard contents
- Write text to clipboard
### ๐ Microsoft Office Integration
- Create Word documents
- Create Excel spreadsheets
- Create PowerPoint presentations
- Create Outlook emails
- Open any Office document
### ๐ผ๏ธ Image & Vision
- Capture screenshots and attach to chat
- Drag & drop or paste images
- Inline image display in chat with full-size overlay
- Vision-capable model support (GPT-4.1, GPT-5, Claude Opus, etc.)
### ๐ค Voice Input
- Azure AI Whisper speech-to-text
- Entra ID authentication (no API key)
- One-click recording with auto-send
### ๐จ Themes & UI
- Dark / Light / System theme toggle
- Chat history panel with session restore
- Slash commands with auto-complete
- Streaming responses with markdown
- Tool execution indicators
- User confirmation dialogs
- Keyboard shortcuts
## Prerequisites
- **Node.js** 18+
- **npm** or **yarn**
- **GitHub Copilot CLI** installed and authenticated
- **Windows 10/11** (tools are Windows-specific)
- **Work IQ** (optional, for M365 integration): `npm install -g @microsoft/workiq`
- **Azure CLI** (optional, for Teams status & voice input): `az login`
## Installation
1. Clone the repository:
```bash
git clone https://github.com/jrubiosainz/desktop-assistant.git
cd desktop-assistant
```
2. Install dependencies:
```bash
npm install
```
3. Authenticate with GitHub Copilot CLI:
```bash
copilot
# Then type /login and follow the prompts
```
4. (Optional) Set up Work IQ for Microsoft 365 integration:
```bash
# Install globally
npm install -g @microsoft/workiq
# Accept the EULA
npx -y @microsoft/workiq accept-eula
# Test the connection (will prompt for Microsoft login on first use)
workiq ask -q "test"
```
5. Build and run:
```bash
npm run build
npm run electron
```
## Usage
1. Launch the app with `npm run electron`
2. Wait for the "Connected" status
3. Type natural language commands like:
- "List my open windows"
- "What files are in my Documents folder?"
- "Take a screenshot"
- "Create a Word document about project planning"
- "What's my system info?"
- "Set volume to 50%"
- "Create a Teams meeting with john@company.com tomorrow at 10am"
- "Set my Teams status to busy"
- "Cancel the meeting about project review"
### Slash Commands
Type `/` in the chat to see available quick commands:
- `/meetings` โ Show today's meetings
- `/emails` โ Show unread emails
- `/system` โ System information
- `/screenshot` โ Take a screenshot
- `/windows` โ List open windows
- `/apps` โ List running apps
- `/files` โ List files in current directory
- `/clipboard` โ Show clipboard contents
- `/help` โ Show all commands
### Keyboard Shortcuts
| Shortcut | Action |
|---|---|
| `Ctrl+Shift+Space` | Global activate (from anywhere) |
| `Ctrl+Shift+N` | New chat |
| `Ctrl+H` | Toggle history panel |
| `Ctrl+,` | Open settings |
| `Enter` | Send message |
| `Shift+Enter` | New line |
| `Escape` | Cancel/abort request |
## Project Structure
```
desktop-assistant/
โโโ src/
โ โโโ main.ts # Electron main process + Copilot SDK
โ โโโ tools/
โ โโโ index.ts # Tool exports
โ โโโ windows-tools.ts # Window management
โ โโโ file-tools.ts # File operations
โ โโโ app-tools.ts # Application control
โ โโโ system-tools.ts # System controls
โ โโโ process-tools.ts # Process management
โ โโโ clipboard-tools.ts # Clipboard operations
โ โโโ office-tools.ts # Microsoft Office + Teams meetings/status
โ โโโ workiq-tools.ts # Microsoft 365 Work IQ integration
โโโ renderer/
โ โโโ index.html # Chat UI
โ โโโ renderer.js # UI logic
โ โโโ styles.css # Styling (dark/light/system themes)
โโโ dist/ # Compiled output
โโโ package.json
โโโ tsconfig.json
โโโ build.mjs # esbuild configuration
```
## Development
### Build
```bash
npm run build
```
### Run in development
```bash
npm run electron
```
### Watch mode (if needed)
```bash
npm run build -- --watch
```
## Configuration
The app uses the GitHub Copilot CLI configuration at `~/.copilot/config.json`. You can add trusted folders there:
```json
{
"trusted_folders": [
"C:\\path\\to\\your\\project"
]
}
```
## Tech Stack
- **[GitHub Copilot SDK](https://www.npmjs.com/package/@github/copilot-sdk)** โ AI-powered assistant
- **[Electron](https://www.electronjs.org/)** โ Desktop application framework
- **[TypeScript](https://www.typescriptlang.org/)** โ Type-safe JavaScript
- **[Zod](https://zod.dev/)** โ Schema validation for tool parameters
- **[esbuild](https://esbuild.github.io/)** โ Fast bundler
- **[Work IQ MCP](https://github.com/microsoft/work-iq-mcp)** โ Microsoft 365 Copilot integration
- **[Azure Identity](https://www.npmjs.com/package/@azure/identity)** โ Entra ID authentication
## License
MIT License โ see [LICENSE](LICENSE) file for details.
## Acknowledgments
- Built with the [GitHub Copilot SDK](https://github.blog/changelog/2025-01-21-github-copilot-sdk-public-preview/)
- Powered by [Work IQ MCP](https://github.com/microsoft/work-iq-mcp) for Microsoft 365 integration
- Inspired by the power of AI-assisted development
Installation
Install the skill from https://github.com/jrubiosainz/desktop-assistantThis skill is not published on the ClawHub registry. Paste the prompt into your coding agent โ Claude Code, Cursor, Codex โ and it will install the skill straight from the source repository.
Open the repository