Skip to content
TakoAPI
Back to skills

desktop-assistant

by jrubiosainz

Copilot
โ€”Not yet rated
Your rating

Brief

Desktop Assistant built with GitHub Copilot SDK - AI-powered Windows control with 44 custom tools

Description

# Desktop Assistant

A powerful desktop assistant application built with the **GitHub Copilot SDK** and **Electron**. This app provides a chat interface to interact with GitHub Copilot, enhanced with 60+ custom tools for Windows system control and Microsoft 365 integration.

---

## โšก <span style="color: gold; font-size: 1.5em;">๐ŸŸก NEW Release โ€” 11th Feb 2026!!</span>

> **๐ŸŸก Major update with 30+ new features and capabilities!**

### ๐Ÿ†• What's New in This Release:

**๐Ÿ—“๏ธ Teams Meetings & Calendar**
- **Create Teams Meetings** โ€” Full meeting invitations with Teams link, attendees, duration, importance, and auto-send
- **Create Calendar Events** โ€” Personal appointments with all-day support, reminders, and custom location
- **Cancel Meetings** โ€” Search and cancel meetings by subject/date with automatic attendee notification

**๐ŸŸข Teams Presence Control**
- **Set Teams Status** โ€” Change your presence to Available, Busy, Do Not Disturb, Be Right Back, Away, or Offline via Microsoft Graph API
- **Get Teams Status** โ€” Query your current Teams presence and status message
- **Custom Status Messages** โ€” Set a custom status message with optional auto-expiration timer

**๐Ÿ–ผ๏ธ Image Attachments in Chat**
- **Inline image preview** โ€” Attached images now display directly inside chat message bubbles
- **Full-size image overlay** โ€” Click any chat image to view it at full resolution
- **Drag & drop support** โ€” Drop image files onto the chat area to attach them
- **Paste from clipboard** โ€” Ctrl+V to paste images directly from clipboard
- **Screenshot capture** โ€” Capture your screen and attach it to a message with one click

**๐Ÿค– Updated AI Models**
- **19 models available** including GPT-5, GPT-5.1, GPT-5.2, GPT-5.1 Codex/Codex-Max, Claude Opus 4.5/4.6, Claude Sonnet 4/4.5, Gemini 2.5 Pro, Gemini 3 Flash/Pro, and more
- **Live model switching** โ€” Change models on the fly without restarting
- **Reasoning effort selector** โ€” Low/Medium/High reasoning for O1/O3/GPT-5 models

**๐ŸŽค Voice Input (Azure AI Whisper)**
- **Speech-to-text** via Azure AI Foundry Whisper with Entra ID authentication (no API key needed)
- **One-click recording** with animated indicator and auto-send
- **In-app setup wizard** and microphone test

**๐ŸŽจ Theme & UI Enhancements**
- **Dark / Light / System theme toggle** with persistence across sessions
- **Chat history panel** โ€” Browse, restore, and delete past conversations (persisted to disk)
- **Slash commands** โ€” Quick actions: `/meetings`, `/emails`, `/system`, `/screenshot`, `/windows`, `/apps`, `/files`, `/clipboard`, `/help` with auto-complete suggestions
- **Streaming responses** โ€” Real-time incremental rendering with markdown support
- **Tool execution indicators** โ€” Visual spinner with tool name during execution, checkmark on completion
- **User confirmation dialogs** โ€” Modal prompts for dangerous operations

**โŒจ๏ธ Keyboard Shortcuts & System Tray**
- `Ctrl+Shift+Space` โ€” Global activate from anywhere
- `Ctrl+Shift+N` โ€” New chat
- `Ctrl+H` โ€” Toggle history
- `Ctrl+,` โ€” Open settings
- **System tray** with quick commands menu (Meetings, Emails, System Info, Screenshot)

**๐Ÿ”„ Session Resilience**
- Automatic session retry with escalating recovery (new session โ†’ full client restart)
- Lazy session creation and reconnection on the fly

---

## ๐Ÿ†• Work IQ โ€” Microsoft 365 Integration

![Work IQ Integration 1](screenshots/captura1.png)
![Work IQ Integration 2](screenshots/captura2.png)
![Work IQ Integration 3](screenshots/Captura3.png)

Learn more:
- [Bringing work context to your code in GitHub Copilot](https://developer.microsoft.com/blog/bringing-work-context-to-your-code-in-github-copilot)
- [Work IQ MCP Repository](https://github.com/microsoft/work-iq-mcp)

---

![Desktop Assistant Chat](screenshots/Desktop_Assistant_1.png)
![Desktop Assistant Welcome](screenshots/Desktop_Assistant_2.png)
![Desktop Assistant Tools](screenshots/Desktop_Assistant_3.png)

![Desktop Assistant Demo](screenshots/desktop_assistant.gif)

## Features

### ๐Ÿ’ผ Work IQ โ€” Microsoft 365 Integration
Query your Microsoft 365 data with natural language powered by [Work IQ MCP](https://github.com/microsoft/work-iq-mcp):
- **๐Ÿ“… Meetings** โ€” "What meetings do I have today?" / "Tell me about my 1:1 with manager"
- **๐Ÿ“ง Emails** โ€” "Show me emails from my manager" / "Summarize emails about the budget"
- **๐Ÿ“„ Documents** โ€” "Find my recent PowerPoint presentations" / "Documents I edited yesterday"
- **๐Ÿ’ฌ Teams** โ€” "Summarize today's messages in the Engineering channel"
- **๐Ÿ‘ฅ People** โ€” "Who is working on Project Alpha?" / "Find John Smith"
- **๐Ÿ“Š Work Summary** โ€” "Give me a summary of my work activity this week"

### ๐Ÿ—“๏ธ Teams Meetings & Calendar
- Create Teams meeting invitations with online link and attendees
- Create personal calendar events
- Cancel meetings with attendee notification
- Set and get your Teams presence status
- Custom status messages with auto-expiration

### ๐ŸชŸ Window Management
- List all open windows
- Focus, minimize, maximize, restore windows
- Close windows by name

### ๐Ÿ“ File Management
- List directory contents
- Search for files by pattern
- Create, move, copy, delete, rename files and folders
- Read file contents

### ๐Ÿš€ Application Management
- List installed applications
- List running applications
- Launch applications by name
- Quit/close applications

### โš™๏ธ System Controls
- Get/set system volume
- Mute/unmute audio
- Take screenshots
- Get system information (OS, CPU, memory, disk)

### ๐Ÿ“Š Process Management
- List running processes with resource usage
- Kill processes by name or PID
- Get detailed process information

### ๐Ÿ“‹ Clipboard
- Read clipboard contents
- Write text to clipboard

### ๐Ÿ“„ Microsoft Office Integration
- Create Word documents
- Create Excel spreadsheets
- Create PowerPoint presentations
- Create Outlook emails
- Open any Office document

### ๐Ÿ–ผ๏ธ Image & Vision
- Capture screenshots and attach to chat
- Drag & drop or paste images
- Inline image display in chat with full-size overlay
- Vision-capable model support (GPT-4.1, GPT-5, Claude Opus, etc.)

### ๐ŸŽค Voice Input
- Azure AI Whisper speech-to-text
- Entra ID authentication (no API key)
- One-click recording with auto-send

### ๐ŸŽจ Themes & UI
- Dark / Light / System theme toggle
- Chat history panel with session restore
- Slash commands with auto-complete
- Streaming responses with markdown
- Tool execution indicators
- User confirmation dialogs
- Keyboard shortcuts

## Prerequisites

- **Node.js** 18+
- **npm** or **yarn**
- **GitHub Copilot CLI** installed and authenticated
- **Windows 10/11** (tools are Windows-specific)
- **Work IQ** (optional, for M365 integration): `npm install -g @microsoft/workiq`
- **Azure CLI** (optional, for Teams status & voice input): `az login`

## Installation

1. Clone the repository:
```bash
git clone https://github.com/jrubiosainz/desktop-assistant.git
cd desktop-assistant
```

2. Install dependencies:
```bash
npm install
```

3. Authenticate with GitHub Copilot CLI:
```bash
copilot
# Then type /login and follow the prompts
```

4. (Optional) Set up Work IQ for Microsoft 365 integration:
```bash
# Install globally
npm install -g @microsoft/workiq

# Accept the EULA
npx -y @microsoft/workiq accept-eula

# Test the connection (will prompt for Microsoft login on first use)
workiq ask -q "test"
```

5. Build and run:
```bash
npm run build
npm run electron
```

## Usage

1. Launch the app with `npm run electron`
2. Wait for the "Connected" status
3. Type natural language commands like:
   - "List my open windows"
   - "What files are in my Documents folder?"
   - "Take a screenshot"
   - "Create a Word document about project planning"
   - "What's my system info?"
   - "Set volume to 50%"
   - "Create a Teams meeting with john@company.com tomorrow at 10am"
   - "Set my Teams status to busy"
   - "Cancel the meeting about project review"

### Slash Commands
Type `/` in the chat to see available quick commands:
- `/meetings` โ€” Show today's meetings
- `/emails` โ€” Show unread emails
- `/system` โ€” System information
- `/screenshot` โ€” Take a screenshot
- `/windows` โ€” List open windows
- `/apps` โ€” List running apps
- `/files` โ€” List files in current directory
- `/clipboard` โ€” Show clipboard contents
- `/help` โ€” Show all commands

### Keyboard Shortcuts
| Shortcut | Action |
|---|---|
| `Ctrl+Shift+Space` | Global activate (from anywhere) |
| `Ctrl+Shift+N` | New chat |
| `Ctrl+H` | Toggle history panel |
| `Ctrl+,` | Open settings |
| `Enter` | Send message |
| `Shift+Enter` | New line |
| `Escape` | Cancel/abort request |

## Project Structure

```
desktop-assistant/
โ”œโ”€โ”€ src/
โ”‚   โ”œโ”€โ”€ main.ts              # Electron main process + Copilot SDK
โ”‚   โ””โ”€โ”€ tools/
โ”‚       โ”œโ”€โ”€ index.ts         # Tool exports
โ”‚       โ”œโ”€โ”€ windows-tools.ts # Window management
โ”‚       โ”œโ”€โ”€ file-tools.ts    # File operations
โ”‚       โ”œโ”€โ”€ app-tools.ts     # Application control
โ”‚       โ”œโ”€โ”€ system-tools.ts  # System controls
โ”‚       โ”œโ”€โ”€ process-tools.ts # Process management
โ”‚       โ”œโ”€โ”€ clipboard-tools.ts # Clipboard operations
โ”‚       โ”œโ”€โ”€ office-tools.ts  # Microsoft Office + Teams meetings/status
โ”‚       โ””โ”€โ”€ workiq-tools.ts  # Microsoft 365 Work IQ integration
โ”œโ”€โ”€ renderer/
โ”‚   โ”œโ”€โ”€ index.html           # Chat UI
โ”‚   โ”œโ”€โ”€ renderer.js          # UI logic
โ”‚   โ””โ”€โ”€ styles.css           # Styling (dark/light/system themes)
โ”œโ”€โ”€ dist/                    # Compiled output
โ”œโ”€โ”€ package.json
โ”œโ”€โ”€ tsconfig.json
โ””โ”€โ”€ build.mjs               # esbuild configuration
```

## Development

### Build
```bash
npm run build
```

### Run in development
```bash
npm run electron
```

### Watch mode (if needed)
```bash
npm run build -- --watch
```

## Configuration

The app uses the GitHub Copilot CLI configuration at `~/.copilot/config.json`. You can add trusted folders there:

```json
{
  "trusted_folders": [
    "C:\\path\\to\\your\\project"
  ]
}
```

## Tech Stack

- **[GitHub Copilot SDK](https://www.npmjs.com/package/@github/copilot-sdk)** โ€” AI-powered assistant
- **[Electron](https://www.electronjs.org/)** โ€” Desktop application framework
- **[TypeScript](https://www.typescriptlang.org/)** โ€” Type-safe JavaScript
- **[Zod](https://zod.dev/)** โ€” Schema validation for tool parameters
- **[esbuild](https://esbuild.github.io/)** โ€” Fast bundler
- **[Work IQ MCP](https://github.com/microsoft/work-iq-mcp)** โ€” Microsoft 365 Copilot integration
- **[Azure Identity](https://www.npmjs.com/package/@azure/identity)** โ€” Entra ID authentication

## License

MIT License โ€” see [LICENSE](LICENSE) file for details.

## Acknowledgments

- Built with the [GitHub Copilot SDK](https://github.blog/changelog/2025-01-21-github-copilot-sdk-public-preview/)
- Powered by [Work IQ MCP](https://github.com/microsoft/work-iq-mcp) for Microsoft 365 integration
- Inspired by the power of AI-assisted development

Installation

Install the skill from https://github.com/jrubiosainz/desktop-assistant

This skill is not published on the ClawHub registry. Paste the prompt into your coding agent โ€” Claude Code, Cursor, Codex โ€” and it will install the skill straight from the source repository.

Open the repository

Links