Skip to main content

Quick Start Guide

This guide will get you from installation to your first AI-powered screenshot analysis in under 5 minutes.
Make sure you’ve completed the installation before proceeding.

Launch Cluely

1

Start the application

Open your terminal in the Cluely directory and run:
npm start
The application will:
  1. Start the Vite development server on port 5180
  2. Wait for the server to be ready
  3. Launch the Electron window
You should see a translucent window appear on your screen.
2

Understand the interface

Cluely’s window is designed to be invisible and non-intrusive:
  • Translucent background: See through to your work underneath
  • Always on top: Stays visible across all applications
  • Compact design: Takes minimal screen space
The window starts in “queue” view, ready to capture screenshots.

Master the keyboard shortcuts

Cluely is designed to be controlled entirely with keyboard shortcuts for maximum efficiency.

Essential shortcuts

ShortcutActionDescription
Cmd/Ctrl + HTake screenshotCaptures screen and auto-processes with AI
Cmd/Ctrl + EnterGet solutionProcesses queued screenshots
Cmd/Ctrl + BToggle visibilityShow/hide the window
Cmd/Ctrl + Shift + SpaceShow & centerBrings window to center of screen
Cmd/Ctrl + RResetClears all queues and cancels requests
Cmd + Q / Ctrl + QQuitCloses the application

Window positioning

ShortcutAction
Cmd/Ctrl + LeftMove window left
Cmd/Ctrl + RightMove window right
Cmd/Ctrl + UpMove window up
Cmd/Ctrl + DownMove window down
All shortcuts are registered globally in electron/shortcuts.ts:11-106 and work even when Cluely isn’t focused.

Your first screenshot analysis

1

Position the window

Move Cluely’s window to a corner of your screen where it won’t obstruct your work:
# Use arrow key shortcuts
Cmd/Ctrl + Right  # Move to right side
Cmd/Ctrl + Down   # Move to bottom
Or hide it completely with Cmd/Ctrl + B - it will reappear automatically when you take a screenshot.
2

Open content to analyze

Open something you want help with:
  • A coding problem
  • An error message
  • A technical diagram
  • Documentation you don’t understand
  • A math equation
  • Interview question
Make sure it’s visible on your screen.
3

Capture the screenshot

Press Cmd + H (macOS) or Ctrl + H (Windows/Linux)What happens:
  1. Cluely window automatically hides
  2. Screenshot is captured (entire screen)
  3. Window reappears with preview
  4. AI automatically processes the image
The screenshot is saved temporarily and will be auto-deleted after processing for privacy.
4

View the AI analysis

Within seconds, you’ll see:
  • AI’s analysis of the screenshot
  • Explanations and insights
  • Code suggestions (if applicable)
  • Step-by-step solutions
The response is formatted with:
  • Syntax highlighting for code
  • Math rendering (via KaTeX)
  • Markdown formatting
5

Ask follow-up questions (optional)

Use the chat interface to:
  • Ask for clarification
  • Request different approaches
  • Dive deeper into specific parts
  • Get additional examples
The AI maintains context from your screenshot.

Example workflows

Debugging code errors

1

Capture the error

  1. Open your IDE with the error message visible
  2. Press Cmd/Ctrl + H to capture
  3. AI analyzes the error and code context
2

Get the solution

AI provides:
  • Explanation of what’s wrong
  • Why the error occurred
  • How to fix it
  • Prevention tips
3

Take additional screenshots if needed

Press Cmd/Ctrl + H again to capture:
  • Related code files
  • Stack traces
  • Configuration files
All screenshots are processed together for full context.

Interview preparation

1

Capture the question

During a coding interview or practice:
  1. Question appears on screen
  2. Press Cmd/Ctrl + H to capture
  3. AI analyzes the problem
2

Review the approach

AI provides:
  • Problem understanding
  • Solution approach
  • Code implementation
  • Time/space complexity
  • Edge cases to consider
3

Toggle visibility

Press Cmd/Ctrl + B to hide Cluely while you implement the solution, then show it again if you need hints.

Learning from presentations

1

Capture slides

During a presentation or lecture:
  1. Interesting slide appears
  2. Press Cmd/Ctrl + H to capture
  3. Continue listening
2

Review later

After the presentation:
  1. Open Cluely
  2. View captured slides
  3. Ask AI for:
    • Concept explanations
    • Additional examples
    • Related resources
    • Practice problems

Understanding the processing flow

When you take a screenshot, here’s what happens under the hood:
1

Screenshot capture

// electron/shortcuts.ts:18-36
globalShortcut.register("CommandOrControl+H", async () => {
  const screenshotPath = await this.appState.takeScreenshot()
  const preview = await this.appState.getImagePreview(screenshotPath)
  mainWindow.webContents.send("screenshot-taken", {
    path: screenshotPath,
    preview
  })
  await this.appState.processingHelper.processScreenshots()
})
The screenshot is:
  1. Captured using screenshot-desktop library
  2. Compressed with Sharp
  3. Stored temporarily
  4. Preview generated for UI
2

AI processing

// electron/ProcessingHelper.ts:24-48
const useOllama = process.env.USE_OLLAMA === "true"
const useK2Think = process.env.USE_K2_THINK === "true"
const openRouterApiKey = process.env.OPENROUTER_API_KEY
const apiKey = process.env.GEMINI_API_KEY
Provider priority:
  1. K2 Think (if USE_K2_THINK=true)
  2. OpenRouter (if OPENROUTER_API_KEY set)
  3. Gemini (if GEMINI_API_KEY set)
  4. Ollama (if USE_OLLAMA=true)
3

Response rendering

The AI response is rendered with:
  • react-markdown: Markdown parsing
  • react-syntax-highlighter: Code syntax highlighting
  • rehype-katex: Math equation rendering
  • remark-gfm: GitHub Flavored Markdown support
4

Cleanup

Screenshots are automatically deleted after processing to protect your privacy.

Advanced tips

Multiple screenshots for context

You can take multiple screenshots before processing to give the AI more context.
  1. Take first screenshot: Cmd/Ctrl + H (auto-processes)
  2. For additional context, manually queue more screenshots
  3. All screenshots are analyzed together

Reset and start fresh

If you want to start a new analysis:
Cmd/Ctrl + R  # Resets queues and cancels ongoing requests
This:
  • Cancels any ongoing API requests
  • Clears screenshot queues
  • Resets view to initial state
  • Deletes screenshot metadata

Using the tray menu

Cluely adds a menu bar icon (macOS shows “IC”):
  • Double-click: Show and center window
  • Right-click menu:
    • Show Interview Coder
    • Toggle Window
    • Take Screenshot (Cmd+H)
    • Quit

Optimize for your use case

Use Ollama for 100% local processing:
USE_OLLAMA=true
OLLAMA_MODEL=llama3.2
  • No data sent to cloud
  • Works offline
  • Requires more RAM

Troubleshooting common issues

Screenshot not capturing

On macOS, you need to grant Screen Recording permissions.
Go to: System Preferences → Security & Privacy → Privacy → Screen Recording Add and enable Cluely/Electron.

AI not responding

1

Check your configuration

Verify your .env file:
cat .env
Ensure API keys are set correctly (no extra spaces).
2

Verify provider status

Test API key:
curl -H "Content-Type: application/json" \
  -d '{"contents":[{"parts":[{"text":"Hello"}]}]}' \
  "https://generativelanguage.googleapis.com/v1beta/models/gemini-2.0-flash:generateContent?key=YOUR_API_KEY"
3

Check console logs

Open DevTools in the Electron window to see error messages.

Window positioning issues

If the window is off-screen or positioned oddly:
Cmd/Ctrl + Shift + Space  # Centers and shows window

What’s next?

Now that you’re familiar with the basics:

Explore AI Providers

Learn about different AI provider options and how to switch between them

Keyboard Shortcuts

Master all shortcuts for maximum productivity

Privacy & Security

Understand how Cluely protects your data

Advanced Configuration

Customize Cluely’s behavior and appearance
Remember: Press Cmd/Ctrl + Q to quit the application properly. The close button (X) doesn’t work yet.

Build docs developers (and LLMs) love