Takeover Mode: Human-AI Collaboration
Takeover mode lets you take control of the desktop to help Bytebot when needed. There are two ways to use it:1. During Task Execution
In the task detail view, you can hit the takeover button to:- Interrupt the agent if it’s going down the wrong path
- Guide it towards the correct solution
- Resolve issues when it’s stumbling on something
2. Automatic Activation
Takeover mode is automatically enabled when a task status is set to “needs help” - this happens when the agent realizes it can’t accomplish something on its own.How Actions Are Recorded
All your actions during takeover (clicks, drags, scrolls, typing, key presses) are automatically logged in the same unified action space that the agent uses. This means Bytebot understands and learns from everything you do.Desktop Tab for Setup
Outside of tasks, there’s a dedicated Desktop tab on the main page that provides:- Free-ranging access to the desktop
- Nothing is recorded in this mode
- Perfect for:
- Installing programs
- Logging into apps or websites
- Setting up the desktop environment
- General desktop maintenance
Activating Takeover Mode
Method 1: Manual Takeover During Tasks
1
Open Task Detail View
While Bytebot is working on a task, click on the task to open the detail view.
2
Click Takeover Button
Hit the takeover button to interrupt the agent and take control.
3
Guide Bytebot
Perform the necessary actions to get past the obstacle or show the correct path.
4
Release Control
Click to release control and let Bytebot continue from where you left off.
Method 2: Automatic When Help Needed
When Bytebot sets a task status to “needs help”:- Takeover mode is automatically enabled
- You’ll see a notification that Bytebot needs assistance
- Take control to help resolve the issue
- Bytebot will continue once you release control
Common Use Cases
1. Complex UI Navigation
Custom Applications
Scenario: Working with proprietary or complex softwareSteps:
- Let Bytebot open the application
- Take control to navigate complex interfaces
- Use the chat to explain what you’re doing
- Return control for Bytebot to continue
2. Error Recovery
Handling Unexpected Situations
Scenario: Bytebot encounters an error or gets stuckSteps:
- Notice Bytebot is struggling
- Take control to resolve the issue
- Guide it past the problem
- Explain what went wrong in chat
- Return control to let Bytebot continue
3. Teaching by Demonstration
Show Don't Tell
Scenario: Complex multi-step processesSteps:
- Take control when you need to demonstrate
- Perform the task normally (no need to move slowly)
- Use chat to explain what you’re clicking and why
- Return control
- Ask Bytebot to repeat the process
Important: Screenshots are taken for every action during takeover mode. Do not enter any data that you don’t want captured in screenshots.
Best Practices
Do’s ✅
- Use Chat While Taking Over: Type messages explaining what you’re doing and why
- Explain Your Clicks: Share context about UI elements and their purpose
- Return Control Before Leaving: Always release control before exiting the task detail view
- Test Understanding: Ask Bytebot to summarize what it learned
Don’ts ❌
- Enter Data You Don’t Want Captured: Screenshots are taken of all actions
- Skip Chat Explanations: Context helps Bytebot learn patterns
- Leave Task View While in Control: This will leave the task stuck in takeover mode
- Assume Knowledge: Explain application-specific workflows
No Need to Move Slowly: Bytebot captures the state before and after each action, so you can work at normal speed.