Control all aspects of the desktop environment with a single endpoint
Method | URL | Description |
---|---|---|
POST | /computer-use/computer | Execute computer actions in the virtual desktop |
action
parameter determines which operation to perform, and the remaining parameters depend on the specific action.
Parameter | Type | Required | Description |
---|---|---|---|
coordinates | Object | Yes | The target coordinates to move to |
coordinates.x | Number | Yes | X coordinate |
coordinates.y | Number | Yes | Y coordinate |
Parameter | Type | Required | Description |
---|---|---|---|
path | Array | Yes | Array of coordinate objects for the mouse path |
path[].x | Number | Yes | X coordinate for each point in the path |
path[].y | Number | Yes | Y coordinate for each point in the path |
holdKeys | Array | No | Keys to hold while moving along the path |
Parameter | Type | Required | Description |
---|---|---|---|
coordinates | Object | No | The coordinates to click (uses current if omitted) |
coordinates.x | Number | Yes* | X coordinate |
coordinates.y | Number | Yes* | Y coordinate |
button | String | Yes | Mouse button: ‘left’, ‘right’, or ‘middle’ |
clickCount | Number | Yes | Number of clicks to perform |
holdKeys | Array | No | Keys to hold while clicking (e.g., [‘ctrl’, ‘shift’]) |
Parameter | Type | Required | Description |
---|---|---|---|
coordinates | Object | No | The coordinates to press/release (uses current if omitted) |
coordinates.x | Number | Yes* | X coordinate |
coordinates.y | Number | Yes* | Y coordinate |
button | String | Yes | Mouse button: ‘left’, ‘right’, or ‘middle’ |
press | String | Yes | Action: ‘up’ or ‘down’ |
Parameter | Type | Required | Description |
---|---|---|---|
path | Array | Yes | Array of coordinate objects for the drag path |
path[].x | Number | Yes | X coordinate for each point in the path |
path[].y | Number | Yes | Y coordinate for each point in the path |
button | String | Yes | Mouse button: ‘left’, ‘right’, or ‘middle’ |
holdKeys | Array | No | Keys to hold while dragging |
Parameter | Type | Required | Description |
---|---|---|---|
coordinates | Object | No | The coordinates to scroll at (uses current if omitted) |
coordinates.x | Number | Yes* | X coordinate |
coordinates.y | Number | Yes* | Y coordinate |
direction | String | Yes | Scroll direction: ‘up’, ‘down’, ‘left’, ‘right’ |
scrollCount | Number | Yes | Number of scroll steps |
holdKeys | Array | No | Keys to hold while scrolling |
Parameter | Type | Required | Description |
---|---|---|---|
keys | Array | Yes | Array of keys to type in sequence |
delay | Number | No | Delay between key presses (ms) |
Parameter | Type | Required | Description |
---|---|---|---|
keys | Array | Yes | Array of keys to press or release |
press | String | Yes | Action: ‘up’ or ‘down’ |
Parameter | Type | Required | Description |
---|---|---|---|
text | String | Yes | The text to type |
delay | Number | No | Delay between characters in milliseconds (default: 0) |
Parameter | Type | Required | Description |
---|---|---|---|
text | String | Yes | The text to paste, including special characters and emojis |
Parameter | Type | Required | Description |
---|---|---|---|
duration | Number | Yes | Wait duration in milliseconds |
Parameter | Type | Required | Description |
---|---|---|---|
application | String | Yes | The application to switch to. See available options below. |
firefox
- Mozilla Firefox web browser1password
- Password managerthunderbird
- Email clientvscode
- Visual Studio Code editorterminal
- Terminal/console applicationdesktop
- Switch to desktopdirectory
- File manager/directory browser