1. Concepts
  2. Virtual Worker

Concepts

Virtual Worker

The Virtual Worker allows an AI agent to control a browser and interact with internal web-based software, simulating human-like actions.

NOTE

This Stubber Virtual Worker is currently in select customer testing phase. Contact Stubber directly to inquire about a use case.

Basic Principle

The Virtual Worker operates on a laptop or virtual machine (VM) and is controlled by an AI agent. This agent can navigate and interact with the browser, performing tasks just like a human user would. The Virtual Worker is particularly useful for automating processes that involve internal web-based systems.

Potential Use Cases

  1. Streamline Customer Data Retrieval: Automate lookup and retrieval of customer information from CRM systems without APIs.

  2. Automated Web-Based Data Entry: Eliminate manual data entry tasks by automating input into web-based portals.

  3. Seamless Case Management: Log new cases efficiently in software applications lacking APIs.

  4. Web-Based Process Automation: Automate tasks requiring human interaction with web-based software, increasing productivity and reducing manual effort.

  5. Surveillance Footage Retrieval: Use to login to surveillance system software and retrieve images for an LLM to analyze based on certain events.

  6. Integration of Legacy Software: Use where there are no APIs and you need to integrate with software

Current Limitations

  • The Virtual Worker is currently only available for browser based applications that run in Chrome.

Training

The AI agent can be trained to interact with the browser in the same way a human would. It begins by chatting to the AI agent and showing it how to interact with the browser.

The Stubber Virtual Worker Training Tool uses :

  • A chat interface
  • A chrome extension that records the actions the AI agent takes in the browser
  • A VNC connection to the Virtual Worker laptop / PC / Virtual Machine that shows what the AI agent is doing

RPA (Robotic Process Automation)

The Virtual Worker can be used as a Robotic Process Automation tool. The Virtual Worker stands out from traditional RPA tools by leveraging AI for adaptability. For instance, it can handle a task like invoice processing even when formats vary across vendors. By analyzing the content on the screen, the AI agent dynamically adjusts its actions, making it ideal for processes with unpredictable inputs.