Step AI desktop intelligences: desktop intelligences that use natural language to operate computers

Step AI Desktop Partner is an artificial intelligence assistant that runs on the operating system of a personal computer and understands and executes the user's natural language commands for various computer operations. The tool is not limited to browsers and can interact directly and deeply with the operating system to manage local files, access the Internet and perform cross-application tasks. Users interact with it through a window that hovers in the top right corner of the desktop, allowing them to dispatch tasks and view progress without interrupting what they are currently working on. It supports the setting of timed tasks and simplifies repetitive workflows by allowing users to save, reuse and even share complex instructions through a feature called "Magic Plan".

Function List

• Autonomy to perform complex tasks. It supports browsing web pages and manipulating documents, and is able to complete a variety of operations such as filling out forms, modifying documents and creating files.
• Information Acquisition and Processing. It can autonomously access social media and data sites to obtain information based on instructions, and organize and save the results to a local file.
• Local Document Management. It helps users to name and categorize local files with one click, simplifying file management.
• Automated Task Execution. Supports setting up timed tasks to automatically start executing tasks at a specified time; also supports actively triggering tasks when specific conditions are met.
• System information synchronization. You can synchronize local file information with a single click and quickly set up system calendar reminders and memos in your natural language.
• The "brilliant idea" command system. Core features allow users to save frequently used complex commands as "brilliant ideas" for easy one-click recall. It also supports importing and sharing of ideas created by others in the community for more efficient workflows.
• Multi-task parallel processing. Supports running multiple tasks simultaneously in the background without interfering with the user's normal work during execution, and will be reminded via pop-up window when the task is completed.

Using Help

The Step AI Desktop Partner is designed to be an efficient assistant on the user's computer, manipulating the computer through simple verbal commands and freeing people from repetitive tasks.

Installation and startup

Currently, Step AI Desktop Partner is only available for macOS, with a Windows version coming soon. Users can get it from the official website https://www.stepfun.com/download Download the installation program. Once the installation is complete, a hover window will appear in the upper right corner of the desktop, which is the main portal for interacting with the Smartbody. Through this portal, you can wake it up at any time, assign tasks, or check the status of an ongoing task.

Core Function Operation

1. Implementation of generic mandates
You can give it commands directly in the dialog box in the way you would speak in everyday life. Example:

• "Help me see what the important macro news is today, summarize the key points, and save it as a Word document."
• "Take all the documents in my downloads folder whose filenames contain 'report' and move them to a new folder called 'annual reports'."
• "Open your browser and do a search for airfare from Shanghai to Beijing to see which flight is cheapest next Friday."

If the instructions given are not clear enough, the smart body will proactively ask you questions to clarify the specific needs and ensure that the task is carried out accurately.

2. Utilization of the "brilliant idea" function
One of the most distinctive features of Step AI Desktop Partner is "Wonderful Plan", which can save a series of complex operations into a simple keyword, which greatly improves the work efficiency.

• brilliant scheme: If you often need to perform a fixed process, such as "every Monday morning to get the last week's sales data and organize it into a chart", you can save a series of instructions to perform this task as a "good idea", and name it as "Weekly Data".
• fall victim to a brilliant scheme: When you need to execute it, simply type in the input box/The symbol will bring up a list of all your saved ideas. Select "Weekly Data" and the smart body will automatically start the complete task process.
• Share and import:: You can share ideas that you find useful in the community, or you can import ideas created by experts in a variety of industries. For example, if a marketing analyst shares a great idea for capturing competitor dynamics, you can import it without having to write complex instructions from scratch.

3. Documentation and web page interaction
When you are working on a specific file or browsing a web page, the # feature that lets intelligences quickly synchronize the context of the currently open web page or file. This allows you to ask more targeted questions, for example:

• After opening a PDF earnings report file, type#And ask: "Help me analyze the reason for the revenue growth in the second quarter in this earnings report."
• When browsing a product page, enter#And the instruction, "Based on the content of this web page, generate a copy of the product description for me."

4. Setting up automated tasks
You can set up automatic execution times for tasks and let the intelligences work for you silently in the background.

• timed task:: "Set a timed task to automatically clean my browser cache and system junk files every night at 11pm."
• Monitoring alerts (forthcoming): Future versions will support monitoring features. For example, you can ask it to "check the stock of a certain item periodically and alert me when it is available" or "monitor the price of a certain stock and notify me when the price is below 10 dollars".

The execution of all tasks is visualized and you can see every step of its operation in the task window. You can pause, take over or abort the task at any time if you find a deviation in the execution path.

application scenario

1. Market Research and Content Creation
   Researchers or content creators can use it to quickly gather information from the web. For example, set a command to have the AI assistant automatically browse multiple industry news sites each day, grab information related to a specific topic, and organize the highlights into a presentation to be stored locally.
2. Daily office and document management
   For office workers who need to deal with a lot of documents, you can use it to automatically organize your desktop. For example, create a "brilliant plan" to move all the image files on the desktop to the "Pictures" folder, and move the documents to the "Working Papers" folder, and rename them by date. Rename them by date.
3. Personal Life Assistants
   It can be used as a personal life assistant to take care of trivial matters. For example, set multiple calendar reminders with a single sentence, or let it check your to-do list regularly and remind you via desktop notifications to avoid missing important appointments or tasks.
4. Data collation and analysis
   When you need to process simple data, you can instruct it to open the specified Excel file, extract data from specific columns, perform simple calculations, and generate a new document with the results, eliminating the tedious steps of manual operation.

QA

1. How is Step AI Desktop Partner different from other AI assistants?
   The big difference is that it's a desktop intelligence (Agent) that runs at the operating system level, not just a browser plug-in or web app. This means it can directly manipulate files and applications on your computer, automating complex tasks across software, whereas most AI assistants only work within a browser environment.
2. Is my data safe?
   As a software that needs to run on a local operating system, it will access local files and information. Regarding the specific data privacy policy, users should read the officially provided privacy terms in detail before installation and use. Its development company, Shanghai Step Star Intelligent Technology Co., Ltd, is a technology company that specializes in the development of large models.
3. Do I need to know how to program to use the "Magic Plan" feature?
   Not at all. The process of creating "Myoji" is the process of saving the commands that you would normally give in your natural language. It's designed to make automated workflows accessible to the average user with no programming background.
4. What operating systems are currently supported?
   The macOS version has been released and can be downloaded from the official website, while the Windows version is in development and users can join the waiting list to be notified as soon as it is released.