In the process of technological exploration, we once imagined using AI to empower existing software and open up new development paths. However, the "AI Usage Computer Model" released by Claude 3.5 on October 23, 2024, may bring a new direction to this established path.
In the past, we expected to use AI to reconstruct various types of software. Take the cursor as an example. Since it has its own IDE, you can easily add, delete, modify and check files, and the user experience is excellent. At that time, some people speculated that it would develop well if it merged with IDE companies such as JetBrains, which occupied a large market share. But now, if Cloud 3.5's "artificial intelligence using computer models" succeeds, the current model of software accessing large models may be subverted. It is no longer a simple access, but the AI computer controls the software through the model. Combined with the precise understanding of user prompt words and the strong support of the back-end large model, the future user experience is expected to achieve a qualitative leap.
The latest version of Claude 3.5, after appropriate software settings, can simulate human operations on the computer screen according to user instructions. For example, you can move the cursor, click on a specified location, and enter information with the help of a virtual keyboard, which perfectly replicates the way humans interact with computers.
The original intention of this technology is that, given that a large number of jobs currently rely on computers, allowing artificial intelligence to interact directly with computer software like humans would unlock many applications that are not possible with current artificial intelligence assistants. In the past few years, many important results have been achieved in the field of artificial intelligence development, such as the ability to perform complex logical reasoning and view and understand images. The core of Cloud 3.5's computer usage model is that it can operate almost any software according to instructions without the need to interact with customized tools. You can carefully study the software's instruction manual and tool manual to master how to use the software. This is undoubtedly a very innovative breakthrough.
During the demo, Alex, Anthropic's Director of Development Relations, showed Claude the process of completing the task of coding a website. First, have Claude navigate to claude.ai in Chrome and create a 90s-themed profile. Claude opens the Chrome browser, searches for claude.ai and enters the command, Claude.ai returns the code and renders it perfectly on the right. Later, Alex wanted to make some local modifications to the website. Claude downloaded the file as requested, opened it in VS Code, and started the server. Although the process encountered an error because Python was not installed on the machine, Claude discovered the problem by viewing the terminal output and successfully started the server using the installed Python 3. Later, Alex discovered that there was an error in the terminal output and the file icon was missing. Claude read the terminal output again, used VS Code's find and replace tool to find and delete the erroneous line, saved the file and re-ran the website, and finally solved the problem.
This time Claude 3.5’s “AI using computer models” has undoubtedly opened up new horizons for us in human-machine automation, and the future development is full of expectations. If you find this information timely and useful, please like, vote, collect and support with one click! You may wish to watch the original video of the press conference later to experience this exciting moment for yourself. I believe you must have many ideas to share in the comment area, come and discuss together!
Share on Twitter Share on Facebook
Indie123
Comments
There are currently no comments