Letting Agents Use Browsers: From Automation Scripts to Browser Infrastructure
If the tools of the Codex Chrome extension, Claude in Chrome, Playwright, Chome DevTools MCP, Browner-Use, Vercel angent-browser, Stagehand, Skyvern, Lightpanda, Brownserbase, Steel.dev, MultiOn are listed, it is easy to write into tools encyclopedia: a small section of each tool, describing functions, scenes and limits. This helps to identify nouns, but it does not explain a more interesting question: why are these tools evolving like this?
The questions in this article can also be addressedMCP (Model Context Protocol)、Agent Extra Resource Collection: Skills, MCP Server, Plugins and Practical ToolsHow the concept of a relatively close read together is developed in different contexts.
Let us start with the sequence of de-activation: first, the ability of the official host to pack the real browser, log-in, rights confirmation and secure boundaries into boxes, then the browser can be stabilized, the web site can be read by models, then action can be saved, validated and organized, and finally the browser itself can become a fully available running time resource.
Why the browser became the Agent infrastructure
A lot of real missions don't clean API. Checking data, filling out forms, logging backstage, downloading invoices, reproducing front-end bugs, checking network requests, running performance analysis, and eventually returning to the browser. For humans, browsers are visual interfaces; for Agent, browsers are complex situations: Dom, barrier-free trees, cut-off charts, web requests, Console logs, cookies, localStorage, farama, bullet windows, authentication codes, loading time series and permission boundaries.
Traditional browser automation concerns how the program controls the browser. The Agent browser tool addresses a wider issue: what the model sees, how to decide on the action, how to judge whether the action is successful, how to recover after failure, and whether successful experience can be reused.
I'll use a watch to hold the pulse.
| Phase | Representative Tool | Core bottlenecks addressed | Changes relative to previous period | The problem that still exists. |
|---|---|---|---|---|
| Official Host Browser Bridge | Codex Chrome extension、Claude in Chrome | Login re-use, permission confirmation, sensitive action confirmation, prompt exposure and real browser operations | From "A browser tool for Agent" to "Cholme" directly accessed by host product and placed a safe boundary on the product layer | Still dependent on UI; structured API and official connector safer; testing, debugging, low token expression, workflow and production still require follow-up tools |
| Call browser from script to Argentina | Playwright、Playwright MCP、Chrome DevTools MCP | Load user operation automation and DevTools debugging into an Agent tool | From author to developer to Agent, who can play "end user" or "front engineer" | The context is highly contaminated, and traditional automation and DevTools outputs are still being tested/debugged for humans, not the original context boundary for Agent |
| From full web to Agent Readable | Vercel agent-browser、Browser-Use | Controls what Agent can see, not just to make it work for browsers. | Semantic compression, referencing and task-related filtering of page status | The cost of autonomous exploration is high and implementation certainty is inadequate |
| From open exploration to industrial landing | Stagehand、Skyvern | Move autonomous browser operations to programable, reusable processes | Staagehand, Discovery Developer Mixed Taking over and Cache Self-Rehabilitation, Skyvern Business Visual Workstream and Target Check | Long process still depends on browser sessions, agents, playbacks and production traffic |
| From single operation to production level | Lightpanda、Browserbase、Steel.dev、MultiOn | Carrying of simultaneous distribution, sessions, isolation, agency, anti-crawling, cost and APIization | Browser from local tools to cloud infrastructure and reuseable operations Time | Chrome compatibility, security of access, login and wind control remain long-term challenges |
The focus is not on the sorting of tools, but on the level of interface they are re-engineered: from the host 's official boundary to page click and run-time diagnostics; from DOM to model readable expression; from free exploration to cache and workflow; from a single machine browser to cloud session and light runtime.
Phase Zero: Official browser bridge, first handing the browser over to the host
Before discussing Playwright, MCP, angent-browser or Browner-Use, there is a more advanced choice today: the browser bridge provided by Agent host itself. They are not an additional layer of CDP sealing, or allow developers to maintain a browser session, but instead allow Codex or Claude to access the already-used, log-in Chrome.
Codex Chrome extension It's this way. It expands the connection to real Chome profile by Codex plugins and Chrome, allowing Codex to operate Gmail, Salesforce, the company's intranet or other pages that need to be accessed using the user's login browser status. More importantly, it places many of the boundaries that were previously to be filled by engineers themselves into the product layer: domain name authorizations before accessing the new website, anallowlist and a blocklist, a visible mandate to view high-risk capabilities such as history, and a security model that treats web content as untrustworthy context.
Claude in Chrome It's similar (he's earlier). Claude Code can pass. claude --chrome Start, or use in session /chrome Connect to the Chrome extension. It returns the user's browser login, executes click, input, navigation and page reading in the visible Chrome window; encounters such events as login pages or CAPTCHA that require human intervention, and suspends user processing. Anthropic has been discussed separately. Safe use of Claude in ChloeThe focus is on the problem injection, site access, sensitive action recognition and high-risk mission boundaries.
So if the question is just "I want Agent to open the browser and use my login to do a web mission for me," these two official tools should be almost the first priority. They make login, authorization, visible operation, manual takeover and security confirmation part of the host product. They are more like a product-oriented road than taking Playwright, profile, running CDP, or connecting a general-purpose browser anent to a real account.
But this does not mean that the browser should become the first option for all tasks. The browser is still, in essence, a temporary intermediary when structured API and official connector fit incompletely. Priority to be given to these structured interfaces is usually safer, more stable and more auditable, as long as the target systems are stable API, MCP, app connéctor or official integration.
The official browser bridge is about "can you open the box and let Agent work in my real browser?" The tools behind this address the more detailed issues: Playwright is needed to write back tests; Chrome DevTools MCP is needed to diagnose frontend operations; angent-browser or Browner-Use is needed to compress the web page; Stagehand or Skyvern is needed to automate the process as a reusable business; and if mass mail is to be carried, it will go to Brownserbase, Steel.dev or Lightpanda.
Phase 1: Call browser from script to Agent
If the official host browser bridge is considered phase zero, the first phase will be attended by Playwright, Playwright MCP and Chrome DevTools MCP. They are not typical autonomous Agent frames, but they are the starting point of the browser Agent's subdivision control and debugging tool chain. Understanding their relationship cannot be based on who can point the button, but on the bottom line: CDP.
Chrome DevTools Protocol It is the debugging and automating protocol for the Chrome, Chromium and other Blink-based browsers. It breaks down the browser's internal capabilities into domains, DOM, CSS, Network, Runtme, Debugger, Performance, Tracing, Input, Page, etc. The Chrome DevTools itself uses this protocol, and many browser automation and debugging tools are directly or indirectly related to it.
Playwright It's a certainty baseline for modern Web automation. It supports Chromium, WebKit and Firefox, which can open pages, locate elements, clicks, enters, waits for network requests, intercepts, records and tracks, and can also work with test assertions, CI, reporting systems. In the Chromium/Chromome scene, Playwright and CDP are linked to the ecological bloodline and support the existing Chrome connection through CDP; it does not give developers original CDP, but higher-level locator, action, auto-wait, trace and test API.
This is Playwright's value: transform bottom browser protocols into stable tests and automated abstractions. As long as the page design is relatively fixed and E2E tests are done using Playwright, you can pass through the entire system process like a true user without having to call at each handwritten DOM, Network or Runtme level protocol.
And many times, we don't really need Agent to understand the web. The criteria for success are clear with respect to login tests, return of closing processes, checklist verification, and front-end changes to E2E. Instead, a layer of uncertainty is added to the freedom of exploration with models.
The new change in Age is that these certainty capabilities are beginning to be exposed through MCP. But Playwright MCP and Chrome DevTools MCP, while both are on the browser automation/debugging spectrum, have allowed models to play two roles.
Different roles from same source: end user vs frontend project Division
Playwright MCPPack Playwright 's automation capability into MCP Server, so that LLM can operate the web page by structuring access and elements. It treats the model as an "end user": what buttons, input boxes, check boxes are on the page, where the point is next, what is to be filled, and what is to be done. Official documents also emphasize that it is based on access snapshot and does not require visual models; typical tools include navigation, click, input, form, tab, dialog, storage, network, tracing, etc.
This step is not to turn Playwright into a full-fledged Argentina, but to allow browser control into an Internet loop:
用户目标
-> 模型判断需要浏览器
-> 调用 Playwright MCP
-> 获取页面状态和元素引用
-> 执行点击、输入、截图、等待等动作
-> 把结果返回模型继续推理
Chrome DevTools MCP uses the model as a "front-end engineer". It also has input automation and navigation tools, which can click, enter, navigate, and intercept; but this is not the most valuable place. It's strong in handing DevTools perspective to the coding anent.
Google's here. Brome DevTools MCP publishing articleIt's very straightforward: coding anent can't see what actually happened in the browser with the front-end code that he wrote. It can change files and run commands, but without browser feedback, it is not known whether the page is white screen, whether the resource is 404, whether the COREs failed, why the buttons are not moving, and why the LPC is high.
Based on Chrome DevTools MCP tool referenceIt exposes not only clicks and fillers, but also automating console, network, personal track, Lighthouse, heap snapshot, DOM/CSS, page navigation, screenshots and input. In other words, it makes Agent not only operate the browser, but also read DevTools.
Context difference: Interactive tree vs running time evidence
Playwright MCP gives the model a context more like the operational semantic structure of the page. It will convert the page to access snapshot and assign interactive elements. Models see titles, buttons, text boxes, check boxes and their references, and are therefore more suitable for page operations at the logical level: login, filling in, clicking on next steps, capturing visible data.
The Chrome DevTools MCP gives the model a context more like the browser running time evidence. It is suitable for checking the reasons for the configation of console, network requet, DOM/CSS details, performance track, Lighthouse results, heap snapshot. It's not about the next point, but about why the page is in this state.
So it is more natural to want the AI auto-entry system, fill out the report forms, and grab the visible data on the page; it is more natural to want the AI React memory leak, analyze the API loading performance, locate the API request failed or the CORS problem.
The problem with this set of tools is here. They allow the browser to finally be called by Agent, but still send the browser in the form of "test engineer" and "front engineer" in the context. Playwright MCP has been compressed with access snapshot, ref and visual mode, but it still inherits the perspective of the E2E automation tool. The Chrome DevTools MCP has a larger amount of information, many logs, requests, styles, strips that are relevant only for a particular issue; if they are not screened, the model is easily taken away by low-value details.
The first stage addresses the question of whether Agent can use the browser tool, and does not address the question of the form in which the browser should enter the Agent context. This is where the second phase begins.
Phase 2: From full web page to Agent readable expression
The second phase is not intended to encapsulate another CDP or add an additional operational interface to the browser, but to re-formulate the browser state into the context of the Agent-consumptionable task.
Playwright provides a strong browser control base, but if Playwright is handed over directly to AI, a few problems will arise.
The first is context-related disaster. The real Web application has a large number of layout containers, style class names, frame status, hydration data, burial nodes and invisible elements; and the data will expand rapidly. Humans can be screened when debugging, not in the context of the model.
The second is that the state is at different rhythms. The traditional Playwright script is more like a one-time run process, while Agent needs to look at, think about, and walk. It requires a browser session to be permanent and to read the current status at every step before deciding on the next step.
The third is the vulnerability of the position. CSS self-prospect and XPath are suitable for developers to write definitive scripts, but not for models to fix themselves after failure. Once the DOM hierarchy, class name or component structure has changed, the model is easily in an awkward state: know where it wants to be, but how to locate it.
So the question is, how do we turn Playwright into a user that can control it, into a space that Agent can understand and continue to operate? Vercel Labs agent-browser And Browner-Use gives two different routes: one to text down, one to Agent closed.
Vercel anent-browser: Text downside and CLI philosophy
The name of Vercel Labs. agent-browser It represents a light quantitative direction. It is an automated CLI browser for AI delegates, working through the CDP of the Chrome/Chromium, with the core form being local CLI plus permanent presence in daemon. The common process is first. agent-browser snapshot Get the access tree, get it back. agent-browser click @e2、fill @e3 This short command completes the action.
The first thing to think about is... context budgetI'm sorry. The model does not need to read the full DOM, nor does it need to see the screenshot, if you see the titles, links, buttons, input boxes on the page, and the corresponding refs for these elements. For the code anent in the terminal, the page is compressed into short text and the action is compressed into short references.
A typical snapshot is probably:
- heading "Example Domain" [ref=e1]
- link "More information..." [ref=e2]
The model does not need to generate complex self-portor, just output:
agent-browser click @e2
This ref-based operation changes the interface between Agent and the web page. Past models may generate a selector:
click("button.submit.primary:nth-child(2)")
Now it just needs to choose a semantic node:
click @e2
This is a small step, but it has a great impact on the cost and the stability of the actions of the token. Agent does not need to guess which Selector is the most appropriate in a bunch of CSS names, but is based on the accessibility syntax and the referencing id operating page.
CLI forms are also critical.agent-browser More like a terminal capability that can be called by such tools as Claude Code, Cursor, Codex, instead of complete autonomous Browner anent. The browser maintains a session in daemon, and AI can explore the web page as if it were a shell command; if AI is stuck, humans can take over the command directly from the same terminal, and light it through a step and let it continue.
This route can be summed up as "de-dimensional": from complex DOM, Trace and DevTools panels down to a short set of text snapshots and action commands. It is suitable for working ant-page light-checking, information search, functional validation and local interaction. The border is clear:agent-browser Address low token controls and terminals that can be taken over and do not have the responsibility for complete mission planning. It makes models work on web pages cheaper, but it's not Web Age brain.
Browner-Use: Organize browser into Agent environment
Browner-Use is going another route.browser-use The location is to make the site accessible to the AI delegates. It is not just about page snapshots, but about packaging browsers into a model that can circulate observations, reasoning, actions, and the environment of the results. The model is not facing a fixed script, but a goal and changing web state.
This frame turns the browser into an active browser:
观察页面
-> 推理和规划下一步
-> 执行动作
-> 读取页面结果
-> 判断任务是否完成或是否需要重试
And this and... agent-browser The difference is great.agent-browser A sharp command line tool, the model requires a decision on how to organize multistep missions; Browner-Use is more like a browser mission framework, combining observation space, action space, state summaries and task loops. It combines DOM/HTML status, interactive elements, using a screenshot or visual information, where necessary, to help the model to move on around natural language targets.
In contrast to Playwright, the Browner-Use progress is not a different way of clicking, but a change in the task pattern. Playwright is a process that developers have written in advance; Browner-Use is faced with an open goal like "Do this web mission for me." The model is no longer just a call to a fixed script, but a loop decision is made in the page state.
It also integrates visual understanding, allowing VLM to support understanding of the page structure, rather than relying entirely on DOM. More precisely, the centrepiece of Browner-Use is the browser state and action cycle; the page structure, interactive elements, transects, visual abilities are all just for this cycle.
The costs are also direct: context and model calls are more costly, implementation paths are more uncertain and long missions are more easily drifting. The more open, the more necessary it is to validate, cache, heal and bind business processes.
A comparison of the two routes
| Dimensions | Playwright | Vercel agent-browser | Browser-Use |
|---|---|---|---|
| Core philosophy | Human Developer writing certainty automation | Token CLI tool to reduce the web page to low | Organize browser as Agent task environment |
| Page Representation | Dom, Locator, Trace, screenshot, incident | Accessibility snapshot、@eN ref, short text |
Page structure, interactive elements, state summaries, combined with screenshots/visual |
| Positioning | CSS selector、locator、XPath | semantic nodes, e. g. @e2 |
Agent selects actions based on observations |
| Token Cost | It's very high for the model. | Very low, pre-empting context | Medium to High, depending on task cycle and visual use |
| Autonomy | Low, dependent on developers scripts | , provide comboable commands | High, built-in multi-step job cycle |
| Human taking over. | Change code or debug script | Click directly on the terminal for the CLI command | Relative loop more like taking over a running |
| Typical scene | CI/E2E, Stable Process | Lightweight web operation for coding anent | Open web missions, multiple steps to implement autonomously |
| Legacy issues | Context and positioning are not appropriate for models | Not responsible for complete planning and operational validation | Cost, drift and reliability pressure are higher |
The second phase is not really a direction, but a two-part cut. The progress of angent-browser is in the down-dimensional compression of browsers into end tools that are easy to use in large text models. Browner-Use progresses in organizing the rings, packaging the browser into an enabling environment for observation, reasoning, action and inspection.
Both answered the contextual questions left by the first phase and left new questions.agent-browser Solving the context economy without being responsible for the full mission planning; Browner-Use provides an autonomous cycle, but brings costs, drift and validation pressure. Phase III, Stagehand/Skyvern, is in the process of re-enacting autonomy into caches, validation, visual recognition and business process constraints.
Phase III: from open exploration to industrial development Land
Phase II addressed the question of how Agent viewed the web page and how to recycle decision-making, but not how to land the industry.
agent-browser Low token operations and terminals are resolved but they are not responsible for complete mission planning. Browner-Use provides an autonomous cycle, which also brings costs, drift and stability pressures. Phase 3 moves from "self-contained" to "land-defeating": how to put AI into a manageable process, how to reduce repetition of reasoning, and how to allow non-developers to configure complex web tasks.
Staagehand and Skyvern are two different routes. Staagehand, for developers, mix Playwright and AI into a more productive SDK; Skyvern, for business automation, package visual priority browsers into workstream platforms.
Staagehand: Developer's route, mixed takeover and implementation cache
Brownserbase's introduction to StagehandIt's called the open source for Browner treaties. SDK, the core originals include act、observe、extract and agentI'm sorry. The idea behind these original words is clear: not to choose between Playwright and Argentina, but to mix definitive scripts with AI reasoning.
Staagehand is more like an AI enhanced Playwright than a black box antroneous anent. Developer still writes codes, defines processes, processes input output and business validation; AI intervenes only when the page is unstable, semantics difficult to locate, and data extraction complex.
A typical Stagehand style process is:
用代码控制主流程
-> 用 observe 找当前页面可行动作
-> 用 act 执行自然语言动作
-> 用 extract 按 schema 提取结构化数据
-> 必要时交给 agent 处理更长流程
-> 成功路径尽量缓存和复用
That's the mix takeover. Opens the web page, fills the fixed account number, enters a backstage path, and these definitive steps continue to be coded. Click a button that always changes the script, extract structured fields from complex pages, and determine what action is possible on the current page, which is handed over to the unstable links act、observe and extract。
Another key point of Stagehand is the cache. Fully autonomous Agent often re-examines the model at every step, which is wasted in a repetitive process. Staged's Cacheline is: First lets the model resolve action or angent step, saves the reusable action results after success; and, when a similar page structure is encountered, first uses the Cache, and then reduces or skips the LLM call. Repositioning and repairing the model when the cache fails or the page changes.
This design is practical: AI is no longer deduced at every step, but only intervenes when there is uncertainty or the cache is not working. It is more suitable for professional developers, for existing business streams, and for stable but small-change web-page tasks. Staagehand is not replacing Playwright, but making Playwright more resilient to real changes in the web.
Skyvern: Businessline, Visual Priority Workstream Platform
Skyvern deals with another category of issues: complex business portals and non-developer automation.
Such websites often have dynamic forms, bullet windows, flame, break pages, upload downloads, unsync buttons and strange layouts. It's often not enough for self or barrier-free trees because key controls are visible and in Dom they're probably just a norole nest. div。
Skyvern DocumentSpecifically, it uses LLM and computer vision automating Browner-based workworkworks. The official implementation cycle described is: screenshot, extraction DOM, LLM reasoning, execution action, inspection of targets, repetition. Understand it as a more accurate view-first: visual and transective are core sensory portals, Dom are auxiliary messages, and the ultimate goal is not to treat vulnerable XPath or self-ecter as the only truth.
This route is closer to AI RPA or workworkloading platform. Skyvern can be triggered by dashboard, API or workflow; workflow block can express the steps of login, navigation, downloading, extraction, loop, code, etc. For business users, it doesn't require you to be well compiled in code as Staagehand did. Line act and extract, instead of better configuration of " login backstage " with natural language targets and visualization processes -> Find outstanding invoices -> Download PDF -> Sending mail's such a job.
Skyvern automating browsers from "developer scripts" to "business process organization". It is more friendly to complex portals, unsync pages and dynamic UIs, and is closer to automated tool forms that non-developers can understand.
The costs are also evident. Visual and multi-modular reasoning is slower and more expensive; the longer the flow of work, the more it requires clear target checks, manual points of intervention, authority management and abnormal treatment. When it comes to login, 2FA, authentication codes, payments or sensitive data, it is not simply possible to believe that “the visual model will solve everything”, and that workflow design and authority governance are still needed.
Coordinates for Phase III
| Dimensions | Playwright | Browser-Use | Stagehand | Skyvern |
|---|---|---|---|---|
| Technical positioning | Automation of certainty API | Open | AI Enhancement Playwright SDK | WorkFlow integration plan |
| Human intervention point | Prepare a full script | Initial objectives and operational monitoring | Combining Codes with AI | Dashboard / workflow blocks / Natural Language Target |
| Implementation speed | Come on. | Slow to medium, relying on model cycles. | Quick, close to certainty on Cache. | Slower, dependent on visual and multistep checks |
| Token Cost | Low, but not suitable for direct modeling | Medium to High | Low to Medium, repeat process can be reduced by cache | High, more costly for visual and long processes |
| Retrofitting | Low, dependent on self/loctor | Medium to high, depending on observation and action design | High, with AI positioning, self-rehabilitation and cache verification | High, based on visual priority and target check |
| Target users | Test/Automation Engineer | Agent Developer | Professional developers and production of water currents | Business Automation Users, Operating Teams, RPA scene |
| Legacy issues | Weakness, context, inappropriate models | Cost, drift, insufficient validation | Still need code and browser running time | High cost, slow pace, complex authority and unusual governance |
This phase moves the browser Agent from "can explore" to "can complete business processes." Staagehand addresses the controlled, cache and low-cost side of the developers; Skyvern addresses the visual workflow and non-developer availability of the business side.
However, phase III still defaults that a browser can be stabilized. As long as it's going to production, the assumption becomes heavier: how does the browser session manage? How does the simultaneous distribution expand? How does the login become isolated? What about agent and authentication codes? How do we put back the track of failure? That is the fourth stage.
Phase 4: from single operation to production browser operation Time
When the browser Agent changes from a demo to a service, the question goes from "Can you operate a web page" to "Can you stabilize the browser session, co-dispatch, agent, login, replay, isolate and cost"? The browser is no longer a tool, but a running time resource.
- Lightpanda: to solve the problem of the browser runningtime too heavy, for the lighter, higher-than-supplendent AI-native/headless Browner.
- Browserbase: Solve the hosting browser session, debugging, replaying, Agent Identity and Stagehand ecological carrying.
- Steel.dev: solving the infrastructure problems of the browser, the proxy, the back-up, the captcha, the cloud session, etc.
- MultiOn: further aPI-based browser operation, allowing developers to submit a Web action in the natural language, rather than managing every click.
This phase is only one example of the fact that the browser Agent will eventually be called from tools to the infrastructure layer. The product selection is not the focus of this paper, but it is important to see that the production load itself becomes a stand-alone issue.
Two real technology main lines.
After reading these tools in stages, two more questions can be abstracted. The first question is: What did Agent see? The second question is: How does Agent do it? The evolution of the browser Agen is essentially a re-interface between the two layers.
But before the sensor level and the action level, the official browser bridge adds a product boundary: whose browser, whose login status, who authorizes, who confirms sensitive actions and what security model the web content is read. The value of Codex Crome extension and Claude in Crome is first here, not just the extra set of clicks and fills.
The sensory layer answers: in what form the browser states into the context of the model.
The earliest automations were based on Dom, Locator and DevTools telemetry. CDP exposed the browser's internal state, Playwright packaged them into tests and automation abstractions, while Chome DevTools packaged them into debugging perspectives. The information here is very strong: Dom, CSS, Console, network, Trace, performance, heap snapshot. They are, however, first for human engineers and testing frameworks, not for the context of the model, so that both the robust observational capacity and the context pollution occur simultaneously.
Playwright MCP starts to compress the first layer: it turns the page into an interactive semantic tree with accessibility snapshot and ref. The model is no longer looking at complete HTML, but rather the button, input box, title, link and reference ID. This is the model that works like an end user: "I want which buttons" "I want which input boxes."
agent-browser Push that direction even more extreme. It compresses the page snapshot into a very short text, turning the elements into @eN Reference, priority service token economy. For local coding parties, this is the equivalent of turning the browser into a low-noise, low-cost text interface.
Browner-Use senses not just a single snapshot, but a state summary in the mission cycle. It needs to tell the model at every step: what the current page is, what interactive elements are, what happens after the last step is completed, and if necessary, can be combined with a screenshot or visual information. It does not focus on the smallest token, but rather on supporting continuous decision-making.
Staagehand's perception serves the uncertain nodes in the code process.observe The blogger says that the government is not a party to the law, but that it is not a party.extract The answer is, "What structured data can I get from here?" It does not give the entire web page to Agent, but instead transforms local uncertainties into structures that can be addressed by models in the determination of the code skeleton.
Skyvern's perception is more selective. It understands complex business pages with screenshots and visual information, while reducing errors with DOM support and target checks. This sense is closer to humans than pure semantics.
This can be written in:
host-native browser bridge / signed-in state / permission gates
-> CDP / DOM / DevTools telemetry
-> Accessibility Tree / ref
-> compressed text snapshot / @eN refs
-> task-oriented browser state
-> 视觉 + DOM
-> engine-native browser state
The second level is the operational level. The action level answers: how the model turns the intent into a browser's action.
The official browser bridge puts the action back in the host product: the action occurs in a real browser that is visible to the user, and access, authentication, sensitive submission and site authorization can be returned to human identification. It does not seek programming at the bottom, but rather the availability and competence of ordinary tasks.
Playwright's actions are script: self, locator, click, bill, haw, auto-wait. It is stable, provided that the process and page structure are known to the developers.
Playwright MCP and Chrome DevTools MCP turn these capabilities into tools for call. Playwright MCP user-actions: navigation, clicks, input, waiting, screenshot. Chrome DevTools MCP Project-wise Diagnostic: Read the console, network, Dom/CSS, personale, and then add to the automated recurrence of the necessary input. They all access the browser capacity to the model, but they still do not fully address the problem of how the context of the action is condensed.
agent-browser Compress action into CLI/ref command. Models don't need to create complex models. Just... click @e2 or fill @e3I'm sorry. This action interface is suitable for local coding anent and facilitates direct human takeover at the terminal.
Browner-Use put the action in ant loop. The model is not a call for a single click, but is a continuous observation, planning, execution, inspection until the mission is completed or a re-test is required. This changes the browser operation from a one-step tool to a multi-step task execution.
Staagehand takes the operation back into the developer's control. The certainty code is responsible for the main process, AI for unstable actions; successful actions or angent step can cache and then the model is repaired when the cache fails. This allows for both AI flexibility and as close as possible to the cost and speed of the script.
Skyvern organizes the action into a workflow. It does not require users to manage each self-portor like developers, but to organize missions through workflows, natural language targets and visual checks, closer to operations RPA.
Brownserbase, Steel.dev and MultiOn push the action to the cloud-side executive level. Brownserbase/Steel.dev cares about session, agent, playback, hair and isolation; MultiOn further encapsulates the action as Web action API, allowing developers to submit assignments, rather than manage each click.
This can be written in:
host-native browser action / human confirmation
-> script / selector
-> MCP tools
-> ref / action primitives
-> agent loop
-> hybrid cached actions / workflow blocks
-> cloud execution / Web action API
The sensory layer determines whether the model is visible and the operational layer determines whether the system is working smoothly. The official browser bridge places these two layers within the host product's login, access and security boundaries. Tool evolution is not a substitute for B from A, but is constantly changing interfaces on these layers.
The tool selection should go back to the level of your card.
So the selection should not start with "What tool is hotter" but with "What level is my bottleneck?"
If the target system already has structured API, official app connéctor, MCP server or stable integration, look at these interfaces first. They are usually safer, more stable, more auditable than browsers and are not easily carried away by the UI re-edited and prompt injection.
If you're just going to have Agent do your job on a log-in page, look at Codex Crope extension and Claude in Crope. They are not the most sophisticated browser automated language, but as a real browser operating capability, open-boxing, access reuse, authorization confirmation, manual takeover and secure borders are more complete.
If you're missing more solid controls, then playwright and playwright MCP. Known processes, E2E tests, CI returns, do not need to be forced to be given to autonomous Agent. Further, Playwright MCP is more natural if the goal is to complete the process like a normal user.
If you're missing debug feedback, look at Chrome DevTools MCP. It's best for the coding anent to read console, network, Dom/CSS, performance and Lighthouse in real Shrome, back to the code fixes. If the goal is to get the model to diagnose the page like a front-end engineer, then the Chrome DevTools MCP is more natural.
If you lack the Agent Readable Pages, or you have found Playwright/ DevTools output contaminating the context, see Vercel angent-browser and Browner-Use. The former are lightweight, low token, local terminal workflows; the latter are full browser mission environments and autonomous exploration. This question does not stop at Playwright MCP or Chrome DevTools MCP to continue stacking more DevTools, Trace or DOM outputs, but instead turns to a clearer context compression and task-related filter.
If you're missing action caches and process layout, look at Stagagehand and Skyvern. The former is suitable for professional developers to mix Playwright with AI reasoning and reduce the cost of duplicate processes by cacheing; the latter is appropriate for the complex business portal and visual priority workflow automation, closer to AI RPA.
If you're missing a production load, look at Lightpanda, Brownserbase, Steel.dev, MultiOn. Lightpanda solves runtime costs, Brownserbase and Steel.dev solves cloud browser infrastructure, MultiOn solves higher-level Web action API.
So, instead of choosing one in a row, you can start by locating the stage of the browser Agent's tool chain:
有结构化 API / 官方 connector -> API / connector
只想让 Agent 操作已登录浏览器 -> Codex Chrome extension / Claude in Chrome
控制不了浏览器 -> Playwright / Playwright MCP
看不到真实运行时 -> Chrome DevTools MCP
上下文被浏览器噪声污染 -> agent-browser / Browser-Use
行动需要被缓存/编排 -> Stagehand(开发者混合接管)/ Skyvern(业务视觉工作流)
生产运行扛不住 -> Lightpanda / Browserbase / Steel.dev / MultiOn
Concluding remarks
The browser was a visible application and is now becoming the Internet-based environmental interface for Agent.
The official browser bridge has made the Browner anent from engineering experiments to direct-use product capacity. The Codex Cropesion and Claude in Cropme solves the problem of "Let's let Agent work in my real browser." This matter: re-entry, access confirmation, retention of manual takeovers and integration of prompt action and sensitive actions into the safe boundaries of the host product.
After this line, Playwright resolves certainty control, while Chome DevTools MCP addresses real running feedback, but they also bring a lot of browser information into Agent's context. Agent-browser and Browner-Use solver model readable web-page status, Staagehand resolves the hybrid take-over and execution cache on the side of the developers, Skyvern addresses the visual workflow on the side of the operation, Lightpanda, Brownserbase, Steel.dev, MultiOn addresses the running time and platformization of production.
So this is not the story of "AI Alternative Automation Script." More precisely, the browser was dismantled into layers of interfaces: the host ' s official security boundaries, a controlled environment, readable status, verifiable actions, and loadable running time.
Once these interfaces stabilize, the Agent Operator Browser will no longer be a fragile automated script, but will be an AI system access to the real Web world.
- Title: Letting Agents Use Browsers: From Automation Scripts to Browser Infrastructure
- Author: Hyacehila
- Created at : 2026-05-22 09:00:00
- Link: https://hyacehila.github.io//blog/2026/05/22/agent-browser-tools-comparison/
- License: This work is licensed under CC BY-NC-SA 4.0.