What Does BrowserAct Semrush Scraper Do?
This template cannot be used directly from the marketplace. Click Create Editable Duplicate, sign in to your own Semrush access route through Improve, publish your personal Bot, and run that copy.
Turn your Semrush workspace into a reusable SEO data API and MCP tool. Collect keyword, domain, backlink, and content research data for your applications and AI Agents through your own BrowserAct Bot. Choose the report you need for competitor reviews, keyword planning, or link research.
Key Features of Semrush Scraper
- Review domain-level authority, search, and backlink metrics without manually copying individual report values.
- Collect organic rankings and top pages for a domain, or compare domains through keyword and backlink gap reports.
- Research keyword metrics and related ideas with Keyword Overview and Keyword Magic Tool, and work with available Keyword Strategy Builder reports.
- Read available Topic Research and SEO Content Template reports for content planning.
- Collect backlink and referring-domain details with a requested result quantity.
- Use supported batch actions to process several domains or keywords in one submission, with a separate result row for each target.
Choose a Report
Select a matching module and action. Each run requests one report type; it does not execute all reports or unlock features outside your Semrush account.
| Module | Actions | Target |
|---|---|---|
| Competitive Analysis | Domain Overview; Organic Rankings; Top Pages; Keyword Gap; Backlink Gap | A domain, or an ordered domain comparison for a gap report. |
| Keyword Research | Keyword Overview; Keyword Magic Tool; Keyword Strategy Builder | A keyword, supported keyword batch, or the seed set for a strategy report. |
| Content Ideas | Topic Research; SEO Content Template | A topic or keyword set for the selected report. |
| Link Building | Backlinks; Referring Domains | A domain or a supported batch of domains. |
What Data Can I Extract from Semrush?
The selected action determines the report payload. The same outer structure identifies the target, market, status, and result quantity; the report-specific content is carried in the following fields.
| Field | What it contains |
|---|---|
| target / database / action | The requested domain or keyword, the selected country database, and the report type. |
| data.summary | Overview metrics where the selected report supplies a summary. |
| data.records | The selected report's detail records, where available. |
| data.sections | Additional named report sections, where available. |
| target_count / actual_count / has_more | Requested quantity, returned quantity, and whether the source reports additional results. |
| status / partial_failure / error_message | Whether the target produced data and any reported access or collection problem. |
How to Use Semrush Scraper
- Click Create Editable Duplicate in the upper-right corner and save the copy to your own workspace.
- Open the copied Bot's Browser settings. Use a Standard Browser for a reusable login profile. Avoid overlapping runs on the same Semrush account; a consistent IP is recommended for ongoing use but does not guarantee that a session will stay signed in.
- Open Build, choose Improve, and use the appropriate login instruction below. Complete sign-in only inside the browser shown for your copied Bot; never put a password or verification code in report inputs.
- After completing sign-in, return control to Improve. Let it finish, then click Publish so the saved login setup and input defaults belong to the version you will run.
- Open Run on your personal Bot. Check the login route, choose a matching module and action, supply the target and desired quantity, and run a small report before connecting an Agent.
Sign In through Semrush
Use the official route when your account signs in directly at Semrush.
I need to sign in to my own Semrush account. Open https://www.semrush.com/home/ in this Bot's Browser Profile and let me complete login. Keep the report logic, business inputs, and output structure unchanged. Set login_mode to official and login_entry to https://www.semrush.com/home/ as the defaults for this copy. Confirm the authenticated workspace before finishing. Do not switch to another login route automatically.Sign In through an Authorized Third-Party Entry
Use this route only when you have authorized Semrush access through a portal. Replace the placeholder with your own reusable HTTPS entry address, not a temporary launch link. Portal compatibility and available reports depend on that provider.
I access Semrush through an authorized third-party entry: <YOUR_REUSABLE_HTTPS_ENTRY>. Open this address in this Bot's Browser Profile and let me sign in, then open its Semrush workspace. Keep the report logic, business inputs, and output structure unchanged. Set login_mode to portal and login_entry to this reusable address as the defaults for this copy. Verify the authenticated workspace before finishing. Do not replace this route with the official Semrush site or save a temporary signed launch URL.Entering a URL does not sign you in. A one-run change to login_mode or login_entry does not change saved defaults. To change the route used by later runs, update your own copy through Improve, complete the matching login, and publish it.
Input Parameters
| Parameter | Configuration |
|---|---|
| login_mode | Dropdown | Optional | Default: official. Choose official for Semrush itself, or portal for an authorized third-party entry. Use the route you actually signed in through. Options: official; portal. |
| login_entry | Text | Optional | Default: https://www.semrush.com/home/. A reusable HTTPS entry address for the selected route. For portal mode, provide your own supported portal or workspace address. Do not include credentials or temporary signed links. |
| module | Dropdown | Required | Default: Competitive Analysis. Select the toolkit area that owns the requested report. Options: Competitive Analysis; Keyword Research; Content Ideas; Link Building. |
| action | Dropdown | Required | Default: Domain Overview. Select one report belonging to the chosen module. The report table lists the valid combinations. |
| target | Text | Required | Default: browseract.com. Enter the keyword, domain, seed set, or ordered domain comparison required by the action. The seven batch-capable actions also accept a JSON list of strings in this field. |
| target_count | Text | Required | Default: 20. Positive integer entered as text. Requested records per target, not a maximum of 20 and not the batch size. Source and account boundaries still apply. |
| database | Dropdown | Required | Default: United States. Select a Semrush country database. Reports without a country dimension do not use this filter. |
Batch Domains and Keywords
Domain Overview, Organic Rankings, Top Pages, Keyword Overview, Keyword Magic Tool, Backlinks, and Referring Domains accept multiple targets. For the single-line Run input, use a JSON list of strings. Each target keeps its own result row in input order; that row may contain detail records belonging to that target.
Keyword Gap and Backlink Gap use multiple domains as one comparison, not as independent reports. Keyword Strategy Builder interprets its targets as a seed set. Do not apply the independent-batch format indiscriminately to every action.
["browser automation","email marketing"]For Keyword Overview, select Keyword Research. For Domain Overview, select Competitive Analysis and replace these keywords with domains. target_count applies to each target's report, not to the number of targets.
Example Output
One Domain Overview result is shown below. Long objects and arrays are shortened for readability. Results vary by target and report.
| Field | Result |
|---|---|
| schema_version | 2 |
| module | Competitive Analysis |
| action | Domain Overview |
| target | browseract.com |
| database | United States |
| status | success |
| target_count | 20 |
| actual_count | 1 |
| has_more | False |
| request_metadata | {"module":"Competitive Analysis","action":"Domain Overview","target":"browseract.com","database":"United States","database_code":"us","target_count":"20","schema_version":"2","session_status":"authenticated","source":"https://www.semrush.com","collected_at":"2026-10-12T08:48:05Z","session_url":"https://www.semrush.com/home/","login_mode":"official","login_entry":"https://www.semrush.com/home/","collection_termination":""} |
| data | {"summary.target":"browseract.com","summary.database":"United States","summary.database_code":"us","summary.authority_score":"32","summary.backlinks":"20960","summary.referring_domains":"2269","summary.referring_ips":"0","summary.link_health":"43","summary.link_power":"4","summary.link_naturalness":"6","summary.organic_keywords":"4150","summary.organic_traffic":"3324","summary.organic_traffic_cost":"5021","summary.paid_keywords":"25","summary.paid_traffic":"1253","summary.paid_traffic_cost":"5853","summary.ai_visibility":"18","summary.positions_updated_at":"1791614857","summary.snapshot_date":"20261015","summary.collected_at":"2026-10-12T08:49:53Z","records":"[]","sections":"[{\"name\":\"ai_top_sources\",\"records\":[{\"record_type\":\"ai_source\",\"domain\":\"browseract.com\",\"mentions_count\":15},{\"record_type\":\"ai_source\",\"domain\":\"youtube.com\",\"mentions_count\":11},{\"recor [...] |
| partial_failure | False |
| error_message | null |
How Does It Work?
- Your personal Bot opens the selected login entry and checks access to the corresponding Semrush workspace.
- It selects the requested module, action, target, and country database using that authenticated workspace.
- It reads the report data available to your account and collects detail records until the requested quantity or the report boundary is reached.
- It returns the result with its status and counts. If data is unavailable, check whether you need to sign in again or select a report included in your account.
Why Use Semrush Scraper?
Use the Bot for repeatable data collection across the Semrush reports you already work with. Feed the results into your own comparisons, dashboards, or Agent conversations; interpretation and marketing recommendations remain a separate step based on the returned data.
Who Can Use Semrush Scraper?
- SEO practitioners comparing domains, organic rankings, and keyword opportunities.
- Content teams collecting research inputs before preparing briefs.
- Link researchers reviewing backlinks, referring domains, and gaps.
- Agent builders connecting an authorized Semrush research workflow to MCP.
How Many Results Can You Scrape?
target_count defaults to 20 and is the quantity requested for a report, not a fixed maximum. You can request another positive integer, such as 50. The returned quantity depends on the selected report, source availability, account allowances, and any report-specific boundary.
Overview reports may return one summary instead of a list of 20 records. For batch-capable actions, the requested quantity applies to each input target.
Turn Your Bot into an MCP Tool and Connect It to an Agent
After signing in and publishing your personal Bot, connect it to your Agent using the default MCP tool configuration. No changes to the tool name, descriptions, or input settings are needed.
- Open your published personal Bot's Integrations tab and choose MCP Server.
- Add your Bot to your own MCP Server's exposed tools.
- Follow Connect to Clients to connect your Agent using that server's URL and matching key. Keep the key private.
Need Help?
Contact BrowserAct support if you need help setting up your personal Bot or connecting it to an Agent. Describe the report and login route involved, but do not send passwords, verification codes, or API keys.
