Google News Scraper | Extract Ranked News Articles, Publishers, URLs, and Dates

Google News Scraper is a BrowserAct Bot template for collecting structured article results from public Google News search pages. Configure the keyword, country, language, date range, and count, then run the Bot to return ranked article records for monitoring, research, competitive intelligence, or downstream automation.

What Does BrowserAct Google News Scraper Do?

This template opens a public Google News search page, applies the configured locale and recency settings, reads article cards, decodes publisher article URLs, and returns clean structured rows. It is designed for non-login use cases and only collects information visible on public Google News pages.

Key Features

Search Google News by keyword.
Configure country, language, date range, and result count.
Extract headline, publisher article URL, publisher name, published time, image URL, rank, and Google News URL.
Apply recency windows such as past hour, past day, past 7 days, past 30 days, and past year.
Return optional snippet values as empty when Google News does not show summaries in result cards.

What Data Can I Extract from Google News?

Field	Description
`headline`	Article headline shown in Google News results.
`article_url`	Real publisher article URL decoded from the result card.
`publisher`	Publisher or source name.
`published_time`	Visible relative or published time.
`snippet`	Snippet when shown; often empty because Google News list cards do not show summaries.
`image_url`	Thumbnail image URL when visible.
`rank`	Article rank in the returned result order.
`google_news_url`	Google News read URL for the article.

How to Use Google News Scraper

Click Run task.
Enter the keyword, country, language, date range, and count.
Run the Bot and review the structured article records.
Export the result or connect it to an API, workflow builder, or agent workflow.

Input Parameters

Parameter	Required	Default	Description
`Keyword`	Yes	`AI browser automation`	Search phrase used in Google News.
`Country`	Yes	`US`	Country or edition code used as the `gl` parameter.
`Language`	Yes	`en-US`	Language setting used as the `hl` parameter.
`Date Range`	Yes	`past_7_days`	Recency window applied through Google News search operators.
`Count`	Yes	`20`	Maximum number of article records to return.

Example Output

{
  "articles": [
    {
      "headline": "Webwright: Why AI Web Agents Should Write Code, Not Click",
      "article_url": "https://towardsdatascience.com/webwright-why-ai-web-agents-should-write-code-not-click/",
      "publisher": "Towards Data Science",
      "published_time": "2 days ago",
      "snippet": "",
      "image_url": "https://news.google.com/api/attachments/...",
      "rank": 1,
      "google_news_url": "https://news.google.com/read/..."
    }
  ]
}

How Does it Work?

How Google News Scraper runs

BrowserAct constructs the Google News search URL with q, hl, and gl parameters. For recency filters, the Bot appends a Google News-supported when: operator to the search query, such as when:7d for the past 7 days.

The Bot reads public article cards from the rendered results page, extracts the headline, publisher, time, image, Google News URL, and DOM rank, then decodes the real publisher article URL from the result metadata. Google News usually renders a bounded result set rather than infinite scrolling, so the Bot returns the requested count or the available public results if fewer are present.

How to Build a New Scraper Bot with Agent Built

Step 1: Describe the Data You Need

Open BrowserAct and start Agent Built from the Home prompt box or from Create -> Build with Agent. Paste a clear request that includes the website, the records to collect, the filters or search conditions, the fields to return, the result limit, and the inputs you want to reuse later.

Agent Built prompt templates

Step 2: Let BrowserAct Build and Test the Bot

BrowserAct explores the live website, works out the navigation and extraction path, and validates the result. If BrowserAct asks for clarification, reply in the same build conversation with the missing URL, condition, field, example, or expected output.

Agent Built exploration

Step 3: Run the Bot and Review the Result

When the build is complete, run the Bot with the default inputs first. Review the structured records, source URLs, missing fields, and row count before reusing the Bot with new inputs or connecting it to another workflow.

Agent Built run inputs

Agent Built run results

Why Scrape Google News Results?

Google News search data helps teams monitor media coverage, track competitors, follow product categories, identify news sources, and build research feeds around fast-moving topics. A reusable BrowserAct Bot makes this workflow repeatable without writing selectors or maintaining a custom browser script.

Who Can Use This Template?

PR and communications teams monitoring coverage.
Market researchers tracking topics and competitors.
Analysts building news feeds for dashboards.
Content teams collecting article references.
Automation builders sending article data into spreadsheets, APIs, or agents.

How Many Results Can You Scrape?

Use Count to control the number of records returned. Google News typically renders a bounded set of public results for each query. If fewer public results are available than requested, the Bot returns the available records.

Automation and Export

Automation and export flow

BrowserAct returns structured article data first. You can then use the output through API JSON responses, n8n workflows, Make scenarios, Zapier automations, MCP-based agent workflows, or manual CSV review depending on your downstream system.

Need Help?

Discord: Discord Community

E-mail: service@browseract.com

Google News Scraper Bot

Brief