MetaCPAN Module Search Scraper

MetaCPAN Module Search Scraper is a BrowserAct Bot template for collecting structured public Perl module and release records from MetaCPAN. Configure a MetaCPAN API base URL, keyword, and result count, then run the Bot to return ranked package metadata for dependency research, ecosystem monitoring, package discovery, or automation workflows.

What Does BrowserAct MetaCPAN Module Search Scraper Do?

This template opens MetaCPAN's public release search JSON endpoint, parses each result from the response, derives a MetaCPAN release page URL, and returns one structured record per Perl release.

Key Features

• Extract public MetaCPAN release search results without requiring a login.
• Capture distribution, release name, abstract, author, version, release date, download URL, status, maturity, license, score, and search keyword.
• Derive a public MetaCPAN release page URL from the author and release name.
• Configure base URL, keyword, and count.
• Return structured JSON records ready for API, workflow, or spreadsheet use.

What Data Can I Extract from MetaCPAN?

How to Use MetaCPAN Module Search Scraper

1. Click Run task.
2. Enter the MetaCPAN API base URL.
3. Enter a module, distribution, topic, or package keyword.
4. Set how many records to collect.
5. Run the Bot and review the structured Perl package results.
6. Reuse the Bot with another keyword or connect the output to your workflow.

Input Parameters

Example Output

{
  "results": [
    {
      "rank": 1,
      "distribution": "JSON",
      "release_name": "JSON-0.98",
      "abstract": "(halfway) server implementation of JSON-RPC protocol",
      "author": "MAKAMAKA",
      "version": "0.98",
      "release_date": "2005-07-18T01:53:41",
      "download_url": "https://cpan.metacpan.org/authors/id/M/MA/MAKAMAKA/JSON-0.98.tar.gz",
      "metacpan_url": "https://metacpan.org/release/MAKAMAKA/JSON-0.98",
      "status": "backpan",
      "maturity": "released",
      "license": "unknown",
      "score": "8.360952",
      "search_keyword": "json"
    }
  ]
}

How Does it Work?

BrowserAct builds the public MetaCPAN API URL in the format {base_url}/v1/release/_search?q={keyword}&size={count}. The response contains a hits.hits array, where each item represents one public Perl release search result.

For each hit, BrowserAct reads _score and _source fields, maps release metadata into a flat record, joins license values when needed, and derives the MetaCPAN release page URL as https://metacpan.org/release/{author}/{release_name}. The Bot stops when it reaches count or when MetaCPAN returns fewer public results.

How to Build a New Scraper Bot with Agent Built

Step 1: Describe the Data You Need

Open BrowserAct and start Agent Built from the Home prompt box or from Create -> Build with Agent. Paste a clear request that includes the website, the records to collect, the filters or search conditions, the fields to return, the result limit, and the inputs you want to reuse later.

Step 2: Let BrowserAct Build and Test the Bot

BrowserAct explores the live website, works out the navigation and extraction path, and validates the result. If BrowserAct asks for clarification, reply in the same build conversation with the missing URL, condition, field, example, or expected output.

Step 3: Run the Bot and Review the Result

When the build is complete, run the Bot with the default inputs first. Review the structured records, source URLs, missing fields, and row count before reusing the Bot with new inputs or connecting it to another workflow.

Why Scrape MetaCPAN Module Results?

MetaCPAN data helps developers discover Perl modules, compare release metadata, monitor package ecosystems, enrich dependency inventories, and route package data into dashboards, reports, alerts, or agent workflows.

Who Can Use This Template?

• Perl developers researching modules and releases.
• Platform teams enriching dependency inventories.
• Open source researchers monitoring CPAN package activity.
• Security and compliance teams reviewing public package metadata.
• Automation builders routing package data into spreadsheets, databases, alerts, or agents.

How Many Results Can You Scrape?

Use count to control the number of records returned. MetaCPAN returns fewer records when fewer public matches are available.

Automation and Export

BrowserAct returns structured MetaCPAN records first. You can then use the output through API JSON responses, n8n workflows, Make scenarios, Zapier automations, MCP-based agent workflows configured from the Bot's Integrations tab, or manual CSV review.

Need Help?

Contact us at

Discord: Discord Community

E-mail: service@browseract.com