# AWS Marketplace Scraper (`parseforge/aws-marketplace-scraper`) Actor

Scrapes AWS Marketplace product listings by search query, category, or direct URL. Returns each product as a flat row with pricing, deployment, and region data.

- **URL**: https://apify.com/parseforge/aws-marketplace-scraper.md
- **Developed by:** [ParseForge](https://apify.com/parseforge) (community)
- **Categories:** Automation, E-commerce, Developer tools
- **Stats:** 6 total users, 0 monthly users, 100.0% runs succeeded, 1 bookmarks
- **User rating**: 5.00 out of 5 stars

## Pricing

from $0.70 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

[![ParseForge](https://raw.githubusercontent.com/ParseForge/apify-assets/main/banner.jpg)](https://apify.com/parseforge?fpr=vmoqkp)

### AWS Marketplace Scraper

**Scrape AWS Marketplace product listings by search query, category, or direct URL, up to a million per run.** Each product comes with its pricing model, deployment type, region, and certification status. No API key required. Export to CSV, JSON, Excel, or XML.

The AWS Marketplace catalog is massive, and manually browsing for software that fits your stack wastes hours. This Actor reads the public product listings directly, letting you filter by category, pricing type, region, operating system, and more. You get a structured dataset of matching products, ready for analysis.

| Who uses it | What they scrape AWS Marketplace for |
|---|---|
| Cloud architects | Building a shortlist of compliant, region-available third-party tools for a new AWS deployment. |
| Procurement teams | Comparing pricing models and free trial availability across competing SaaS products. |
| Market researchers | Tracking which new security or machine learning products are listed each week. |
| Sales engineers | Finding complementary products to partner with or benchmark against. |

### What it does

This Actor collects AWS Marketplace product listings by search query, category, or direct URL, and returns each one as a flat row.

- 🔍 **Search-driven scraping:** Enter a search query like 'machine learning' or 'database' to target specific product niches.
- 📂 **Category filtering:** Narrow results to categories such as Security, Data Analytics, or DevOps.
- 💰 **Pricing model filters:** Select free, paid, freemium, BYOL, or pay-as-you-go products only.
- 🌍 **Region and OS targeting:** Filter by AWS region and operating system to find products that run where you do.
- ✅ **Certification and trial flags:** Include only AWS Certified products or those with a free trial available.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

### What you can do with AWS Marketplace data

**📋 Build a compliant software shortlist.**

A cloud architect filters for security products available in eu-west-1 with AWS Certification to meet a client's compliance requirements.

**💸 Compare SaaS pricing at scale.**

A procurement analyst scrapes all products in the Data Analytics category with a free trial to evaluate cost before vendor calls.

**📈 Monitor new market entrants.**

A market researcher runs a weekly scrape for 'machine learning' products to track new listings and competitive shifts.

**🤝 Identify partnership targets.**

A sales engineer scrapes the DevOps category for complementary container-based products to propose a bundled offering.

### Why choose this scraper

|  | What you get |
|---|---|
| **No API key** | Reads the public AWS Marketplace catalog with no registration or credentials. |
| **Structured output** | Every product returns as a flat row with consistent columns for pricing, deployment, and region. |
| **Flexible input** | Start from a search term, a category, a direct URL, or scrape the entire catalog. |

### How it compares

No other Store actor targets AWS Marketplace the same way, so the honest comparison is with the alternatives teams actually weigh.

| | AWS Marketplace Scraper | Build it in-house | By hand |
|---|---|---|---|
| Setup | Run it now, zero config | Days of engineering | None, but hours per pull |
| When AWS Marketplace changes | Maintained for you | You fix it | You re-learn the page |
| Proxies, retries, anti-bot | Built in | Your problem | Browser only |
| Output | Fixed JSON schema, CSV/Excel export | Whatever you build | Copy-paste |
| Cost | Pay per result | Engineering time | Analyst hours |

### Configure the run

Drive the Actor from a search query, a category, or a direct URL, and filters run as each product is read so only matches reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

```json
{
  "maxItems": 10,
  "categories": [
    "security"
  ],
  "pricingTypes": [
    "free",
    "paid"
  ],
  "productTypes": [
    "saas"
  ],
  "regions": [
    "us-east-1"
  ],
  "operatingSystems": [
    "Linux"
  ],
  "deploymentTypes": [
    "cloud"
  ],
  "freeTrialAvailable": "ALL",
  "awsCertified": "ALL",
  "featured": "ALL"
}
```

A larger pull:

```json
{
  "maxItems": 200,
  "categories": [
    "security"
  ],
  "pricingTypes": [
    "free",
    "paid"
  ],
  "productTypes": [
    "saas"
  ],
  "regions": [
    "us-east-1"
  ],
  "operatingSystems": [
    "Linux"
  ],
  "deploymentTypes": [
    "cloud"
  ],
  "freeTrialAvailable": "ALL",
  "awsCertified": "ALL",
  "featured": "ALL"
}
```

### Pricing

Pay-per-result: **$0.001 per result** collected. You pay only for the results written to your dataset.

| Results collected | Approximate cost |
|---|---|
| 100 results | $0.10 |
| 1,000 results | $1.00 |
| 10,000 results | $10.00 |

New Apify accounts start with $5 in free credit.

### Free users

Free-plan runs return up to 10 results as a preview. [Upgrade your Apify plan](https://console.apify.com/sign-up?fpr=vmoqkp) to collect up to 1,000,000 results per run.

### Run it

1. [Create a free Apify account with $5 in credit](https://console.apify.com/sign-up?fpr=vmoqkp).
2. Open the [AWS Marketplace Scraper](https://apify.com/parseforge/aws-marketplace-scraper?fpr=vmoqkp).
3. Set your inputs and any filters, then click **Start**.
4. Export the results as CSV, Excel, JSON, or XML from the **Dataset** tab.

Run it programmatically through the [Apify API](https://docs.apify.com/api/v2) (`run-sync-get-dataset-items`) or the [ApifyClient](https://docs.apify.com/api/client/js) for JavaScript and Python.

### Use with AI agents (MCP)

Give an AI agent live access to AWS Marketplace through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

```bash
claude mcp add --transport http apify "https://mcp.apify.com/?tools=parseforge/aws-marketplace-scraper"
```

Then prompt it in plain language to run the scraper and read back the results.

### Troubleshooting

**Why am I getting no results?**

Check that your search query or filters are not too restrictive. Try leaving all filters empty and using only a broad search term, or scrape without any filters to see the full catalog.

**The Actor is running slowly. Is that normal?**

Scraping many pages takes time. Reduce the Max Items limit for a faster test run, or narrow your search with additional filters to target a smaller set of products.

**Some products are missing fields in the output.**

Not every product listing on AWS Marketplace fills in all fields. If a product does not list its operating system or deployment type, that cell will be empty in your dataset.

**I get an error when using a direct URL.**

Ensure the URL is a full, valid AWS Marketplace product page link. The Actor expects a URL that starts with 'https://aws.amazon.com/marketplace/'. If the product is no longer listed, the scrape will fail.

### FAQ

| Question | Answer |
|---|---|
| Can I scrape the entire AWS Marketplace catalog? | Yes. Leave the search query and all filters empty, and set a high Max Items limit. The Actor will paginate through all available product listings. |
| Do I need an AWS account or API key to use this? | No. This Actor reads the public AWS Marketplace website. You do not need an AWS account, IAM role, or any API credentials. |
| What data does each product row include? | Each row includes the product name, description, pricing model, deployment type, supported regions, operating systems, and flags like AWS Certified or free trial availability. |
| How do I filter for only free products? | In the input, set the Pricing Types filter to 'free'. You can combine this with other filters like category or region to narrow results further. |
| Can I scrape a specific product page directly? | Yes. Paste the full URL of an AWS Marketplace product page into the Start URL field. The Actor will extract that single product's details. |
| What is the maximum number of products I can scrape? | Free Apify users are limited to 10 items per run. Paid users can set Max Items up to 1,000,000 to scrape the full catalog. |
| How do I filter products by AWS region? | Use the Regions filter to select one or more AWS regions like us-east-1 or eu-west-1. Only products available in those regions will be returned. |
| Can I filter for products that offer a free trial? | Yes. Set the Free Trial Available filter to 'true' to return only products that offer a free trial. |
| What export formats are supported? | You can export your dataset in CSV, JSON, Excel, or XML formats from the Apify platform. |
| Does this Actor handle pagination automatically? | Yes. It navigates through all pages of search results or category listings until it reaches your Max Items limit or the end of the catalog. |

### Related actors

Browse the full [ParseForge collection](https://apify.com/parseforge?fpr=vmoqkp) for more scrapers.

🆘 **Need help?** Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ **Disclaimer.** This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Amazon Web Services, Inc. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.

# Actor input Schema

## `startUrl` (type: `string`):

Direct URL to scrape from AWS Marketplace. Leave empty to use search filters or scrape all products.

## `maxItems` (type: `integer`):

Free users: Limited to 100. Paid users: Optional, max 1,000,000

## `searchQuery` (type: `string`):

Enter specific terms like 'machine learning', 'security', 'database', or 'analytics' to find relevant products. Leave all filters empty to fetch all products.

## `categories` (type: `array`):

Filter by product categories (optional). Leave empty to include all categories.

## `pricingTypes` (type: `array`):

Choose pricing models (optional). Leave empty to include all pricing types.

## `productTypes` (type: `array`):

Filter by product types (optional). Leave empty to include all types.

## `regions` (type: `array`):

Filter by AWS regions (optional). Leave empty to include all regions.

## `operatingSystems` (type: `array`):

Filter by operating systems (optional). Leave empty to include all operating systems.

## `deploymentTypes` (type: `array`):

Filter by deployment types (optional). Leave empty to include all deployment types.

## `freeTrialAvailable` (type: `string`):

Filter by free trial availability (optional).

## `awsCertified` (type: `string`):

Filter by AWS certification status (optional).

## `featured` (type: `string`):

Filter by featured status (optional).

## Actor input object example

```json
{
  "maxItems": 10,
  "categories": [
    "security"
  ],
  "pricingTypes": [
    "free",
    "paid"
  ],
  "productTypes": [
    "saas"
  ],
  "regions": [
    "us-east-1"
  ],
  "operatingSystems": [
    "Linux"
  ],
  "deploymentTypes": [
    "cloud"
  ],
  "freeTrialAvailable": "ALL",
  "awsCertified": "ALL",
  "featured": "ALL"
}
```

# Actor output Schema

## `products` (type: `string`):

Complete dataset with all AWS Marketplace products including product details, pricing information, vendor information, ratings, features, and technical specifications

## `overview` (type: `string`):

Overview view of products with key fields displayed in a table format

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "maxItems": 10,
    "categories": [
        "security"
    ],
    "pricingTypes": [
        "free",
        "paid"
    ],
    "productTypes": [
        "saas"
    ],
    "regions": [
        "us-east-1"
    ],
    "operatingSystems": [
        "Linux"
    ],
    "deploymentTypes": [
        "cloud"
    ],
    "freeTrialAvailable": "ALL",
    "awsCertified": "ALL",
    "featured": "ALL"
};

// Run the Actor and wait for it to finish
const run = await client.actor("parseforge/aws-marketplace-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "maxItems": 10,
    "categories": ["security"],
    "pricingTypes": [
        "free",
        "paid",
    ],
    "productTypes": ["saas"],
    "regions": ["us-east-1"],
    "operatingSystems": ["Linux"],
    "deploymentTypes": ["cloud"],
    "freeTrialAvailable": "ALL",
    "awsCertified": "ALL",
    "featured": "ALL",
}

# Run the Actor and wait for it to finish
run = client.actor("parseforge/aws-marketplace-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "maxItems": 10,
  "categories": [
    "security"
  ],
  "pricingTypes": [
    "free",
    "paid"
  ],
  "productTypes": [
    "saas"
  ],
  "regions": [
    "us-east-1"
  ],
  "operatingSystems": [
    "Linux"
  ],
  "deploymentTypes": [
    "cloud"
  ],
  "freeTrialAvailable": "ALL",
  "awsCertified": "ALL",
  "featured": "ALL"
}' |
apify call parseforge/aws-marketplace-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,parseforge/aws-marketplace-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/G0ahpQ8VsAogdgSsr/builds/fbxb1K2v2Cm4dwp9k/openapi.json