# 🔥 Similarweb Data Bulk Scraper (`powerai/similarweb-data-bulk-scraper`) Actor

Scrape comprehensive website analytics from Similarweb in bulk. Get traffic metrics, rankings, engagement stats, traffic sources, geographic data, competitors, and top keywords for multiple domains.

- **URL**: https://apify.com/powerai/similarweb-data-bulk-scraper.md
- **Developed by:** [PowerAI](https://apify.com/powerai) (community)
- **Categories:** SEO tools, Developer tools, Integrations
- **Stats:** 58 total users, 2 monthly users, 100.0% runs succeeded, 1 bookmarks
- **User rating**: No ratings yet

## Pricing

from $19.99 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## 📊 Similarweb Data Bulk Scraper

Scrape comprehensive website analytics and traffic insights from Similarweb in bulk. Get detailed data including traffic metrics, rankings, engagement statistics, traffic sources, geographic distribution, competitors, and top keywords for multiple domains efficiently in a single run.

### ✨ Key Features

- **Comprehensive Analytics**: Extract website traffic, rankings, engagement metrics, and traffic sources
- **Bulk Processing**: Scrape data for multiple domains efficiently in a single run
- **Geographic Insights**: Get top countries distribution and available country data
- **Competitor Analysis**: Access competitor information and similarity data
- **Keyword Research**: Extract top keywords with volume, estimated value, and CPC data
- **Ranking Data**: Global rank, country rank, category rank, and global category rank
- **Traffic Sources**: Detailed breakdown of traffic sources including search, direct, social, referrals, mail, and paid referrals
- **Engagement Metrics**: Bounce rate, pages per visit, time on site, and monthly visits
- **Structured Output**: Clean JSON format with logically organized fields for easy integration

### 💪 Why Choose This Actor?

- **Save Time**: Process multiple domains in a single run instead of scraping one by one
- **Comprehensive Data**: Get all essential Similarweb metrics in one structured output
- **Efficient Processing**: Optimized for bulk operations with real-time data streaming
- **Easy Integration**: Well-structured JSON output ready for analysis and integration
- **Accurate Metrics**: Reliable data extraction from Similarweb's public analytics
- **Geographic Insights**: Understand audience distribution across countries
- **Competitor Intelligence**: Identify and analyze competitor websites
- **SEO Research**: Access top keywords and search performance data

### 🎯 Perfect For

- 📊 SEO Professionals
- 📈 Digital Marketing Teams
- 💼 Market Research Analysts
- 🏢 Competitive Intelligence Teams
- 🔍 Website Analytics Specialists
- 📋 Business Intelligence Analysts
- 🛡️ Brand Monitoring Teams
- 📧 Web Performance Analysts

### 📈 Use Cases

1. **Competitive Analysis**: Compare traffic and engagement metrics across competitor websites
2. **Market Research**: Analyze industry trends and website performance across multiple domains
3. **SEO Strategy**: Research top keywords and traffic sources for optimization
4. **Lead Generation**: Identify high-traffic websites in specific categories for outreach
5. **Brand Monitoring**: Track your website's performance and compare with competitors
6. **Geographic Expansion**: Understand audience distribution to plan regional strategies
7. **Content Strategy**: Analyze top keywords to inform content creation
8. **Performance Benchmarking**: Compare your website metrics against industry standards

### Input

| Field                | Type   | Required | Description                                    |
|----------------------|--------|----------|------------------------------------------------|
| targetDomains        | array  | Yes      | List of website domains to scrape data from   |

#### Input Details

- **targetDomains**: An array of domain strings (e.g., \["apple.com", "google.com"]). You can provide any number of domains to scrape in a single run. Each domain will be processed independently.

### Output

Each output item contains comprehensive website analytics data with the following structure:

```json
{
  "siteName": "apple.com",
  "domain": "apple.com",
  "title": "Apple",
  "description": "Website description...",
  "category": "computers_electronics_and_technology/consumer_electronics",
  "siteUrl": "https://similarweb.com/website/apple.com",
  "screenshotUrl": "https://site-images.similarcdn.com/image?url=apple.com&t=1&s=1&h=...",
  "globalRank": {
    "Rank": 73
  },
  "countryRank": {
    "Country": 840,
    "CountryCode": "US",
    "Rank": 60
  },
  "categoryRank": {
    "Rank": "1",
    "Category": "Computers_Electronics_and_Technology/Consumer_Electronics"
  },
  "globalCategoryRank": null,
  "monthlyVisits": {
    "2025-10-01": 530116917,
    "2025-11-01": 501764660,
    "2025-12-01": 537880935
  },
  "engagementMetrics": {
    "BounceRate": "0.5261225228313529",
    "Month": "12",
    "Year": "2025",
    "PagePerVisit": "3.158354675288676",
    "Visits": "537880935",
    "TimeOnSite": "141.5840967648178"
  },
  "trafficSources": {
    "Social": 0.014138507186330732,
    "Paid Referrals": 0.010943163409247027,
    "Mail": 0.0017031062302256012,
    "Referrals": 0.10987022987247097,
    "Search": 0.4026025754992595,
    "Direct": 0.46074241780246605
  },
  "topCountries": [
    {
      "Country": 840,
      "CountryCode": "US",
      "Value": 0.33669251617788676
    }
  ],
  "availableCountries": [...],
  "competitors": {
    "TopSimilarityCompetitors": []
  },
  "topKeywords": [
    {
      "Name": "apple",
      "EstimatedValue": 5577210,
      "Volume": 7146820,
      "Cpc": 0.48
    }
  ],
  "snapshotDate": "2025-12-01T00:00:00+00:00",
  "dataVersion": 1,
  "isSmallSite": false,
  "policyFlag": 0,
  "isGoogleAnalyticsData": false,
  "notification": {
    "Content": null
  }
}
```

#### Output Fields

##### Basic Information

- **siteName**: The website name/domain
- **domain**: The domain name
- **title**: Website title
- **description**: Website description
- **category**: Website category path
- **siteUrl**: Similarweb URL for the website
- **screenshotUrl**: URL to the website screenshot

##### Ranking Information

- **globalRank**: Global ranking with rank number
- **countryRank**: Country-specific ranking with country code and rank
- **categoryRank**: Category ranking with rank and category name
- **globalCategoryRank**: Global category ranking (may be null)

##### Traffic Data

- **monthlyVisits**: Estimated monthly visits as an object with date keys and visit counts
- **engagementMetrics**: Engagement statistics including bounce rate, pages per visit, time on site, and total visits
- **trafficSources**: Traffic source breakdown with percentages for Social, Paid Referrals, Mail, Referrals, Search, and Direct

##### Geographic Data

- **topCountries**: Array of top countries with country code, country code, and traffic value percentage
- **availableCountries**: Complete list of available countries with code, URL code, and name

##### Additional Data

- **competitors**: Competitor information with top similarity competitors
- **topKeywords**: Array of top keywords with name, estimated value, search volume, and CPC
- **snapshotDate**: ISO timestamp of when the data snapshot was taken

##### Metadata

- **dataVersion**: Data version number
- **isSmallSite**: Boolean indicating if the site is considered small
- **policyFlag**: Policy flag value
- **isGoogleAnalyticsData**: Boolean indicating if data comes from Google Analytics
- **notification**: Notification object with content (may be null)

### Example Usage

```json
{
  "targetDomains": [
    "apple.com",
    "google.com",
    "microsoft.com"
  ]
}
```

### Understanding the Data

The actor extracts comprehensive analytics data from Similarweb:

1. **Traffic Metrics**: Monthly visit estimates and engagement statistics help understand website popularity and user behavior
2. **Rankings**: Global, country, and category rankings provide context for website performance
3. **Traffic Sources**: Breakdown shows how visitors arrive at the website (search, direct, social, etc.)
4. **Geographic Distribution**: Top countries data reveals audience location patterns
5. **Keywords**: Top keywords with search volume and CPC data support SEO research
6. **Competitors**: Competitor information helps identify similar websites in the market

This comprehensive data enables informed decision-making for SEO, marketing, competitive analysis, and business intelligence purposes.

# Actor input Schema

## `targetDomains` (type: `array`):

List of website domains to scrape data from Similarweb.

## Actor input object example

```json
{
  "targetDomains": [
    "apple.com",
    "google.com",
    "microsoft.com"
  ]
}
```

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "targetDomains": [
        "apple.com",
        "google.com",
        "microsoft.com"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("powerai/similarweb-data-bulk-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "targetDomains": [
        "apple.com",
        "google.com",
        "microsoft.com",
    ] }

# Run the Actor and wait for it to finish
run = client.actor("powerai/similarweb-data-bulk-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "targetDomains": [
    "apple.com",
    "google.com",
    "microsoft.com"
  ]
}' |
apify call powerai/similarweb-data-bulk-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,powerai/similarweb-data-bulk-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/8PAGaZynpaAGfWo3z/builds/Zm5kVK0D211dQylxn/openapi.json