# SimilarWeb Scraper Pro (`burbn/similarweb-scraper-pro`) Actor

Scrape SimilarWeb website analytics for any domain: traffic, rankings, competitors, keywords, demographics, and tech stack.

- **URL**: https://apify.com/burbn/similarweb-scraper-pro.md
- **Developed by:** [Kevin](https://apify.com/burbn) (community)
- **Categories:** Developer tools, SEO tools, Other
- **Stats:** 338 total users, 30 monthly users, 100.0% runs succeeded, 6 bookmarks
- **User rating**: No ratings yet

## Pricing

from $5.00 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## SimilarWeb Scraper Pro 🌐

Extract **SimilarWeb website analytics** data and export clean, structured results for any domain, including traffic metrics, rankings, competitors, demographics, keywords, technologies, and more.

This actor is built for:

- Competitive intelligence 🧠
- Market & audience research
- SEO & organic traffic analysis 📈
- Media buying / ads & placements research
- Product / startup market validation 🚀

***

### 📌 Table of Contents

- [✨ Features](#-features)
- [🎯 Use Cases](#-use-cases)
- [⚡ Quick Start](#-quick-start)
- [🧾 Input Parameters](#-input-parameters)
- [📤 Output](#-output)
- [🧩 Dataset Views (Table View)](#-dataset-views-table-view)
- [❓ FAQ](#-faq)
- [🔎 SEO Keywords](#-seo-keywords)

***

### ✨ Features

- **🌐 Domain-level analytics from SimilarWeb**\
  Get rich analytics for any domain (e.g. `instagram.com`, `threads.com`, `x.com`).

- **📊 Traffic & engagement metrics**\
  Snapshot of visits, bounce rate, pages/visit, and visit duration.

- **🏆 Rankings & performance**\
  Global, country, and category ranks with historical changes and competitor comparison.

- **👥 Audience demographics & geography**\
  Gender split, age distribution, top countries and their traffic share.

- **Keywords & search traffic**\
  Organic vs paid search share, total keywords count, and top keywords with CPC.

- **🎯 Competitors & similar sites**\
  Top similar/competing domains with traffic and affinity metrics.

- **📢 Ads & social presence**\
  Ads placements, top ads sites, recent creatives, and top social networks.

- **⚙️ Technology stack**\
  Technologies used on the site, grouped by category.

- **🧼 Clean, structured JSON dataset**\
  Optimized for dashboards, BI tools, spreadsheets, or automation workflows.

***

### 🎯 Use Cases

| Use Case | What you can do | Why it helps |
|---|---|---|
| 🧠 Competitor analysis | Analyze competing domains in your niche | See who dominates traffic, category, and country ranks |
| 📈 SEO & organic strategy | Inspect organic vs paid share & top keywords | Plan SEO content and search strategy around real data |
| 👥 Audience research | Understand demographics and top countries | Tailor messaging, localization, and targeting |
| Media buying / ads planning | Explore ads placements & recent creatives | Find potential placements and partner sites |
| ⚙️ Tech stack research | See technologies & platforms in use | Evaluate tooling and integration opportunities |
| Market validation | Check traction of tools, startups, or niches | Validate ideas with real traffic & engagement data |

***

### ⚡ Quick Start

#### Basic run

```json
{
  "domains": [
    "instagram.com",
    "threads.com"
  ]
}
```

***

### 🧾 Input Parameters

| Parameter | Type | Required | Default | Description |
|---|---:|:---:|---:|---|
| `domains` | Array of strings | ✅ | `["threads.com"]` | List of domains to analyze. One output row per domain. |

Each domain must match a pattern like `example.com`, `sub.domain.co.uk`, etc. Duplicates are ignored.

***

### 📤 Output

Each dataset item represents **one analyzed domain**.

High‑level fields (not exhaustive):

| Category | Fields (examples) |
|---|---|
| 🌐 Domain meta | `domain`, `status`, `snapshotDate`, `icon`, `previewDesktop`, `previewMobile`, `categoryId`, `isDataFromGa` |
| 🏆 Rankings | `globalRank`, `countryRank`, `categoryRank`, `globalRankChange`, `countryRankChange`, `categoryRankChange`, `countryCode`, `countryUrlCode` |
| 📊 Engagement | `graphVisitsGrade`, `bounceRate`, `pagesPerVisit`, `avgVisitDuration`, `trafficBounceRate`, `trafficPagesPerVisit`, `trafficAvgDuration`, `trafficHistory` |
| 🏢 Company | `companyName`, `companyYearFounded`, `companyHeadquarter`, `companyHeadquarterCountryCode`, `companyEmployeesMin`, `companyEmployeesMax`, `companyRevenueMin`, `companyRevenueMax`, `companyParentDomain` |
| 🎯 Competitors | `topCompetitors`, `globalRankCompetitors`, `countryRankCompetitors`, `categoryRankCompetitors` |
| 🔍 Search & keywords | `organicSearchShare`, `paidSearchShare`, `keywordsTotalCount`, `topKeywords` |
| 👥 Demographics | `malePercentage`, `femalePercentage`, `ageDistribution`, `topAgeGroup` |
| 🌍 Geography | `topCountries`, `countriesTotalCount` |
| ⚙️ Technologies | `technologiesCount`, `technologiesCategoriesCount`, `topTechnologies` |
| 💡 Interests | `interestedWebsitesCount`, `topInterestedWebsites`, `topInterestedTopics`, `topInterestedCategories` |
| 📥 Incoming referrals | `referralSitesCount`, `topReferralSites`, `topIncomingCategories` |
| 📤 Outgoing referrals | `outgoingSitesCount`, `topOutgoingSites`, `topOutgoingCategories` |
| 📢 Ads & social | `adsSitesCount`, `adsNetworksCount`, `topAdsSites`, `recentAdsCount`, `recentAdsData`, `socialNetworksCount`, `topSocialNetworks` |
| 🔗 Traffic sources | `trafficSources` (direct, organic, referrals, social, mail, ads, paid) |

***

### 🧩 Dataset Views (Table View)

- **🌐 Website Overview**\
  Domain, global / country / category rank, visits grade, bounce rate, pages per visit.

- **🏆 Rankings & Performance**\
  Rank metrics + changes, traffic change, and performance indicators.

- **📊 Traffic Metrics**\
  Visits, bounce rate, pages per visit, avg duration, organic vs paid share.

- **👥 Audience Demographics**\
  Gender split, top age group, and top traffic countries.

- **🎯 Competitor Analysis**\
  Top competitors and their category.

- **🔑 Keywords & SEO**\
  Total keywords count, organic/paid share, and top keywords.

- **⚙️ Technology Stack**\
  Count of technologies and top technology categories.

- **🏢 Company Information**\
  Company name, year founded, HQ, and employee ranges.

***

### ❓ FAQ

#### **Q1: Why do I not see all fields in the Apify UI table?**

Dataset views show only selected fields for clarity. To see everything, open the dataset in **JSON** or export it (JSON/CSV/XLSX) and inspect full records.

#### **Q2: Can I analyze many domains in one run?**

Yes. Pass multiple domains in the `domains` array. Actor will process each domain sequentially and push one item per domain.

#### **Q3: Why do some metrics show `null`?**

Not all metrics are available for every domain. If SimilarWeb doesn’t provide a value, the actor will set it to `null`.

#### **Q5: Can I use this data in dashboards or BI tools?**

Yes. Export the dataset to JSON/CSV/XLSX and connect it to your BI stack (Looker Studio, Power BI, Tableau, etc.).

***

### 🔎 SEO Keywords

SimilarWeb scraper, SimilarWeb API, website analytics scraper, traffic analysis tool, web traffic scraper, competitor analysis, competitor traffic, domain analytics, website stats, audience demographics, traffic by country, top countries traffic, Similarweb pro, search traffic analysis, organic vs paid traffic, top keywords, SEO intelligence, market research, ads intelligence, media buying research, technology stack analysis, tech stack scraper, Apify SimilarWeb actor, website intelligence tool, website traffic checker similarweb, semrush website audit.

If this actor is useful in your workflow, please **leave a rating or star on Apify** so others can discover it.

### 🔗 Related Scrapers

- [Semrush Keyword Magic Tool](https://apify.com/burbn/semrush-keyword-magic-tool)
- [Semrush Global Keyword Scraper](https://apify.com/burbn/semrush-global-keyword-scraper)

# Actor input Schema

## `domains` (type: `array`):

Enter the website domains you want to analyze. Examples: 'google.com', 'threads.com', 'amazon.co.uk'.

## Actor input object example

```json
{
  "domains": [
    "threads.com"
  ]
}
```

# Actor output Schema

## `overview` (type: `string`):

Open the dataset view with an overview of website analytics including rankings, monthly visits, bounce rate, and pages per visit.

## `traffic` (type: `string`):

Open the dataset view with traffic data including monthly visits and breakdown of traffic sources.

## `keywords` (type: `string`):

Open the dataset view with keyword data showing top performing keywords.

## `geography` (type: `string`):

Open the dataset view showing geographic traffic distribution.

## `competitors` (type: `string`):

Open the dataset view showing top similar websites.

## `ai_traffic` (type: `string`):

Open the dataset view showing top similar websites.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "domains": [
        "threads.com"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("burbn/similarweb-scraper-pro").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "domains": ["threads.com"] }

# Run the Actor and wait for it to finish
run = client.actor("burbn/similarweb-scraper-pro").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "domains": [
    "threads.com"
  ]
}' |
apify call burbn/similarweb-scraper-pro --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,burbn/similarweb-scraper-pro"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/7RhdZeIP9JzJ0uiOf/builds/0Hp3g5HyutZ1VFOMK/openapi.json