# Similarweb Scraper - Traffic, Audience & Competitors (`trakk/similarweb-scraper`) Actor

Get traffic & competitor intelligence for any website - ranks, monthly visits, engagement, traffic sources, top keywords, AI-referral traffic. Complete profile adds audience age & gender, referring domains, ad publishers, technologies, ranked competitors & rank history. No login. CSV, Excel, JSON.

- **URL**: https://apify.com/trakk/similarweb-scraper.md
- **Developed by:** [Kelopr\_bk](https://apify.com/trakk) (community)
- **Categories:** SEO tools, Lead generation, E-commerce
- **Stats:** 104 total users, 49 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $1.50 / 1,000 base data

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

<p align="center">
  <a href="https://apify.com/trakk/similarweb-scraper"><img src="https://api.apify.com/v2/key-value-stores/yPV10YMbm1141PAB7/records/similarweb-scraper-cover.png" alt="Similarweb Scraper" width="260"></a>
</p>

## Similarweb Scraper — traffic, competitors, AI visibility & monitoring

**Explore website traffic, audiences and competitors from one list of domains.** Collect growth, ranks, acquisition channels, keywords, AI referrals, WHOIS, company signals and homepage technologies. Compare websites, track changes between runs or build a competitive market map.

No Similarweb login or browser session is required. Existing API integrations using `base_data`, `similar_sites`, `aitdk`, or `all` remain compatible.

### ▶️ Your first run

1. Open **Input** and select **Website overview**. This includes traffic sources, engagement, ranks, top countries, search keywords, and available AI-referral data.
2. Under **Domains**, add the websites you want to analyze, one per entry. A domain such as `apify.com` or a full HTTP(S) website URL is accepted. Duplicate websites are removed automatically.
3. Leave the other settings at their defaults and click **Start**. For a first run, use 1–3 domains.
4. Open **Output → Results → Overview** for eight headline metrics. Switch to **Traffic**, **Channels**, **Countries** or **Keywords** for details.
5. Use **Export** to download the data. Choose **All fields** when you want the full record. JSON preserves nested objects; list cells in the table expand to show their entries.

Copy this into **Input → JSON** for a first run:

```json
{
  "domains": ["python.org", "docker.com"],
  "mode": "base_data"
}
```

Choose **Complete intelligence profile** to add competitor discovery, domain analysis, demographics, referrals and rank history. Each website produces one main result. The countries, keywords and other lists inside that record are included in its collection event.

### 🚀 Pick your goal

| Workflow | Best for | What you receive | Collection event |
|---|---|---|---|
| `base_data` | Fast website overview | Traffic history, growth, ranks, engagement, channels, geography, keywords, AI visibility, screenshot | `base-data` |
| `similar_sites` | Competitor discovery | Similar websites, similarity grades, estimated visits, categories, tags, related apps | `similar-sites` |
| `aitdk` | Domain due diligence | WHOIS/RDAP, domain age, expiry, homepage keyword density, company metadata, social links, detected technologies | `whois-keywords` |
| `all` | Complete profile | Traffic, competitor discovery and domain insights, plus in-depth audience, referrals, ads, technologies and rank history | `all-in-one` |
| `compare` | Side-by-side benchmark | Actual traffic shares, leaders, ranks, engagement position, and gaps versus the first domain | `base-data` |
| `monitor` | Recurring intelligence | Saved baseline and material changes in traffic, ranks, engagement, acquisition shares, keywords and available AI referrals | `base-data` or `all-in-one` |
| `market_map` | Competitive landscape | Seed sites, auto-discovered competitors, enriched traffic rows, market shares, and a separate relationship dataset | `base-data` |

Current rates are listed in the Actor's [Pricing tab](https://apify.com/trakk/similarweb-scraper/pricing). Successful and partial records use the workflow's collection event. Failed lookups go to **Errors** without a result-event charge; the platform's Actor start event still applies. Monitoring checks are charged even when `onlyChanges` filters their rows from the output.

#### 🧠 In-depth audience & referral intelligence — included in the Complete profile

The **Complete intelligence profile** (`all`) adds these details within the same
`all-in-one` result event:

| Group | Fields |
|---|---|
| Audience | Age distribution, largest age group, male/female split, audience topics, the other sites that audience visits |
| Competitive set | Similarweb's own ranked competitors with category rank and affinity, plus the websites immediately above and below in the global ranking |
| Referral graph | Incoming referring domains and outgoing destinations with visit shares, category splits, and the real totals behind both |
| Paid & social | Advertising publishers and network counts, and the split of social traffic per network |
| Technographics | Technology providers by category, and how many technologies are detected in each |
| Firmographics | Legal name, year founded, employee range, headquarters, revenue range, parent domain — when Similarweb publishes them |
| History | Global, category, and country rank month by month, movement versus the previous month, and traffic by country |
| Previews | Desktop and mobile preview images |

Select `all` with `includeInDepth: true` to collect this layer. Set the flag to
`false` for a lighter Complete profile. Other workflows, including Monitor and
Market map, return their own workflow data.

`indepthStatus` reports whether the profile was collected. If it is unavailable,
the website's available data is still returned under the same collection event.
`indepthWithheldRows` counts entries for which Similarweb did not disclose a domain;
the returned lists contain the identifiable websites.

```json
{
  "domains": ["python.org", "docker.com"],
  "mode": "all",
  "includeInDepth": true
}
```

### ✨ What makes the output comfortable

- **Flat columns where they matter:** `latestMonthlyVisits`, `trafficChangePercent`, `bounceRatePercent`, `organicSearchPercent`, and dozens more export cleanly to CSV and Excel.
- **Original objects remain:** existing consumers can still use `engagement`, `estimatedMonthlyVisits`, `trafficSources`, `countryRank`, and other legacy fields.
- **Four output destinations:** Results, Market links, Errors and Run summary. Topic tabs inside Results show the data for your chosen workflow.
- **Results appear as they finish:** independent website profiles are saved immediately. Compare and Market Map calculate their cohort-wide shares after collecting the bounded comparison group.
- **Clean failures:** no error rows mixed into paid result counts or downstream exports.
- **Clear finish state:** every run writes an `OUTPUT` JSON summary with exact result, error, filter, duration, and charged-event counts.
- **Honest enrichment:** unavailable values stay empty. The Actor does not invent demographics, traffic, technologies, or company data.

### 📊 Website overview fields

The `base_data` workflow returns the source-compatible objects plus useful derived fields.

#### Identity and rank

`domain`, `websiteUrl`, `similarwebUrl`, `siteName`, `title`, `description`, `category`, `snapshotDate`, `screenshot`, `globalRank`, `countryRank`, `countryCode`, `countryRankValue`, `categoryRank`, `categoryRankValue`, `marketPosition`

#### Traffic and engagement

`engagement`, `estimatedMonthlyVisits`, `trafficHistory`, `latestMonthlyVisits`, `previousMonthlyVisits`, `trafficChangeMoM`, `trafficChangePercent`, `threeMonthGrowthPercent`, `trafficTrend`, `bounceRatePercent`, `pagesPerVisit`, `timeOnSiteSeconds`

| Metric | Meaning and units |
|---|---|
| `latestMonthlyVisits` | Estimated visits in the latest available month, not unique visitors |
| `engagement.month`, `engagement.year` | Period of the engagement metrics |
| `bounceRatePercent` | Bounce rate on a 0–100 scale; `engagement.bounceRate` preserves the original 0–1 fraction |
| `pagesPerVisit` | Average pages per visit, not total pageviews |
| `timeOnSiteSeconds` | Average visit duration in seconds |
| `trafficChangePercent` | Calculated month-over-month change; `trafficChangeMoM` retains the fractional form |

Use the dates in `trafficHistory` and `snapshotDate` when comparing periods. An unavailable metric stays empty; a real zero stays zero.

#### Acquisition channels

`trafficSources`, `directPercent`, `organicSearchPercent`, `paidSearchPercent`, `organicSocialPercent`, `paidSocialPercent`, `referralsPercent`, `mailPercent`, `displayAdsPercent`, `affiliatePercent`, `aiTrafficPercent`, `topTrafficChannel`, `topTrafficChannelPercent`, `organicPaidRatio`, `trafficConcentrationScore`, `acquisitionDiversityScore`

The **Channels** view separates organic and paid search, organic and paid social, direct visits, referrals, email, display advertising, affiliates, and AI referrals. Flat `*Percent` fields use 0–100; values inside `trafficSources` use 0–1. Referral share measures the channel's contribution, not a list of referring URLs.

#### Geography, search, AI, and competitors

`topCountryShares`, `topCountryCode`, `topCountrySharePercent`, `topKeywords`, `topKeyword`, `topKeywordVolume`, `aiTraffic`, `aiChatbotDistribution`, `aiTotalVisits`, `estimatedAiVisits`, `topAiPlatform`, `topAiPrompts`, `competitors`, `competitorCount`, `topCompetitor`

**Countries** shows each available top country with `countryCode`, `countryName`, `countryId`, `share`, and `sharePercent` inside `topCountryShares`. Names are taken from the source's country dictionary. These are the leading countries, so their shares need not add up to 100%.

`countryRank.countryCode` / `countryCode` identify the country used for the country rank. `topCountryCode` identifies the first country in the audience breakdown. They can legitimately differ.

**Keywords** shows the leading term and an expandable `topKeywords` list with `name`, `volume`, `cpc`, and `estimatedValue`, as supplied by the source. Search-channel shares are split into organic and paid; the keyword list itself is not classified as `OrganicKeywords` or `PaidKeywords`. A CPC value does not prove that the website pays for that keyword. `keywordDensity` in Domain SEO & WHOIS is a separate analysis of words on the homepage, not search traffic.

For competitor discovery, use `similar_sites` or `all`: their `similarSites` lists include descriptions, estimated visits, categories and similarity signals. Complete profile also supplies Similarweb's ranked competitive set in `similarwebCompetitors` and uses it to populate `competitors` when the basic list is empty. Similarity is a discovery signal, not a guarantee that every listed site is a direct business competitor.

In **Demographics**, `audienceMaleShare` and `audienceFemaleShare` use a 0–1 scale: `0.4628` means **46.28%**. Fields ending in `Percent`, such as `topCountrySharePercent`, use a 0–100 scale.

Illustrative country entry:

```json
{
  "countryCode": "US",
  "countryId": 840,
  "countryName": "United States",
  "share": 0.2543,
  "sharePercent": 25.43
}
```

#### Quality signals

`dataCompletenessScore`, `riskFlags`, `isSmall`, `status`

The legacy `isDataFromGoogleAds` key is retained for API compatibility only. It mirrors the source's `IsDataFromGa` flag and must not be used as evidence of Google Ads spending; use `paidSearchPercent` for paid-search traffic share.

`riskFlags` are deterministic signals such as `traffic_decline`, `single_channel_dependence`, `high_bounce_rate`, `domain_expiring_soon`, and `limited_public_data`. They are not an opaque AI score.

### 🧭 Competitor discovery fields

The `similar_sites` workflow returns:

```json
{
  "domains": ["docker.com", "notion.so"],
  "mode": "similar_sites"
}
```

`domain`, `title`, `description`, `category`, `categoryRank`, `totalVisits`, `thumbnail`, `screenshot`, `favicon`, `tags`, `similarSites`, `relatedApps`, `status`

Each `similarSites` item can contain:

```json
{
  "site": "peer-site.test",
  "description": "Example competitor website",
  "category": "Business_and_Consumer_Services",
  "similarityRank": 1,
  "topCountryRank": 2400,
  "totalVisits": 1850000,
  "grade": 0.91,
  "thumbnail": "https://example.test/example-preview.png"
}
```

Result fragments are illustrative. The runnable input examples use real websites.

### 🔍 Domain, company & technology fields

The `aitdk` workflow combines domain registration data with analysis of the public homepage. Open **Results → Website** to inspect it.

```json
{
  "domains": ["python.org", "docker.com"],
  "mode": "aitdk"
}
```

- `whois`: registrar, status, nameservers, DNSSEC, registration, expiration, and last-change dates
- `domainAgeDays`, `daysUntilDomainExpiration`
- `keywordDensity`: page title, visible token count, top tokens, counts, and frequencies
- `websiteIntelligence`: page title, meta description, language, canonical URL, page image, company metadata, public social profiles, generator, and technology signals
- `companyName`, `companyLogo`
- `technologies`, `technologyCount`

Technology detection is based on visible homepage signatures and is labelled as `detected` or `declared`; it is not presented as a guaranteed full technology stack. A company logo is returned only when structured organization data explicitly identifies it as a logo — a generic Open Graph hero image is not mislabeled.

WHOIS fields are filled from the available registry data. When a registry record is unavailable, other collected details remain in the result and `notes` explains the missing part.

### ⚔️ Compare websites

Put the primary website first. Open **Results → Compare** to see each site's share, position and gap against that primary website.

```json
{
  "domains": ["nytimes.com", "theguardian.com", "cnn.com"],
  "mode": "compare",
  "maxConcurrency": 10
}
```

Comparison fields include:

`primaryDomain`, `compareRank`, `trafficSharePercent`, `trafficGapVsPrimaryPercent`, `globalRankGapVsPrimary`, `growthRank`, `engagementRank`, `competitivePositionScore`, `winnerMetrics`

Illustrative result fragment:

```json
{
  "domain": "competitor-a.test",
  "mode": "compare",
  "primaryDomain": "primary-site.test",
  "compareRank": 2,
  "trafficSharePercent": 31.42,
  "trafficGapVsPrimaryPercent": -38.7,
  "growthRank": 1,
  "engagementRank": 3,
  "winnerMetrics": ["growth"]
}
```

### 🔔 Monitor changes

Run the same domains with the same **Monitor name** (`monitorName`) to compare against the previous successful check. Open **Results → Changes** for the outcome. The older API spelling `monitorKey` is also accepted; use `monitorName` in new inputs.

```json
{
  "domains": ["python.org", "docker.com"],
  "mode": "monitor",
  "monitorName": "weekly-competitors",
  "monitorDepth": "base_data",
  "changeThreshold": "medium",
  "onlyChanges": false
}
```

The first run returns `changeStatus: "baseline"`. Later runs return `changed` or `unchanged` and can include:

`checkedAt`, `previousCheckedAt`, `changeSeverity`, `changedMetrics`, `recommendedAction`

Sensitivity presets:

- `low`: catches smaller movements
- `medium`: recommended default
- `high`: reports only major movements

`monitorDepth: "base_data"` returns traffic data. `monitorDepth: "all"` also returns competitor discovery, WHOIS and homepage insights as context; in-depth demographics and referrals belong to the standalone Complete profile workflow. `changedMetrics` compares traffic, ranks, engagement, channel shares, search keywords and the available `competitors` and AI-platform lists. The discovery list `similarSites`, WHOIS and homepage insights remain contextual fields in the returned record.

Set `onlyChanges: true` to omit unchanged rows. For example, checking two unchanged websites produces **zero result rows and two paid monitoring checks**. **Run summary** reports the checks in `filteredUnchanged` and `details.unchanged`.

### 🕸️ Build a market map

Market Map starts with one or more seed domains, discovers related sites, deduplicates them, enriches the strongest candidates, and calculates share inside the returned landscape.

```json
{
  "domains": ["docker.com"],
  "mode": "market_map",
  "marketMapMaxCompetitors": 2,
  "maxConcurrency": 10
}
```

The main dataset contains site rows with:

`marketRole`, `sourceSeedDomains`, `similarityGrade`, `similarityRank`, `marketTrafficSharePercent`, `marketRank`, `emergingCompetitor`

Open **Results → Market** for the website rows. The separate **Market links** destination contains one edge per returned seed-to-competitor connection:

```json
{
  "seedDomain": "seed-site.test",
  "competitorDomain": "peer-site.test",
  "similarityRank": 1,
  "grade": 0.91,
  "competitorVisits": 1850000,
  "competitorGlobalRank": 43210,
  "trafficChangePercent": 8.4,
  "marketTrafficSharePercent": 17.6,
  "category": "Business_and_Consumer_Services"
}
```

### 📥 Input reference

| Field | Type | Default | Notes |
|---|---|---:|---|
| `domains` | array of strings | required | Domains or full URLs; normalized, deduplicated, and validated |
| `mode` | string | `base_data` | One of the seven workflows above |
| `includeInDepth` | boolean | `true` | Collects the audience, referral, ads, technology, and rank-history layer in the `all` workflow, at no extra charge. Set to `false` for a faster, lighter Complete profile |
| `maxDomains` | integer | `10000` | Safety limit for unexpectedly large pasted lists |
| `monitorName` | string | `my-monitor` | Reuse the same name on later checks; `monitorKey` remains an accepted API alias |
| `monitorDepth` | string | `base_data` | `all` adds competitor and domain details to monitoring results; in-depth audience data is collected by standalone `all` |
| `changeThreshold` | string | `medium` | `low`, `medium`, or `high` |
| `onlyChanges` | boolean | `false` | Hide unchanged monitor rows after evaluation |
| `marketMapMaxCompetitors` | integer | `10` | Up to 100 unique discovered sites |
| `maxConcurrency` | integer | `10` | 1–50 websites processed in parallel |
| `proxyConfiguration` | object | Actor default | Optional connection configuration; use the default in Apify Console |

### 📦 Outputs and table views

The output menu has four destinations. Choose **Results** to browse website data, then switch topics using the tabs above the table. **Overview** starts with eight headline metrics; detailed fields remain available in the topic views and dataset export.

| Destination | Contains |
|---|---|
| **Results** | Website records and their topic views |
| **Market links** | Seed-to-competitor relationships from Market map |
| **Errors** | Failed lookups, stored separately and never charged as results |
| **Run summary** | Counts, timing, filters and workflow details |

Within **Results**, use these topic tabs. Start with **Competitors** for competitor discovery and **Website** for Domain SEO; traffic metrics belong to workflows that collect traffic data.

| Output | Contains |
|---|---|
| **Overview** | Website, monthly visits, growth, global rank, leading country, top channel, bounce rate and status |
| **Traffic** | Traffic history, growth and engagement |
| **Channels** | Source percentages, concentration, and diversity |
| **Countries** | Leading country plus country names, codes and audience shares |
| **Keywords** | Leading term plus keyword text, volume, CPC and source-estimated value |
| **AI traffic** | AI share, chatbot distribution and available prompts |
| **Competitors** | Similar websites, direct competitors, tags, apps, and Similarweb's ranked competitive set |
| **Demographics** | Age and gender, audience topics and other visited sites |
| **Referrals** | Incoming referrers, outgoing destinations and totals |
| **Ads & tech** | Advertising publishers, social networks and technology providers |
| **Ranks** | Global, country and category rankings and their history |
| **Website** | Preview, category, company, WHOIS, technologies and collection details |
| **Compare** | Leaders, shares and gaps between compared websites |
| **Changes** | Baselines and material changes from Monitor |
| **Market** | Enriched seed and competitor websites |

Demographics, Referrals, Ads & tech and rank history use the Complete profile data. Compare, Changes and Market show their corresponding workflow results. Switching views does not collect data or create additional charges. Export the full dataset to keep all original fields; display presets do not remove stored values.

### 📤 Website overview example

Illustrative result fragment showing the field structure:

```json
{
  "domain": "demo-site.test",
  "mode": "base_data",
  "snapshotDate": "2026-07-01T00:00:00+00:00",
  "globalRank": 18420,
  "estimatedMonthlyVisits": {
    "2026-05-01": 220000,
    "2026-06-01": 238000,
    "2026-07-01": 245000
  },
  "latestMonthlyVisits": 245000,
  "previousMonthlyVisits": 238000,
  "trafficChangePercent": 2.94,
  "trafficTrend": "stable",
  "bounceRatePercent": 41.2,
  "pagesPerVisit": 3.84,
  "timeOnSiteSeconds": 176.5,
  "directPercent": 31.0,
  "organicSearchPercent": 46.0,
  "aiTrafficPercent": 2.1,
  "topTrafficChannel": "Organic search",
  "topCountryCode": "US",
  "topKeyword": "demo analytics",
  "topAiPlatform": "chatgpt.com",
  "dataCompletenessScore": 92,
  "riskFlags": [],
  "status": "ok"
}
```

Traffic values are estimates tied to the source snapshot date, not real-time analytics or exact first-party measurements.

### 🔌 API examples

Set the `APIFY_TOKEN` environment variable to your Apify API token. These examples use Bash syntax.

Start a run:

```bash
curl -X POST "https://api.apify.com/v2/acts/trakk~similarweb-scraper/runs" \
  -H "Authorization: Bearer $APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"domains":["python.org","docker.com"],"mode":"base_data","maxConcurrency":2}'
```

Run synchronously and receive dataset items:

```bash
curl -X POST "https://api.apify.com/v2/acts/trakk~similarweb-scraper/run-sync-get-dataset-items" \
  -H "Authorization: Bearer $APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"domains":["nytimes.com","theguardian.com","cnn.com"],"mode":"compare"}'
```

For larger jobs, start an asynchronous run and consume the output URLs returned with the run. Dataset items can be exported as JSON, JSONL, CSV, Excel, XML, HTML, or RSS.

### ⚙️ Following a run

- Completed website profiles appear in the dataset during collection.
- Compare and Market map calculate shares across the collected group before saving their final rows.
- **Run summary** shows saved results, partial records, errors, filtered checks and elapsed time.
- `ok` identifies a successful collection; `partial` keeps the available data and explains missing parts in `notes`. Failed lookups appear in **Errors**.

Start with the default **512 MB** run configuration. Duration depends on workflow depth, the number of websites and source response times.

The run summary exposes `validDomains`, `scheduledDomains`, `skippedByChargeLimit`, and `details.chargeLimitReached`. If a budget limits a comparison or market map, its shares describe the collected group, not the websites that were not processed.

### ❓ FAQ

#### Do old inputs still work?

Yes. `base_data`, `similar_sites`, `aitdk`, and `all` keep their existing values and legacy nested fields. The new flat fields are additive.

#### Why is a field empty?

Public coverage varies by domain, size, source, and snapshot. Optional fields remain `null`, empty arrays, or empty objects instead of being guessed.

#### What happens if I enter something incorrectly?

Invalid website entries are skipped with a warning. If none remain, or an input setting is invalid, the Actor exits normally with zero results and an explanation in **Run summary** (`status: invalid_input`, `message`, `actionNeeded`), without requesting website data. Apify's input form can also reject incorrectly typed settings before a run starts. Diagnostic messages are not inserted into the paid results dataset.

#### Does a country or keyword view create extra billable results?

No. These views display arrays already stored inside a website result. They do not create new dataset items or trigger extra collection events.

#### Are failed domains mixed into my export?

No. Valid and partial results go to the default dataset. Failures go to **Errors** with a short reason such as `not_found`, `no_data`, or `source_unavailable`; they are not charged as collection results.

#### Does `onlyChanges` make unchanged monitoring checks free?

No. It filters unchanged rows from the result dataset after the Actor checks the source and compares the saved baseline. The run summary tells you exactly how many checks were filtered.

#### What does in-depth data cost me?

Nothing beyond the Complete profile's own result event. Websites with no in-depth
profile come back with `indepthStatus: "unavailable"` and a note, and are charged
exactly like any other row.

#### Why did in-depth data stop partway through my run?

Open **Run summary** and inspect `details.inDepth.stoppedBecause`. If the reason is
the run's spending limit, increase **Maximum charge per run** for the next collection.
If a profile is unavailable from the source, review the returned `notes` and retry
that website later. Other collected website data remains available.

#### Why are some referrers missing from the in-depth lists?

Similarweb withholds part of those lists from anonymous visitors and ships the withheld
entries with an empty domain. Exporting them would put blank rows in your spreadsheet, so
they are dropped and counted in `indepthWithheldRows`. The `incomingReferrerCount` and
`outgoingReferrerCount` totals still reflect the full figure the source reports.

#### Is technology detection definitive?

No. It reports signatures present on the public homepage. Server-side and hidden technologies may not be visible.

#### Which examples can I run?

The input examples use real websites and can be copied into **Input → JSON**. The result fragments use illustrative values and reserved `.test` domains to explain the field structure. A live run returns the latest data available from its sources.

# Actor input Schema

## `mode` (type: `string`):

Overview is fastest. Complete profile also collects competitor discovery, WHOIS, homepage keywords, company metadata, and detected technologies.

## `domains` (type: `array`):

For Compare, the first domain is the primary website. For Market map, these are seed websites.

## `includeInDepth` (type: `boolean`):

Part of the Complete intelligence profile at no extra charge: audience age and gender, Similarweb's own ranked competitors, incoming and outgoing referring domains, advertising publishers, technology providers, social split, rank history and traffic by country. Turn it off for a faster, lighter Complete profile. Other workflows do not collect it.

## `maxDomains` (type: `integer`):

Stops unexpectedly large pasted lists before they consume time or budget. It does not create extra results.

## `monitorName` (type: `string`):

Use the same name in future runs to compare against the stored baseline, for example weekly-competitors.

## `monitorDepth` (type: `string`):

Traffic overview is faster and cheaper. Complete profile tracks all available website intelligence.

## `changeThreshold` (type: `string`):

Controls the minimum relative traffic/rank change and acquisition-channel shift reported as material.

## `onlyChanges` (type: `boolean`):

After the baseline run, omit unchanged rows from the main dataset. Every valid monitoring check is still charged.

## `marketMapMaxCompetitors` (type: `integer`):

Maximum number of unique competitor websites to auto-enrich across all seed domains. Seed domains are added separately.

## `maxConcurrency` (type: `integer`):

Number of websites processed at the same time. Lower it if a custom proxy is rate-limited.

## `proxyConfiguration` (type: `object`):

Apify Residential is recommended for reliable results. Direct mode is intended only for development.

## Actor input object example

```json
{
  "mode": "base_data",
  "domains": [
    "apify.com",
    "example.com"
  ],
  "includeInDepth": true,
  "maxDomains": 10000,
  "monitorName": "my-monitor",
  "monitorDepth": "base_data",
  "changeThreshold": "medium",
  "onlyChanges": false,
  "marketMapMaxCompetitors": 10,
  "maxConcurrency": 10,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL"
    ]
  }
}
```

# Actor output Schema

## `results` (type: `string`):

Website data. Use the topic tabs to explore traffic, audience, search, competitors and workflow analysis.

## `marketRelationships` (type: `string`):

The seed-to-competitor edge list, in its own dataset, ready to load into a graph tool.

## `errors` (type: `string`):

Websites that could not be collected, with a specific reason each. These live in a separate dataset and are never billed as results.

## `runSummary` (type: `string`):

OUTPUT: counts, timing, what was skipped and why, and where each part of this run's data ended up.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "domains": [
        "apify.com"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("trakk/similarweb-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "domains": ["apify.com"] }

# Run the Actor and wait for it to finish
run = client.actor("trakk/similarweb-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "domains": [
    "apify.com"
  ]
}' |
apify call trakk/similarweb-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,trakk/similarweb-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/BBX2Pjax6ghxvPBqV/builds/2A1o6EbLWLl3Itcx9/openapi.json