# Builtwith Domain Scraper (`gordian/builtwith-domain-scraper`) Actor

Instantly reveal the technology stack, company details, and historical data behind any website. Ideal for competitive analysis, market research, and sales intelligence.

- **URL**: https://apify.com/gordian/builtwith-domain-scraper.md
- **Developed by:** [Gordian](https://apify.com/gordian) (community)
- **Categories:** Developer tools, Lead generation, SEO tools
- **Stats:** 54 total users, 2 monthly users, 100.0% runs succeeded, 5 bookmarks
- **User rating**: No ratings yet

## Pricing

Pay per event

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

BuiltWith Domain Scraper is an Apify Actor that extracts comprehensive technology profiles from BuiltWith.com for any domain. Get detailed insights into the tech stack, performance metrics, company information, and relationships of any website.

### 🎯 Why scrape BuiltWith?

Use cases:

- **Competitive Analysis** - Discover what technologies your competitors are using and find technology gaps
- **Lead Generation** - Identify companies using specific technologies for targeted outreach
- **Market Research** - Analyze technology adoption trends across industries
- **Sales Intelligence** - Build targeted prospect lists based on tech stack
- **Investment Research** - Evaluate a company's technical infrastructure before investment decisions

### ✨ What can BuiltWith Domain Scraper do?

This Actor allows you to:

- **Extract Technology Stacks** - Get all technologies detected on a website, grouped by category (Analytics, Widgets, Frameworks, CDN, etc.)
- **Historical Technology Data** - See when technologies were first and last detected, including removed technologies
- **Company Information** - Retrieve company name, location, employee estimates, and industry vertical
- **Rankings & Metrics** - Get BuiltWith rank, PageRank, Tranco rank, and Majestic rank
- **Performance Analysis** - Extract load performance metrics, performance scores, and identified issues
- **Product/eCommerce Data** - Scrape product listings, SKUs, and eCommerce platform information
- **Redirects & Relationships** - Discover inbound/outbound redirects and related sites with shared attributes
- **Social Links** - Extract all social media profile links

### 🚀 How to scrape BuiltWith?

1. Make a free Apify account here: [https://console.apify.com/sign-up](https://console.apify.com/sign-up?fpr=7p4wu)
2. Click on "Try for free"
3. Enter the domains you want to analyze (e.g., `apify.com`, `google.com`)
4. Select which data types to scrape (technologies, performance, company info, etc.)
5. Click "Start" and wait for the Actor to complete
6. Download your data in JSON, CSV or Excel format

### 💡 What data will you receive?

BuiltWith Domain Scraper extracts detailed information for each domain:

| Field                    | Description                                                  |
| ------------------------ | ------------------------------------------------------------ |
| **domain**               | The analyzed domain                                          |
| **technologies**         | Technologies grouped by category with descriptions and icons |
| **detailedTechnologies** | Historical technology data with first/last detection dates   |
| **companyName**          | Company or organization name                                 |
| **vertical**             | Business vertical/industry                                   |
| **estimatedEmployees**   | Estimated employee count range                               |
| **builtWithRank**        | BuiltWith popularity ranking                                 |
| **pageRank**             | Google PageRank score                                        |
| **trancoRank**           | Tranco list ranking                                          |
| **majesticRank**         | Majestic ranking                                             |
| **socialLinks**          | Social media profile URLs                                    |
| **loadPerformance**      | Page load performance metrics                                |
| **performanceScore**     | Overall performance score                                    |
| **performanceIssues**    | Identified performance problems                              |
| **products**             | Product listings with prices and SKUs                        |
| **ecommercePlatform**    | Detected eCommerce platform                                  |
| **inboundRedirects**     | Domains redirecting to this site                             |
| **outboundRedirects**    | Domains this site redirects to                               |
| **relatedSites**         | Sites sharing attributes (IPs, analytics, etc.)              |
| **recommendations**      | Technology recommendations by category                       |

#### Output example

```json
{
	"domain": "apify.com",
	"technologies": [
		{
			"category": "Analytics and Tracking",
			"categoryLink": "https://trends.builtwith.com/analytics",
			"technologies": [
				{
					"name": "Hubspot",
					"description": "Hubspot provides marketing information and leads via inbounding marketing software.",
					"link": "https://trends.builtwith.com/analytics/Hubspot",
					"icon": "https://x.cdnpi.pe/serve/CmBSWOMPjh6lEXhc/hubspot.com",
					"categories": [
						"CRM",
						"Marketing Automation"
					],
					"isSubTechnology": false
				},
				{
					"name": "HubSpot Analytics",
					"description": "Measure the performance of all your marketing campaigns",
					"link": "https://trends.builtwith.com/analytics/HubSpot-Analytics",
					"icon": "https://x.cdnpi.pe/serve/CmBSWOMPjh6lEXhc/hubspot.com",
					"categories": [],
					"isSubTechnology": true
				}
			]
		},
		{
			"category": "Widgets",
			"categoryLink": "https://trends.builtwith.com/widgets",
			"technologies": [
				{
					"name": "Algolia",
					"description": "Algolia's Search API makes it possible to deliver a search experience in your apps & websites.",
					"link": "https://trends.builtwith.com/widgets/Algolia",
					"icon": "https://x.cdnpi.pe/serve/4kUPDERPM5pGPuLi/algolia.com",
					"categories": [
						"Site Search"
					],
					"isSubTechnology": false
				},
				{
					"name": "Intercom",
					"description": "Intercom is a customer relationship management and messaging tool for web app owners",
					"link": "https://trends.builtwith.com/widgets/Intercom",
					"icon": "https://x.cdnpi.pe/serve/aaoiZOOM9MtraRiR/intercom.io",
					"categories": [
						"Feedback Forms and Surveys",
						"Ticketing System"
					],
					"isSubTechnology": false
				}
			]
		}
	],
	"detailedTechnologies": [
		{
			"category": "Analytics and Tracking",
			"technologies": [
				{
					"name": "Hubspot",
					"link": "https://trends.builtwith.com/analytics/Hubspot",
					"categories": [
						"CRM",
						"Marketing Automation"
					],
					"firstDetected": "Apr 2021",
					"lastDetected": "Dec 2025",
					"isPremium": true,
					"isRemoved": false,
					"isSubTechnology": false
				},
				{
					"name": "HubSpot Analytics",
					"link": "https://trends.builtwith.com/analytics/HubSpot-Analytics",
					"categories": [],
					"firstDetected": "Jun 2021",
					"lastDetected": "Aug 2025",
					"isPremium": true,
					"isRemoved": false,
					"isSubTechnology": true
				}
			]
		},
		{
			"category": "Widgets",
			"technologies": [
				{
					"name": "Upgrade to Advanced",
					"link": "https://builtwith.com/checkout/advanced",
					"categories": [
						"Site Search"
					],
					"firstDetected": "Aug 2019",
					"lastDetected": "Dec 2025",
					"isPremium": true,
					"isRemoved": false,
					"isSubTechnology": false
				},
				{
					"name": "Upgrade to Advanced",
					"link": "https://builtwith.com/checkout/advanced",
					"categories": [
						"Feedback Forms and Surveys",
						"Ticketing System"
					],
					"firstDetected": "Oct 2017",
					"lastDetected": "Nov 2025",
					"isPremium": true,
					"isRemoved": false,
					"isSubTechnology": false
				}
			]
		}
	],
	"builtWithRank": 64468,
	"pageRank": 26675,
	"trancoRank": 32279,
	"majesticRank": 34225,
	"socialLinks": [
		"https://twitter.com/apify",
		"https://facebook.com/apifytech",
		"https://github.com/apify",
		"https://instagram.com/apifytech",
		"https://linkedin.com/company/apifytech",
		"https://x.com/apify",
		"https://tiktok.com/@apifytech"
	],
	"brandFollowers": 816,
	"estimatedEmployees": "-",
	"vertical": "Business And Industrial",
	"companyName": "Apify",
	"firstIndexed": "February 2011",
	"countries": [
		{
			"country": "Czech Republic",
			"info": "Website Main Address"
		},
		{
			"country": "United States",
			"info": "Domain TLD"
		},
		{
			"country": "Italy",
			"info": "Redirect TLD"
		}
	],
	"loadPerformance": [
		{
			"name": "GET Requests (requests)",
			"value": 165
		},
		{
			"name": "JavaScript Requests (requests)",
			"value": 83
		},
		{
			"name": "Stylesheet Requests (requests)",
			"value": 1
		},
		{
			"name": "Document Size (bytes)",
			"value": 3050271
		},
		{
			"name": "HTML Size (bytes)",
			"value": 52652
		},
		{
			"name": "Maximum Server Latency (ms)",
			"value": 321.11
		},
		{
			"name": "Maximum Round Trip Time (ms)",
			"value": 29.78
		}
	],
	"pagePerformance": [
		{
			"name": "First Render",
			"description": "The performance of rendering the webpage to the end user."
		},
		{
			"name": "Render Blocking Scripts",
			"description": "Scripts that block rendering of content to the page."
		},
		{
			"name": "Layout Shift",
			"description": "The shifting of the content of the page as it loads images and other resources."
		},
		{
			"name": "Page Redirects",
			"description": "Resource that delay by redirecting to other resources before loading."
		},
		{
			"name": "HTTP2",
			"description": "HTTP2 providers performance improvements over HTTP1."
		},
		{
			"name": "Text Compression",
			"description": "Gzip and other compression algorithms to render content."
		},
		{
			"name": "Minified JavaScript",
			"description": "Compressed and minified JavaScript resources."
		},
		{
			"name": "Minified CSS",
			"description": "Compressed and minified CSS resources."
		},
		{
			"name": "Duplicate JavaScript",
			"description": "JavaScript duplication across the site."
		},
		{
			"name": "Unused CSS",
			"description": "CSS rules not used by the webpage."
		}
	],
	"performanceScore": 0.84,
	"performanceIssues": [
		{
			"name": "🎨 Color Contrast",
			"description": "The page has contrast issues which may affect accessibility. 58% of sites tested have this issue.",
			"percentAffected": 0.58
		},
		{
			"name": "🖼 Image Sizes",
			"description": "Images on the page don't have width, height or aspect ratio. 72% of sites tested have this issue.",
			"percentAffected": 0.72
		}
	],
	"products": [],
	"productCategories": [],
	"recommendations": [
		{
			"name": "HubSpot WordPress Plugin",
			"category": "Widgets",
			"description": "Customer interaction tracking for WordPress by HubSpot."
		},
		{
			"name": "Heartbeat",
			"category": "Widgets",
			"description": "Heartbeat is a platform that allows users to create and host conversations, events, content and more on their own domain. It provides users with the tools to create a highly customized online community."
		}
	],
	"inboundRedirects": [
		{
			"domain": "apify.com.au",
			"country": "AU",
			"firstDetected": "Sep 2025",
			"lastDetected": "Nov 2025"
		},
		{
			"domain": "apify.de",
			"country": "DE",
			"firstDetected": "Jun 2018",
			"lastDetected": "Sep 2024"
		},
		{
			"domain": "apify.dev",
			"firstDetected": "Mar 2019",
			"lastDetected": "Nov 2020"
		}
	],
	"outboundRedirects": [],
	"redirectCountries": [
		"AU"
	],
	"relatedSites": [
		{
			"domain": "help.apify.com",
			"sharedAttributes": [
				{
					"type": "GTM",
					"value": "GTM-MNGXGGB",
					"firstDetected": "Aug 2020",
					"lastDetected": "Dec 2022",
					"overlapDuration": "2 years, 132 days"
				},
				{
					"type": "IC",
					"value": "IC-KOD1R788",
					"firstDetected": "Mar 2022",
					"lastDetected": "Sep 2022",
					"overlapDuration": "208 days"
				},
				{
					"type": "KM",
					"value": "KM-7575C23896ADFCE07AAF490B01A9664A83E0CFBA",
					"firstDetected": "Mar 2022",
					"lastDetected": "Sep 2022",
					"overlapDuration": "208 days"
				}
			]
		},
		{
			"domain": "securitybyobscurity.apify.com",
			"sharedAttributes": [
				{
					"type": "GTM",
					"value": "GTM-MNGXGGB",
					"firstDetected": "Oct 2021",
					"lastDetected": "Apr 2024",
					"overlapDuration": "2 years, 166 days"
				},
				{
					"type": "GTM",
					"value": "GTM-MNGXGGB\\",
					"firstDetected": "Jun 2024",
					"lastDetected": "Nov 2025",
					"overlapDuration": "1 year, 142 days"
				}
			]
		}
	]
}
```

### 📥 Input

The Actor accepts these input parameters:

| Parameter                    | Type    | Required | Default | Description                               |
| ---------------------------- | ------- | -------- | ------- | ----------------------------------------- |
| `domains`                    | array   | Yes      | -       | List of domains to scrape                 |
| `scrapeTechnologies`         | boolean | No       | `true`  | Scrape main technologies overview         |
| `scrapeDetailedTechnologies` | boolean | No       | `true`  | Scrape detailed tech with historical data |
| `scrapeMeta`                 | boolean | No       | `true`  | Scrape rankings and social links          |
| `scrapeCompany`              | boolean | No       | `true`  | Scrape company information                |
| `scrapePerformance`          | boolean | No       | `true`  | Scrape performance metrics                |
| `scrapeProducts`             | boolean | No       | `true`  | Scrape product/eCommerce data             |
| `scrapeRecommendations`      | boolean | No       | `true`  | Scrape technology recommendations         |
| `scrapeRedirects`            | boolean | No       | `true`  | Scrape redirect information               |
| `scrapeRelationships`        | boolean | No       | `true`  | Scrape related sites                      |

#### Input example

```json
{
    "domains": ["apify.com", "crunchbase.com"],
    "scrapeTechnologies": true,
    "scrapeDetailedTechnologies": true,
    "scrapeMeta": true,
    "scrapeCompany": true,
    "scrapePerformance": true,
    "scrapeProducts": true,
    "scrapeRecommendations": true,
    "scrapeRedirects": true,
    "scrapeRelationships": true
}
```

### 💰 How much does it cost to scrape BuiltWith?

This actor is cost-effective. Check the "Pricing" tab for more details.

With Apify's **free tier**, you get $5 of platform credits monthly for free, which you can use to test this actor.

Do you need to scrape more? [Upgrade to a paid plan](https://apify.com/pricing?fpr=7p4wu) which includes more platform credits and discounted pricing.

**Tips**:

- Provide multiple URLs in your input, that way you only pay the actor start cost once.
- If you are doing a large run, consider increasing the RAM used per run to scrape faster. When doing a small run decrease the RAM used to reduce the actor start costs.
- Upgrade to a higher plan to get discounted pricing. Link: [https://apify.com/pricing](https://apify.com/pricing?fpr=7p4wu)

### 🔗 Integrate with your workflows

This Actor integrates seamlessly with:

- **Automation platforms** - Build no code workflows with [Make.com](https://www.make.com/en/register?pc=louisdeconinck), n8n, and Zapier
- **Webhooks** - Trigger actions when scraping completes through [webhooks](https://docs.apify.com/platform/integrations/webhooks?fpr=7p4wu)
- **Schedulers** - Run weekly to monitor competitor tech changes with Apify's [Scheduler](https://docs.apify.com/schedules?fpr=7p4wu)
- **API** - Start runs and access data programmatically with the [Apify API](https://docs.apify.com/api/v2#/reference/actors/run-collection/run-actor?fpr=7p4wu)
- **Google Sheets** - Export directly to spreadsheets for analysis
- **CRM Integration** - Enrich lead data with technology information

### 👥 Who made this Actor?

Gordian is a specialised Apify web scraping agency founded by Louis Deconinck.

Louis is a top 1% Apify developer, Oxford University IT graduate, and creator of 70+ scrapers used by 1,000+ data professionals every month. He has scraped 10,000,000+ pages bypassing the most advanced anti-scraping protections.

- Apify AI Agent Hackathon Winner
- 300+ contributions in Apify Discord
- Former senior data engineer in EU banking

Looking for a custom data solution? Get in touch.

### ❓ FAQ

#### Is it legal to scrape BuiltWith?

Yes, web scraping publicly available data is legal. This scraper only extracts information that is publicly visible on BuiltWith.com.

For more information on web scraping legality, read this blog post: [Is web scraping legal?](https://blog.apify.com/is-web-scraping-legal?fpr=7p4wu)

#### Can I export data to CSV or Excel?

Yes, Apify supports exporting dataset results in multiple formats: JSON, CSV, Excel (XLSX), HTML, XML and RSS.

#### What happens if BuiltWith changes their website?

We monitor the site's structure and update the Actor when changes occur. If you encounter issues, please report them in the Issues tab.

#### How many domains can I scrape at once?

There's no hard limit. The Actor processes domains sequentially, so more domains will take longer. For large batches (1000+ domains), consider splitting into multiple runs.

#### Why are some fields empty?

Not all domains have data for every field. For example, only eCommerce sites will have product data, and not all sites have performance metrics available on BuiltWith.

#### How do I get started?

[Make a free Apify account](https://console.apify.com/sign-up?fpr=7p4wu) to claim your free $5 usage and start scraping today by clicking "Try for free".

# Actor input Schema

## `domains` (type: `array`):

List of domains to scrape from BuiltWith (e.g., apify.com, google.com). Enter domains without https:// prefix.

## `scrapeTechnologies` (type: `boolean`):

Scrape the main technologies overview page

## `scrapeDetailedTechnologies` (type: `boolean`):

Scrape detailed technology information with historical data

## `scrapeMeta` (type: `boolean`):

Scrape rankings, social links, and website info

## `scrapeCompany` (type: `boolean`):

Scrape company name, first indexed date, and country information

## `scrapePerformance` (type: `boolean`):

Scrape load performance metrics and page performance analysis

## `scrapeProducts` (type: `boolean`):

Scrape product listings and eCommerce information

## `scrapeRecommendations` (type: `boolean`):

Scrape technology recommendations by category

## `scrapeRedirects` (type: `boolean`):

Scrape inbound and outbound redirect information

## `scrapeRelationships` (type: `boolean`):

Scrape sites with shared attributes and relationships

## Actor input object example

```json
{
  "domains": [
    "apify.com"
  ],
  "scrapeTechnologies": true,
  "scrapeDetailedTechnologies": true,
  "scrapeMeta": true,
  "scrapeCompany": true,
  "scrapePerformance": true,
  "scrapeProducts": true,
  "scrapeRecommendations": true,
  "scrapeRedirects": true,
  "scrapeRelationships": true
}
```

# Actor output Schema

## `overview` (type: `string`):

Summary of all scraped domains with company info and rankings

## `technologies` (type: `string`):

All detected technologies grouped by category

## `rankings` (type: `string`):

Domain rankings and social media links

## `performance` (type: `string`):

Load performance metrics and issues

## `products` (type: `string`):

Product listings and eCommerce platform information

## `relationships` (type: `string`):

Related sites and redirect information

## `fullData` (type: `string`):

Complete raw data for all domains

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "domains": [
        "apify.com"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("gordian/builtwith-domain-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "domains": ["apify.com"] }

# Run the Actor and wait for it to finish
run = client.actor("gordian/builtwith-domain-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "domains": [
    "apify.com"
  ]
}' |
apify call gordian/builtwith-domain-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,gordian/builtwith-domain-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/fV4Z2Wfsyup00CI9P/builds/QcqkiUiFkEoLttUZh/openapi.json