# BuiltWith Scraper -  Bulk Domain Analysis API (`datavoyantlab/builtwith-bulk-scraper`) Actor

BuiltWith scraper for bulk technology stack analysis. Extract CMS, frameworks, analytics, CDN, and payment processors from 1000+ domains. Perfect for competitor intelligence, market research, and lead generation.

- **URL**: https://apify.com/datavoyantlab/builtwith-bulk-scraper.md
- **Developed by:** [DataVoyantLab](https://apify.com/datavoyantlab) (community)
- **Categories:** Lead generation, SEO tools, Automation
- **Stats:** 55 total users, 0 monthly users, 100.0% runs succeeded, 3 bookmarks
- **User rating**: No ratings yet

## Pricing

Pay per event

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## BuiltWith Technology Intelligence - Bulk Domain Analyzer

> Extract technology stacks from BuiltWith.com for multiple domains. Perfect for market research, competitive intelligence, and lead generation.

### 🚀 Overview

Automatically extract comprehensive technology stack data from BuiltWith.com for hundreds or thousands of domains in a single run. This Actor scrapes 27+ technology categories including frameworks, CMS, analytics, CDN, payment processors, and more.

**Key Features:**

- ✅ **Bulk Processing** - Analyze up to 1000 domains per run
- ✅ **Pay-Per-Event Pricing** - Only pay for successfully scraped domains
- ✅ **High Performance** - 5 parallel requests for fast processing
- ✅ **Reliable** - Comprehensive error handling and retry logic
- ✅ **Structured Output** - Clean JSON data ready for analysis
- ✅ **Auto Proxy** - Built-in proxy rotation

### 📊 Example Output

```json
{
  "domain": "nike.com",
  "scrapedAt": "2025-01-10T12:00:00.000Z",
  "totalTechnologies": 159,
  "totalCategories": 18,
  "technologies": {
    "Analytics and Tracking": ["Google Analytics 4", "Segment", "Adobe Marketing Cloud"],
    "Frameworks": ["React", "Next.js", "Express"],
    "Content Delivery Network": ["Cloudflare", "Akamai", "CloudFront"],
    "Payment": ["Stripe", "PayPal", "Apple Pay"],
    "JavaScript Libraries and Functions": ["jQuery", "React", "lodash"],
    "Web Servers": ["nginx", "Apache"],
    "Web Hosting Providers": ["Amazon", "Google Cloud"]
  },
  "languages": ["English", "Spanish", "French"],
  "verifiedLinks": ["Facebook", "Twitter", "LinkedIn"],
  "seoTags": {
    "Header": ["SEO_H1", "SEO_H2"],
    "Meta": ["SEO_META_DESCRIPTION"]
  },
  "domainInfo": {
    "Name Server": ["Amazon Route 53"],
    "Registrar Services": ["MarkMonitor Registrar"]
  }
}
```

### 🎯 Use Cases

- **Competitive Intelligence**: Track competitor technology stacks
- **Market Research**: Analyze technology adoption trends by industry
- **Lead Generation**: Find companies using specific technologies (e.g., "Find all companies using Shopify")
- **Technology Trends**: Research emerging technologies and frameworks
- **Sales Intelligence**: Qualify leads based on their tech stack
- **Migration Analysis**: Identify companies using legacy technologies

### ⚙️ Input

**Required:**

- **`domains`** (array or string): List of domains to analyze (1-1000 domains)
  - Enter domains without `http://` or `https://`
  - Supports: JSON array, comma-separated list, or one domain per line

**Example:**

```json
{
  "domains": ["nike.com", "adidas.com", "shopify.com"]
}
```

### 📤 Output

**Data Fields:**

- `domain` (string) - The analyzed domain
- `scrapedAt` (string) - ISO timestamp of when data was scraped
- `totalTechnologies` (number) - Total count of technologies detected
- `totalCategories` (number) - Number of technology categories found
- `technologies` (object) - Technology categories with arrays of technology names
- `languages` (array) - Detected languages
- `verifiedLinks` (array) - Verified links found on the domain
- `seoTags` (object) - SEO metadata (headers, meta tags, titles)
- `domainInfo` (object) - Domain information (name servers, registrar, etc.)
- `metadata` (object) - Additional metadata (last detected, server location)
- `error` (string, optional) - Error message if scraping failed

**Output Formats:** JSON, CSV, Excel

### 💰 Pricing

**Pay-Per-Event (PPE) pricing** - you only pay for successfully scraped domains:

- **`DOMAIN_SCRAPED`** - Charged per successfully scraped domain
- Failed/invalid domains are **NOT** charged

**Example:** Scraping 100 domains with 95 successful results = 95 charges

### 🚀 Getting Started

1. Open the Actor in Apify Console
2. Enter your domains (array, comma-separated, or one per line)
3. Click **Run** and monitor progress
4. Download results from the Dataset tab

**Minimal Example:**

```json
{
  "domains": ["nike.com"]
}
```

### 📈 Output Views

Data is automatically saved to the dataset with three views:

- **Overview** - Summary with domain, total technologies, categories, and timestamp
- **Technologies Detail** - Technology breakdown by category
- **Full Data** - Complete dataset with all fields

### 🔍 Technology Categories

Extracts data from 27+ categories including:

- Advertising Platforms, Analytics & Tracking
- CDN Providers, CMS Platforms
- Frameworks (Frontend & Backend)
- JavaScript Libraries, Payment Processors
- SSL Certificates, Web Servers
- Hosting Providers, Email Hosting
- Mobile Technologies, Widgets & Plugins
- SEO Tools, Marketing Automation
- And more...

### 🆘 Troubleshooting

**No data found:**

- BuiltWith may not have data for this domain
- Check if domain exists and is accessible
- Try removing `www.` prefix

**Invalid domain:**

- Use format: `nike.com` (not `https://nike.com`)
- Remove trailing slashes
- Check for typos

### 🔒 Privacy & Compliance

This Actor scrapes publicly available data from BuiltWith.com. Ensure your use complies with BuiltWith Terms of Service and applicable data protection regulations (GDPR, CCPA, etc.).

# Actor input Schema

## `domains` (type: `array`):

List of domains to analyze (up to 1000). Enter domains without http:// or https:// (e.g., 'nike.com', 'adidas.com'). You can also paste a comma-separated list or one domain per line.

## Actor input object example

```json
{
  "domains": [
    "nike.com",
    "adidas.com",
    "google.com"
  ]
}
```

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "domains": [
        "nike.com",
        "adidas.com",
        "google.com"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("datavoyantlab/builtwith-bulk-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "domains": [
        "nike.com",
        "adidas.com",
        "google.com",
    ] }

# Run the Actor and wait for it to finish
run = client.actor("datavoyantlab/builtwith-bulk-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "domains": [
    "nike.com",
    "adidas.com",
    "google.com"
  ]
}' |
apify call datavoyantlab/builtwith-bulk-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,datavoyantlab/builtwith-bulk-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/SjCML5GjOQbLat6j8/builds/icShj17azZezxZ2y6/openapi.json