# Open Construction Estimate Scraper (`rigelbytes/openconstructionestimate-scraper`) Actor Scrape construction cost estimates from OpenConstructionEstimate. Export the full catalog, filter by search/category/price, or scrape individual estimate URLs. Optional detail pages include resources, machines, work steps, and cost breakdowns. - **URL**: https://apify.com/rigelbytes/openconstructionestimate-scraper.md - **Developed by:** [Rigel Bytes](https://apify.com/rigelbytes) (community) - **Categories:** - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $0.97 / 1,000 single results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event ## What's an Apify Actor? Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. - **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use). - **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`. - **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`. - **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`. - **Any other language** — the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Open Construction Estimate Scraper Extract **OpenConstructionEstimate** unit costs — names, EUR prices, categories, labor hours, and optional resource breakdowns — for bid research, estimating databases, and reconstruction planning. Search the catalog, filter by trade, or paste estimate URLs. Pay only **$1.00 per 1,000 estimates** (optional **$1.50 per 1,000 listing-details**). You do not pay platform compute. [![Open Construction Estimate Scraper — input to structured data](https://raw.githubusercontent.com/faizanalii/apify-actor-assets/main/openconstructionestimate-scraper/openconstructionestimate-scraper-value-demo.gif)](https://apify.com/rigelbytes/openconstructionestimate-scraper) *** ### What can Open Construction Estimate Scraper do for you? - **Search any trade** — Type queries such as `hydrojet`, `concrete`, or a catalog code like `PUNE_KAVO_KAPUPU_KARI` and collect matching estimates. - **Filter like the catalog UI** — Narrow by category, department, unit, price, labor hours, resource count, work steps, workers, cost structure, machines, and electricity. - **Paste catalog or estimate URLs** — Drop in `https://openconstructionestimate.com/estimates/` or a single item such as `/estimates/en/hydrojet-cleaning-concrete-surfaces/`. - **Export the full catalog** — Leave URLs and filters empty to scrape every published estimate, capped with `maxItems` if you want a predictable run. - **Optional listing details** — Turn on `scrapeListingDetails` to add resources, machines, work steps, and labor/equipment/electricity cost splits. - **Localized names** — Choose `language` (`en`, `de`, `fr`, `es`, `ru`, `zh`, `ar`, `hi`, `us`, `uk`) for titles, slugs, units, and category labels. ### What data can you extract from OpenConstructionEstimate? | Field | Description | |-------|-------------| | 🆔 **Code** | Stable catalog code (`code`) used for deduplication | | 🏷️ **Name** | Localized estimate title | | 🔗 **URL** | Public estimate page in the selected language | | 💰 **Price** | Unit cost in EUR (`price`, `currency`, `unit`) | | 📂 **Category** | Trade category and department | | ⏱️ **Labor hours** | Catalog labor hours and worker count | | 📊 **Cost mix** | Material, labor, and machine percentages | | 🧰 **Resources** | Resource rows (code, name, type, quantity, unit, price, total) when details are on | | 🚜 **Machines** | Machine rows with class, hours, and kWh when details are on | | 📋 **Work steps** | Numbered method steps from the estimate page | | 💵 **Cost breakdown** | Total, labor, equipment, material, electricity, and crew fields when details are on | | ✅ **Details flag** | `detailsScraped` shows whether the listing-details event applied | ### Why use this scraper? - **📊 Bid research** — Compare EUR unit costs for the same method (for example hydrojet cleaning at €2.69–€12.03 per m2) before you price a job. - **🏗️ Estimating databases** — Load catalog rows into your own cost library instead of copying the website by hand. - **🔍 Trade monitoring** — Schedule searches for earthworks, tunnels, or reconstruction categories and watch for new or updated positions. - **🧰 Resource planning** — With details on, see labor hours, machines, electricity, and work steps for each estimate. - **🤖 Automated exports** — Download JSON, CSV, Excel, or HTML from Apify, or pull results through the API. ### Pricing This Actor uses pay-per-event pricing. You are charged for data events, not platform compute. | Event | When it fires | No discount | Bronze | Silver | Gold | |-------|---------------|-------------|--------|--------|------| | `dataset-item` (Single result) | Every catalog estimate saved to the dataset | **$1.00 / 1,000** | $0.99 / 1,000 | $0.98 / 1,000 | $0.97 / 1,000 | | `listing-details` (Detailed Result) | Only when `scrapeListingDetails` is on and details are scraped | **$1.50 / 1,000** | $1.40 / 1,000 | $1.30 / 1,000 | $1.20 / 1,000 | - No hidden fees or limits on usage. - Apify plan discounts apply automatically based on your subscription tier. A catalog-only run (details off) costs **$1.00 per 1,000 estimates**. Enabling details adds a second event at **$1.50 per 1,000** when `detailsScraped` is true. *** ### How to use Open Construction Estimate Scraper 1. **Create an Apify account** — Sign up at [apify.com](https://apify.com) (free tier includes $5 monthly credit). 2. **Open the actor** — Go to the [Open Construction Estimate Scraper](https://apify.com/rigelbytes/openconstructionestimate-scraper) page. 3. **Choose a start** — Enter `searchQueries`, paste catalog/estimate `startUrls`, add `estimateCodes`, or leave them empty to export the full catalog. 4. **Add filters** — Optional categories, price range, units, labor hours, and cost-structure flags. 5. **Start the run** — Keep `scrapeListingDetails` off for catalog cards, or turn it on for resources and cost breakdowns. 6. **Export data** — Download the dataset as JSON, CSV, Excel, or HTML. ### Input | Field | Type | Required | Description | |-------|------|----------|-------------| | `startUrls` | Array of URLs | No | Catalog or estimate URLs, e.g. `https://openconstructionestimate.com/estimates/` or `https://openconstructionestimate.com/estimates/en/hydrojet-cleaning-concrete-surfaces/`. | | `searchQueries` | Array of strings | No | Match name, code, or slug (OR), e.g. `concrete`, `hydrojet`, `PUNE_KAVO_KAPUPU_KARI`. | | `estimateCodes` | Array of strings | No | Exact catalog codes such as `PUNE_KAVO_KAPUPU_KARI`. | | `categories` | Array of strings | No | Category names in any supported language (e.g. `Erdarbeiten`, `Earthworks`). | | `departments` | Array of strings | No | Subcategory / department names (e.g. `SONSTIGE ARBEITEN`). | | `units` | Array of strings | No | Units to keep (e.g. `m`, `m3`, `100 m2`). | | `minPrice` | Number | No | Inclusive EUR lower bound. | | `maxPrice` | Number | No | Inclusive EUR upper bound. | | `minLaborHours` | Number | No | Inclusive labor-hour lower bound. | | `maxLaborHours` | Number | No | Inclusive labor-hour upper bound. | | `minResources` | Integer | No | Inclusive resource-count lower bound. | | `maxResources` | Integer | No | Inclusive resource-count upper bound. | | `minWorkSteps` | Integer | No | Inclusive work-step lower bound. | | `maxWorkSteps` | Integer | No | Inclusive work-step upper bound. | | `minWorkers` | Integer | No | Inclusive worker-count lower bound. | | `maxWorkers` | Integer | No | Inclusive worker-count upper bound. | | `costStructure` | Array of strings | No | `material`, `labor`, and/or `machine` (material >40%, labor >40%, machine >25%). | | `hasMachines` | Boolean | No | Keep only estimates with machines (`true`) or without (`false`). | | `hasElectricity` | Boolean | No | Keep only estimates with electricity (`true`) or without (`false`). | | `sortBy` | String | No | `name-asc`, `price-asc`, `price-desc`, `resources-desc`, or `labor-desc` (default `name-asc`). | | `language` | String | No | `en`, `de`, `fr`, `es`, `ru`, `zh`, `ar`, `hi`, `us`, or `uk` (default `en`). | | `scrapeListingDetails` | Boolean | No | Visit each estimate page for resources, machines, work steps, and cost breakdown. Charges `listing-details`. Default `false`. | | `maxConcurrency` | Integer | No | Parallel detail requests (1–20, default `5`). | | `maxItems` | Integer | No | Maximum estimates to scrape (`0` = unlimited). | | `proxyConfiguration` | Proxy object | No | Residential proxies are recommended for catalog and detail requests. | #### 📝 Copy for Use: ```json { "searchQueries": ["hydrojet"], "language": "en", "scrapeListingDetails": true, "maxItems": 5, "maxConcurrency": 3, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } } ``` ### Why Choose This Scraper? - **💰 Affordable**: Pay only $1.00 per 1,000 catalog estimates, plus $1.50 per 1,000 listing-details when you enable full pages (as low as $0.97 and $1.20 per 1,000 with the Gold plan). - **📋 Comprehensive**: Extract code, name, EUR price, unit, category, labor hours, cost mix, and optional resources, machines, work steps, and cost breakdowns. - **⚡ Easy to Use**: Type a search, paste an OpenConstructionEstimate URL, or leave input empty to export the catalog — no site login required. - **🔒 Reliable**: Built for Apify residential proxies with fail-soft detail fetches so one missing page does not stop the run. ### Recommended Proxy Providers - ## **Shifter** - Reliable residential proxies all over the world. - Cheap rates - [Order Shifter Now](https://shifter.io/r/YoBB/order) - Get 10% Off any product, use coupan `rigelbytes-YoBB`. - ## **OxyLabs** - **100M+ Proxies** - Fastest proxies in the market - Real profile, human-like Residential IPs - Quality assurance framework for most reliable IPs - [Get Proxies](https://oxylabs.go2cloud.org/aff_c?offer_id=7\&aff_id=1366\&url_id=7) - ## **DataImpulse** - Covers **200+ Counties** - Reliable Residential Proxies for just $1/GB - [Get Residential Proxies](https://dataimpulse.com/?aff=89421) ### [![Learn More About Proxies](https://img.shields.io/badge/Learn_More-About_Proxies-blue?style=for-the-badge)](#understanding-proxies) ### 🙌 Why Buy Through Our Affiliate Link? - Exclusive Deals: Some providers may offer special discounts or bonuses when you use our link. - Support Our Work: Each purchase helps us maintain and improve the tools and services we provide. - No Extra Cost: You pay the same price, but part of it goes to supporting our efforts. #### Running via Apify Console You can run this actor from the Apify Console by providing the necessary input parameters. #### Running via API You can trigger this actor using the Apify API, passing the required input in the request body. ### API Examples #### Python ```shell from apify_client import ApifyClient client = ApifyClient("YOUR-APIFY-TOKEN") run_input = { "searchQueries": ["hydrojet"], "language": "en", "scrapeListingDetails": True, "maxItems": 5, "maxConcurrency": 3, "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"] } } run = client.actor("rigelbytes/openconstructionestimate-scraper").call(run_input=run_input) ``` #### JavaScript ```shell import { ApifyClient } from 'apify-client'; const client = new ApifyClient({ token: 'YOUR-APIFY-TOKEN' }); const runInput = { searchQueries: ["hydrojet"], language: "en", scrapeListingDetails: true, maxItems: 5, maxConcurrency: 3, proxyConfiguration: { useApifyProxy: true, apifyProxyGroups: ["RESIDENTIAL"] } }; const run = await client.actor("rigelbytes/openconstructionestimate-scraper").call(runInput); ``` #### cURL ```shell curl -X POST "https://api.apify.com/v2/acts/rigelbytes/openconstructionestimate-scraper/runs?token=YOUR-APIFY-TOKEN" \ -H "Content-Type: application/json" \ -d '{ "searchQueries": ["hydrojet"], "language": "en", "scrapeListingDetails": true, "maxItems": 5, "maxConcurrency": 3, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } }' ``` ### Scheduling & Deduplication **Scheduling.** OpenConstructionEstimate is a construction cost catalog, not a fast-moving marketplace. Use the Apify Console **Schedules** tab (or the Schedules API) to rerun this Actor: - **Weekly or monthly** for a full or filtered catalog snapshot (earthworks, tunnels, reconstruction). - **Daily** only when you need to catch newly published positions for a hot `searchQueries` term. - **On demand** for one-off bid research with a small `maxItems`. Create one schedule per `searchQueries` term if you want isolated datasets (e.g. `hydrojet` vs `earthworks`), or pass several queries in a single run. Keep `maxItems` set so each scheduled run has a predictable cap — especially if `scrapeListingDetails` is on. **Deduplication.** Each record has a stable `code` and `url`. A single run does not emit the same estimate twice. Across scheduled runs, point every run at the **same dataset** (`datasetId`) or deduplicate downstream by `code`: ```python seen = set() unique = [] for row in dataset: code = row.get("code") if code and code not in seen: seen.add(code) unique.append(row) ``` **Webhooks.** Attach an Apify webhook to `ACTOR.RUN.SUCCEEDED` to load new estimate rows into a sheet, warehouse, or estimating tool as soon as the run finishes. ### 🚀 Other Tools by Rigel Bytes Explore **166** more scraping tools by Rigel Bytes, organized by use case: #### 📱 Social Media Scrape Instagram, TikTok, LinkedIn, and more for content research and marketing intelligence. - **[Export Instagram Reels](https://apify.com/rigelbytes/export-instagram-reels)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Facebook Ads Scraper](https://apify.com/rigelbytes/facebook-ads-scraper)** — Extract posts, profiles, and engagement data from Facebook for content research, influencer tracking, and marketing analytics. - **[Instagram Analytics Tool](https://apify.com/rigelbytes/instagram-analytics-tool)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Comment Scraper](https://apify.com/rigelbytes/instagram-comment-scraper)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Creator Stats](https://apify.com/rigelbytes/instagram-creator-stats)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Engagement Tool](https://apify.com/rigelbytes/instagram-engagement-tool)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Post Scraper](https://apify.com/rigelbytes/instagram-post-scraper)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[instagram-posts](https://apify.com/rigelbytes/instagram-posts)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Profile Scraper](https://apify.com/rigelbytes/instagram-profile-scraper)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Instagram Reel Scraper](https://apify.com/rigelbytes/instagram-reel-scraper)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[linkedin-company-details](https://apify.com/rigelbytes/linkedin-company-details)** — Extract posts, profiles, and engagement data from LinkedIn for content research, influencer tracking, and marketing analytics. - **[Linkedin Company Scraper](https://apify.com/rigelbytes/linkedin-company-scraper)** — Extract posts, profiles, and engagement data from LinkedIn for content research, influencer tracking, and marketing analytics. - **[LinkedIn Job Scraper](https://apify.com/rigelbytes/linkedin-job-scraper)** — Extract posts, profiles, and engagement data from LinkedIn for content research, influencer tracking, and marketing analytics. - **[LinkedIn Profile Scraper](https://apify.com/rigelbytes/linkedin-profile-scraper)** — Extract posts, profiles, and engagement data from LinkedIn for content research, influencer tracking, and marketing analytics. - **[Reddit Comment Scraper](https://apify.com/rigelbytes/reddit-comment-scraper)** — Scrape comments from Reddit post URLs. Uses a stealth browser session with a sticky residential proxy — no Reddit... - **[Reddit Profile Scraper](https://apify.com/rigelbytes/reddit-profile-scraper)** — Scrape Reddit user profiles — overview, posts, and comments. Uses CloakBrowser with a sticky residential proxy to... - **[Reddit Community Scraper](https://apify.com/rigelbytes/reddit-scraper)** — Scrape posts from any Reddit community (subreddit). Bypasses captcha automatically and extracts post data including... - **[Scrape Instagram Creators](https://apify.com/rigelbytes/scrape-instagram-creators)** — Extract posts, profiles, and engagement data from Instagram for content research, influencer tracking, and marketing analytics. - **[Social Media Content Outlier Finder](https://apify.com/rigelbytes/social-media-content-outlier)** — Find unusually successful organic content across Instagram, TikTok, YouTube, Reddit, and LinkedIn by comparing each... - **[Tiktok Comment Scraper](https://apify.com/rigelbytes/tiktok-comment-scraper)** — Extract posts, profiles, and engagement data from TikTok for content research, influencer tracking, and marketing analytics. - **[Tiktok Creator Stats](https://apify.com/rigelbytes/tiktok-creator-stats)** — Extract posts, profiles, and engagement data from TikTok for content research, influencer tracking, and marketing analytics. - **[Tiktok Engagement Rate](https://apify.com/rigelbytes/tiktok-engagement-rate)** — Extract posts, profiles, and engagement data from TikTok for content research, influencer tracking, and marketing analytics. - **[TikTok Profile Scraper](https://apify.com/rigelbytes/tiktok-profile-scraper)** — Extract posts, profiles, and engagement data from TikTok for content research, influencer tracking, and marketing analytics. - **[Twitter X Profile Scraper](https://apify.com/rigelbytes/twitter-x-profile-scraper)** — Extract posts, profiles, and engagement data from Twitter/X for content research, influencer tracking, and marketing analytics. - **[YouTube Channel Scraper](https://apify.com/rigelbytes/youtube-channel-scraper)** — Extract posts, profiles, and engagement data from YouTube for content research, influencer tracking, and marketing analytics. - **[YouTube Comment Scraper](https://apify.com/rigelbytes/youtube-comment-scraper)** — Extract posts, profiles, and engagement data from YouTube for content research, influencer tracking, and marketing analytics. - **[YouTube Transcript Export](https://apify.com/rigelbytes/youtube-transcript-export)** — Extract posts, profiles, and engagement data from YouTube for content research, influencer tracking, and marketing analytics. #### 🏠 Real Estate Extract property listings, prices, and agent data from top real estate platforms. - **[Aengevelt Scraper — German Real Estate Property Listings](https://apify.com/rigelbytes/aengevelt-scraper)** — Extract property listings from Aengevelt Immobilien. Get pricing, location, contact data, and images from Germany's... - **[Airbnb Address Finder](https://apify.com/rigelbytes/airbnb-address-finder)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Availability Calendar](https://apify.com/rigelbytes/airbnb-availability-calendar)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Detailed Scraper - Search & Listing Details](https://apify.com/rigelbytes/airbnb-detailed-scraper)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Images Downloader](https://apify.com/rigelbytes/airbnb-images-downloader)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Listing](https://apify.com/rigelbytes/airbnb-listing)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Listing Urls](https://apify.com/rigelbytes/airbnb-listing-urls)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Property Details](https://apify.com/rigelbytes/airbnb-property-details)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Reviews](https://apify.com/rigelbytes/airbnb-reviews)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Airbnb Scraper - Search & Listing Details](https://apify.com/rigelbytes/airbnb-scraper)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Apartments.com Scraper](https://apify.com/rigelbytes/apartments-scraper)** — Scrape rental listings from apartments.com by entering location search queries. Returns property details including... - **[Aqar.fm Scraper — النسخة العربية](https://apify.com/rigelbytes/aqar-fm-scraper)** — Scrapes Saudi real estate listings from aqar.fm via Next.js RSC search API. Supports Arabic search paths, start... - **[Asunnot Oikotie.fi Real Estate Scraper](https://apify.com/rigelbytes/asunnot-oikotie-fi)** — Scrape Finnish property listings from asunnot.oikotie.fi by location, filters, or search/listing URLs. Optionally... - **[Bayut Scraper](https://apify.com/rigelbytes/bayut-scraper)** — Scrape property listings and market data from Bayut for market research, price monitoring, and investment analysis. - **[BNP Paribas Real Estate Scraper](https://apify.com/rigelbytes/bnppre-scraper)** — Scrape commercial property listings from BNP Paribas Real Estate (bnppre.de) — offices, retail, industrial, and... - **[Boliga Denmark Real Estate Scraper](https://apify.com/rigelbytes/boliga-dk-scraper)** — Scrape property listings from Boliga.dk (Denmark). Search by zip code, free text, or result URLs. Optionally fetch... - **[Boligsiden.dk Scraper](https://apify.com/rigelbytes/boligsiden-dk-scraper)** — Scrape Danish real estate listings from Boligsiden.dk — for sale, sold, and rental properties with pricing, details,... - **[CBRE Scraper — Extract German Commercial Property Listings](https://apify.com/rigelbytes/cbre-scraper)** — Scrape commercial real estate letting listings from CBRE Germany (cbre.de). Office & industrial property data for... - **[Colliers Scraper — German Commercial Property Listings](https://apify.com/rigelbytes/colliers-scraper)** — Extract commercial property listings from Colliers.de — offices, industrial, retail & logistics with pricing, map... - **[Crexi Scraper](https://apify.com/rigelbytes/crexi-scraper)** — Scrape Crexi.com commercial real estate listings for sale and lease with filters, search queries, URLs, and optional... - **[Daft.ie Property Scraper](https://apify.com/rigelbytes/daft-ie-scraper)** — Scrapes property listings from Daft.ie including residential, rental, commercial, and new homes across Ireland. - **[DAHLER Real Estate Scraper — German Property Listings API](https://apify.com/rigelbytes/dahler-scraper)** — Extract buy and rent property listings from DAHLER Immobilien across Germany, Austria, and Spain. Get prices,... - **[Dubizzle UAE Scraper](https://apify.com/rigelbytes/dubizzle-scraper)** — Scrape Dubizzle UAE listings across motors, property, jobs, classifieds, and community — from start URLs, keywords,... - **[Etuovi.com Real Estate Scraper](https://apify.com/rigelbytes/etuovi-scraper)** — Scrape Finnish property listings from Etuovi.com by search location, filters, or search/listing URLs. Optionally... - **[Export Airbnb Calendar](https://apify.com/rigelbytes/export-airbnb-calendar)** — Scrape property listings and market data from Airbnb for market research, price monitoring, and investment analysis. - **[Funda Netherlands Real Estate Scraper](https://apify.com/rigelbytes/funda-nl-scraper)** — Scrape property listings from Funda.nl — the largest real estate platform in the Netherlands. Supports buy and rent,... - **[Furnished Finder Fast](https://apify.com/rigelbytes/furnished-finder-fast)** — Scrape property listings and market data from Furnished Finder for market research, price monitoring, and investment analysis. - **[Extract Furnished Finder Hosts](https://apify.com/rigelbytes/furnished-finder-hosts)** — Scrape property listings and market data from Furnished Finder for market research, price monitoring, and investment analysis. - **[FurnishedFinder](https://apify.com/rigelbytes/furnishedfinder)** — Scrape property listings and market data from Furnished Finder for market research, price monitoring, and investment analysis. - **[German Real Estate MCP](https://apify.com/rigelbytes/german-realestate-mcp)** — MCP server for German real estate — 14 Rigel Bytes scrapers (ImmoScout24, Immowelt, Kleinanzeigen, RE/MAX, CBRE,... - **[GrandCityProperty Scraper — Extract German Rental Listings](https://apify.com/rigelbytes/grandcityproperty)** — Extract rental property listings from GrandCityProperty.de — prices, floor plans, energy data, and contact details.... - **[Grossmann Berger Scraper — German Real Estate Listings](https://apify.com/rigelbytes/grossmann-berger-scraper)** — Extract property listings, prices, agent contacts, and images from grossmann-berger.de. From $2/1,000 listings.... - **[Hemnet.se Scraper - Swedish Real Estate Listings](https://apify.com/rigelbytes/hemnet-se-scraper)** — Scrape property listings from Hemnet.se including for-sale, upcoming, and sold homes. Search by URL or location... - **[home.dk Real Estate Scraper](https://apify.com/rigelbytes/home-dk-scraper)** — Scrape Danish property listings from home.dk by search location, filters, or search/listing URLs. Optionally enrich... - **[HouseSigma Scraper](https://apify.com/rigelbytes/housesigma-scraper)** — Scrape HouseSigma for-sale and for-lease listings with filters or map/search start URLs. Returns listing cards and... - **[Idealista Scraper](https://apify.com/rigelbytes/idealista-scraper)** — Scrape property listings from Idealista.com — search results and full detail pages with photos, features, location,... - **[Immobiliare Italy Real Estate Scraper](https://apify.com/rigelbytes/immobiliare-it-scraper)** — Scrape property listings and market data from real estate portals for market research, price monitoring, and investment analysis. - **[Immobilienscout24](https://apify.com/rigelbytes/immobilienscout24)** — Scrape property listings and market data from real estate portals for market research, price monitoring, and investment analysis. - **[Immobilienscout24-scraper](https://apify.com/rigelbytes/immobilienscout24-scraper)** — Scrape property listings and market data from real estate portals for market research, price monitoring, and investment analysis. - **[Immoweb Scraper - Belgium Property Listings](https://apify.com/rigelbytes/immoweb-scraper)** — Scrapes property listings from Immoweb.be. Supports search result extraction with optional property detail enrichment. - **[Immowelt Property Scraper](https://apify.com/rigelbytes/immowelt-property-scraper)** — The Immowelt Scraper helps you extract unlimited real estate listings from Immowelt with complete details including... - **[Immowelt Scraper](https://apify.com/rigelbytes/immowelt-scraper)** — The Immowelt Scraper helps you extract unlimited real estate listings from Immowelt with complete details including... - **[JLL Property Scraper — Extract Commercial Investment Listings](https://apify.com/rigelbytes/jll-scraper)** — Scrape commercial and investment property data from JLL Germany (gewerbeimmobilien.jll.de and invest.jll.com).... - **[Land.com Agents Scraper](https://apify.com/rigelbytes/landdotcom-agents)** — Scrape property listings and market data from Land.com for market research, price monitoring, and investment analysis. - **[Land.com Scraper](https://apify.com/rigelbytes/landdotcom-scraper)** — Scrape property listings and market data from Land.com for market research, price monitoring, and investment analysis. - **[Nybolig Denmark Real Estate Scraper](https://apify.com/rigelbytes/nybolig-dk-scraper)** — Scrape property listings from Nybolig.dk (Denmark). Search by zip code, free text, filters, or result/listing URLs.... - **[Outdoorsy Scraper](https://apify.com/rigelbytes/outdoorsy-scraper)** — Scrape property listings and market data from Outdoorsy for market research, price monitoring, and investment analysis. - **[PropertyFinder Eygpt](https://apify.com/rigelbytes/propertyfinder-eygpt)** — Scrape property listings and market data from Property Finder for market research, price monitoring, and investment analysis. - **[Propertyfinder Scraper](https://apify.com/rigelbytes/propertyfinder-scraper)** — Scrape property listings and market data from Property Finder for market research, price monitoring, and investment analysis. - **[PropertyGuru Singapore Scraper](https://apify.com/rigelbytes/propertyguru-sg-scraper)** — Scrape Singapore property listings from PropertyGuru for sale and rent. Apply the same filters as the website (type,... - **[Realestate.com.au Scraper](https://apify.com/rigelbytes/realestate-com-au-scraper)** — Scrape Australian property listings and real estate agents from realestate.com.au — buy, rent, sold, and new homes,... - **[Realtor.com Agent Scraper](https://apify.com/rigelbytes/realtor-agent-scraper)** — Scrape real estate agents from Realtor.com by city or ZIP code. Optionally fetch full agent profiles and reviews via... - **[Realtor.com Scraper](https://apify.com/rigelbytes/realtor-scraper)** — Scrape Realtor.com property listings with full search filters via GraphQL. Supports price, beds/baths, property... - **[Redfin Scraper](https://apify.com/rigelbytes/redfin-scraper)** — Scrape property listings and market data from Redfin for market research, price monitoring, and investment analysis. - **[RE/MAX Germany Scraper](https://apify.com/rigelbytes/remax-scraper)** — Scrapes residential and commercial real estate listings from remax.de by German Bundesland. Extracts prices, areas,... - **[Rent.com Scraper](https://apify.com/rigelbytes/rent-com-scraper)** — Scrape rental listings from rent.com — search by location query or URL. Extracts property details, photos, floor... - **[Rightmove Scraper](https://apify.com/rigelbytes/rightmove-scraper)** — Scrape property listings and market data from Rightmove for market research, price monitoring, and investment analysis. - **[RVshare Scraper](https://apify.com/rigelbytes/rvshare-scraper)** — Scrape property listings and market data from RVshare for market research, price monitoring, and investment analysis. - **[Savills Property Scraper — Extract Listings by Location](https://apify.com/rigelbytes/savills-scraper)** — Scrape residential and commercial property listings from Savills by city. Get prices, addresses, sizes, bedrooms,... - **[Trulia Scraper](https://apify.com/rigelbytes/trulia-scraper)** — Scrape Trulia for-sale, for-rent, and sold listings from search URLs or location queries, with optional... - **[Unlimited Redfin Scraper](https://apify.com/rigelbytes/unlimited-redfin-scraper)** — Scrape property listings and market data from Redfin for market research, price monitoring, and investment analysis. - **[Wüstenrot Immobilien Scraper — German Property Listings API](https://apify.com/rigelbytes/wuestenrot-immobilien)** — Scrape property listings and market data from real estate portals for market research, price monitoring, and investment analysis. - **[Zillow Detail Scraper](https://apify.com/rigelbytes/zillow-detail-scraper)** — Scrape property listings and market data from Zillow for market research, price monitoring, and investment analysis. - **[Zillow Scraper](https://apify.com/rigelbytes/zillow-scraper)** — Scrape property listings and market data from Zillow for market research, price monitoring, and investment analysis. - **[Zoopla Scraper](https://apify.com/rigelbytes/zoopla-scraper)** — Scrape property listings and market data from Zoopla for market research, price monitoring, and investment analysis. #### ✈️ Travel & Hospitality Monitor rentals, bookings, and travel listings at scale. - **[Autotrader Scraper](https://apify.com/rigelbytes/autotrader-scraper)** — Scrapes car listings from Autotrader.com with advanced search filters, pagination, and detailed vehicle data. - **[Booking.com Scraper](https://apify.com/rigelbytes/booking-com-scraper)** — Scrapes hotels from Booking.com search results with optional hotel details, availability pricing calendar, and guest... - **[CarMax Scraper](https://apify.com/rigelbytes/carmax-scraper)** — Scrapes used car listings from CarMax.com with search URL, zip code filtering, and pagination support. - **[Cars.com Scraper](https://apify.com/rigelbytes/cars-scraper)** — Scrapes car listings from Cars.com using their GraphQL API. Extracts detailed vehicle data including price, specs,... - **[Cars & Bids Scraper](https://apify.com/rigelbytes/carsandbids-scraper)** — Scrape live, upcoming, and past car auctions from Cars & Bids. Extract vehicle details, bids, photos, comments, and... - **[Ticketmaster Scraper](https://apify.com/rigelbytes/ticketmaster-scraper)** — Collect rental and travel listings from Ticketmaster for pricing intelligence and availability tracking. #### 🛒 E-commerce Scrape products, prices, and marketplace data for competitive research. - **[Amazon Product Scraper](https://apify.com/rigelbytes/amazon-product-scraper)** — Scrape products, prices, and seller data from Amazon for competitor monitoring, pricing, and product research. - **[Amazon Search Scraper](https://apify.com/rigelbytes/amazon-scraper)** — Scrape products, prices, and seller data from Amazon for competitor monitoring, pricing, and product research. - **[AutoScout24 Scraper](https://apify.com/rigelbytes/autoscout24-scraper)** — Scrape car listings from AutoScout24 with full filter support. Extract makes, models, prices, mileage, seller info,... - **[Best Buy Product Scraper](https://apify.com/rigelbytes/best-buy-scraper)** — Scrape Best Buy US and Canada products by search query, category URL, or SKU. Optionally enrich each item with full... - **[Daraz](https://apify.com/rigelbytes/daraz)** — Scrape products, prices, and seller data from Daraz for competitor monitoring, pricing, and product research. - **[eBay Product Scraper](https://apify.com/rigelbytes/ebay-scraper)** — Scrape products, prices, and seller data from eBay for competitor monitoring, pricing, and product research. - **[Etsy Scraper](https://apify.com/rigelbytes/etsy-scraper)** — Scrape products, prices, and seller data from Etsy for competitor monitoring, pricing, and product research. - **[Europages Scraper](https://apify.com/rigelbytes/europages-scraper)** — Scrape Europages products and suppliers by keyword, category, or URL. Apply the same filters as the site (country,... - **[Facebook Marketplace Scraper](https://apify.com/rigelbytes/facebook-marketplace)** — Scrape products, prices, and seller data from Facebook for competitor monitoring, pricing, and product research. - **[Gumtree Scraper](https://apify.com/rigelbytes/gumtree-scraper)** — Scrapes Gumtree UK listings from search URLs, category filters, or direct listing links. Extracts titles, prices,... - **[Homedepot Scraper](https://apify.com/rigelbytes/homedepot-scraper)** — HomeDepot Products Scraper lets you extract product data from homedepot.com using a collection URL and delivery ZIP.... - **[Kleinanzeigen Scraper](https://apify.com/rigelbytes/kleinanzeigen-scraper)** — Scrape listings from kleinanzeigen.de — search results and detail pages for any category (electronics, vehicles,... - **[Otodom Scraper - Polish Real Estate Listings](https://apify.com/rigelbytes/otodom-scraper)** — Scrapes property listings from Otodom.pl, Poland's leading real estate marketplace. Supports filters for transaction... - **[Zalando Product Scraper](https://apify.com/rigelbytes/zalando-scraper)** — Scrape product listings and optional product details from Zalando category pages and search queries. #### 💼 Jobs & Recruitment Collect job listings and company hiring data for market analysis. - **[Dice.com Job Scraper](https://apify.com/rigelbytes/dice-scraper)** — Scrape Dice.com tech jobs by keyword, URL, and filters. Optionally enrich results with job details, company... - **[Glassdoor Jobs Scraper](https://apify.com/rigelbytes/glassdoor-jobs-scraper)** — Scrape job listings from Glassdoor by search query and location, with optional job detail enrichment. - **[Remote OK Scraper](https://apify.com/rigelbytes/remoteok-scraper)** — Scrape remote job listings from Remote OK with filters for role, location, benefits, salary, and sort order. Accepts... - **[StepStone Jobs Scraper — Extract German/DACH Job Listings](https://apify.com/rigelbytes/stepstone-jobs-scraper)** — Scrape thousands of job listings from StepStone (DE, AT, BE, NL) with salary, skills, remote status & more. From... - **[Upwork Jobs Scraper](https://apify.com/rigelbytes/upwork-jobs-scraper)** — Scrapes Upwork freelance job listings by keyword with full search filters (sort, experience, job type, budget,... - **[ZipRecruiter Job Scraper](https://apify.com/rigelbytes/ziprecruiter-scraper)** — Scrape job listings from ZipRecruiter with search queries, locations, and radius filters. Extracts title, company,... #### 📩 Lead Generation Find business contacts, leads, and company data for sales and outreach. - **[Booli.se Scraper](https://apify.com/rigelbytes/booli-se-scraper)** — Scrapes Swedish real estate listings from Booli.se — for sale, sold prices, and new construction. Supports search... - **[Company Service Finder](https://apify.com/rigelbytes/company-service-finder)** — The Company Service Finder uses AI to extract and analyze company services from Google Search & Maps. Get detailed... - **[Doctify Scraper](https://apify.com/rigelbytes/doctify-scraper)** — Doctify Scraper lets you extract doctor and practice data from doctify.com using a search results URL. Collect... - **[Doctolib Scraper](https://apify.com/rigelbytes/doctolib-scraper)** — Scrape doctor profiles, availability, and practice details from Doctolib.de — Germany's largest medical appointment... - **[FindLaw Law Firm Scraper - Attorney & Law Firm Data Extraction](https://apify.com/rigelbytes/findlaw-scraper)** — Scrape law firm profiles from FindLaw.com. Extract detailed attorney and firm information including contact details,... - **[Finn.no Real Estate Scraper](https://apify.com/rigelbytes/finn-no-scraper)** — Scrape Norwegian real-estate listings from Finn.no with search URL or filter-based discovery, optional full details... - **[Google Maps Scraper](https://apify.com/rigelbytes/google-maps-scraper)** — Find business leads and contact details from Google Maps for outbound sales, prospecting, and CRM enrichment. - **[Krogsveen.no Real Estate Scraper](https://apify.com/rigelbytes/krogsveen-no-scraper)** — Scrape Norwegian real-estate listings from Krogsveen.no with search URL or filter-based discovery, optional full... - **[LandSearch Scraper](https://apify.com/rigelbytes/landsearch-scraper)** — Scrape land listings and agent profiles from LandSearch.com. Search properties by location query or URL, and agents... - **[LeadRocks Scraper](https://apify.com/rigelbytes/leadrocks-scraper)** — Export filtered B2B leads from the LeadRocks dataset by category, state, job title, company, and industry. Free... - **[Website Services Finder](https://apify.com/rigelbytes/website-services-finder)** — Automatically extract and analyze company services from any business website using advanced AI. Choose from 5 AI... - **[Zillow Agents](https://apify.com/rigelbytes/zillow-agents)** — Find business leads and contact details from Zillow for outbound sales, prospecting, and CRM enrichment. - **[Zillow Agents Phone](https://apify.com/rigelbytes/zillow-agents-phone)** — Find business leads and contact details from Zillow for outbound sales, prospecting, and CRM enrichment. - **[Zillow Agents Vault](https://apify.com/rigelbytes/zillow-agents-vault)** — Find business leads and contact details from Zillow for outbound sales, prospecting, and CRM enrichment. #### ⭐ Reviews & Ratings Monitor reviews and reputation data across review platforms. - **[Airbnb Listing Reviews](https://apify.com/rigelbytes/airbnb-listing-reviews)** — Collect reviews and ratings from Airbnb for reputation monitoring and customer insights. - **[AppSumo Scraper](https://apify.com/rigelbytes/appsumo-scraper)** — Scrape AppSumo software deals from browse, categories, new arrivals, Radar, or product URLs. Optional listing... - **[BBB Scraper](https://apify.com/rigelbytes/bbb-scraper)** — Collect reviews and ratings from BBB for reputation monitoring and customer insights. - **[Clutch.co Company Scraper](https://apify.com/rigelbytes/clutch-scraper)** — Scrape Clutch.co company listings, profiles, and reviews by directory URL or service + location search. Optional... - **[Costco Product Scraper](https://apify.com/rigelbytes/costco-scraper)** — Scrapes product data from Costco.com including prices, descriptions, ratings, and availability. Supports search... - **[Disboard Scraper](https://apify.com/rigelbytes/disboard-scraper)** — Scrape Discord server listings from DISBOARD by community tag, search query, or direct URL. Extracts server name,... - **[Flipkart Product Scraper](https://apify.com/rigelbytes/flipkart-scraper)** — Scrape Flipkart product listings from start URLs, categories, or search queries, with optional product details and... - **[hipages Australia Scraper](https://apify.com/rigelbytes/hipages-au-scraper)** — Scrape hipages.com.au tradie listings by category or URL. Optionally enrich each company with profile details and... - **[HRS Hotel Reviews Scraper](https://apify.com/rigelbytes/hrs-hotel-reviews-scraper)** — Extract hotel details, room offers, and guest reviews from HRS hotel URLs. - **[HRS Hotel Scraper](https://apify.com/rigelbytes/hrs-scraper)** — Scrapes hotel listings, prices, ratings, and amenities from HRS (hrs.com) by location and travel dates. - **[IKEA Product Scraper](https://apify.com/rigelbytes/ikea-scraper)** — Scrape IKEA product listings from search queries or start URLs, with optional product details and customer reviews. - **[Naukri Job Scraper](https://apify.com/rigelbytes/naukri-scraper)** — Scrape Naukri.com job listings by keyword, location, start URL, or company page, with optional job details, company... - **[Google Play Store App Reviews Scraper](https://apify.com/rigelbytes/playstore-app-reviews)** — Scrape Google Play Store app reviews by app ID or Play Store URL. Supports multiple apps, sorting, score filters,... - **[Rottentomatoes Reviews Scraper](https://apify.com/rigelbytes/rottentomatoes-reviews-scraper)** — Collect reviews and ratings from Rotten Tomatoes for reputation monitoring and customer insights. - **[SEEK Australia Jobs Scraper](https://apify.com/rigelbytes/seek-au-jobs-scraper)** — Scrape SEEK Australia job listings by keyword, location, or URL. Optionally enrich each job with full details,... - **[Skool Community Scraper](https://apify.com/rigelbytes/skool-scraper)** — Scrape Skool communities from discovery search and category filters. Extract listing data plus optional about-page... - **[Target.com Product Scraper](https://apify.com/rigelbytes/target-scraper)** — Scrape Target.com products from search queries or URLs. Optionally enrich with product details and customer reviews. - **[The Movie Database (TMDB) Scraper](https://apify.com/rigelbytes/themoviedb-scraper)** — Scrape movies, TV shows, people, and awards from themoviedb.org with the same list filters as the website — genres,... - **[TripAdvisor Reviews Scraper](https://apify.com/rigelbytes/tripadvisor-reviews-scraper)** — Scrape reviews from TripAdvisor hotel pages using GraphQL API with DataDome protection bypass. - **[Trustpilot Reviews Scraper](https://apify.com/rigelbytes/trustpilot-reviews)** — Collect reviews and ratings from Trustpilot for reputation monitoring and customer insights. - **[Yelp Scraper](https://apify.com/rigelbytes/yelp-scraper)** — Scrape Yelp business listings by search term, category, location, or URL. Optional full business details with phone,... #### 🍔 Food & Delivery Extract restaurant, grocery, and delivery platform data. - **[Instacart Scraper](https://apify.com/rigelbytes/instacart-scraper)** — Scrape menus, stores, and delivery data from Instacart for data-driven research and automation. - **[Lidl Product Scraper](https://apify.com/rigelbytes/lidl-scraper)** — Scrape Lidl supermarket products across Europe by search query or category/product URL. Optionally enrich each item... - **[OpenTable Scraper](https://apify.com/rigelbytes/opentable-scraper)** — Scrape OpenTable restaurants by search query (with date/time/party size) or start URLs. Optional listing details and... - **[Publix Scraper](https://apify.com/rigelbytes/publix-scraper)** — Scrape menus, stores, and delivery data from Publix for data-driven research and automation. #### 📰 News & Media Scrape news, articles, and media content for research. - **[BizBuySell Scraper](https://apify.com/rigelbytes/bizbuysell-scraper)** — Scrape BizBuySell business-for-sale listings via search URLs or structured filters, with optional full listing details. - **[SEC IPO Event Intelligence](https://apify.com/rigelbytes/ipo-events-api)** — Monitors SEC EDGAR for IPO filings and converts them into structured business events, with optional AI company... - **[SEC Filings Scraper](https://apify.com/rigelbytes/sec-filings-intelligence)** — Retrieve clean, normalized SEC EDGAR filing data by ticker, CIK, or company name — with document links, optional... #### 🛠️ Developer Tools General-purpose scraping and automation tools. - **[EU Tenders Scraper](https://apify.com/rigelbytes/eu-tenders-scraper)** — Scrape EU public procurement notices from TED (Tenders Electronic Daily) with advanced search filters,... - **[Web Crawler](https://apify.com/rigelbytes/webcrawler)** — This web crawler is designed to provide users with complete flexibility by allowing them to use their \*\*own... - **[Zapier Apps Scraper](https://apify.com/rigelbytes/zapier-apps-scraper)** — Scrape Zapier’s app directory by category, subcategory, sort (popularity, premium, beta, recently launched), or URL.... #### 🔧 Other Additional scraping tools by Rigel Bytes. - **[Bilibili Scraper](https://apify.com/rigelbytes/bilibili-scraper)** — Scrape Bilibili videos, categories, search results, and creator spaces. Extract titles, stats, tags, and optional... - **[Google Ads Transparency Scraper](https://apify.com/rigelbytes/google-ads-scraper)** — Scrape ads from the Google Ads Transparency Center by domain, advertiser, or keyword. Filter by region, time period,... - **[Red Note Scraper](https://apify.com/rigelbytes/rednote-scraper)** — Scrape Red Note (Xiaohongshu) posts from home-feed categories or URLs. Optionally attach creator profiles and top... ### Understanding Proxies: When scraping data or browsing anonymously, proxies are essential. They act as intermediaries, masking your original IP address and allowing you to send requests from another location. #### Why Use Proxies? - Avoid IP Blocks: By routing requests through proxies, you prevent the target website from recognizing your IP as a scraper or spammer. - Access Geo-restricted Content: Proxies let you access content or websites restricted by location. - Enhance Anonymity: Hide your actual IP, ensuring privacy while scraping or browsing. #### Types of Proxies 1. Residential Proxies - Real IP addresses provided by ISPs to home users. - They mimic regular users, making them harder to detect. - Best for: Long-term, undetectable scraping, and avoiding blocks. 2. Data Center Proxies - IP addresses from servers in data centers. - Faster and cheaper than residential proxies but easier to detect and block. - Best for: High-speed scraping, but with a higher risk of detection. 3. Mobile Proxies - IPs provided by mobile carriers (3G/4G/5G networks). - Very difficult to detect, as they appear as regular mobile users. - Best for: Mobile-related scraping or avoiding sophisticated blocks. #### Rotating Proxies vs. Straight Proxies - Rotating Proxies: Every request you send goes through a different proxy, making it harder for websites to detect patterns. - Straight Proxies: All requests are sent through the same proxy, making it easier to track your IP. ### FAQs & Troubleshooting #### Q: What counts as a billed result? Every dataset row charges one `dataset-item` event (**$1.00 per 1,000**). If `scrapeListingDetails` is enabled and that row has `detailsScraped: true`, a second `listing-details` event is charged at **$1.50 per 1,000**. Failed or skipped detail pages are not charged for details. You do not pay platform compute. #### Q: How do I export the full catalog instead of a search? Leave `startUrls`, `searchQueries`, `estimateCodes`, and the filter fields empty. The Actor then reads the full OpenConstructionEstimate catalog. Set `maxItems` (for example `100`) unless you truly want every position. #### Q: What does scrapeListingDetails add? Catalog rows already include code, name, EUR price, unit, category, labor hours, and cost-mix percentages. With `scrapeListingDetails` on, each page adds `resources`, `machines`, `workSteps`, and fields such as `laborCost`, `equipmentCost`, and `electricityCost`. That second event is only charged when `detailsScraped` is true. #### Q: Should I use startUrls, searchQueries, or estimateCodes? Use `startUrls` when you already have a catalog or estimate link. Use `searchQueries` for keyword discovery (`hydrojet`, `concrete`). Use `estimateCodes` for exact codes. You can combine them. Language in a URL such as `/estimates/en/` also sets the output language if `language` is omitted. #### Q: Why are some names still in German? The catalog source is German. Non-German `language` values use the site translation files. If a code has no translation, the Actor keeps the German name, slug, and unit so the row is still usable. #### Q: How do I export estimates as CSV or Excel? After the run, open the **Output** / **Storage** tab and download the default dataset as JSON, CSV, Excel, or HTML. The same dataset is available at the Apify Dataset API. ### About Rigel Bytes Rigel Bytes specializes in web scraping, automation, and data analytics. We help businesses extract and leverage valuable data for informed decision-making. ### Contact Us Ready to unlock the power of data? Reach out to us at (contact@rigelbytes.com) or [book an appointment](https://cal.com/faizanali/appointments) with us to learn more about how we can help you achieve your data goals. ### Detailed Data [![Detailed Data](https://img.shields.io/badge/Detailed%20Data-JSON-blue?style=for-the-badge)](#detailed-data) ```json [ { "code": "METO_KANE_KAKASA_KAME", "name": "Hydrojet cleaning of concrete surfaces", "slug": "hydrojet-cleaning-of-concrete-surfaces", "url": "https://openconstructionestimate.com/estimates/en/hydrojet-cleaning-of-concrete-surfaces/", "price": 6.413479668, "currency": "EUR", "unit": "m2", "category": "Protection of building structures and equipment from corrosion", "department": "PREPARATORY WORK", "laborHours": 0.2, "workers": 1, "materialPct": 0.0, "laborPct": 43.0, "machinePct": 54.0, "resourceCount": 3, "workStepCount": 1, "hasMachines": true, "hasElectricity": false, "language": "en", "detailsScraped": true, "section": "Hydrojet cleaning of surfaces", "totalCost": 6.413479668, "laborCost": 2.7361314, "equipmentCost": 3.441319452, "resources": [ { "code": "ME_MEKAKA_TOKA", "name": "Average workload TO.KA", "type": "Resource", "quantity": 0.18, "unit": "hrs", "price": 15.20073, "total": 2.7361314 } ], "machines": [ { "code": "DXME-RIME-KARI_KAMEME", "name": "High-pressure devices with internal combustion engines for hydrocleaning surfaces, capacity 20 l/min, pressure 100 MPa", "class": "High-pressure devices", "quantity": 0.17, "unit": "Machine hours", "price": 20.2430556, "total": 3.441319452, "electricityKwh": 0.0 } ], "workSteps": [ { "number": 1, "text": "Cleaning of concrete surfaces" } ] }, { "code": "PUNE_KAVO_KAPUPU_KARI", "name": "Hydrojet cleaning: concrete surfaces", "slug": "hydrojet-cleaning-concrete-surfaces", "url": "https://openconstructionestimate.com/estimates/en/hydrojet-cleaning-concrete-surfaces/", "price": 2.686485204, "currency": "EUR", "unit": "m2", "category": "Work during the reconstruction of buildings and structures", "department": "OTHER WORKS", "laborHours": 0.2, "workers": 1, "materialPct": 0.0, "laborPct": 85.0, "machinePct": 9.0, "resourceCount": 4, "workStepCount": 1, "hasMachines": true, "hasElectricity": true, "language": "en", "detailsScraped": true, "section": "Surface cleaning", "totalCost": 2.686485204, "laborCost": 2.2801095, "equipmentCost": 0.244395144, "electricityCost": 0.1140048, "resources": [ { "code": "ME_MEKAKA_TOKA", "name": "Average workload TO.KA", "type": "Resource", "quantity": 0.15, "unit": "hrs", "price": 15.20073, "total": 2.2801095 } ], "machines": [ { "code": "DXME-RIME-KARI_KAKAME", "name": "Electric high-pressure devices for hydrocleaning surfaces, capacity 17 l/min, pressure 50 MPa", "class": "High-pressure devices", "quantity": 0.14, "unit": "Machine hours", "price": 1.7456796, "total": 0.244395144, "electricityKwh": 6.11 } ], "workSteps": [ { "number": 1, "text": "Hydrojet cleaning of the surface" } ] } ] ``` # Actor input Schema ## `startUrls` (type: `array`): Catalog pages and/or individual estimate URLs, e.g. "https://openconstructionestimate.com/estimates/" or "https://openconstructionestimate.com/estimates/en/hydrojet-cleaning-concrete-surfaces/". Leave empty together with the other filters to export the full catalog. ## `searchQueries` (type: `array`): Match estimate name, code, or slug (OR), e.g. "concrete", "hydrojet", or "PUNE\_KAVO\_KAPUPU\_KARI". ## `estimateCodes` (type: `array`): Exact catalog codes such as PUNE\_KAVO\_KAPUPU\_KARI. Use instead of, or together with, start URLs. ## `categories` (type: `array`): Category names in German or another language (e.g. "Erdarbeiten", "Earthworks", "Tunnel construction"). Leave empty for all categories. ## `departments` (type: `array`): Subcategory / department names from the catalog sidebar (e.g. "SONSTIGE ARBEITEN"). ## `units` (type: `array`): Measurement units to keep (e.g. "m", "m3", "100 m2", "1 Trennstelle"). ## `minPrice` (type: `number`): Inclusive lower bound in EUR. Leave empty for no minimum. ## `maxPrice` (type: `number`): Inclusive upper bound in EUR. Leave empty for no maximum. ## `minLaborHours` (type: `number`): Inclusive lower bound for catalog labor hours. ## `maxLaborHours` (type: `number`): Inclusive upper bound for catalog labor hours. ## `minResources` (type: `integer`): Inclusive lower bound for resource count. ## `maxResources` (type: `integer`): Inclusive upper bound for resource count. ## `minWorkSteps` (type: `integer`): Inclusive lower bound for work-step count. ## `maxWorkSteps` (type: `integer`): Inclusive upper bound for work-step count. ## `minWorkers` (type: `integer`): Inclusive lower bound for people per unit. ## `maxWorkers` (type: `integer`): Inclusive upper bound for people per unit. ## `costStructure` (type: `array`): Keep estimates that are material-intensive (>40%), labor-intensive (>40%), or machine-intensive (>25%). Leave empty for any mix. ## `hasMachines` (type: `boolean`): When set, keep only estimates that include machines (true) or exclude them (false). Leave empty for any. ## `hasElectricity` (type: `boolean`): When set, keep only estimates that include electricity (true) or exclude them (false). Leave empty for any. ## `sortBy` (type: `string`): Order of catalog results before maxItems is applied. ## `language` (type: `string`): Language for names, slugs, units, category labels, and detail pages. ## `scrapeListingDetails` (type: `boolean`): Visit each estimate page for resources, machines, work steps, and cost breakdown. Charges a second pay-per-event (listing-details) when the detail payload is extracted. ## `maxConcurrency` (type: `integer`): How many detail pages to fetch at once (each request can use a rotated proxy). ## `maxItems` (type: `integer`): Maximum number of estimates to scrape (0 = unlimited). ## `proxyConfiguration` (type: `object`): Residential proxies are recommended for catalog and detail requests. ## Actor input object example ```json { "startUrls": [ { "url": "https://openconstructionestimate.com/estimates/" } ], "searchQueries": [ "concrete" ], "sortBy": "name-asc", "language": "en", "scrapeListingDetails": false, "maxConcurrency": 5, "maxItems": 10, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # Actor output Schema ## `results` (type: `string`): Dataset containing scraped construction cost estimates ## `runStats` (type: `string`): Record counts and timestamps for this run # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://openconstructionestimate.com/estimates/" } ], "searchQueries": [ "concrete" ], "maxItems": 10, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }; // Run the Actor and wait for it to finish const run = await client.actor("rigelbytes/openconstructionestimate-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://openconstructionestimate.com/estimates/" }], "searchQueries": ["concrete"], "maxItems": 10, "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], }, } # Run the Actor and wait for it to finish run = client.actor("rigelbytes/openconstructionestimate-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}") for item in client.dataset(run.default_dataset_id).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://openconstructionestimate.com/estimates/" } ], "searchQueries": [ "concrete" ], "maxItems": 10, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }' | apify call rigelbytes/openconstructionestimate-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "type": "http", "url": "https://mcp.apify.com/?tools=fetch-actor-details,rigelbytes/openconstructionestimate-scraper" } } } ``` The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations). ## OpenAPI specification Download the OpenAPI definition: https://api.apify.com/v2/actors/erX6YMtK2BlLr1t6o/builds/2bs9bl2djGtmaQORC/openapi.json