# Ecommerce Aggregator Spider (`getdataforme/ecommerce-aggregator-spider`) Actor Ecommerce Aggregator Spider is an Apify Actor that scrapes product listings from eBay, Etsy, and Flipkart using a single keyword. Extract prices, ratings, images, availability, and product URLs in structured JSON format for analytics, monitoring, and research. - **URL**: https://apify.com/getdataforme/ecommerce-aggregator-spider.md - **Developed by:** [GetDataForMe](https://apify.com/getdataforme) (community) - **Categories:** AI, Automation, E-commerce - **Stats:** 3 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: 5.00 out of 5 stars ## Pricing from $9.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event ## What's an Apify Actor? Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. - **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use). - **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`. - **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`. - **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`. - **Any other language** — the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Ecommerce Aggregator Spider Aggregate product listings from multiple e-commerce marketplaces including eBay, Etsy, and Flipkart using a single search keyword. This Apify Actor collects structured product data such as product titles, prices, ratings, availability, product URLs, and image links in a clean JSON format. The Actor is designed for developers, researchers, dropshippers, e-commerce analysts, and businesses that need scalable product intelligence and marketplace monitoring. *** ### Features - Search products across multiple marketplaces simultaneously - Extract product titles, pricing, ratings, availability, and images - Supports eBay, Etsy, and Flipkart - Residential proxy support via Apify Proxy - Structured JSON output for automation and integrations - Scalable scraping for large product datasets *** ### Input Example Provide the following input to start scraping: ```json { "ItemLimit": 10, "Sites": [ "ebay", "etsy", "flipkart" ], "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] }, "SearchKeyword": "iphone" } ``` *** ### Input Parameters | Parameter | Type | Description | | -------------------- | ------- | ------------------------------------------- | | `SearchKeyword` | String | Product keyword or search term | | `Sites` | Array | List of supported marketplaces to scrape | | `ItemLimit` | Number | Maximum number of product results to return | | `proxyConfiguration` | Object | Apify proxy configuration | | `useApifyProxy` | Boolean | Enables Apify proxy usage | | `apifyProxyGroups` | Array | Proxy groups such as `RESIDENTIAL` | *** ### Output Example The Actor returns structured product data in JSON format: ```json [ { "source": "flipcart", "title": "Apple iPhone 15 (Blue, 256 GB)", "url": "https://www.flipkart.com/apple-iphone-15-blue-256-gb/p/itm986f66c53cae4", "price": 69900, "currency": "INR", "images": [ "https://rukminim1.flixcart.com/image/400/400/xif0q/mobile/k/l/l/-original-imagtc5fz9spysyk.jpeg?q=70" ], "rating": 4.6, "rating_count": 245433, "availability": "IN_STOCK", "actor_id": null, "run_id": null }, { "source": "flipcart", "title": "Apple iPhone 17 (Mist Blue, 256 GB)", "url": "https://www.flipkart.com/apple-iphone-17-mist-blue-256-gb/p/itm1834df7ee2812", "price": 82900, "currency": "INR", "images": [ "https://rukminim1.flixcart.com/image/400/400/xif0q/mobile/p/x/y/-original-imahft5gkyd8wcqc.jpeg?q=70" ], "rating": 4.6, "rating_count": 11655, "availability": "IN_STOCK", "actor_id": null, "run_id": null } ] ``` *** ### Supported Marketplaces Currently supported marketplaces: - eBay - Etsy - Flipkart Additional marketplaces can be supported upon request. *** ### Use Cases This Actor is ideal for: - Product price monitoring - Competitor analysis - E-commerce product aggregation - Marketplace intelligence - Dropshipping product discovery - Building product databases - Inventory and stock tracking - Product trend analysis *** ### Recommended Proxy Setup For optimal scraping reliability and reduced blocking risk, use Apify Residential Proxies: ```json { "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } } ``` *** ### Data Fields Returned The Actor may return the following fields: | Field | Description | | -------------- | ------------------------------ | | `source` | Marketplace source | | `title` | Product title | | `url` | Product page URL | | `price` | Product price | | `currency` | Currency code | | `images` | Array of product image URLs | | `rating` | Product rating | | `rating_count` | Number of ratings | | `availability` | Stock availability | | `actor_id` | Apify Actor ID (if applicable) | | `run_id` | Apify Run ID (if applicable) | *** ### Notes - Product prices and availability may change frequently. - Some marketplaces may apply anti-bot protection or rate limits. - Residential proxies are highly recommended for large-scale scraping tasks. *** ### Support For more custom/simplified outputs or bug reports, please contact: - - Please include the following email subject line: ```text Custom Support - Ecommerce Aggregator Spider ``` Thank you! # Actor input Schema ## `SearchKeyword` (type: `string`): The product or keyword to search for across all ecommerce platforms (e.g., 'iphone', 'laptop'). ## `Sites` (type: `array`): Select which ecommerce platforms to scrape from. ## `ItemLimit` (type: `integer`): Maximum number of items to collect from each source. ## `proxyConfiguration` (type: `object`): Specifies proxy servers that will be used by the scraper to hide its origin. ## Actor input object example ```json { "SearchKeyword": "iphone", "Sites": [ "ebay", "etsy", "flipkart" ], "ItemLimit": 10, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }; // Run the Actor and wait for it to finish const run = await client.actor("getdataforme/ecommerce-aggregator-spider").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], } } # Run the Actor and wait for it to finish run = client.actor("getdataforme/ecommerce-aggregator-spider").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}") for item in client.dataset(run.default_dataset_id).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }' | apify call getdataforme/ecommerce-aggregator-spider --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "type": "http", "url": "https://mcp.apify.com/?tools=fetch-actor-details,getdataforme/ecommerce-aggregator-spider" } } } ``` The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations). ## OpenAPI specification Download the OpenAPI definition: https://api.apify.com/v2/actors/WU8Hs1rCnHyLyuIsG/builds/4LRO0bxwwjvs9wInC/openapi.json