# Article Content Extractor 📄 (`easyapi/article-content-extractor`) Actor

Extract clean article content, metadata and structured information from any web page. Supports multiple URLs and returns well-formatted JSON with title, description, content, author, publish date and more. 🔍📄

- **URL**: https://apify.com/easyapi/article-content-extractor.md
- **Developed by:** [EasyApi](https://apify.com/easyapi) (community)
- **Categories:** Developer tools, Integrations, Other
- **Stats:** 207 total users, 45 monthly users, 100.0% runs succeeded, 4 bookmarks
- **User rating**: 5.00 out of 5 stars

## Pricing

from $2.99 / 1,000 results

This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## Article Content Extractor 📄

Extract clean article content and metadata from any web pages automatically. This actor helps you get structured content from news sites, blogs, and other article-based websites.

### Features ✨

- Extract article content and metadata from any URL
- Support batch processing of multiple URLs
- Clean and structured JSON output
- Built-in rate limiting to avoid overloading target sites
- Robust error handling and validation
- Fast and efficient processing

### Output Data Structure 📊

The actor extracts the following information from each article:

- Title
- Description
- Main content (both HTML and plain text)
- Author
- Publication date
- Source domain
- Featured image URL
- Related links
- Tags
- Scraping timestamp

### Use Cases 💡

- Content aggregation and syndication
- News monitoring and analysis
- Research and data collection
- Content migration
- SEO analysis
- Digital archiving

### Limitations ⚠️

- Respects robots.txt and implements polite scraping
- 2-second delay between requests to avoid overwhelming target servers
- URLs must be valid and accessible
- Content extraction quality depends on page structure

### Tips for Best Results 💪

1. Provide valid, accessible URLs
2. Use for public content only
3. Consider target website's terms of service
4. Monitor execution logs for any issues

Need help or have questions? Feel free to reach out!

#### Input Example

A full explanation of an input example in JSON.

```json
{
    "urls": [
        "https://cleartax.in/s/gst-hsn-lookup",
        "https://www.fancode.com/pickleball/schedule"
    ]
}
```

#### Output sample

The results will be wrapped into a dataset which you can always find in the **Storage** tab. Here's an excerpt from the data you'd get if you apply the input parameters above:

And here is the same data but in JSON. You can choose in which format to download your data: JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML.

```json
[
    {
        "url": "https://www.fancode.com/pickleball/schedule",
        "title": "Pickleball Schedule - Check International and Domestic matches on FanCode",
        "description": "ABOUT FANCODEIndia's Premium Live Streaming, Live Scores & Sports Merchandise Shopping platform FanCode has grown to become one of the most loved and followed all-sports destination in the last few years....",
        "content": "<div><p><label>ABOUT FANCODE</label><label>India's Premium Live Streaming, Live Scores &amp; Sports Merchandise Shopping platform FanCode has grown to become one of the most loved and followed all-sports destination in the last few years. The FanCode app has been downloaded by more than 3+ crore users. It offers interactive live streaming of all major sporting events, premier cricket tournaments, women's cricket, live football, basketball, baseball, wrestling, badminton, and other major sports. It also offer real-time match highlights, match videos, cricket videos, India cricket highlights, highlights of today's match, highlights of yesterday's match, cricket data, statistics, cricket analysis, fantasy insights, cricket updates, breaking news from India cricket and world of sports. It also offers sports merchandise for all major sporting leagues and teams from across the world.</label></p></div>",
        "author": "",
        "publishedDate": "",
        "source": "fancode.com",
        "image": "https://www.fancode.com/skillup-uploads/fc-web/home-page-new-arc/hero-image/v1/hero-image-dweb-v4.png",
        "links": [
            "https://www.fancode.com/pickleball/schedule"
        ],
        "tags": [],
        "scrapedAt": "2025-02-05T07:19:26.119Z"
    },
    ...
]
```

### Related Actors

- 📄 [URL Metadata Crawler](https://apify.com/easyapi/url-metadata-crawler) - Extract comprehensive metadata from web pages including meta tags, favicons, and Open Graph tags.
- 🔍 [Google News Scraper](https://apify.com/easyapi/google-news-scraper) - Collect up to 5000 news articles with flexible search options and language support.
- 📚 [arXiv Search Scraper](https://apify.com/easyapi/arxiv-search-scraper) - Extract comprehensive research paper data including titles, authors, and abstracts.
- 🔬 [Nature Search Results Scraper](https://apify.com/easyapi/nature-search-results-scraper) - Extract research article data from Nature.com with detailed metadata.
- 📚 [Medium Posts Search Scraper](https://apify.com/easyapi/medium-posts-search-scraper) - Get detailed information about articles, authors, and engagement metrics from Medium.
- 📚 [Substack Posts Scraper](https://apify.com/easyapi/substack-posts-scraper) - Extract comprehensive post data including title, author, and publication details.
- 🔍 [PubMed Search Scraper](https://apify.com/easyapi/pubmed-search-scraper) - Scrape research papers and academic articles with comprehensive metadata.
- 📄 [WikiHow Article Scraper](https://apify.com/easyapi/wikihow-article-scraper) - Extract article titles, dates, views, and detailed step-by-step content.
- 🔍 [Cointelegraph Search Scraper](https://apify.com/easyapi/cointelegraph-search-scraper) - Extract comprehensive article data including titles, authors, and publish dates.
- 📚 [Medium User Posts Scraper](https://apify.com/easyapi/medium-user-posts-scraper) - Extract detailed post data including engagement metrics and publication details.
- 🎯 [Keyword Discovery Tool](https://apify.com/easyapi/keyword-discovery-tool) - Discover new keyword ideas and uncover valuable search insights.
- 🔍 [Keyword Density Checker](https://apify.com/easyapi/keyword-density-checker) - Analyze webpage content to calculate keyword density and frequency.
- 🔍 [AI-powered Search](https://apify.com/easyapi/ai-powered-search) - Transform search queries into structured, AI-powered summaries with references.
- 📝 [Text Summarization](https://apify.com/easyapi/text-summarization) - Automatically generate concise summaries of documents while preserving original content.
- 🌐 [Website Content to Markdown for LLM Training](https://apify.com/easyapi/website-content-to-markdown-for-llm-training) - Transform web content into clean, LLM-ready Markdown format.

# Actor input Schema

## `urls` (type: `array`):

List of article URLs to extract content from

## Actor input object example

```json
{
  "urls": [
    "https://www.fancode.com/pickleball/schedule"
  ]
}
```

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "urls": [
        "https://www.fancode.com/pickleball/schedule"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("easyapi/article-content-extractor").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "urls": ["https://www.fancode.com/pickleball/schedule"] }

# Run the Actor and wait for it to finish
run = client.actor("easyapi/article-content-extractor").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "urls": [
    "https://www.fancode.com/pickleball/schedule"
  ]
}' |
apify call easyapi/article-content-extractor --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,easyapi/article-content-extractor"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/k23ty7AnmPk81AFxp/builds/cvgMnpT9Oqstda8E4/openapi.json