# DEV.to Scraper - Articles by Tag & Author (`scrapesage/devto-scraper`) Actor

Scrape DEV.to articles by tag or author: title, author, tags, reactions, comments, reading time, description and optional full Markdown content. No login, no key. Export JSON, CSV, Excel. Independent tool, not affiliated with DEV Community (dev.to).

- **URL**: https://apify.com/scrapesage/devto-scraper.md
- **Developed by:** [Scrape Sage](https://apify.com/scrapesage) (community)
- **Categories:** News, AI, Automation
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $1.65 / 1,000 articles

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## DEV.to Scraper - Articles by Tag & Author

> **Disclaimer:** This Actor is an independent tool and is not affiliated with, endorsed by, or sponsored by DEV Community (dev.to) or any of its subsidiaries. All trademarks mentioned are the property of their respective owners. "DEV Community (dev.to)" is referenced only to describe the publicly available website this Actor collects data from.

Scrape **DEV.to** articles by **tag** or **author** via the public API: title, author, tags, **reactions**, **comments**, reading time, description and optional full **Markdown content**. Clean JSON, CSV or Excel. No login, no API key, no browser.

> **Why this actor exists (demand):** the DEV.to niche draws **~44 monthly users** on Apify Store. This actor reads the DEV.to API directly and returns a rich, engagement-aware record (reactions, comments, reading time) for content monitoring, developer-trend research and **RAG / LLM ingestion**.

### What you can scrape

- **By tag** - `javascript`, `python`, `webdev`, `ai`, `react` - paged through fully (hundreds of articles per tag).
- **By author** - every article by a DEV.to username.
- **Full content** - optionally fetch each article's full Markdown body.

Each article returns: `title`, `url`, `author`, `authorUsername`, `organization`, `description`, `content` (optional), `tags`, `reactions`, `comments`, `readingTimeMin`, `coverImage`, `publishedAt`.

### Example input

```json
{ "tags": ["python", "machine-learning"], "maxResults": 200, "includeContent": true }
```

### Use with AI assistants (MCP)

Available through the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp).

### Agent-ready: autonomous payments (x402 & Skyfire)

This actor is **agent-ready** - AI agents can discover it, run it, and **pay for it autonomously**, with no Apify account and no human in the loop. It uses [pay-per-event](https://docs.apify.com/platform/actors/publishing/monetize/pay-per-event) pricing and [limited permissions](https://docs.apify.com/platform/actors/development/permissions), so it qualifies for Apify's agentic-payment standards:

- **[x402](https://docs.apify.com/platform/integrations/x402)** - an open, HTTP-native payment protocol. Agents pay per run in USDC on the Base network directly through the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp) - no account, no API key.
- **[Skyfire](https://docs.apify.com/platform/integrations/skyfire)** - agent-to-service payments for fully autonomous AI-agent workflows.

### Pricing

Pay-per-event, tiered by volume: **$0.003** per article at the free tier, down to **$0.00075** at the top tier.

***

*This is an independent scraper for publicly available data. It is not affiliated with, endorsed by, or sponsored by DEV / Forem. "DEV" and "DEV.to" are trademarks of their respective owner, used here for descriptive purposes only. Use the data in compliance with the source's terms and applicable law.*

### Automate & schedule

Run this Actor on autopilot and pull results into your own stack:

- **[Apify API](https://docs.apify.com/api/v2)** - start runs, fetch datasets and manage schedules over REST.
- **[apify-client for JavaScript](https://docs.apify.com/api/client/js/)** and **[apify-client for Python](https://docs.apify.com/api/client/python/)** - official SDKs.
- **[Schedules](https://docs.apify.com/platform/schedules)** - run it hourly, daily or weekly and keep your dataset current.
- **[Webhooks](https://docs.apify.com/platform/integrations/webhooks)** - trigger downstream actions (CRM import, Slack alert, email sequence) the moment a run finishes.

```js
import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'MY_APIFY_TOKEN' });

const run = await client.actor('scrapesage/devto-scraper').call({
    "tags": [
        "javascript"
    ],
    "maxResults": 100
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(`Got ${items.length} records`);
```

### Integrate with any app

Connect the dataset to thousands of apps - no code required:

- **[Make](https://docs.apify.com/platform/integrations/make)** - multi-step automation scenarios.
- **[Zapier](https://docs.apify.com/platform/integrations/zapier)** - push new records straight into your CRM or spreadsheet.
- **[Slack](https://docs.apify.com/platform/integrations/slack)** - get notified when a scheduled run finds something new.
- **[Google Drive / Sheets](https://docs.apify.com/platform/integrations/drive)** - auto-export every run to a spreadsheet.
- **[Airbyte](https://docs.apify.com/platform/integrations/airbyte)** - pipe results into your data warehouse.
- **[GitHub](https://docs.apify.com/platform/integrations/github)** - trigger runs from commits or releases.

### More scrapers from scrapesage

Related Actors in the same category:

- **[Google News Scraper](https://apify.com/scrapesage/google-news-scraper)** - Articles, Sources & Monitoring
- **[Telegram Scraper](https://apify.com/scrapesage/telegram-scraper)** - Channels, Messages, Media & Search
- **[Google Trends Scraper](https://apify.com/scrapesage/google-trends-scraper)** - Interest, Regions & Trends
- **[Substack Scraper](https://apify.com/scrapesage/substack-scraper)** - Newsletters, Posts & Creator Leads
- **[IMDb Scraper](https://apify.com/scrapesage/imdb-scraper)** - Movies, TV Shows, Ratings, Cast & Box Office

### FAQ

**How is this Actor billed?** Pay-per-event: you pay only for the results it delivers, with no monthly rental and no start fee. The per-event price is shown on the Pricing tab.

**Can I schedule it and get results automatically?** Yes - create a [Schedule](https://docs.apify.com/platform/schedules) and add a [webhook](https://docs.apify.com/platform/integrations/webhooks) or an integration (Google Sheets, Slack, Make, Zapier) to push each run's dataset wherever you need it.

**Which export formats are available?** Every run's dataset can be downloaded as JSON, CSV, Excel (XLSX), XML, HTML or RSS from the Apify Console or the API.

**Can I run it from code or an AI agent?** Yes - through the [Apify API](https://docs.apify.com/api/v2) and client libraries, or from Claude, ChatGPT and other assistants via the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp).

**Is it legal to scrape DEV Community (dev.to)?** This Actor collects publicly available data only. You are responsible for using the output in compliance with applicable laws (including data-protection law where personal data is involved) and the source's terms. See **Data & lawful use** and the **Disclaimer** below.

**Is this an official DEV Community (dev.to) tool?** No. It is an independent, third-party Actor with no affiliation to, endorsement by or sponsorship from DEV Community (dev.to). See the **Disclaimer** below.

### Data & lawful use

This Actor reads only what DEV Community (dev.to) publishes to logged-out visitors: it does not log in, use cookies or session tokens, create accounts, or reach anything behind a sign-in. Names, handles, bios and engagement figures are public, but they relate to identifiable people, so treat the output as personal data. If you are in the EU or UK you are the data controller for what you do with it: have a lawful basis (usually legitimate interest for research, marketing analytics or B2B prospecting), honour access and deletion requests, and do not use the output for spam or unsolicited messaging.

Under [Apify's Standard Actor Contract](https://docs.apify.com/legal/standard-actor-contract), which governs your use of this Actor, you are the controller of any personal data in your input and output and scrapesage acts only as your processor: that data is processed solely to run your job, written only to your own Apify storage, never used for any other purpose and never shared onward. If you need help with a data-subject request that involves this Actor's output, open an issue on the Issues tab.

### Disclaimer

**This Actor is an independent tool and is not affiliated with, endorsed by, or sponsored by DEV Community (dev.to) or any of its subsidiaries. All trademarks mentioned are the property of their respective owners.**

"DEV Community (dev.to)" and any related marks are the property of their respective owners and are used here only in a descriptive, nominative sense - to identify the publicly accessible website from which this Actor collects data. This Actor is not an official DEV Community (dev.to) product, is not authorised or certified by DEV Community (dev.to), and does not distribute DEV Community (dev.to) software. It collects only publicly available information; you are responsible for ensuring your use of that data complies with applicable laws, regulations and the terms of the source website.

### Need help?

Open an issue on the Actor's **Issues** tab, or visit the [Apify help center](https://help.apify.com/). Feature requests are welcome - this Actor is actively maintained.

# Actor input Schema

## `tags` (type: `array`):

DEV.to tags to pull articles for, e.g. <code>javascript</code>, <code>python</code>, <code>webdev</code>, <code>ai</code>. Each tag is paged through separately.

## `username` (type: `string`):

Optional. Pull all articles by a single author (their DEV.to username, e.g. <code>ben</code>). Used instead of tags when set.

## `includeContent` (type: `boolean`):

Fetch each article's full Markdown body (one extra request per article). Off by default - the list already includes title, tags, reactions, comments and reading time.

## `maxResults` (type: `integer`):

Maximum number of articles to return.

## `proxyConfiguration` (type: `object`):

Proxies to use. The DEV.to API is public, so the default Apify datacenter proxy is plenty.

## Actor input object example

```json
{
  "tags": [
    "javascript",
    "python"
  ],
  "includeContent": false,
  "maxResults": 100,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}
```

# Actor output Schema

## `results` (type: `string`):

All scraped DEV.to article records as JSON items in the default dataset.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "tags": [
        "javascript",
        "python"
    ],
    "maxResults": 100,
    "proxyConfiguration": {
        "useApifyProxy": true
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("scrapesage/devto-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "tags": [
        "javascript",
        "python",
    ],
    "maxResults": 100,
    "proxyConfiguration": { "useApifyProxy": True },
}

# Run the Actor and wait for it to finish
run = client.actor("scrapesage/devto-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "tags": [
    "javascript",
    "python"
  ],
  "maxResults": 100,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}' |
apify call scrapesage/devto-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,scrapesage/devto-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/gT5AnlLtzH3nCQoHW/builds/RCQxnZjuNSYLAWMEq/openapi.json