Medium Articles Scraper

Here is one real result, with every field the actor returns:

{
  "imageUrl": "https://cdn-images-1.medium.com/max/1672/1*TKtuorIle-mvLIaoMRGE4Q.png",
  "title": "The AI Campus Is Entering the Gas Market",
  "url": "https://medium.com/@adrianvaren/the-ai-campus-is-entering-the-gas-market-ed979a2ab749",
  "id": "ed979a2ab749",
  "subtitle": "A 20-year power agreement can secure generation, while turbine slots, pipeline capacity, air permits and reserve margins still set the...",
  "previewText": "A 20-year power agreement can secure generation, while turbine slots, pipeline capacity, air permits and reserve margins still set the...",
  "author": "Adrian Varen",
  "authorUsername": "adrianvaren",
  "authorUrl": "https://medium.com/@adrianvaren",
  "authorBio": "Independent journalist covering AI infrastructure, power, data centers and capital. The physical economy behind AI. Disclosed pen name.",
  "authorFollowerCount": 0,
  "authorImageUrl": "https://miro.medium.com/v2/resize:fill:176:176/1*XFtQXRp2k_oRTzEdUO-Rqw.png",
  "authorTwitter": null,
  "publication": null,
  "publicationSlug": null,
  "publicationUrl": null,
  "publishedAt": "2026-08-10T14:18:57.070Z",
  "updatedAt": "2026-08-10T14:18:57.070Z",
  "readingTimeMinutes": 6,
  "wordCount": 1538,
  "clapCount": 0,
  "responsesCount": 0,
  "tags": ["artificial-intelligence", "data-center", "energy", "natural-gas", "infrastructure"],
  "primaryTopic": null,
  "isMemberOnly": false,
  "isSeries": false,
  "isShortform": false,
  "isNewsletter": false,
  "license": "ALL_RIGHTS_RESERVED",
  "language": "en",
  "canonicalUrl": "https://medium.com/@adrianvaren/the-ai-campus-is-entering-the-gas-market-ed979a2ab749",
  "fullText": null,
  "sourceType": "tag",
  "sourceInput": "artificial-intelligence",
  "source": "Medium",
  "observedAt": "2026-08-10T14:33:12.957Z",
  "error": null
}

Note: the source subtitle ends with an ellipsis, shown here as three dots; every value above is real. The most complete Medium scraper available. It returns every field the article and author expose, including claps, responses, reading time, word count, member-only and license flags, language and author bio, and lets you collect by tag, publication, author, direct URL or any start URL in one run.

📥 Input · 📤 Output · 💰 Pricing · ▶️ Examples

Table of contents

• What it does
• Quickstart
• Input reference
• Output reference
• Example output record
• Run via API and CLI
• Fetch results
• Billing and limits
• FAQ and troubleshooting

What it does

The actor collects Medium articles from any mix of tags, publications, authors, direct article URLs or start URLs, and writes one normalized record per article to the run's dataset. With withDetails on (the default), each article is opened to add claps, responses, reading time, subtitle, word count, member-only flag, language and the resolved author and publication. With withContent on, the full plain-text body is included too. Everything runs in one job under a single shared maxArticles cap, and missing source values are returned as null.

Quickstart

Open the actor, paste this into the input, and press Run. It returns the 10 latest articles under the artificial-intelligence tag, with stats.

{
  "maxArticles": 10,
  "withDetails": true,
  "tags": ["artificial-intelligence"]
}

Mix in publications, authors, articleUrls or startUrls to collect from several sources in one run. Set withContent to true to include the full article body.

Input reference

Field	Type	Required	Default	Description
maxArticles	integer	no	10	Maximum articles to collect across every tag, publication, author and URL. Free Apify plans are capped at 10 per run.
withDetails	boolean	no	true	Open each article to add claps, responses, reading time, subtitle, word count, member-only flag, language and resolved author/publication. Off is a faster listing-only run.
withContent	boolean	no	false	Also include the full plain-text body of each article. Opens each article page.
tags	string[]	no	["artificial-intelligence"]	Medium tag slugs, for example programming, startup, data-science, productivity. Collects the latest articles per tag.
publications	string[]	no	(none)	Publication slugs or custom domains, for example better-programming, towardsdatascience.com. Collects each publication's latest articles.
authors	string[]	no	(none)	Medium usernames, with or without the leading @, for example @quincylarson. Collects each author's latest articles.
articleUrls	string[]	no	(none)	Direct Medium article URLs to scrape individually.
startUrls	array	no	(none)	Any Medium URL (tag, publication, author, feed or article). The type is detected automatically.

Output reference

One dataset item per article. Types: string, integer, boolean, array, or null when the source value is absent.

Field	Type	Description
imageUrl	string	Article cover image URL.
title	string	Article title.
url	string	Article URL.
id	string	Medium article identifier.
subtitle	string	Article subtitle.
previewText	string	Preview snippet.
author	string	Author display name.
authorUsername	string	Author username.
authorUrl	string	Author profile URL.
authorBio	string	Author bio.
authorFollowerCount	integer	Author follower count.
authorImageUrl	string	Author avatar URL.
authorTwitter	string	Author Twitter/X handle, or null.
publication	string	Publication name, or null.
publicationSlug	string	Publication slug, or null.
publicationUrl	string	Publication URL, or null.
publishedAt	string	ISO 8601 publish timestamp.
updatedAt	string	ISO 8601 last-updated timestamp.
readingTimeMinutes	integer	Estimated reading time in minutes.
wordCount	integer	Article word count.
clapCount	integer	Number of claps.
responsesCount	integer	Number of responses.
tags	string[]	Article tag slugs.
primaryTopic	string	Primary topic, or null.
isMemberOnly	boolean	true if behind the Medium paywall.
isSeries	boolean	true if the article is a series.
isShortform	boolean	true if short-form.
isNewsletter	boolean	true if a newsletter issue.
license	string	Content license, for example ALL_RIGHTS_RESERVED.
language	string	Article language code.
canonicalUrl	string	Canonical article URL.
fullText	string	Full plain-text body when withContent is on, else null.
sourceType	string	Which source produced the record: tag, publication, author, or url.
sourceInput	string	The tag, publication, author or URL that produced this record.
source	string	Always Medium.
observedAt	string	ISO 8601 timestamp of when the record was collected.
error	string	null on success. On a failed run, a single item with a populated error field is written instead.

Example output record

Real record from a live run (input {"tags": ["artificial-intelligence"], "withDetails": true, "maxArticles": 10}):

{
  "title": "The AI Campus Is Entering the Gas Market",
  "url": "https://medium.com/@adrianvaren/the-ai-campus-is-entering-the-gas-market-ed979a2ab749",
  "id": "ed979a2ab749",
  "author": "Adrian Varen",
  "authorUsername": "adrianvaren",
  "authorBio": "Independent journalist covering AI infrastructure, power, data centers and capital. The physical economy behind AI. Disclosed pen name.",
  "publishedAt": "2026-08-10T14:18:57.070Z",
  "readingTimeMinutes": 6,
  "wordCount": 1538,
  "clapCount": 0,
  "responsesCount": 0,
  "tags": ["artificial-intelligence", "data-center", "energy", "natural-gas", "infrastructure"],
  "isMemberOnly": false,
  "license": "ALL_RIGHTS_RESERVED",
  "language": "en",
  "sourceType": "tag",
  "sourceInput": "artificial-intelligence",
  "source": "Medium",
  "observedAt": "2026-08-10T14:33:12.957Z",
  "error": null
}

Some fields are omitted here for length; live runs return every field listed above with real values.

Run via API and CLI

Start a run and wait for it to finish, then read the dataset. Replace <TOKEN> with your Apify API token.

Run synchronously and get dataset items in one call:

curl -X POST "https://api.apify.com/v2/acts/scrapers_lat~medium-scraper/run-sync-get-dataset-items?token=<TOKEN>" \
  -H "Content-Type: application/json" \
  -d '{"tags":["programming"],"withDetails":true,"maxArticles":25}'

Start a run asynchronously:

curl -X POST "https://api.apify.com/v2/acts/scrapers_lat~medium-scraper/runs?token=<TOKEN>" \
  -H "Content-Type: application/json" \
  -d '{"authors":["@quincylarson"],"withContent":true,"maxArticles":50}'

Apify CLI:

apify call scrapers_lat/medium-scraper \
  --input '{"publications":["towardsdatascience.com"],"maxArticles":50}'

Fetch results

Every run writes to a dataset. Fetch items as JSON, CSV, or Excel by changing format:

# JSON
curl "https://api.apify.com/v2/datasets/<DATASET_ID>/items?token=<TOKEN>&clean=true&format=json"

# CSV
curl "https://api.apify.com/v2/datasets/<DATASET_ID>/items?token=<TOKEN>&clean=true&format=csv"

# Paginate large datasets
curl "https://api.apify.com/v2/datasets/<DATASET_ID>/items?token=<TOKEN>&offset=1000&limit=1000"

<DATASET_ID> is returned as defaultDatasetId in the run object. Use offset and limit to page through large result sets. clean=true drops empty and internal fields.

Billing and limits

• Pay per result. You are charged per record returned (result event). See the pricing tab for the current per-result price.
• No charge on failure. If a run errors, the actor writes a single item with a populated error field and does not charge for it. Empty runs cost nothing.
• Spend cap respected. Set maxTotalChargeUsd on the run; once reached, the actor stops emitting and charging further billable results.
• Free Apify plans are capped at 10 records per run. Upgrade for higher maxArticles.

FAQ and troubleshooting

A run returned 0 records. Why? The tag, publication or author had no accessible articles, or the slug was wrong. Use the exact Medium tag slug (for example data-science) and a valid username. Zero-result runs are not charged.

How do I get the full article text? Set withContent to true. The full plain-text body is written to fullText.

What is the difference between withDetails and withContent? withDetails adds stats and resolved author/publication by opening each article. withContent additionally includes the full body text.

Why is publication null? The article was published on a personal profile, not under a publication. Missing values are returned as null, never invented.

Is this an official Medium tool? No. This actor is independent and has no affiliation with Medium. It reads only data that is publicly available on the site.

Related scrapers

• Hacker News Scraper: Hacker News stories and comments.
• Google News Scraper: News articles from Google News.
• GitHub Repositories Scraper: repositories and developer projects on GitHub.
• DeviantArt Scraper: DeviantArt creator content.
• Goodreads Scraper: Books, authors and reviews on Goodreads.
• GDELT News Events Scraper: Global news events from GDELT.

More scrapers at scrapers.lat

Built and maintained by scrapers.lat, where we publish scrapers for US and Latin American public platforms: company registries, government data, finance, e-commerce and more. Browse the catalog or request a custom scraper at scrapers.lat.

---

Independent tool, not affiliated with Medium. Accesses only publicly available data.