# medRxiv Preprints Scraper (`parseforge/medrxiv-scraper`) Actor

Scrapes medRxiv preprint records by search query or direct URL. Returns each paper as a flat row with title, authors, abstract, DOI, subject collection, and posting date.

- **URL**: https://apify.com/parseforge/medrxiv-scraper.md
- **Developed by:** [ParseForge](https://apify.com/parseforge) (community)
- **Categories:** Developer tools, Automation, Other
- **Stats:** 9 total users, 0 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $1.28 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

[![ParseForge](https://raw.githubusercontent.com/ParseForge/apify-assets/main/banner.jpg)](https://apify.com/parseforge?fpr=vmoqkp)

### medRxiv Preprints Scraper

**Scrape medRxiv preprints by keyword, subject, author, or date range, up to a million papers per run.** Every record comes with its title, authors, abstract, DOI, subject collection, and posting date. No API key or login. Export to CSV, JSON, Excel, or XML.

medRxiv's official API needs registration and rate limits you. This reads the public preprint listings directly, filtered by search term, subject collection, author, or posting date, and returns each match in one fixed schema.

| Who uses it | What they scrape medRxiv for |
|---|---|
| Epidemiologists | Monitor new preprint evidence on a disease or intervention |
| Systematic reviewers | Build a corpus of preprints for a living review |
| Pharma competitive intelligence teams | Track competitor research posted as preprints |
| Science journalists | Find early findings on a topic before journal publication |
| Academic researchers | Stay current on preprints in their field |

### What it does

This Actor collects medRxiv preprint records by search query or direct URL, and returns each paper as a flat row.

- 🔍 **Keyword search:** enter any term, from 'bacterial infection' to a full title, and get matching preprints.
- 📅 **Date range filter:** restrict results to papers posted between two dates with Posted From and Posted To.
- 👤 **Author filter:** narrow to preprints by a specific author name.
- 🏷️ **Subject collection:** pick from 50+ medical specialties, from Cardiology to Public and Global Health.
- 🔗 **Direct URL:** paste any medRxiv search URL to scrape exactly that result set.
- 📊 **Structured output:** each paper is a flat row with title, authors, abstract, DOI, subject, and posting date.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

### What you can do with medRxiv data

**📈 Track emerging research topics.**

A public health researcher runs the scraper weekly with the query 'long covid' and a date range of the last 7 days to see new preprints and decide which to read.

**🧪 Build a systematic review corpus.**

A systematic reviewer collects all preprints in the Infectious Diseases subject collection from the last year, then exports the CSV to screen titles and abstracts.

**💊 Monitor competitor preprints.**

A pharma analyst sets the author filter to a competitor's lead scientist and gets every preprint they post, with abstracts, to inform pipeline strategy.

**📰 Find early science stories.**

A journalist searches for 'cancer vaccine' and sorts by newest to spot preprints that could become news before journal publication.

**🎓 Stay current in a specialty.**

A cardiologist runs the scraper with subject collection 'Cardiovascular Medicine' and date from last month to keep up with new findings.

### Why choose this scraper

|  | What you get |
|---|---|
| **No API key** | Scrape public preprint pages without registering or waiting for rate limits |
| **Full record** | Title, authors, abstract, DOI, subject collection, and posting date in one row |
| **Flexible input** | Search by keyword, subject, author, date range, or paste a URL |
| **Any volume** | Collect up to 1,000,000 papers per run |
| **Export anywhere** | CSV, JSON, Excel, or XML for your analysis pipeline |

### How it compares

This Actor focuses on medRxiv only, with a full set of search filters and a flat row per paper. The competitors below either cover both bioRxiv and medRxiv or offer a subset of fields.

| Feature | ParseForge | bioRxiv & medRxiv Preprint Scraper | Medrxiv Preprints Scraper | Medrxiv Scraper |
|---|---|---|---|---|
| Search by keyword | Yes | Not listed | Not listed | Not listed |
| Filter by subject collection | Yes | Not listed | Not listed | Not listed |
| Filter by author | Yes | Not listed | Not listed | Not listed |
| Filter by date range | Yes | Yes | Not listed | Yes |
| Full abstract text | Yes | Not listed | Not listed | Yes |
| DOI | Yes | Yes | Yes | Yes |
| Export to CSV, JSON, Excel, XML | Yes | Not listed | Yes | Not listed |

### Configure the run

Drive the Actor from a search query or a direct medRxiv URL, and filters run as each paper is read so only matches reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

```json
{
  "maxItems": 10,
  "searchQuery": "bacterial infection",
  "orderBy": "relevance"
}
```

A larger pull:

```json
{
  "maxItems": 200,
  "searchQuery": "bacterial infection",
  "orderBy": "relevance"
}
```

### Pricing

Pay-per-result: **$0.075 per result** collected. You pay only for the results written to your dataset.

| Results collected | Approximate cost |
|---|---|
| 100 results | $7.50 |
| 1,000 results | $75.00 |
| 10,000 results | $750.00 |

New Apify accounts start with $5 in free credit.

### Free users

Free-plan runs return up to 10 results as a preview. [Upgrade your Apify plan](https://console.apify.com/sign-up?fpr=vmoqkp) to collect up to 1,000,000 results per run.

### Run it

1. [Create a free Apify account with $5 in credit](https://console.apify.com/sign-up?fpr=vmoqkp).
2. Open the [medRxiv Preprints Scraper](https://apify.com/parseforge/medrxiv-scraper?fpr=vmoqkp).
3. Set your inputs and any filters, then click **Start**.
4. Export the results as CSV, Excel, JSON, or XML from the **Dataset** tab.

Run it programmatically through the [Apify API](https://docs.apify.com/api/v2) (`run-sync-get-dataset-items`) or the [ApifyClient](https://docs.apify.com/api/client/js) for JavaScript and Python.

### Use with AI agents (MCP)

Give an AI agent live access to medRxiv through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

```bash
claude mcp add --transport http apify "https://mcp.apify.com/?tools=parseforge/medrxiv-scraper"
```

Then prompt it in plain language to run the scraper and read back the results.

### Troubleshooting

**Why am I getting no results?**

Check that your search query or URL is correct and that the filters are not too restrictive. Try removing the date range or subject collection to see if results appear.

**Why did the run stop before reaching my maximum papers?**

The scraper stops when there are no more results matching your filters. Try broadening the search or removing some filters.

**Why are some papers missing fields like abstract or author?**

Some medRxiv records may have incomplete metadata. The scraper returns whatever is available on the page.

**Can I scrape a search URL with multiple pages?**

Yes. The scraper follows pagination automatically. Set the Maximum papers field to control how many papers to collect.

**Why did I get an error when using both searchQuery and startUrl?**

These fields are mutually exclusive. Use only one of them per run.

### FAQ

| Question | Answer |
|---|---|
| What is medRxiv? | medRxiv is a free online archive for complete but unpublished manuscripts in the medical, clinical, and related health sciences. It is operated by Cold Spring Harbor Laboratory. |
| Do I need an API key or login? | No. The scraper reads the public medRxiv search pages directly, so no registration or authentication is required. |
| Can I scrape a specific medRxiv article? | Yes. Paste the article URL into the startUrl field and the scraper will collect that paper's record. |
| What data does each paper include? | Each row includes the title, authors, abstract, DOI, subject collection, and posting date, among other fields shown in the sample output. |
| How do I filter by date? | Use the Posted From and Posted To fields with dates in YYYY-MM-DD format. The scraper maps these to medRxiv's limit\_from and limit\_to filters. |
| Can I search by author? | Yes. Enter a name in the Author field and the scraper will restrict results to papers where that name appears in the author list. |
| What subject collections are available? | There are over 50 subject collections, from Addiction Medicine to Urology. Select one from the dropdown or leave it blank for all subjects. |
| How do I sort the results? | Use the Sort Order field to choose Best Match, Oldest First, or Newest First. |
| Can I export the data? | Yes. The scraper outputs structured data that you can export as CSV, JSON, Excel, or XML from the Apify dataset. |
| Is there a limit on how many papers I can scrape? | You can set the Maximum papers field up to 1,000,000 per run. The default is 10. |
| Can I use both a search query and a start URL? | No. Use either the searchQuery field or the startUrl field, not both. The scraper will use whichever is provided. |
| Does this scrape bioRxiv too? | No, this Actor is for medRxiv only. For bioRxiv, consider a dedicated bioRxiv scraper. |

### Related actors

Browse the full [ParseForge collection](https://apify.com/parseforge?fpr=vmoqkp) for more scrapers.

🆘 **Need help?** Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ **Disclaimer.** This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Cold Spring Harbor Laboratory. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.

# Actor input Schema

## `startUrl` (type: `string`):

medRxiv.org search URL to start scraping from. Use this for custom searches or specific URLs. Cannot be used together with searchQuery. Example: https://www.medrxiv.org/search/asd or https://www.medrxiv.org/search/asd?page=1

## `maxItems` (type: `integer`):

How many papers to collect per run.

## `searchQuery` (type: `string`):

Search term to query medRxiv articles. Cannot be used together with startUrl. The scraper will search for articles matching this query.

## `subjectCollection` (type: `string`):

Restrict results to articles posted in a specific medRxiv subject collection. Maps to the source's subject\_collection\_code filter.

## `dateFrom` (type: `string`):

Lower bound for the posting date, in YYYY-MM-DD format. Maps to the source's limit\_from filter.

## `dateTo` (type: `string`):

Upper bound for the posting date, in YYYY-MM-DD format. Maps to the source's limit\_to filter.

## `author` (type: `string`):

Restrict results to articles where this name appears in the author list. Maps to the source's author1 filter.

## `orderBy` (type: `string`):

How to sort the search results. 'relevance' = Best match, 'oldest' = Oldest First, 'newest' = Newest First

## Actor input object example

```json
{
  "startUrl": "https://www.medrxiv.org/search/asd",
  "maxItems": 10,
  "searchQuery": "bacterial infection",
  "dateFrom": "2025-01-01",
  "dateTo": "2025-12-31",
  "author": "Smith",
  "orderBy": "relevance"
}
```

# Actor output Schema

## `articles` (type: `string`):

Complete dataset with all scraped medRxiv articles including full details

## `overview` (type: `string`):

Overview view of articles with key fields displayed in a table format

## `details` (type: `string`):

Complete article details view with all fields including full text and declarations

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "maxItems": 10,
    "searchQuery": "bacterial infection",
    "orderBy": "relevance"
};

// Run the Actor and wait for it to finish
const run = await client.actor("parseforge/medrxiv-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "maxItems": 10,
    "searchQuery": "bacterial infection",
    "orderBy": "relevance",
}

# Run the Actor and wait for it to finish
run = client.actor("parseforge/medrxiv-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "maxItems": 10,
  "searchQuery": "bacterial infection",
  "orderBy": "relevance"
}' |
apify call parseforge/medrxiv-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,parseforge/medrxiv-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/xXWi84HlqtCUqmG1M/builds/iCN5VsxfOkgnNo24T/openapi.json