# arXiv Paper Tracker - Free Academic API (`wiry_kingdom/arxiv-paper-tracker`) Actor

Track new arXiv papers. Filter by category (cs.AI, cs.LG, q-bio.NC...), author, keyword, date. Returns title, authors, abstract, PDF link, DOI. Free official arXiv API. For AI/ML researchers, biotech analysts, journalists.

- **URL**: https://apify.com/wiry\_kingdom/arxiv-paper-tracker.md
- **Developed by:** [Mohieldin Mohamed](https://apify.com/wiry_kingdom) (community)
- **Categories:** Business, Developer tools
- **Stats:** 4 total users, 0 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

Pay per event

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## arXiv Paper Tracker

**Track new academic papers on arXiv. Filter by category, author, keyword, or date. Free official arXiv API. No key required.**

This actor uses the official arXiv Atom-format public API to extract paper metadata with full structured fields. Tested on real data: 172,328 cs.AI papers, 307,287 cs.LG diffusion model papers, 759 papers with "Hinton" co-authors.

### What you actually get

Real papers returned in test runs:

| ID | Title | Authors |
|----|-------|---------|
| 2604.13029v1 | Visual Preference Optimization with Rubric Rewards | 18 authors led by Ya-Qi Yu |
| 2401.05779v4 | Erasing Undesirable Influence in Diffusion Models | Jing Wu, Trung Le, Munawar Hayat |
| 2603.24741v1 | The Diffuse Gamma-ray Sky of a Milky Way Analogue | 11 authors incl. Jim Hinton |

Each row includes:

- arXiv ID (e.g. `2604.13029v1`)
- Title (cleaned of XML escaping)
- Full author list as array
- Primary category + all categories (cs.AI, cs.CV, hep-ph, etc.)
- Published date and last-updated date
- Full abstract (optional)
- Direct links: HTML abstract page + PDF
- DOI (when paper is linked to a published version)
- Author comment (e.g. "Accepted at NeurIPS 2024", page count)
- Journal reference (when published)

### Why use this

arXiv hosts **2.5 million+ research papers** across CS, math, physics, biology, economics, and more. ~17,000 new papers are submitted **every week**. Tracking new releases in your domain is essential for:

- **AI/ML researchers** — be the first to read new SOTA papers in your area
- **Tech investors and VCs** — predict which research areas will become commercial in 12-24 months
- **Science journalists** — break stories on new papers from labs you watch
- **Biotech analysts** — track competitive research from labs at Big Pharma + universities
- **Indie hackers building AI tools** — find new papers for your RAG dataset
- **Academic literature reviewers** — automate paper discovery for systematic reviews
- **Patent attorneys and IP firms** — track prior art in real time
- **Newsletters and blogs** — automate "this week in AI" content sourcing

Commercial alternatives that do similar things:

- **Semantic Scholar API** — free, but rate-limited and missing some fields
- **Connected Papers** — $5-15/month, beautiful UI but no bulk export
- **Paperscape** — free, visual, but no API
- **Google Scholar Alerts** — free, email only, no structured export
- **Scite.ai** — $99-499/month, citation-focused

This actor delivers structured JSON output with pay-per-event pricing — perfect for low-volume use that doesn't justify a $99/month subscription.

### Honest limitations

- **arXiv has a self-imposed 3-second rate limit** between requests. We comply, so large pulls (10,000+ papers) take a while.
- **arXiv author search is fuzzy.** Searching `"Hinton"` matches any author with "Hinton" in their name, not just Geoffrey Hinton. Use `"Geoffrey Hinton"` or include co-authors for disambiguation.
- **The boolean query syntax is arXiv's own**, not standard SQL. Use `AND`, `OR`, `ANDNOT`, parentheses. Field prefixes: `ti:` (title), `au:` (author), `abs:` (abstract), `cat:` (category), `all:` (anywhere).
- **arXiv only covers preprints**, not peer-reviewed final versions. Many papers eventually get DOIs, but the abstract on arXiv may differ slightly from the published version.
- **arXiv ID versions matter.** `2604.13029v1` and `2604.13029v2` are different revisions. We return whatever version was current at fetch time.

### How to use

1. Click **Try for free** (or **Start**)
2. Pick **categories** to filter (e.g. `["cs.AI", "cs.LG"]`)
3. Optionally add **search query** with arXiv syntax (e.g. `"transformer ANDNOT survey"`)
4. Optionally add **author names** for disambiguation
5. Pick **sort order** (newest first / recently updated / relevance)
6. Set **max results** (default 50, max 50,000)
7. Click **Start**

### Common arXiv categories

| Code | Field |
|------|-------|
| `cs.AI` | Artificial Intelligence |
| `cs.LG` | Machine Learning |
| `cs.CL` | Computation and Language (NLP) |
| `cs.CV` | Computer Vision |
| `cs.RO` | Robotics |
| `cs.NE` | Neural and Evolutionary Computing |
| `cs.IR` | Information Retrieval |
| `cs.CR` | Cryptography and Security |
| `cs.DC` | Distributed Computing |
| `cs.SE` | Software Engineering |
| `cs.HC` | Human-Computer Interaction |
| `stat.ML` | Statistics - Machine Learning |
| `math.OC` | Math - Optimization and Control |
| `q-bio.NC` | Quantitative Biology - Neurons and Cognition |
| `q-fin.TR` | Quantitative Finance - Trading and Microstructure |
| `econ.EM` | Economics - Econometrics |
| `physics.bio-ph` | Physics - Biological Physics |
| `hep-ph` | High Energy Physics - Phenomenology |

Full list: https://arxiv.org/category\_taxonomy

### Output

```json
{
    "arxivId": "2604.13029v1",
    "title": "Visual Preference Optimization with Rubric Rewards",
    "authors": ["Ya-Qi Yu", "Fangyu Hong", "Xiangyang Qu", "Hao Wang", "..."],
    "primaryCategory": "cs.CV",
    "categories": ["cs.CV", "cs.AI"],
    "publishedAt": "2026-04-14T17:58:22Z",
    "updatedAt": "2026-04-14T17:58:22Z",
    "abstract": "The effectiveness of Direct Preference Optimization (DPO) depends on preference data...",
    "absUrl": "https://arxiv.org/abs/2604.13029v1",
    "pdfUrl": "https://arxiv.org/pdf/2604.13029v1",
    "doi": null,
    "comment": "12 pages, 5 figures",
    "journalRef": null,
    "extractedAt": "2026-04-15T21:35:00.000Z"
}
```

### Pricing

This actor uses **pay-per-event** pricing — extremely cheap given how cheap academic data is to extract:

- **Actor start**: $0.05 per run
- **Per paper extracted**: $0.005 per paper

**Example costs:**

- 100 latest cs.AI papers → $0.55
- 1,000 papers for a literature review → $5.05
- Daily check on cs.LG (50 new papers/day) → ~$8/month
- Bulk pull of all 50,000 cs.CL papers ever → $250.05

For comparison: Connected Papers Pro is $5/month with limited filters. Scite.ai is $99/month base. Most academic researchers can use this actor for under $5/month.

Free Apify tier members get $5/month in platform credits, which covers ~1,000 papers per month.

### Tips

- **Use `sortBy: submittedDate`** for new-paper alerts (default)
- **Use `sortBy: relevance`** when you have a search query and want the best matches first
- **Combine categories with `+OR+`** in your downstream pipeline if you want union, or pass multiple categories in the input array (we OR them automatically)
- **Schedule daily runs** with date filters in your downstream code to build a fresh-papers queue
- **Pipe abstracts into an LLM** for summarization — each paper is ~200-400 tokens of abstract, perfect for batch summarization

### Source

This actor uses the official **arXiv Atom-format query API** at `http://export.arxiv.org/api/query`. The API is documented at https://info.arxiv.org/help/api/index.html. It's free, public, requires no authentication, and is maintained by Cornell University as a community service.

### License

This actor is MIT licensed. arXiv papers themselves are licensed individually by their authors — most use Creative Commons or arXiv's nonexclusive license. **Always cite the original paper** when using extracted abstracts in your work.

# Actor input Schema

## `categories` (type: `array`):

List of arXiv category codes. Common: cs.AI (artificial intelligence), cs.CL (computation and language), cs.LG (machine learning), cs.CV (computer vision), q-bio.NC (neural and cognitive), hep-ph (high-energy physics phenomenology), math.OC (optimization). Empty = use search query only.

## `searchQuery` (type: `string`):

Free-text search across title, abstract, comments, authors. Use arXiv's syntax: AND, OR, ANDNOT, parentheses. Example: 'attention AND transformer ANDNOT survey'. Empty = no text filter.

## `authors` (type: `array`):

Filter by author name (e.g. \['Hinton', 'LeCun', 'Bengio']). Searches the author field.

## `sortBy` (type: `string`):

How to sort results. submittedDate (newest first), lastUpdatedDate (recently updated first), or relevance.

## `maxResults` (type: `integer`):

Cap on papers extracted. arXiv returns up to 2000 per request; we paginate up to 50,000 total.

## `includeAbstracts` (type: `boolean`):

Include the full paper abstract. Recommended for RAG/training datasets.

## `proxyConfiguration` (type: `object`):

Optional Apify Proxy. arXiv is friendly to direct access — proxy rarely needed.

## Actor input object example

```json
{
  "categories": [
    "cs.AI"
  ],
  "searchQuery": "",
  "authors": [],
  "sortBy": "submittedDate",
  "maxResults": 50,
  "includeAbstracts": true,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}
```

# Actor output Schema

## `dataset` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "categories": [
        "cs.AI"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("wiry_kingdom/arxiv-paper-tracker").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "categories": ["cs.AI"] }

# Run the Actor and wait for it to finish
run = client.actor("wiry_kingdom/arxiv-paper-tracker").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "categories": [
    "cs.AI"
  ]
}' |
apify call wiry_kingdom/arxiv-paper-tracker --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,wiry_kingdom/arxiv-paper-tracker"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/H3amNRNQQCv0f2JiE/builds/8k4EO7H5JVfj72kJ1/openapi.json