# \[DEPRECATED] CrossRef Academic Scraper (`klondikeking/crossref-academic-scraper`) Actor

\[DEPRECATED — will be removed 2026-09-20] This actor is no longer maintained due to persistent reliability issues with the CrossRef target. Please use alternative academic data sources. Existing runs remain available until removal.

- **URL**: https://apify.com/klondikeking/crossref-academic-scraper.md
- **Developed by:** [Pierrick McD0nald](https://apify.com/klondikeking) (community)
- **Categories:** Developer tools, Business
- **Stats:** 2 total users, 1 monthly users, 86.2% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

$1.00 / 1,000 work extracteds

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## CrossRef Academic Scraper — DOI, Citation & Paper Metadata Extractor

Extract academic paper metadata, DOIs, authors, citations, and abstracts from CrossRef via the official public REST API. This Actor is designed for researchers, data scientists, bibliometricians, and anyone who needs structured academic publication data at scale.

CrossRef is the largest open scholarly metadata registry, indexing over 150 million works. This Actor queries that registry directly — no web scraping, no browser overhead, no proxy costs. Results are fast, clean, and reliable.

### Use Cases

- **Literature review automation** — Build structured datasets of papers on any topic for systematic reviews or meta-analyses.
- **Bibliometric research** — Collect citation counts, reference networks, and publisher distributions across disciplines.
- **Journal quality analysis** — Filter by journal, publisher, or publication type to map the scholarly landscape.
- **Research trend tracking** — Monitor emerging topics by querying new publications year over year.
- **Reference management** — Export paper metadata with DOIs and URLs for import into Zotero, Mendeley, or EndNote.

### Input

| Field | Type | Required | Description |
|-------|------|----------|-------------|
| `searchQuery` | String | Yes | Search terms to find academic works (e.g., "machine learning", "climate change") |
| `maxItems` | Integer | No | Maximum results to extract, 1–1000 (default: 100) |
| `workType` | String | No | Filter by type: journal-article, book-chapter, proceedings-article, book, dataset, etc. |
| `publisher` | String | No | Filter by publisher name (partial match) |
| `fromYear` | Integer | No | Only include works published on or after this year |
| `toYear` | Integer | No | Only include works published on or before this year |
| `sort` | String | No | Sort by relevance, published, updated, or deposited (default: relevance) |
| `proxyConfiguration` | Object | No | Proxy settings (optional, API calls rarely need a proxy) |

### Output

The Actor outputs a dataset where each item represents one academic work:

```json
{
  "title": "Machine learning vs. neutrosophic machine learning",
  "doi": "10.1201/9781003606055-5",
  "url": "https://doi.org/10.1201/9781003606055-5",
  "type": "book-chapter",
  "publisher": "CRC Press",
  "publishedDate": "2025-03-26",
  "authors": ["Florentin Smarandache"],
  "abstract": "",
  "subjects": ["Computer Science", "Artificial Intelligence"],
  "referenceCount": 0,
  "citationCount": 12,
  "containerTitle": "Neutrosophic Machine Learning",
  "page": "",
  "volume": "",
  "issue": "",
  "issn": ""
}
```

All fields are consistently typed. Missing values return empty strings or zeroes rather than nulls, making downstream processing easier.

### Pricing

Pay per event: **$0.001 per extracted work**.

Because this Actor uses the public CrossRef REST API directly, there are no proxy or browser costs. Margins exceed 95%, allowing us to pass those savings on to you at a highly competitive rate.

### Limitations

- CrossRef abstracts are not always available; many works return an empty abstract field.
- Author names are formatted as provided by publishers and may vary in completeness.
- CrossRef rate limits apply; the Actor handles 429 responses with automatic retry and exponential backoff.
- The API returns a maximum of 1,000 results per query due to CrossRef pagination limits.

### FAQ

**Q: Do I need an API key?**
A: No. CrossRef's public API does not require authentication for read operations.

**Q: Can I filter by specific journals?**
A: Yes. Use the `publisher` filter or post-process the `containerTitle` field in your downstream pipeline.

**Q: Are citation counts real-time?**
A: Citation counts are updated periodically by CrossRef and reflect their latest deposited data.

### Changelog

- **v1.0.0** — Initial release with search, filtering, author extraction, and citation counts.

# Actor input Schema

## `searchQuery` (type: `string`):

Search terms to find academic works (e.g., machine learning, climate change, CRISPR)

## `maxItems` (type: `integer`):

Maximum number of papers to extract (1-1000)

## `workType` (type: `string`):

Filter by publication type (leave empty for all types)

## `publisher` (type: `string`):

Filter by publisher name (optional, partial match)

## `fromYear` (type: `integer`):

Only include works published on or after this year

## `toYear` (type: `integer`):

Only include works published on or before this year

## `sort` (type: `string`):

How to sort the results

## `proxyConfiguration` (type: `object`):

Proxy settings for the Actor (optional, API calls usually do not need a proxy)

## Actor input object example

```json
{
  "searchQuery": "machine learning",
  "maxItems": 100,
  "workType": "",
  "sort": "relevance",
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}
```

# Actor output Schema

## `dataset` (type: `string`):

Dataset containing extracted academic works with metadata, DOIs, authors, and citations

## `stats` (type: `string`):

Key-value store with execution statistics (works extracted, API calls, duration)

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "searchQuery": "machine learning",
    "maxItems": 100,
    "workType": "",
    "publisher": "",
    "sort": "relevance",
    "proxyConfiguration": {
        "useApifyProxy": true
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("klondikeking/crossref-academic-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "searchQuery": "machine learning",
    "maxItems": 100,
    "workType": "",
    "publisher": "",
    "sort": "relevance",
    "proxyConfiguration": { "useApifyProxy": True },
}

# Run the Actor and wait for it to finish
run = client.actor("klondikeking/crossref-academic-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "searchQuery": "machine learning",
  "maxItems": 100,
  "workType": "",
  "publisher": "",
  "sort": "relevance",
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}' |
apify call klondikeking/crossref-academic-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,klondikeking/crossref-academic-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/HCSCaGdjVV3BlgjFR/builds/S0m6lC9ylfHJfcaWZ/openapi.json