Crossref Scholar Scraper

Search scholarly publications across 150+ million works via the Crossref REST API with intelligent author disambiguation, institution normalization, and subject classification.

What It Does

• Search the Crossref database by keyword, author, affiliation, funder, or DOI
• Normalize author names (J Smith → John Smith) and deduplicate
• Standardize institution names (MIT → Massachusetts Institute of Technology)
• Classify publications into broad subject areas (AI, medicine, physics, etc.)
• Output clean, structured data ready for bibliometric analysis, literature reviews, or knowledge graphs

Input Parameters

Parameter	Type	Required	Description
searchQuery	string	✅	Keywords, author name, DOI, or institution to search
maxResults	integer	No	Maximum results (1–1000, default: 50)
searchField	string	No	all, title, author, affiliation, funder, or doi
filterType	string	No	Filter by: journal-article, proceedings-article, book, dissertation, etc.
yearFrom	string	No	Filter from year (e.g., 2020)
yearTo	string	No	Filter to year (e.g., 2024)
normalizeAuthors	boolean	No	Normalize and deduplicate author names (default: true)
normalizeAffiliations	boolean	No	Normalize institution names (default: true)
emailAddress	string	No	Your email for Crossref's Polite Pool (better rate limits)

Example Input

{
  "searchQuery": "large language model alignment",
  "maxResults": 25,
  "searchField": "all",
  "filterType": "journal-article",
  "yearFrom": "2023",
  "normalizeAuthors": true,
  "normalizeAffiliations": true
}

Example Output

Each result includes:

• DOI and resolvable URL
• Title and abstract
• Normalized authors (deduplicated, name-expanded)
• Normalized affiliations (standardized institution names)
• Normalized journal name
• Subject areas (AI, medicine, etc.)
• Citation count (referenced-by count)
• Publication date, type, publisher, funders, ISSN

Plus aggregated statistics: top subject areas, most cited paper, publication type breakdown.

Use Cases

• Academic researchers — literature reviews, systematic reviews, citation analysis
• Bibliometric analysts — impact metrics, research trend analysis, institution benchmarking
• University libraries — publication tracking, open access monitoring
• AI/ML companies — building knowledge graphs, training data curation
• Journal publishers — monitoring publication metrics, competitor analysis
• Industry R&D — tracking scientific literature in specific domains

Data Source

Powered by the Crossref REST API — a free, open API providing metadata for 150+ million scholarly works. No API key required. Uses the Polite Pool with configurable email for better rate limits.

Pricing

Pay-per-result: $2.00 per 1,000 results. You only pay for the data you retrieve.