# Duolingo Language Data Scraper (`parseforge/duolingo-language-data-scraper`) Actor

Scrapes Duolingo vocabulary and phrase data for a specified source and learning language pair. Returns each word with its translation, skill, and unit as a flat row.

- **URL**: https://apify.com/parseforge/duolingo-language-data-scraper.md
- **Developed by:** [ParseForge](https://apify.com/parseforge) (community)
- **Categories:** Lead generation
- **Stats:** 7 total users, 0 monthly users, 91.4% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $19.00 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

[![ParseForge](https://raw.githubusercontent.com/ParseForge/apify-assets/main/banner.jpg)](https://apify.com/parseforge?fpr=vmoqkp)

### Duolingo Language Data Scraper

**Scrape Duolingo course data for any language pair, up to a million records per run.** Every record includes the word, translation, skill, unit, and lexical metadata. No API key required. Export to CSV, JSON, Excel, or XML.

Duolingo's internal API is undocumented and changes frequently, making reliable data collection difficult. This actor reads the public course data directly for any source and target language combination you specify. It returns a structured dataset of vocabulary, phrases, and their associated skills, ready for linguistic analysis or app development.

| Who uses it | What they scrape Duolingo for |
|---|---|
| Language learning researchers | Analyze the vocabulary scope and sequence of a Duolingo course. |
| EdTech product managers | Benchmark a competitor's curriculum content and skill progression. |
| Flashcard app developers | Populate a new study deck with official Duolingo translations. |
| Polyglots and linguists | Extract a full word list for a less-common language to build a personal glossary. |

### What it does

This Actor collects Duolingo vocabulary and phrase data for a specified language pair and returns each lexical entry as a flat row.

- 🌐 **Any language pair:** Specify source and target languages using standard ISO codes like 'en' for English or 'es' for Spanish.
- 📚 **Full course structure:** Each word is linked to its skill, unit, and position within the Duolingo learning path.
- 📊 **Lexical metadata:** Returns the base form, translation, part of speech, and gender where applicable.
- ⚙️ **Simple configuration:** set the source language, target language, and the maximum number of records you need.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

### What you can do with Duolingo data

**📈 Analyze curriculum design.**

A researcher extracts the full Spanish-for-English-speakers course to study the order in which grammatical concepts are introduced.

**🧠 Build a custom study tool.**

A developer scrapes the French vocabulary list to create a specialized Anki deck with native audio and example sentences.

**📊 Compare language courses.**

A product manager collects data for the English-from-Japanese and English-from-Korean courses to compare vocabulary count and topic coverage.

**🔤 Create a bilingual dictionary.**

A linguist downloads all translations for a rare language pair to bootstrap a new digital dictionary project.

### Why choose this scraper

| | What you get |
|---|---|
| **No API key** | Access the data without registering an application or managing OAuth tokens. |
| **Structured output** | Get a clean, flat table with consistent columns for every lexical item, ready for analysis. |
| **Full course coverage** | Retrieve words and phrases from every skill and unit in the selected language course. |

### How it compares

No other Store actor targets Duolingo the same way, so the honest comparison is with the alternatives teams actually weigh.

| | Duolingo Language Data Scraper | Build it in-house | By hand |
|---|---|---|---|
| Setup | Run it now, zero config | Days of engineering | None, but hours per pull |
| When Duolingo changes | Maintained for you | You fix it | You re-learn the page |
| Proxies, retries, anti-bot | Built in | Your problem | Browser only |
| Output | Fixed JSON schema, CSV/Excel export | Whatever you build | Copy-paste |
| Cost | Pay per result | Engineering time | Analyst hours |

### Configure the run

Drive the Actor with a source language code and a learning language code, and set a maximum record limit to control the size of your output dataset. The Input tab lists every parameter.

A first run with the defaults:

```json
{
 "maxItems": 10
}
```

A larger pull:

```json
{
 "maxItems": 200
}
```

### Pricing

Pay-per-result: **$0.021 per result** collected. You pay only for the results written to your dataset.

| Results collected | Approximate cost |
|---|---|
| 100 results | $2.10 |
| 1,000 results | $21.00 |
| 10,000 results | $210.00 |

New Apify accounts start with $5 in free credit.

### Free users

Free-plan runs return up to 10 results as a preview. [Upgrade your Apify plan](https://console.apify.com/sign-up?fpr=vmoqkp) to collect up to 1,000,000 results per run.

### Run it

1. [Create a free Apify account with $5 in credit](https://console.apify.com/sign-up?fpr=vmoqkp).
2. Open the [Duolingo Language Data Scraper](https://apify.com/parseforge/duolingo-language-data-scraper?fpr=vmoqkp).
3. Set your inputs and any filters, then click **Start**.
4. Export the results as CSV, Excel, JSON, or XML from the **Dataset** tab.

Run it programmatically through the [Apify API](https://docs.apify.com/api/v2) (`run-sync-get-dataset-items`) or the [ApifyClient](https://docs.apify.com/api/client/js) for JavaScript and Python.

### Use with AI agents (MCP)

Give an AI agent live access to Duolingo through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

```bash
claude mcp add --transport http apify "https://mcp.apify.com/?tools=parseforge/duolingo-language-data-scraper"
```

Then prompt it in plain language to run the scraper and read back the results.

### Troubleshooting

**Why am I getting no results?**

Check that your language codes are valid two-letter ISO codes and that Duolingo offers a course for that specific language pair. Not all combinations are available. Try a common pair like 'en' to 'es' to verify the actor is working.

**The actor returns fewer records than my maxItems setting.**

This is normal. The actor stops when it has collected all available words for the course. A typical Duolingo course has a finite number of lexical items, often between 2000 and 5000 words.

**I received an error about an invalid language code.**

Ensure you are using the correct two-letter ISO 639-1 code. For languages with multiple variants, try the base code. For example, use 'zh' for Chinese instead of 'cmn'.

**The run timed out before finishing.**

Increase the timeout setting in your actor run configuration. A full course extraction can take several minutes depending on the course size and Duolingo's server response times.

### FAQ

| Question | Answer |
|---|---|
| What language codes can I use? | You can use any standard two-letter ISO 639-1 language code, such as 'en' for English, 'es' for Spanish, 'fr' for French, or 'de' for German. The actor will attempt to fetch the course data for the combination you provide. |
| Does this scraper require a Duolingo login? | No, this actor does not require a Duolingo account or password. It accesses the same public course data that the Duolingo web application loads for new users. |
| What data fields are included in the results? | Each record typically includes the source language word, the translation in the learning language, the skill name, the unit number, and the lexical category. The exact fields are shown in the sample output on the actor's page. |
| Can I scrape a course that is not from English? | Yes, you can set any source language and any learning language. For example, you can scrape the German course for French speakers by setting the source to 'fr' and the learning language to 'de'. |
| How many records can I collect in one run? | You can set the maximum records limit up to 1,000,000. A full Duolingo course typically contains several thousand lexical items, so this limit is more than enough for a complete extraction. |
| Is the data returned in real time? | Yes, the actor fetches the current live course data from Duolingo's servers each time it runs. This ensures you always get the latest vocabulary and course structure. |
| What output formats are supported? | You can export your dataset in JSON, CSV, Excel, or XML format directly from the Apify platform. |
| Can I use this data for commercial purposes? | You are responsible for complying with Duolingo's terms of service. This actor is a tool for accessing publicly available data, and you should review Duolingo's policies before any commercial use. |
| How do I find the correct language code? | Use the standard two-letter ISO 639-1 code for the language. For example, 'ja' for Japanese, 'ko' for Korean, 'zh' for Chinese, and 'pt' for Portuguese. |

### Related actors

Browse the full [ParseForge collection](https://apify.com/parseforge?fpr=vmoqkp) for more scrapers.

🆘 **Need help?** Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ **Disclaimer.** This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Duolingo, Inc. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.

# Actor input Schema

## `maxItems` (type: `integer`):

How many records to collect per run.

## `fromLanguage` (type: `string`):

ISO code (en, es, fr, de, ...) of the learner native language.

## `learningLanguage` (type: `string`):

ISO code of the target language.

## Actor input object example

```json
{
  "maxItems": 10
}
```

# Actor output Schema

## `results` (type: `string`):

Scraped records

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "maxItems": 10
};

// Run the Actor and wait for it to finish
const run = await client.actor("parseforge/duolingo-language-data-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "maxItems": 10 }

# Run the Actor and wait for it to finish
run = client.actor("parseforge/duolingo-language-data-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "maxItems": 10
}' |
apify call parseforge/duolingo-language-data-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,parseforge/duolingo-language-data-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/i2BgFs9ZykxURjY9W/builds/SKMrOtP35OGTqoNPo/openapi.json