# Stack Overflow Jobs Scraper (`parseforge/stack-overflow-jobs-scraper`) Actor

Scrapes tech job listings from Stack Overflow Jobs by title, location, company, and occupation. Returns each listing as a flat row with full description, skills, and salary data.

- **URL**: https://apify.com/parseforge/stack-overflow-jobs-scraper.md
- **Developed by:** [ParseForge](https://apify.com/parseforge) (community)
- **Categories:** Jobs, Lead generation, Other
- **Stats:** 4 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $23.99 / 1,000 result items

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

[![ParseForge](https://raw.githubusercontent.com/ParseForge/apify-assets/main/banner.jpg)](https://apify.com/parseforge?fpr=vmoqkp)

### Stack Overflow Jobs Scraper

**Scrape job listings from Stack Overflow Jobs by title, location, company, or occupation, up to a million per run.** Each listing returns the full job description, required skills, salary range, remote status, and company details. Export to CSV, JSON, Excel, or XML.

Stack Overflow Jobs hosts technical job listings from companies that value developer skills. Manually searching and copying listings is slow and does not scale when you need to track the market. This scraper reads the public job feed directly, applies your filters, and returns structured data without needing an API key or browser extension.

| Who uses it | What they scrape Stack Overflow Jobs for |
|---|---|
| Recruiters | Build a pipeline of open technical roles at target companies. |
| Job seekers | Monitor new listings for a specific tech stack and location. |
| Market analysts | Track hiring demand for programming languages and frameworks. |
| Sales teams | Identify companies that are actively hiring and expanding their engineering departments. |

### What it does

This Actor collects job listings from Stack Overflow Jobs based on your search criteria and returns each one as a flat, structured row.

- 🔍 **Keyword search:** Filter by job title, skill, or company name like 'python developer' or 'Google'.
- 📍 **Location targeting:** Narrow results to a city, state, or set to 'remote' for work-from-home roles.
- 🏢 **Company filter:** Limit results to a specific company's open positions.
- 💼 **Occupation filter:** Target broad categories like 'Software Development Occupations' or 'Technology Occupations'.
- 🏠 **Remote only toggle:** A single switch to collect only jobs that are explicitly remote.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

### What you can do with Stack Overflow Jobs data

**📊 Analyze tech hiring trends.**

A market analyst runs the scraper weekly for 'data engineer' across major US cities to track which tools and cloud platforms employers are requesting.

**🎯 Build a target account list for sales.**

A sales team scrapes listings filtered by 'cybersecurity' and remote-only to find companies actively investing in security engineering headcount.

**💼 Monitor the job market for a specific stack.**

A job seeker sets a daily run for 'React' and 'TypeScript' in Berlin to be the first to apply to new matching roles.

**🏢 Map a competitor's engineering growth.**

A competitive intelligence analyst filters by a specific company name to collect every open technical role and infer their product roadmap.

### Why choose this scraper

|  | What you get |
|---|---|
| **No API registration** | Reads the public job feed directly with no OAuth or developer app required. |
| **Structured output** | Every listing is a flat row with a fixed schema, ready for spreadsheets or databases. |
| **Full job details** | Captures the description body, required skills, salary range, and company information. |
| **High volume** | Collect up to a million listings per run for large-scale market analysis. |

### How it compares

No other Store actor targets Stack Overflow Jobs the same way, so the honest comparison is with the alternatives teams actually weigh.

| | Stack Overflow Jobs Scraper | Build it in-house | By hand |
|---|---|---|---|
| Setup | Run it now, zero config | Days of engineering | None, but hours per pull |
| When Stack Overflow Jobs changes | Maintained for you | You fix it | You re-learn the page |
| Proxies, retries, anti-bot | Built in | Your problem | Browser only |
| Output | Fixed JSON schema, CSV/Excel export | Whatever you build | Copy-paste |
| Cost | Pay per result | Engineering time | Analyst hours |

### Configure the run

Drive the Actor with a job title or keyword, and optionally narrow results by location, company, occupation, and remote status. Filters are applied as each page is read so only matching listings reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

```json
{
  "maxItems": 10,
  "searchKeyword": "software engineer",
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}
```

A larger pull:

```json
{
  "maxItems": 200,
  "searchKeyword": "software engineer",
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}
```

### Pricing

Pay-per-result: **$0.03199 per result** collected. You pay only for the results written to your dataset.

| Results collected | Approximate cost |
|---|---|
| 100 results | $3.20 |
| 1,000 results | $31.99 |
| 10,000 results | $319.90 |

New Apify accounts start with $5 in free credit.

### Free users

Free-plan runs return up to 10 results as a preview. [Upgrade your Apify plan](https://console.apify.com/sign-up?fpr=vmoqkp) to collect up to 1,000,000 results per run.

### Run it

1. [Create a free Apify account with $5 in credit](https://console.apify.com/sign-up?fpr=vmoqkp).
2. Open the [Stack Overflow Jobs Scraper](https://apify.com/parseforge/stack-overflow-jobs-scraper?fpr=vmoqkp).
3. Set your inputs and any filters, then click **Start**.
4. Export the results as CSV, Excel, JSON, or XML from the **Dataset** tab.

Run it programmatically through the [Apify API](https://docs.apify.com/api/v2) (`run-sync-get-dataset-items`) or the [ApifyClient](https://docs.apify.com/api/client/js) for JavaScript and Python.

### Use with AI agents (MCP)

Give an AI agent live access to Stack Overflow Jobs through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

```bash
claude mcp add --transport http apify "https://mcp.apify.com/?tools=parseforge/stack-overflow-jobs-scraper"
```

Then prompt it in plain language to run the scraper and read back the results.

### Troubleshooting

**Why am I getting no results?**

Check that your search keyword and filters are not too restrictive. Try broadening the keyword or removing the location and company filters to see if results appear.

**The run is slow or timing out.**

Reduce the 'Max Concurrency' setting to lower the number of parallel requests. Also ensure you are using the recommended Apify proxy configuration.

**Some job descriptions are truncated.**

The Actor captures the full description as displayed on the listing page. If a listing is very long, check the original URL in your dataset to view the complete posting.

**I am getting blocked or seeing captchas.**

Ensure the proxy configuration is enabled with 'Use Apify Proxy' set to true. If the issue persists, try reducing the max concurrency to slow down the request rate.

### FAQ

| Question | Answer |
|---|---|
| Do I need a Stack Overflow account to scrape jobs? | No. This Actor reads the publicly available job listings and does not require a login, account, or API key. |
| Can I scrape remote jobs only? | Yes. Set the 'Remote Only' toggle to true and the Actor will collect only listings that are explicitly marked as remote. |
| What data fields does each job listing include? | Each row includes the job title, company name, location, remote status, full description body, required skills, salary range when available, and the original URL. |
| How many job listings can I collect in one run? | You can set the maximum up to 1,000,000 listings. The Actor will stop when it reaches your limit or when no more matching listings are found. |
| Can I filter by a specific company? | Yes. Use the 'Company Filter' input to return only listings from a specific company, such as 'Google' or 'Apple'. |
| What is the occupation filter? | Stack Overflow groups jobs into broad occupation categories. You can filter by categories like 'Software Development Occupations' to narrow results to a specific field. |
| Does this scraper handle pagination automatically? | Yes. The Actor navigates through all available pages of results for your search query until it reaches your max items limit or the end of the listings. |
| Can I export the results to a spreadsheet? | Yes. You can export your dataset in CSV, JSON, Excel, or XML formats directly from the Apify platform. |
| Is a proxy required to run this Actor? | Using an Apify proxy is recommended for reliable access and to avoid IP-based rate limiting, and it is pre-configured in the input settings. |
| Can I schedule this scraper to run automatically? | Yes. You can set up a recurring schedule in Apify to run the Actor daily, weekly, or at any custom interval to monitor new listings. |

### Related actors

Browse the full [ParseForge collection](https://apify.com/parseforge?fpr=vmoqkp) for more scrapers.

🆘 **Need help?** Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ **Disclaimer.** This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Stack Exchange, Inc. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.

# Actor input Schema

## `maxItems` (type: `integer`):

Maximum number of job listings to collect per run.

## `searchKeyword` (type: `string`):

Job title, keywords, or company name (e.g. 'software engineer', 'python developer')

## `location` (type: `string`):

City, state, or 'remote' (e.g. 'New York', 'San Francisco, CA', 'remote')

## `remoteOnly` (type: `boolean`):

Only show remote jobs

## `companyFilter` (type: `string`):

Filter by company name (e.g. 'Google', 'Apple')

## `occupationFilter` (type: `string`):

Filter by occupation category (e.g. 'Software Development Occupations', 'Technology Occupations')

## `maxConcurrency` (type: `integer`):

Maximum number of parallel page requests

## `proxyConfiguration` (type: `object`):

Proxy settings for reliable data collection

## Actor input object example

```json
{
  "maxItems": 10,
  "searchKeyword": "software engineer",
  "remoteOnly": false,
  "maxConcurrency": 5,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}
```

# Actor output Schema

## `overview` (type: `string`):

Overview of job listings with key fields

## `fullData` (type: `string`):

Complete dataset with all job fields

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "maxItems": 10,
    "searchKeyword": "software engineer",
    "proxyConfiguration": {
        "useApifyProxy": true
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("parseforge/stack-overflow-jobs-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "maxItems": 10,
    "searchKeyword": "software engineer",
    "proxyConfiguration": { "useApifyProxy": True },
}

# Run the Actor and wait for it to finish
run = client.actor("parseforge/stack-overflow-jobs-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "maxItems": 10,
  "searchKeyword": "software engineer",
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}' |
apify call parseforge/stack-overflow-jobs-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,parseforge/stack-overflow-jobs-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/82JViLmSa0LwfQU7l/builds/qLbpHIDrWqrLBzpIn/openapi.json