# Hacker News Job Scraper: Who is Hiring Posts (`getascraper/hn-hiring-scraper`) Actor Extract structured job postings from Hacker News monthly 'Who is Hiring?' threads, plus each poster's HN account karma, age, and a derived trust score, so you can tell an established company from a brand-new account. Parse company, role, location, salary, and technologies. - **URL**: https://apify.com/getascraper/hn-hiring-scraper.md - **Developed by:** [GetAScraper](https://apify.com/getascraper) (community) - **Categories:** Lead generation, AI, Social media - **Stats:** 3 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $0.67 / 1,000 jobs This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event ## What's an Apify Actor? Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. - **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use). - **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`. - **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`. - **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`. - **Any other language** — the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## 💻 HN Who is Hiring Scraper

Auto-discover Hacker News hiring threads and extract every job posting as clean JSON. Company, role, remote status, salary, tech stack, and contact emails pulled from HN's monthly Who is Hiring threads, no manual copy-paste required.
Global technology and remote hiring • Hacker News Hiring, GoFractional, NoFluffJobs, and Welcome to the Jungle tech roles
HN Hiring ➤ You are here	GoFractional Fractional jobs, direct ATS links	NoFluffJobs European tech jobs and salaries	WTTJ Raw JSON or RAG-ready jobs

Turn HN hiring threads into structured job data
Auto-discovers Hacker News Who is Hiring threads and parses company, role, remote status, salary, and tech stack out of raw comment text into clean JSON.

🧩 Structured data
Company, role, salary, and tech stack pulled from unstructured comments

🔍 Auto-discovery
Finds the latest hiring thread automatically, no URL needed

🗓️ Historical data
Scrape up to 12 months back for hiring trend analysis

✉️ Contact extraction
Emails and application URLs pulled out automatically

Extract structured job postings from Hacker News monthly "Who is Hiring?" threads. Parse company, role, location, remote status, salary, technologies, emails, and application URLs from the largest organic tech job board on the internet. Built on the official Hacker News Firebase API and Algolia Search API for reliable, rate-limit-free access to job data. ### 💡 Why use it? - **Structured Data**: Extracts company, role, location, remote status, salary, technologies, emails, and URLs from unstructured HN comments - **Auto-Discovery**: Automatically finds the latest "Who is Hiring?" posts without needing specific URLs - **Historical Data**: Scrape multiple months back for trend analysis - **Tech-Focused**: Identifies technologies mentioned in each job post for filtering and analysis - **Contact Extraction**: Automatically finds email addresses and application URLs ### 🚀 How to use

STEP 1
Open and configure
Leave startUrls empty to auto-discover, or set monthsBack up to 12.

STEP 2
Set limits
Cap maxJobsPerMonth and optionally include nested reply threads.

STEP 3
Run and export
Consume the output via Apify API, CSV, or JSON.

### 📋 Input fields - `startUrls` (array, optional): Specific HN "Who is Hiring?" post URLs. If empty, auto-discovers the latest posts. - `monthsBack` (integer): How many months of hiring posts to scrape when auto-discovering. Default: 1, Max: 12. - `maxJobsPerMonth` (integer): Maximum job postings to extract per month. Default: 0 (unlimited). - `includeReplies` (boolean): Whether to include nested replies/discussion threads. Default: false. - `proxyConfiguration` (object): Proxy configuration for API requests. Optional - HN APIs are generally open. ### 📦 Output schema Each dataset item represents one job posting: ```json { "commentId": 22666455, "hnUser": "kfx", "postedAt": 1584984975, "postedAtIso": "2020-03-23T17:36:15.000Z", "rawText": "PBS | Various Engineers | Full-Time | ONSITE...", "cleanText": "PBS | Various Engineers | Full-Time | ONSITE...", "company": "PBS", "role": "Various Engineers", "location": "Alexandria, VA", "remoteStatus": "ONSITE (Flexible WFH)", "employmentType": "Full-Time", "salary": null, "technologies": ["express", "iOS"], "emails": ["digitaljobs@pbs.org"], "urls": ["https://tinyurl.com/v7c8nb2"], "isTopLevel": true, "parentId": 22665398, "replyCount": 0, "hnUrl": "https://news.ycombinator.com/item?id=22666455" } ``` ### 📊 Data table | Field | Type | Description | |---|---|---| | `commentId` | number | Unique HN comment ID | | `company` | string | Company name (extracted from post) | | `role` | string | Job role/title | | `location` | string | Job location | | `remoteStatus` | string | REMOTE, ONSITE, HYBRID, etc. | | `employmentType` | string | Full-time, Contract, Intern, etc. | | `salary` | string | Salary range if found in text | | `technologies` | array | Technologies mentioned in the post | | `emails` | array | Email addresses found | | `urls` | array | Application/company URLs found | | `hnUser` | string | HN username who posted the job | | `postedAtIso` | string | ISO timestamp of the post | | `replyCount` | number | Number of replies to this job post | | `hnUrl` | string | Direct link to the comment on HN | ### 💰 Pricing / cost estimation Priced at **$0.02 per job posting** (Pay-per-Result). | Target Jobs | Estimated Cost | |---|---| | 100 | $2.00 | | 500 | $10.00 | | 1,000 | $20.00 | HN APIs are open and free to access. No proxy costs typically required. ### ⭐ Enjoying HN Who is Hiring Scraper?

⭐ ⭐ ⭐ ⭐ ⭐
Turn Hacker News hiring threads into a searchable feed of company, role, and salary leads within minutes.
A 5-star rating takes 10 seconds and helps other tech recruiters and job seekers find it. Your feedback also tells us what to build next.

★ Rate this Actor on Apify

### ✨ Tips / Advanced - **Auto-Discovery**: Leave `startUrls` empty and set `monthsBack` to 3-6 to get a rolling window of hiring posts - **Focus on Remote**: Filter output by `remoteStatus` field containing "REMOTE" - **Tech Filtering**: Use the `technologies` array to find jobs matching specific skills - **Speed**: Each API call has a 50ms delay to be respectful to HN. Expect ~20 jobs/minute ### ❓ FAQ **Is scraping Hacker News legal?** HN provides official APIs (Firebase and Algolia) for accessing this data. This Actor uses those APIs, not HTML scraping. **Why did I get fewer results than expected?** Some comments in hiring threads are discussion, not job posts. The parser attempts to filter these, but imperfectly. Set `includeReplies: true` to capture more. **Can I scrape historical data?** Yes. Set `monthsBack` up to 12 to scrape past hiring threads. Note that older posts may have fewer active listings. ### 🛠️ Support For bug reports or feature requests, open a ticket in the Issues tab. ### 🔗 Other actors - [TeamBlind Reviews Scraper](https://apify.com/getascraper/teamblind-reviews-scraper) ↗ - collects anonymous tech employer ratings and reviews from Blind. - [NoFluffJobs Scraper](https://apify.com/getascraper/nofluffjobs-scraper) ↗ - extracts tech job listings and transparent salary ranges. - [CWJobs Scraper](https://apify.com/getascraper/cwjobs-scraper) ↗ - pulls UK tech job listings with salaries and locations. - [Wantedly Japan Jobs Scraper](https://apify.com/getascraper/wantedly-jobs-scraper) ↗ - gathers startup job listings from Japan's Wantedly platform. - [Bug Bounty Finder](https://apify.com/getascraper/bug-bounty-finder) ↗ - aggregates active bug bounty programs from HackerOne and Bugcrowd. # Actor input Schema ## `startUrls` (type: `array`): Specific Hacker News 'Who is Hiring?' post URLs. If empty, auto-discovers the latest posts. ## `monthsBack` (type: `integer`): How many months of hiring posts to scrape when auto-discovering. Max 12. ## `maxJobsPerMonth` (type: `integer`): Maximum job postings to extract per month. 0 = unlimited. ## `includeReplies` (type: `boolean`): Whether to include nested replies/discussion threads. ## `includeRawText` (type: `boolean`): Include the original HTML-encoded comment text alongside the cleaned text. Off by default: the cleaned text alone carries the full content and roughly halves the size (and cost) of each row. ## `minPosterTrust` (type: `integer`): Only include jobs whose poster has at least this HN trust score (0-100), derived from their account karma and age. Leave empty to include all posts regardless of poster trust. ## `proxyConfiguration` (type: `object`): Optional proxy settings. Defaults to enabling Apify Proxy to prevent blocks during cloud runs. ## Actor input object example ```json { "startUrls": [ { "url": "https://news.ycombinator.com/item?id=47975571" } ], "monthsBack": 1, "maxJobsPerMonth": 0, "includeReplies": false, "includeRawText": false, "proxyConfiguration": { "useApifyProxy": true } } ``` # Actor output Schema ## `dataset` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://news.ycombinator.com/item?id=47975571" } ], "proxyConfiguration": { "useApifyProxy": true } }; // Run the Actor and wait for it to finish const run = await client.actor("getascraper/hn-hiring-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://news.ycombinator.com/item?id=47975571" }], "proxyConfiguration": { "useApifyProxy": True }, } # Run the Actor and wait for it to finish run = client.actor("getascraper/hn-hiring-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}") for item in client.dataset(run.default_dataset_id).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://news.ycombinator.com/item?id=47975571" } ], "proxyConfiguration": { "useApifyProxy": true } }' | apify call getascraper/hn-hiring-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "type": "http", "url": "https://mcp.apify.com/?tools=fetch-actor-details,getascraper/hn-hiring-scraper" } } } ``` The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations). ## OpenAPI specification Download the OpenAPI definition: https://api.apify.com/v2/actors/gYsH3egwBgpHrYvDy/builds/KsLf3noAAI1kgp994/openapi.json