Hacker News Scraper – Stories, Comments & Who's Hiring avatar

Hacker News Scraper – Stories, Comments & Who's Hiring

Pricing

$1.00 / 1,000 items

Go to Apify Store
Hacker News Scraper – Stories, Comments & Who's Hiring

Hacker News Scraper – Stories, Comments & Who's Hiring

Search or browse Hacker News stories, comments, Ask HN, Show HN and Who's Hiring threads via the official Algolia API. Filter by points and date. Pay per item.

Pricing

$1.00 / 1,000 items

Rating

0.0

(0)

Developer

Fetch Smith

Fetch Smith

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

13 hours ago

Last modified

Share

Hacker News Scraper

Search or browse Hacker News (stories, comments, Ask HN, Show HN, jobs, and monthly Who's Hiring threads) using the official Algolia Search API — fast, reliable, no scraping fragility. Pay only per item returned.

Use cases

  • Track mentions of your product, company or keyword on HN
  • Pull the newest Who's Hiring / Who Wants to Be Hired threads for job-market research
  • Feed trending tech discussions into AI agents, newsletters or dashboards
  • Build datasets of Show HN launches or Ask HN discussions by topic

Input

FieldTypeDescription
queriesarrayKeywords to search. Leave empty to just browse by tag/date.
tagsarraystory, comment, poll, ask_hn, show_hn, job (default ["story"])
includeCommentsbooleanFetch comment text when tags includes comment
sortBystringrelevance or date (newest first)
minPointsintegerOnly items with at least this many points
minCommentsintegerOnly stories with at least this many comments (find high-engagement discussions)
authorstringOnly items posted by this exact HN username
postedAfter / postedBeforestringISO date bounds
maxItemsPerQueryintegerCap per query (up to 1000)
maxResultsintegerOverall cap

Output (one item per story/comment)

{
"id": "41930211",
"type": "story",
"title": "Show HN: FetchSmith – pay-per-use scraper APIs",
"url": "https://fetchsmith.com",
"hnUrl": "https://news.ycombinator.com/item?id=41930211",
"author": "someuser",
"points": 142,
"numComments": 38,
"createdAt": "2026-09-01T12:00:00.000Z",
"query": "fetchsmith"
}

Pricing

result — charged per item returned. Empty queries and failed pages are free.

Tips

  • For the current "Who is hiring?" thread: set queries to ["Ask HN: Who is hiring"], tags: ["story"], sortBy: "date", maxItemsPerQuery: 1 to find the thread, or use tags: ["comment"] with postedAfter set to the 1st of the month to pull all replies.
  • Use sortBy: "date" for a live monitoring feed of new mentions of your keyword.
  • Use author to pull everything a specific user has posted (e.g. track a founder's HN activity), or minComments to surface only high-engagement discussions.

FAQ

Why did my run return 0 items with status SUCCEEDED? The status message distinguishes "no matches for this query/tags/date/points filter" from "the Algolia request failed" — check it before assuming the query is wrong. Can I combine author and minComments? Yes, filters are ANDed together, e.g. author: "pg" + minComments: 50 returns only that user's high-engagement posts. Does this scrape the HN website? No — it uses Algolia's official HN Search API, the same one that powers hn.algolia.com, so there's no scraping fragility to break. Do I get charged for empty queries? No — only items actually returned to the dataset are charged.

Engineering write-ups behind this Actor:

Only publicly available data is collected via HN's official search API. Questions or feature requests: support@fetchsmith.com. Also available as a hosted API at https://fetchsmith.com/tools/hacker-news-scraper

Source code: https://github.com/Fetchsmith/fetchsmith/tree/main/actors/hacker-news-scraper