GitHub Scraper — repos, trending, users (no token)

Structured GitHub data with no token and no login, via the public REST API. Four modes:

Mode	What you get	Use it for
Search repos	Repositories matching a query, sorted by stars / forks / updated	Market & competitor research, tech landscape mapping
Trending	Most-starred repos pushed in the last N days (optional language)	Spotting rising projects, daily "what's hot" digests
Repo details	Full details for any owner/repo	Enrichment, dependency/tech due-diligence
Users	A user's or org's profile + their repositories	Developer sourcing, recruiter research, OSS analytics

Built for AI agents

As an MCP tool, an agent can answer "what are the trending Rust repos this week?" or "get this repo's stats" in one structured call.

Output

Flat JSON rows. Repos: full_name, description, stars, forks, language, topics, license, created_at, updated_at, url. Users: login, name, bio, company, followers, public_repos, url.

Input examples

{ "mode": "search", "query": "llm agent", "language": "python", "minStars": 500, "maxItems": 200 }

{ "mode": "trending", "language": "rust", "sinceDays": 7, "maxItems": 50 }

{ "mode": "user", "users": ["torvalds"], "includeRepos": true }

Notes

Uses the unauthenticated GitHub REST API (rate-limited per IP); requests route through rotating proxies with backoff so larger pulls complete. Public data only, no login.

Pricing

Pay-per-event: a small actor-start fee plus a per-item charge — you pay for exactly the data you pull.

Use cases

• Developer-tool market research — track trending repositories by language and stars to spot rising frameworks before they peak.
• Lead generation — find active maintainers and organizations in a niche (e.g. all popular Terraform tooling authors).
• Competitive intelligence — monitor competitors' open-source activity, release cadence and community growth.
• Academic & data science — build datasets of repositories, topics and user profiles without wrestling with API tokens and rate limits.
• AI agents — as an MCP tool, lets an agent answer "what are the top new Rust repos this month?" with live data.

FAQ

How can I scrape GitHub without an API token? This actor reads GitHub's public pages and endpoints for you — no personal access token, no OAuth app, no rate-limit juggling. Just provide a search query or usernames.

Can I get GitHub trending repositories as JSON or CSV? Yes — run the trending mode and download the dataset as JSON, CSV or Excel. Schedule it daily to build a trending-history dataset (GitHub itself keeps no trending archive).

How do I search GitHub repos by stars or language? Use a search query like stars:>1000 language:python — the same qualifiers GitHub search supports.

Is scraping GitHub legal? The actor reads public pages only, respecting rate limits. Public repository metadata is broadly used for research and archiving; always check GitHub's terms for your specific use.

Can I monitor a GitHub user or organization over time? Schedule the actor with your list of users/orgs and each run appends fresh snapshots to the dataset — a time series of followers, repos and stars.