# DIBBS RFQ Scraper (`parseforge/dibbs-rfq-scraper`) Actor

Scrape RFQ solicitations from DLA's DIBBS system. Filter by NSN, FSC, solicitation number, description, or date range. Optionally extract detail page data and PDF text.

- **URL**: https://apify.com/parseforge/dibbs-rfq-scraper.md
- **Developed by:** [ParseForge](https://apify.com/parseforge) (community)
- **Categories:** E-commerce, Lead generation, Automation
- **Stats:** 42 total users, 14 monthly users, 100.0% runs succeeded, 3 bookmarks
- **User rating**: No ratings yet

## Pricing

from $14.00 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

[![ParseForge](https://raw.githubusercontent.com/ParseForge/apify-assets/main/banner.jpg)](https://apify.com/parseforge?fpr=vmoqkp)

### DIBBS RFQ Scraper

**Scrape RFQ solicitations from DLA's DIBBS system, up to a million per run.** Every RFQ comes with its NSN, description, quantity, unit, return-by date, and solicitation PDF link. No login or API key. Export to CSV, JSON, Excel, or XML.

DLA's DIBBS (Defense Logistics Agency Internet Bid Board System) posts public RFQ solicitations, but browsing them manually is slow and there is no bulk export. This scraper reads the daily RFQ files directly, filters by NSN, solicitation number, description, FSC code, or date range, and returns each match as a flat row. Optionally fetch detail-page fields and full PDF text for deeper analysis.

| Who uses it | What they scrape DIBBS for |
|---|---|
| Government contractors | Find new bid opportunities matching their NSN or FSC codes. |
| Supply chain analysts | Monitor DLA procurement volumes and trends by item description. |
| Market researchers | Analyze which items the DoD is sourcing and at what quantities. |
| AI scoring model developers | Collect PDF text with buyer info, NAICS, and procurement history for training. |

### What it does

This Actor collects RFQ solicitations from DLA's DIBBS system and returns each one as a flat row with solicitation number, NSN, description, quantity, unit, return-by date, and PDF link.

- 📊 **Date range filter:** Collect RFQs from the last N days (1 to 30) to stay current.
- 🔍 **NSN filter:** Partial match on National Stock Number, e.g. '8465' for textiles.
- 📄 **Solicitation filter:** Partial match on solicitation number, e.g. 'SPE1C1' for DLA Troop Support.
- 🏷️ **Description filter:** Case-insensitive keyword search on item description.
- 🔢 **FSC filter:** Single or comma-separated Federal Supply Classification codes.
- 📋 **Detail page data:** Optionally fetch status, issue date, set-aside type, fast-award flag, Mil-Spec flag, and exact PDF link.
- 📝 **PDF text extraction:** Optionally extract full text from each SF-18 solicitation PDF, including buyer name/email/phone, NAICS, and procurement history.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

### What you can do with DIBBS data

**📈 Find new bid opportunities.**

A government contractor runs the scraper daily with their NSN or FSC filters to get fresh RFQs and submit bids before deadlines.

**🔍 Monitor DLA procurement trends.**

A supply chain analyst collects all RFQs from the last 30 days to see which items the DoD is sourcing and at what volumes.

**🤖 Train AI bid-scoring models.**

A developer enables PDF text extraction to collect buyer names, NAICS codes, and procurement history for training a model that scores bid fit.

**📊 Analyze set-aside patterns.**

A market researcher uses the detail page data to track set-aside types (e.g., small business, HUBZone) across FSC codes.

### Why choose this scraper

|  | What you get |
|---|---|
| **No login needed** | Public DIBBS data, no registration or API key required. |
| **Flexible filters** | Filter by NSN, FSC, solicitation number, description, or date range. |
| **Detail page data** | Optionally get status, set-aside type, fast-award flag, and more. |
| **PDF text extraction** | Extract buyer info, NAICS, and procurement history from solicitation PDFs. |
| **Bulk export** | Export to CSV, JSON, Excel, or XML for analysis or bidding systems. |

### How it compares

This actor offers the same core RFQ data as other DIBBS scrapers, with additional options for detail page fields and PDF text extraction.

| Feature | ParseForge | DIBBS RFQ Scraper (7 users) | DIBBS RFQ Scraper (3 users) |
|---|---|---|---|
| NSN filter | Yes, partial match | Not listed | Not listed |
| FSC filter | Yes, single or comma-separated | Not listed | Not listed |
| Solicitation number filter | Yes, partial match | Not listed | Not listed |
| Description keyword filter | Yes, case-insensitive | Not listed | Not listed |
| Date range filter | Yes, last N days | Not listed | Not listed |
| Detail page data (status, set-aside, fast award) | Yes, optional | Not listed | Not listed |
| PDF text extraction | Yes, optional | Not listed | Not listed |

### Configure the run

Drive the Actor from date range, NSN, solicitation number, description, or FSC code filters, alone or together, and filters run as each RFQ is read so only matches reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

```json
{
  "maxItems": 10
}
```

A larger pull:

```json
{
  "maxItems": 200
}
```

### Pricing

Pay-per-result: **$0.015 per result** collected. You pay only for the results written to your dataset.

| Results collected | Approximate cost |
|---|---|
| 100 results | $1.50 |
| 1,000 results | $15.00 |
| 10,000 results | $150.00 |

New Apify accounts start with $5 in free credit.

### Free users

Free-plan runs return up to 10 results as a preview. [Upgrade your Apify plan](https://console.apify.com/sign-up?fpr=vmoqkp) to collect up to 1,000,000 results per run.

### Run it

1. [Create a free Apify account with $5 in credit](https://console.apify.com/sign-up?fpr=vmoqkp).
2. Open the [DIBBS RFQ Scraper](https://apify.com/parseforge/dibbs-rfq-scraper?fpr=vmoqkp).
3. Set your inputs and any filters, then click **Start**.
4. Export the results as CSV, Excel, JSON, or XML from the **Dataset** tab.

Run it programmatically through the [Apify API](https://docs.apify.com/api/v2) (`run-sync-get-dataset-items`) or the [ApifyClient](https://docs.apify.com/api/client/js) for JavaScript and Python.

### Use with AI agents (MCP)

Give an AI agent live access to DIBBS through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

```bash
claude mcp add --transport http apify "https://mcp.apify.com/?tools=parseforge/dibbs-rfq-scraper"
```

Then prompt it in plain language to run the scraper and read back the results.

### Troubleshooting

**Why am I getting no results?**

Check your filters. If you set a daysBack value, ensure there are RFQs within that range. If using an NSN or FSC filter, verify the code is correct. Try running without filters to see if data is available.

**The run is very slow with PDF text extraction enabled.**

PDF text extraction adds 2-4 seconds per RFQ. For large runs, disable it or reduce maxItems. You can also run without it and re-run with it on a smaller filtered set.

**Some RFQs have null pdfText.**

This happens when the PDF is unavailable, the fetch fails, or the PDF is not a standard SF-18. The scraper sets pdfText to null in those cases.

**The detail page data is missing some fields.**

Not all RFQs have every detail field. For example, set-aside type or fast-award flag may be absent. The scraper returns null for missing fields.

### FAQ

| Question | Answer |
|---|---|
| Do I need a DIBBS account or API key? | No. This scraper reads public DIBBS data directly from the DLA website. No login or API key is required. |
| What is the maximum number of RFQs I can scrape? | You can set maxItems up to 1,000,000. The actual number depends on available RFQs and your Apify account limits. |
| How do I filter by NSN? | Enter a partial NSN in the NSN Filter field. For example, '8465' matches all textile/leather items. The filter is case-insensitive. |
| What does the 'Include Detail Page Data' option do? | It fetches additional fields from each RFQ's detail page: status, issue date, return-by date, set-aside type, fast-award flag, Mil-Spec flag, exact solicitation PDF link, technical-data link, and attachments. This slows the run but gives richer data. |
| What does the 'Include Solicitation PDF Text' option do? | It downloads each RFQ's SF-18 solicitation PDF and extracts the full text into a pdfText field. This includes buyer name/email/phone, procurement history, NAICS code, packaging/delivery requirements, and FAR/DFARS clauses. Adds 2-4 seconds per record. |
| Can I filter by multiple FSC codes? | Yes. Enter a comma-separated list in the FSC Filter field, e.g. '3460,5305,3710'. The scraper will match RFQs with any of those codes. |
| What export formats are supported? | You can export the dataset as CSV, JSON, Excel, or XML from the Apify dataset page. |
| Does the scraper handle pagination? | Yes. It automatically paginates through all available RFQ files up to your maxItems limit. |

### Related actors

- [dibbs-rfq-scraper](https://apify.com/parseforge/dibbs-rfq-scraper?fpr=vmoqkp): Use this actor for DIBBS RFQ scraping. No alternative needed.

Browse the full [ParseForge collection](https://apify.com/parseforge?fpr=vmoqkp) for more scrapers.

🆘 **Need help?** Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ **Disclaimer.** This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Defense Logistics Agency. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.

# Actor input Schema

## `maxItems` (type: `integer`):

How many RFQs to collect per run.

## `daysBack` (type: `integer`):

Collect RFQs from the last N days. Leave empty for all available files.

## `nsnFilter` (type: `string`):

Filter by National Stock Number. Partial match supported (e.g., '8465' for all textile/leather items).

## `solicitationFilter` (type: `string`):

Filter by solicitation number. Partial match (e.g., 'SPE1C1' for specific DLA center).

## `descriptionFilter` (type: `string`):

Filter by item description keyword. Case-insensitive (e.g., 'jacket', 'strap', 'bolt').

## `fscFilter` (type: `string`):

Filter by Federal Supply Classification code (first 4 digits of NSN). Single value e.g. '8465' or comma-separated list e.g. '3460,5305,3710' to match any of them.

## `includeDetails` (type: `boolean`):

Collect additional fields from each RFQ's detail page: status, issue date, return-by date, set-aside type, fast-award flag, Mil-Spec flag, exact solicitation PDF link, technical-data link and attachments. Slower but more complete. Buyer name, phone, email and CAGE history are not on the detail page - enable PDF text for those.

## `includePdfText` (type: `boolean`):

Fetch each RFQ's SF-18 solicitation PDF and add the full extracted text as a `pdfText` field. The PDF contains buyer name/email/phone, procurement history (prior CAGEs, contract numbers, quantities, prices), NAICS code, packaging/delivery requirements, and FAR/DFARS clauses — useful for AI scoring models. Adds ~2-4s per record. Null if the PDF is unavailable or fetch fails.

## Actor input object example

```json
{
  "maxItems": 10,
  "includeDetails": false,
  "includePdfText": false
}
```

# Actor output Schema

## `results` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "maxItems": 10
};

// Run the Actor and wait for it to finish
const run = await client.actor("parseforge/dibbs-rfq-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "maxItems": 10 }

# Run the Actor and wait for it to finish
run = client.actor("parseforge/dibbs-rfq-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "maxItems": 10
}' |
apify call parseforge/dibbs-rfq-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,parseforge/dibbs-rfq-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/uygfXaVUQwG89qWuy/builds/VMA4pTaNvVxEAhscH/openapi.json