# FreightWaves News Scraper (`parseforge/freightwaves-scraper`) Actor

Scrapes public FreightWaves news articles by keyword, category, or date range. Returns each article as a flat row with headline, author, date, and full body text.

- **URL**: https://apify.com/parseforge/freightwaves-scraper.md
- **Developed by:** [ParseForge](https://apify.com/parseforge) (community)
- **Categories:** News, Automation, Other
- **Stats:** 10 total users, 0 monthly users, 100.0% runs succeeded, 3 bookmarks
- **User rating**: 5.00 out of 5 stars

## Pricing

from $23.99 / 1,000 result items

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

[![ParseForge](https://raw.githubusercontent.com/ParseForge/apify-assets/main/banner.jpg)](https://apify.com/parseforge?fpr=vmoqkp)

### FreightWaves News Scraper

**Scrape FreightWaves news articles by keyword, category, or date range, up to a million per run.** Each article returns its headline, author, publication date, and full body text. No login or API key. Export to CSV, JSON, Excel, or XML.

FreightWaves is the leading news source for freight markets, but manually tracking trucking rates, maritime disruptions, or supply chain regulation is slow. This Actor reads the public news feeds directly, filtered by logistics category, search keyword, or date, and returns each matching article in one fixed schema.

| Who uses it | What they scrape FreightWaves for |
|---|---|
| Logistics analysts | Monitor daily trucking rate headlines and capacity shifts. |
| Supply chain managers | Track container shipping disruptions and port congestion news. |
| Freight brokers | Follow LTL and truckload market trends to adjust pricing. |
| Market researchers | Collect historical freight economics articles for quarterly reports. |

### What it does

This Actor collects FreightWaves news articles by keyword, category, or date range, and returns each one as a flat row.

- 🔍 **Keyword search:** find articles mentioning specific freight topics like 'trucking rates' or 'container shortage'.
- 📂 **Category filter:** restrict results to trucking, maritime, railroad, air cargo, logistics, shipping, regulation, supply chains, economics, finance, or weather.
- 📅 **Date range:** pull articles published between two dates to build a historical dataset or track a developing story.
- ⚡ **High volume:** collect up to 1,000,000 articles in a single run for large-scale freight market intelligence.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

### What you can do with FreightWaves data

**📈 Monitor trucking rate trends.**

A logistics analyst runs the Actor daily with the 'trucking' category and a keyword like 'spot rates' to feed a dashboard that flags pricing shifts.

**🚢 Track maritime disruption alerts.**

A supply chain manager scrapes the 'maritime' category for 'port congestion' weekly, exporting to CSV for a risk report shared with procurement.

**📊 Build a freight news archive.**

A market researcher sets a wide date range and the 'economics' category to collect a year of articles for a freight market outlook study.

**⚖️ Follow regulatory changes.**

A compliance officer filters by the 'regulation' category and a keyword like 'FMCSA' to catch new trucking rules as they are reported.

### Why choose this scraper

| | What you get |
|---|---|
| **Full article text** | The complete body of each news piece, not a snippet. |
| **Fixed flat schema** | Every article lands in your dataset with the same predictable columns. |
| **No API key needed** | Reads public FreightWaves pages directly with no registration. |
| **Multi-format export** | Download as CSV, JSON, Excel, or XML for your existing workflow. |

### How it compares

This Actor focuses on high-volume, filtered FreightWaves news extraction with full article text, while other scrapers on Apify offer similar headline-level collection.

| Feature | ParseForge | FreightWaves News Scraper - Low-cost💲🔥📰🚛 | FreightWaves News Scraper |
|---|---|---|---|
| Full article body text | Yes | Not listed | Yes |
| Category filter (trucking, maritime, etc.) | Yes | Not listed | Not listed |
| Keyword search within articles | Yes | Not listed | Not listed |
| Date range filter | Yes | Not listed | Not listed |
| Up to 1,000,000 articles per run | Yes | Not listed | Not listed |

### Configure the run

Drive the Actor from a search keyword, a freight category, and a date range, alone or together, and filters run as each article is read so only matches reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

```json
{
 "maxItems": 10
}
```

A larger pull:

```json
{
 "maxItems": 200
}
```

### Pricing

Pay-per-result: **$0.03199 per result** collected. You pay only for the results written to your dataset.

| Results collected | Approximate cost |
|---|---|
| 100 results | $3.20 |
| 1,000 results | $31.99 |
| 10,000 results | $319.90 |

New Apify accounts start with $5 in free credit.

### Free users

Free-plan runs return up to 10 results as a preview. [Upgrade your Apify plan](https://console.apify.com/sign-up?fpr=vmoqkp) to collect up to 1,000,000 results per run.

### Run it

1. [Create a free Apify account with $5 in credit](https://console.apify.com/sign-up?fpr=vmoqkp).
2. Open the [FreightWaves News Scraper](https://apify.com/parseforge/freightwaves-scraper?fpr=vmoqkp).
3. Set your inputs and any filters, then click **Start**.
4. Export the results as CSV, Excel, JSON, or XML from the **Dataset** tab.

Run it programmatically through the [Apify API](https://docs.apify.com/api/v2) (`run-sync-get-dataset-items`) or the [ApifyClient](https://docs.apify.com/api/client/js) for JavaScript and Python.

### Use with AI agents (MCP)

Give an AI agent live access to FreightWaves through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

```bash
claude mcp add --transport http apify "https://mcp.apify.com/?tools=parseforge/freightwaves-scraper"
```

Then prompt it in plain language to run the scraper and read back the results.

### Troubleshooting

**Why am I getting no results?**

Check that your keyword or category combination returns articles on the live FreightWaves site. Also verify your date range is not too narrow or set in the future.

**The Actor is running but collecting fewer articles than my maxItems setting.**

This is normal when there are not enough articles matching your filters. Try broadening your date range, removing the keyword, or selecting a less specific category.

**Some article body text looks truncated or incomplete.**

The Actor captures the full text displayed on the public article page. If FreightWaves truncates an article behind a 'read more' paywall, that portion is not accessible.

**I get an error about the date format.**

The Date From and Date To fields require the exact format YYYY-MM-DD, for example 2024-06-15. Make sure you include the hyphens and use two digits for month and day.

**The run takes a long time with a high maxItems value.**

Scraping many articles requires polite delays between requests. Reduce the maxItems count or narrow your filters to speed up the run.

### FAQ

| Question | Answer |
|---|---|
| Does this scraper need a FreightWaves subscription or login? | No. It reads the public news pages that anyone can view in a browser. You do not need a FreightWaves account, and it does not access SONAR or subscriber-only content. |
| What data fields does each article row include? | The exact field list is shown in the sample output on the Actor's page. It typically includes the headline, author, publication date, category, and the full body text of the article. |
| Can I scrape articles from a specific date range? | Yes. Set the Date From and Date To inputs in YYYY-MM-DD format, and the Actor will return only articles published within that window. |
| How many articles can I collect in one run? | You can set the maximum up to 1,000,000 articles. The Actor will stop when it hits that number or when no more matching articles are found. |
| Can I search for a specific topic across all categories? | Yes. Enter a keyword like 'intermodal' or 'fuel surcharge' in the search field, and the Actor will return articles matching that term from any category. |
| What export formats are supported? | You can export your dataset as CSV, JSON, Excel, or XML directly from the Apify platform. |
| Does this Actor scrape SONAR data or subscriber-only articles? | No. It only collects articles from the publicly accessible FreightWaves news sections. Paywalled content and SONAR market data are not included. |
| Can I combine a category filter with a keyword search? | Yes. All input filters work together. For example, you can set the category to 'trucking' and the keyword to 'driver shortage' to narrow results. |
| Is this an official FreightWaves API? | No. This is an independent web scraper that extracts data from the public FreightWaves website. It is not affiliated with or endorsed by FreightWaves, Inc. |

### Related actors

Browse the full [ParseForge collection](https://apify.com/parseforge?fpr=vmoqkp) for more scrapers.

🆘 **Need help?** Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ **Disclaimer.** This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by FreightWaves, Inc. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.

# Actor input Schema

## `maxItems` (type: `integer`):

How many articles to collect per run.

## `searchKeyword` (type: `string`):

Search for specific freight or logistics topics

## `category` (type: `string`):

Filter by freight category or industry sector

## `dateFrom` (type: `string`):

Start date for filtering articles (YYYY-MM-DD)

## `dateTo` (type: `string`):

End date for filtering articles (YYYY-MM-DD)

## Actor input object example

```json
{
  "maxItems": 10,
  "searchKeyword": "trucking rates",
  "dateFrom": "2024-01-01",
  "dateTo": "2024-12-31"
}
```

# Actor output Schema

## `results` (type: `string`):

Complete dataset with all scraped freight and logistics data

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "maxItems": 10
};

// Run the Actor and wait for it to finish
const run = await client.actor("parseforge/freightwaves-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "maxItems": 10 }

# Run the Actor and wait for it to finish
run = client.actor("parseforge/freightwaves-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "maxItems": 10
}' |
apify call parseforge/freightwaves-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,parseforge/freightwaves-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/xduWCG2mitNAcn8w7/builds/wgURTTTvELTWW7H8M/openapi.json