# News Archive Scraper - Historical News Past the 100-Item Limit (`vonsensey/news-archive-scraper`) Actor

Pull historical news archives, not just today's headlines. Google's feed caps at about 100 articles per query; this splits your query into date windows and returns thousands, reaching back years. Real publisher URL on every row, optional full article text. Pay per article, failed runs are free.

- **URL**: https://apify.com/vonsensey/news-archive-scraper.md
- **Developed by:** [Blackcube](https://apify.com/vonsensey) (community)
- **Categories:** News, Automation, Developer tools
- **Features:** Limited permissions
- **Stats:** 3 total users, 0 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $3.50 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## News Archive Scraper - Historical News Past the 100-Item Limit

<table style="border-collapse:collapse;width:100%;margin:0 0 4px">
<tr><td colspan="3" style="padding:9px 12px;background:#0B6E75;border:1px solid #0B6E75"><span style="color:#FFFFFF;font-weight:700;font-size:13px;letter-spacing:.3px">Google News Suite</span><span style="color:#CFF0F2;font-size:12px"> &nbsp;&bull;&nbsp; 7 Actors, one codebase, one article billed once</span></td></tr>
<tr><td style="padding:9px 12px;border:1px solid #E5E7EB;background:#FFFFFF;vertical-align:top;width:33%"><a href="https://apify.com/vonsensey/google-news-scraper-api" style="color:#111827;font-weight:700;font-size:13px;text-decoration:none">Google News Scraper API</a><br><span style="color:#6B7280;font-size:11px">Real URLs, Full Text &amp; Sentiment</span></td><td style="padding:9px 12px;border:1px solid #E5E7EB;background:#FFFFFF;vertical-align:top;width:33%"><a href="https://apify.com/vonsensey/google-news-api" style="color:#111827;font-weight:700;font-size:13px;text-decoration:none">Google News API</a><br><span style="color:#6B7280;font-size:11px">JSON News Feed with Real Article URLs</span></td><td style="padding:9px 12px;border:1px solid #E5E7EB;background:#FFFFFF;vertical-align:top;width:33%"><a href="https://apify.com/vonsensey/news-monitoring-scraper" style="color:#111827;font-weight:700;font-size:13px;text-decoration:none">News Monitoring Scraper</a><br><span style="color:#6B7280;font-size:11px">Track Brands, Competitors &amp; Topics</span></td></tr>
<tr><td style="padding:9px 12px;border:1px solid #E5E7EB;background:#ECFDF5;vertical-align:top;width:33%"><span style="color:#0B6E75;font-weight:700;font-size:13px">News Archive Scraper</span><br><span style="color:#0B6E75;font-size:11px;font-weight:600">&#10148; You are here</span></td><td style="padding:9px 12px;border:1px solid #E5E7EB;background:#FFFFFF;vertical-align:top;width:33%"><a href="https://apify.com/vonsensey/breaking-news-scraper-api" style="color:#111827;font-weight:700;font-size:13px;text-decoration:none">Breaking News API</a><br><span style="color:#6B7280;font-size:11px">Live Headlines Feed as JSON</span></td><td style="padding:9px 12px;border:1px solid #E5E7EB;background:#FFFFFF;vertical-align:top;width:33%"><a href="https://apify.com/vonsensey/finance-news-scraper-api" style="color:#111827;font-weight:700;font-size:13px;text-decoration:none">Finance News Scraper API</a><br><span style="color:#6B7280;font-size:11px">Market &amp; Ticker News as JSON</span></td></tr>
<tr><td style="padding:9px 12px;border:1px solid #E5E7EB;background:#FFFFFF;vertical-align:top;width:33%"><a href="https://apify.com/vonsensey/crypto-news-scraper-api" style="color:#111827;font-weight:700;font-size:13px;text-decoration:none">Crypto News Scraper API</a><br><span style="color:#6B7280;font-size:11px">Bitcoin &amp; Altcoin News as JSON</span></td></tr>
</table>

**More from this account:** [YouTube Transcript Suite](https://apify.com/vonsensey/youtube-transcript-scraper) · [Website Contact & Email Suite](https://apify.com/vonsensey/website-contact-email-extractor) · [Career Site & ATS Jobs Suite](https://apify.com/vonsensey/career-page-job-postings-scraper-api) · [Keyword Research Suite](https://apify.com/vonsensey/google-keyword-ideas-scraper) · [Shopify Store Intelligence Suite](https://apify.com/vonsensey/shopify-store-leads-scraper) · [eBay Data Suite](https://apify.com/vonsensey/ebay-scraper-api) · [Amazon Reviews Suite](https://apify.com/vonsensey/amazon-reviews-scraper-api) · [Reddit](https://apify.com/vonsensey/reddit-scraper-posts-comments-api) · [Meta Ad Library](https://apify.com/vonsensey/facebook-ads-library-scraper-meta-ad-api) · [Vinted](https://apify.com/vonsensey/vinted-scraper-api) · [Trustpilot Review Intelligence Suite](https://apify.com/vonsensey/trustpilot-reviews-scraper) · [App Store & Google Play Reviews Suite](https://apify.com/vonsensey/app-store-google-play-reviews-scraper) · [Etsy Research Suite](https://apify.com/vonsensey/etsy-scraper) · [YouTube Comments Intelligence Suite](https://apify.com/vonsensey/youtube-comments-scraper) · [Telegram Channel Intelligence Suite](https://apify.com/vonsensey/telegram-channel-scraper-api) · [Business Reviews Suite](https://apify.com/vonsensey/business-reviews-aggregator-scraper-api) · [Google Trends Suite](https://apify.com/vonsensey/google-trends-scraper) · [Amazon Product Data Suite](https://apify.com/vonsensey/amazon-product-scraper-api) · [Polymarket Order Book](https://apify.com/vonsensey/polymarket-orderbook-clob-prices-scraper-api) · [Nordic Marketplaces Suite](https://apify.com/vonsensey/blocket-finn-nordic-marketplace-scraper-api) · [Google Sheets Suite](https://apify.com/vonsensey/google-sheets-scraper-api) · [TikTok Suite](https://apify.com/vonsensey/tiktok-scraper-api) · [Snapchat Suite](https://apify.com/vonsensey/snapchat-scraper-api) · [LinkedIn Public Data Suite](https://apify.com/vonsensey/linkedin-scraper-api) · [Instagram Suite](https://apify.com/vonsensey/instagram-posts-scraper-api) · [Contact Validation Suite](https://apify.com/vonsensey/email-verifier-validator-api) · [Google Maps Suite](https://apify.com/vonsensey/google-maps-reviews-scraper-api) · [X / Twitter](https://apify.com/vonsensey/tweet-scraper)

Pull historical news archives, not just today's headlines. Google's feed caps at about 100 articles per query; this splits your query into date windows and returns thousands, reaching back years. Real publisher URL on every row, optional full article text. Pay per article, failed runs are free.

**Pay per article. Failed runs and empty runs cost nothing.**

### What you get

Articles come back with **the publisher's real URL already resolved** (`resolveStatus` names any a run could not resolve before its timeout) — not Google's
encoded `news.google.com/rss/articles/CBMi…` redirect. Measured 2026-08-19: 500 of 500
articles in one run resolved to a real publisher domain.

- `title`, `source`, `publishedAt` — 100% filled (3,140 of 3,140 rows measured); `publisherUrl`, `publisherDomain` — filled whenever Google's link resolves (500 of 500 measured), and `resolveStatus` says why when one does not
- `articleText`, `author`, `snippet`, `imageUrl` — with `fetchArticleText` on
- `resolveStatus` and `textStatus` on every row, so you always know what you got

### Beyond today's headlines

Google's feed returns at most ~100 articles per query. Set `archiveDays` and this splits the
query into date windows: measured 500 unique articles from 14 days of one query, against 101
from the same query unsharded.

### Full text, billed only when it arrives

With `fetchArticleText` on, a measured 100-article run returned 50 full bodies, 30 blocked
by the publisher, 15 with no article body, 3 paywalled and 2 failed. **You pay for the 50.**
Blocked and paywalled pages cost nothing and are labelled, never guessed.

### Pricing

Per 1,000, tiered by your Apify plan (prices in effect since 2026-08-22):

| Event | FREE | GOLD | DIAMOND |
|---|---:|---:|---:|
| One article (incl. sentiment) | $7.00 | **$3.50** | $3.10 |
| Resolved publisher URL | $0.80 | $0.50 | $0.40 |
| Full article body | $1.80 | $1.40 | $1.00 |

No run-start fee, and every event bills only on success: an unresolved URL and a paywalled
body both cost nothing. Set `maxCostUsd` to cap any run.

### Use it from anywhere

```bash
curl -X POST "https://api.apify.com/v2/acts/vonsensey~news-archive-scraper/run-sync-get-dataset-items?token=YOUR_TOKEN" \
  -H 'Content-Type: application/json' -d '{"maxItems":50}'
```

```python
from apify_client import ApifyClient
client = ApifyClient("YOUR_TOKEN")
run = client.actor("vonsensey/news-archive-scraper").call(run_input={"maxItems": 100})
for a in client.dataset(run["defaultDatasetId"]).iterate_items():
    if a.get("type") == "article":
        print(a["publishedAt"], a["source"], a["publisherUrl"])
```

Also available through the Apify integrations for n8n, Make and Zapier — schedule it and you
have a monitoring feed. Feeding a model? `textStatus` tells you which rows have a real body,
so you can filter before embedding.

### Legal

Unofficial tool, **not affiliated with, endorsed by, or sponsored by Google**. "Google" and
"Google News" are trademarks of Google LLC. Reads public RSS feeds and public publisher
pages only — no login, no paywall circumvention.

### The rest of the family

- [Google News Scraper API - Real URLs, Full Text & Sentiment](https://apify.com/vonsensey/google-news-scraper-api)
- [Google News API - JSON News Feed with Real Article URLs](https://apify.com/vonsensey/google-news-api)
- [News Monitoring Scraper - Track Brands, Competitors & Topics](https://apify.com/vonsensey/news-monitoring-scraper)
- [Breaking News API - Live Headlines Feed as JSON](https://apify.com/vonsensey/breaking-news-scraper-api)
- [Finance News Scraper API - Market & Ticker News as JSON](https://apify.com/vonsensey/finance-news-scraper-api)
- [Crypto News Scraper API - Bitcoin & Altcoin News as JSON](https://apify.com/vonsensey/crypto-news-scraper-api)

Issues and requests go in the **Issues** tab — first response within 24 hours.

### Use it from n8n, MCP, the API or a schedule

Built to be called by a workflow, not only from the Store form. The Actor is `vonsensey/news-archive-scraper`; every snippet below sends `{}`, which runs the defaults shown on the form — replace it with your own input.

#### n8n

Install the **Apify** community node (`@apify/n8n-nodes-apify` under *Settings → Community Nodes*, or search "Apify" on n8n Cloud). Add **Apify → Run Actor** with Actor `vonsensey/news-archive-scraper` and your input JSON, then **Apify → Get Dataset Items** on the run's `defaultDatasetId` and pipe the rows anywhere. For scheduled runs, the **On new Apify Event** trigger fires when a run of this Actor finishes.

#### MCP (Claude, Cursor, VS Code, any MCP client)

```json
{
  "mcpServers": {
    "apify": {
      "url": "https://mcp.apify.com?tools=vonsensey/news-archive-scraper",
      "headers": {
        "Authorization": "Bearer <YOUR_APIFY_TOKEN>"
      }
    }
  }
}
```

Your agent then calls `vonsensey/news-archive-scraper` as a tool with the same input the form takes and reads the dataset back.

#### REST API (one call, rows in the response)

```bash
curl -X POST "https://api.apify.com/v2/acts/vonsensey~news-archive-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" -d '{}'
```

#### Python

```python
from apify_client import ApifyClient
client = ApifyClient("<YOUR_APIFY_TOKEN>")
run = client.actor("vonsensey/news-archive-scraper").call(run_input={})
for row in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(row)
```

#### JavaScript

```js
import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: process.env.APIFY_TOKEN });
const run = await client.actor('vonsensey/news-archive-scraper').call({});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
```

#### Make, Zapier, LangChain, CrewAI

The Apify app in **Make** and **Zapier** has a *Run an Actor* module: pick `vonsensey/news-archive-scraper`. In **LangChain** and **CrewAI** the Apify tool wrappers take the same Actor id. A daily **schedule** needs nothing but the Console: *Schedules → Create → this Actor → cron*, and the dataset fills on its own.

> **Run it without configuring anything** — [Search the historical news archive](https://apify.com/vonsensey/news-archive-scraper/examples/historical-news-archive-search), a ready-made example you can start as-is or copy.

### Use cases

- **Brand and competitor monitoring.** Track your own name and a rival's in one run and see both in the same dataset.
- **Feed a model or a dashboard.** Clean JSON with the real publisher URL, headline, source and publication time — no scraping of your own required.
- **Build a historical dataset.** Walk a date window to reach far more than the ~100 items a single news query returns.
- **Run it on a schedule.** News is a feed, not a one-off — a daily or hourly run is what turns this into a monitoring system.

### Run it on a schedule

A one-off pull answers a question; a schedule answers it every day without you. Open **Schedules** in the Apify Console, point a cron at this Actor, and the dataset keeps filling on its own — no server, no cron box, no babysitting. Everything here is built to be re-run: you are billed per article delivered, and the FAQ below says exactly what a scheduled run that finds nothing new costs.

### FAQ

#### Do I get the real article URL or a Google redirect link?

The real publisher URL, resolved for you. Redirect links are useless downstream, which is the single most common complaint about news scrapers.

#### Can I get the full article text, not just the headline?

Yes — full text, author and lead image where the publisher exposes them.

#### How far back can I go?

Far past the ~100-item ceiling a single query returns: the archive Actor in this suite walks the date range window by window.

#### Can I filter by topic or country?

Yes. Query, topic feed, language and country are all inputs, and can be combined in one run.

***

Something wrong, or a field you need that is missing? Open an issue on the **Issues** tab — it is read and it gets fixed. If this saved you time, a rating on the Store page helps the next person find it.

# Actor input Schema

## `queries` (type: `array`):

Keywords to search Google News for. Supports Google operators: "exact phrase", tesla OR rivian, tesla -musk, intitle:tesla, site:reuters.com. One row is returned per article found.

## `archiveDays` (type: `integer`):

Go back this many days to break Google's 100-article-per-feed ceiling. The query is split into consecutive date windows and each is fetched separately, so 30 days can return thousands of articles instead of 100. Leave at 0 for a single latest-news pull. Applies to search and publisher inputs only.

## `windowDays` (type: `integer`):

Size of each date window when Archive depth is set. 1 gives the deepest coverage (up to ~100 articles per day); raise it for broad topics with fewer daily articles to save requests.

## `maxItems` (type: `integer`):

Hard cap on billable article rows for this run. The run stops as soon as it is reached.

## `maxCostUsd` (type: `string`):

Optional spend ceiling for this run. The run stops cleanly before exceeding it. Leave empty for no ceiling.

## `language` (type: `string`):

Google News interface language, e.g. en, de, fr, ja, sv, pt-BR. Controls which language the articles are returned in.

## `country` (type: `string`):

Two-letter country code for the Google News edition, e.g. US, GB, DE, IN, SE. Controls which regional outlets appear.

## `resolvePublisherUrls` (type: `boolean`):

Turn Google's encoded news.google.com/rss/articles/CBMi... redirect into the real article URL on the publisher's own domain. On by default — this is what makes the output usable.

## `fetchArticleText` (type: `boolean`):

Also fetch each publisher page and extract the full body text, author, image and canonical URL. Slower, and billed as a separate event — but only when text is actually returned. Paywalled and blocked pages cost nothing extra.

## `analyzeSentiment` (type: `boolean`):

Score each article positive / negative / neutral using VADER, the standard lexicon for short news text (it handles negation, so "not doing badly" reads positive). Free - no extra charge. English only: other languages return null rather than a score computed from an English word list.

## `dedupeSyndicated` (type: `boolean`):

One wire story often runs across dozens of outlets. Turn this on to return one row per story, with the other outlets listed in republishedBy — so you pay once for a story instead of forty times.

## `includeDuplicates` (type: `boolean`):

When collapsing syndicated duplicates, still emit the duplicate rows (tagged with duplicateOfId) instead of dropping them. Only applies when the option above is on.

## `topics` (type: `array`):

Google News topic sections: WORLD, NATION, BUSINESS, TECHNOLOGY, ENTERTAINMENT, SPORTS, SCIENCE, HEALTH. Opaque topic IDs from a Google News URL (CAAqJggK...) also work.

## `locations` (type: `array`):

Local news editions by place name, e.g. London, New York, Berlin. Returns the local headlines Google curates for that place.

## `publishers` (type: `array`):

Restrict results to specific outlets. Accepts reuters.com, www.reuters.com or a full URL. Use this to monitor a defined media set.

## `publisherQuery` (type: `string`):

Optional keyword applied to the publisher domains above, e.g. "earnings" to get only earnings coverage from those outlets.

## `includeTopHeadlines` (type: `boolean`):

Add Google News' main front-page headlines for the selected language and country.

## `concurrency` (type: `integer`):

How many requests to run in parallel. The default is tuned for speed without tripping rate limits; lower it only if you see errors.

## `proxy` (type: `object`):

Optional. Google News is reachable without a proxy from Apify, so leaving this off is both faster and cheaper. Enable it only if you need requests to originate from a specific country. Publisher pages for full article text are always read directly, never through the proxy.

## Actor input object example

```json
{
  "queries": [
    "tesla",
    "\"interest rates\" OR inflation"
  ],
  "archiveDays": 14,
  "windowDays": 1,
  "maxItems": 200,
  "maxCostUsd": "5.00",
  "language": "de",
  "country": "GB",
  "resolvePublisherUrls": true,
  "fetchArticleText": false,
  "analyzeSentiment": true,
  "dedupeSyndicated": false,
  "includeDuplicates": false,
  "topics": [
    "BUSINESS",
    "TECHNOLOGY"
  ],
  "locations": [
    "London",
    "New York"
  ],
  "publishers": [
    "reuters.com",
    "bbc.co.uk"
  ],
  "publisherQuery": "earnings",
  "includeTopHeadlines": false,
  "concurrency": 20,
  "proxy": {
    "useApifyProxy": false
  }
}
```

# Actor output Schema

## `articles` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "queries": [
        "tesla"
    ],
    "archiveDays": 14,
    "windowDays": 1,
    "maxItems": 200
};

// Run the Actor and wait for it to finish
const run = await client.actor("vonsensey/news-archive-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "queries": ["tesla"],
    "archiveDays": 14,
    "windowDays": 1,
    "maxItems": 200,
}

# Run the Actor and wait for it to finish
run = client.actor("vonsensey/news-archive-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "queries": [
    "tesla"
  ],
  "archiveDays": 14,
  "windowDays": 1,
  "maxItems": 200
}' |
apify call vonsensey/news-archive-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,vonsensey/news-archive-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/p0vjRtbTXsfk7z8fM/builds/Zq6GRndiG6wOlEdov/openapi.json