# Shopify Products Scraper (`trovevault/shopify-products-scraper`) Actor

Scrape Shopify products with prices, real inventory counts when public, product and variant IDs, SKUs, barcodes and GTINs, named options, weights, images, SEO, and metafields. Enter store domains with no API keys or category URLs.

- **URL**: https://apify.com/trovevault/shopify-products-scraper.md
- **Developed by:** [Trove Vault](https://apify.com/trovevault) (community)
- **Categories:** E-commerce, Other
- **Features:** Limited permissions
- **Stats:** 880 total users, 125 monthly users, 100.0% runs succeeded, 11 bookmarks
- **User rating**: 5.00 out of 5 stars

## Pricing

from $0.85 / 1,000 products

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## Shopify Products Scraper: Full Catalogue from Any Store Domain

> **New:** Clean $1-per-1,000-product catalogues, plus optional exact-inventory and deep-detail enrichment.

Extract complete public Shopify catalogues from one or more store domains with no API key, collection URLs, or browser.

### Why use the Shopify Products Scraper?

Start from a store domain instead of collecting product or collection URLs. The actor paginates the public catalogue directly and returns normalized data for exports, dashboards, or downstream Actors.

### What data does the Shopify Products Scraper extract?

Each row is one product. Standard rows omit premium-only fields completely; they are added only when **Exact Inventory & Deep Details** is selected and enrichment succeeds.

| Fields | What they mean |
|---|---|
| `store`, `productId`, `handle`, `title`, `vendor`, `url` | Product identity, vendor, and canonical URL |
| `featuredImage`, `imageUrls`, `imageCount`, `imageAltTexts`, `images` | Image URLs plus IDs, dimensions, positions, linked variants, alt text, and timestamps |
| `currency`, `priceMin`, `priceMax`, `compareAtPrice`, `onSale` | ISO 4217 currency, lowest and highest variant price, highest compare-at price (or `null`), and whether any variant is discounted |
| `available`, `fullyOutOfStock`, `requiresShipping` | Catalogue availability and shipping flags |
| `variantCount`, `variants`, `options`, `productOptions` | Variant IDs, SKUs, named options, prices, weights, images, tax/shipping, and timestamps |
| `productType`, `tags`, `description`, `descriptionHtml` | Classification and product content |
| `createdAt`, `publishedAt`, `updatedAt`, `runId` | Lifecycle and optional pipeline metadata |
| Premium only | `detailLevel`, `inventoryAccuracy`, `inventoryCount`, exact variant inventory, policy/management, barcode/GTIN, quantity rules, selling plans, SEO, structured brand, and public metafields when available |

### What can you do with Shopify product data?

- **Price monitoring**: compare current, range, and compare-at prices across scheduled runs.
- **Inventory tracking**: monitor real variant quantities, stockouts, and restocks.
- **Assortment analysis**: compare brands, types, tags, variants, SKUs, options, and price bands.
- **New product detection**: diff scheduled datasets using product IDs and timestamps.

### How do I scrape all products from a Shopify store?

1. Enter one or more store domains, such as `gymshark.com` or `deathwishcoffee.com`.
2. Set **Max Products** per store: `50` to test, `500` for a sample, or `0` for the full catalogue.
3. Select **Exact Inventory & Deep Details** for premium enrichment. It is free until September 23, 2026; afterward, only successfully enriched products add an Inventory Enrichment event.
4. Leave proxy disabled unless a store returns HTTP 403, then start the actor and export the dataset.

### What input does the Shopify Products Scraper need?

```json
{
  "domains": ["gymshark.com", "deathwishcoffee.com"],
  "maxProducts": 500,
  "includeInventoryDetails": false,
  "proxyConfiguration": { "useApifyProxy": false }
}
```

| Field | Type | Default | Description |
|---|---|---|---|
| `domains` | Array | required | Shopify store domains. Accepts bare hostnames, full URLs, and Shopify-hosted domains. |
| `maxProducts` | Number | `0` | Maximum products per store. `0` means no limit. |
| `includeInventoryDetails` | Boolean | `false` | Adds exact public inventory and deep details. Free until September 23, 2026; afterward, only successful enrichments add an event. |
| `proxyConfiguration` | Object | disabled | Proxy settings. Enable Apify Proxy Residential only when a domain returns HTTP 403. |
| `datasetId` | String | optional | Existing Apify dataset ID to append rows to alongside the default dataset. |
| `runId` | String | optional | Parent run ID copied into each output row for pipeline traceability. |

### What does the output look like?

The actor returns one dataset item per product. This example has premium enrichment enabled; these premium keys are absent from standard rows.

```json
{
  "store": "gymshark.com",
  "productId": 100,
  "vendor": "Gymshark",
  "title": "Vital Seamless 2.0 Shorts",
  "url": "https://gymshark.com/products/vital-seamless-2-0-shorts",
  "featuredImage": "https://cdn.shopify.com/vital-seamless-shorts.jpg",
  "imageUrls": [
    "https://cdn.shopify.com/vital-seamless-shorts.jpg",
    "https://cdn.shopify.com/vital-seamless-shorts-back.jpg"
  ],
  "imageCount": 2,
  "imageAltTexts": ["Vital Seamless 2.0 Shorts - Black", "Back view - Black"],
  "currency": "GBP",
  "priceMin": 45,
  "priceMax": 45,
  "compareAtPrice": null,
  "onSale": false,
  "available": true,
  "fullyOutOfStock": false,
  "detailLevel": "enriched",
  "inventoryAccuracy": "exact",
  "inventoryCount": 7,
  "variantCount": 1,
  "variants": [
    {
      "variantId": 201,
      "productId": 100,
      "title": "Black / S",
      "sku": "VITAL-BLK-S",
      "selectedOptions": { "Color": "Black", "Size": "S" },
      "inventoryQuantity": 7,
      "inventoryManagement": "shopify",
      "inventoryPolicy": "deny",
      "barcode": "5060990123456",
      "gtin": "5060990123456",
      "available": true,
      "price": 45,
      "compareAtPrice": null
    }
  ],
  "options": ["Color", "Size"],
  "productType": "Shorts",
  "tags": ["bottoms", "seamless", "training"],
  "publishedAt": "2023-06-14T09:00:00Z"
}
```

### How do I run the Shopify Products Scraper via API?

Trigger a run with curl:

```bash
curl -X POST "https://api.apify.com/v2/acts/trovevault~shopify-products-scraper/runs" \
  -H "Authorization: Bearer YOUR_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"domains":["gymshark.com"],"maxProducts":500,"includeInventoryDetails":true}'
```

Run with the JavaScript client and read the dataset:

```javascript
import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_APIFY_TOKEN' });

const run = await client.actor('trovevault~shopify-products-scraper').call({
    domains: ['gymshark.com'],
    maxProducts: 500,
    includeInventoryDetails: true,
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items.slice(0, 3));
```

You can also call the actor from any MCP-compatible AI assistant through the Apify MCP server.

### How do I fix common Shopify scraping errors?

| Issue | Solution |
|---|---|
| HTTP 403 or IP blocked | Enable Apify Proxy with the Residential group in `proxyConfiguration`. Large brands block datacenter IP ranges. |
| Store is not recognized or its catalogue is unavailable | The actor automatically checks compatible catalogue routes. If none work, confirm that the site runs on Shopify and exposes a public catalogue. |
| Fewer products than expected | Only the public storefront catalogue is exposed. Draft, hidden, password-protected, and wholesale-only products never appear. |
| Currency is `null` | Some stores restrict the public settings used to confirm currency. Product rows still return, but the currency remains unconfirmed. |
| Network errors or timeouts | Retry with a lower `maxProducts`, then enable the Residential proxy and check the run log. |

### FAQ

**Does it return variant-level data?**
Yes. Standard rows include IDs, SKU, options, availability, prices, weight, images, tax/shipping, and timestamps. Premium enrichment adds exact inventory, barcode/GTIN, inventory policy, quantity rules, and selling plans.

**Can I scrape several stores at once?**
Yes. Add multiple domains to `domains`; each row includes the `store` field.

**Can I append output to an existing dataset?**
Yes. Pass `datasetId` to append rows to an existing dataset, and `runId` to link rows to a parent pipeline run.

**Is scraping Shopify product data legal?**
The actor requests public storefront endpoints. Accessing public data is generally lawful, but review the target site's terms and your use case.

### What are the limitations of the Shopify Products Scraper?

- Variant and SKU details are nested in each product row, not emitted as separate rows.
- Only public Shopify catalogue data is returned; headless, password-protected, wholesale, or restricted stores may not expose a compatible public catalogue.
- Exact inventory and other premium fields require **Exact Inventory & Deep Details**. They are omitted—not filled with `null`—when the add-on is disabled or public detail data is unavailable. Unavailable enrichments are not charged.
- Premium enrichment uses throttled public product requests and retries rate limits, so it is slower than standard catalogue mode. Exact inventory is store-wide, not location-level.
- Status, publication scope, template suffix, and most metafields are not public; absent values are omitted. Metafields commonly require Storefront API token access.
- `compareAtPrice` appears only when the merchant sets compare-at pricing, and currency may be `null` when the store does not expose enough public settings to confirm it.
- The actor does not crawl non-Shopify platforms such as WooCommerce, Magento, BigCommerce, or Amazon.

### Related actors

- [WooCommerce Products Scraper](https://apify.com/trovevault/woocommerce-products-scraper) for WooCommerce product catalogues.
- [E-Commerce Tech Stack Detector](https://apify.com/trovevault/e-commerce-tech-stack-detector) to identify a store platform before scraping.

### Changelog

#### v0.1

- Optional paid per-product enrichment with exact inventory and deep details
- Clean standard rows that omit every enrichment-only field
- Full public Shopify catalogue scraping from a store domain
- Automatic pagination and multi-store input
- Automatic domain resolution for custom, regional, and Shopify-hosted stores
- Public product, variant, option, image, pricing, and lifecycle metadata

# Actor input Schema

## `domains` (type: `array`):

One or more Shopify store domains to scrape, one per line. What it does: each domain is scraped independently and its rows are tagged with the store field. Format: a bare hostname, full URL, or Shopify-hosted domain; any URL path is ignored (https://gymshark.com/collections/all is treated as gymshark.com). Examples: gymshark.com, https://deathwishcoffee.com, or allbirds.com. Default: https://deathwishcoffee.com when left empty.

## `maxProducts` (type: `integer`):

Maximum number of product rows to return per store domain. What it does: caps collection for each domain independently. Format: 0 or any positive integer. Examples: 50 or 100 for a quick test, 500 for a sample, 5000 for a large catalogue, or 0 for the full public catalogue. Default: 0, which continues until no more public products are returned.

## `includeInventoryDetails` (type: `boolean`):

Enable the optional enrichment add-on. What it does: fetches each product's public detail data to add exact variant inventory when exposed, inventory policy and management, barcodes/GTINs, quantity rules, selling plans, SEO metadata, and structured brand data. Cost: free during the announced preview period; afterward, one Inventory Enrichment event per successfully enriched product. Unavailable or failed enrichments are not charged. Default: false, which keeps the fast catalogue output and completely omits enrichment-only fields.

## `proxyConfiguration` (type: `object`):

How outgoing requests are routed. What it does: sends Shopify requests through the Apify proxy when enabled. Format: an Apify proxy configuration object. Leave disabled for most stores; enable Apify Proxy with the RESIDENTIAL group only when a domain returns HTTP 403 or blocks datacenter IPs. Examples: disabled for deathwishcoffee.com, Residential for large protected brands such as Gymshark, Allbirds, or MVMT. Default: disabled ({ "useApifyProxy": false }).

## `datasetId` (type: `string`):

Optional Apify dataset ID that receives a copy of every product row in addition to the run's default dataset. What it does: appends this run's rows to an existing dataset, so scheduled or multi-store runs accumulate in one place. Format: a 17-character Apify dataset ID (letters and digits), found in the dataset URL or the Storage tab. Examples: aBcD1234efGh5678i, or leave empty to skip. Default: empty, which writes only to the run's default dataset.

## `runId` (type: `string`):

Optional parent Apify run ID written into every output row as the runId field. What it does: stamps each product with an upstream run identifier so results trace back through a pipeline. Format: a 17-character Apify run ID (letters and digits), found in the run URL or run detail. Examples: aBcD1234efGh5678i, or leave empty to skip. Default: empty, which leaves runId unset on output rows.

## Actor input object example

```json
{
  "domains": [
    "https://deathwishcoffee.com"
  ],
  "maxProducts": 0,
  "includeInventoryDetails": false,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}
```

# Actor output Schema

## `dataset` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "domains": [
        "https://deathwishcoffee.com"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("trovevault/shopify-products-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "domains": ["https://deathwishcoffee.com"] }

# Run the Actor and wait for it to finish
run = client.actor("trovevault/shopify-products-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "domains": [
    "https://deathwishcoffee.com"
  ]
}' |
apify call trovevault/shopify-products-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,trovevault/shopify-products-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/dsYHmuqeHvtR7NYxx/builds/Kh0fdhaxbJmZWJR4j/openapi.json