Skip to main content

Product Category Scraper

The Product Category scraper type generates scrapers that extract product listings from category and browse pages. This includes the category information, subcategories, product listings, applied filters, and pagination data.


When to Use

Use the Product Category Page scraper type when your target URLs are category or browse pages — pages that display a curated list of products within a specific category or department.

Example URLs:

  • https://www.amazon.com/b?node=565108 (Amazon "Books" category)
  • https://www.walmart.com/browse/electronics/3944 (Walmart "Electronics" category)
  • https://www.target.com/c/headphones-audio-electronics/-/N-5xtb0
  • https://www.ebay.com/b/Cell-Phones/9355/bn_320094
Category vs. Search Pages

Category pages display products organized by a specific department or category, often with subcategories and curated filters. Search pages display results for a user-entered search query. If the URL contains a search query parameter (e.g., ?q=, ?k=, ?searchTerm=), use the Product Search scraper type instead.


Data Schema

The Product Category scraper extracts the following fields:

Category Information

FieldTypeDescription
categoryNamestringThe name of the product category
categoryUrlstringThe absolute URL of the category page
categoryIdstringUnique identifier for the category (e.g., browse node ID)
descriptionstringCategory description or promotional text
bannerImagestringCategory banner or header image URL
FieldTypeDescription
breadcrumbsarrayNavigation breadcrumb trail showing category hierarchy
breadcrumbs[].namestringBreadcrumb item name
breadcrumbs[].urlstringBreadcrumb item URL

Subcategories

FieldTypeDescription
subcategoriesarrayList of subcategories within this category
subcategories[].namestringSubcategory name
subcategories[].urlstringSubcategory URL
subcategories[].productCountnumberNumber of products in this subcategory

Products

Each product in the products array contains:

FieldTypeDescription
namestringProduct name/title
urlstringProduct detail page URL
productIdstringUnique product identifier (e.g., ASIN, SKU)
pricenumberProduct price
currencystringCurrency code (e.g., USD, GBP)
preDiscountPricenumberOriginal price if product is on sale
imagestringPrimary product image URL
ratingnumberProduct rating (e.g., 4.5 out of 5)
reviewCountnumberTotal number of reviews
availabilitystringAvailability status: in_stock, out_of_stock, pre_order, or limited_stock
brandstringProduct brand name
isPrimebooleanWhether product has Prime shipping (Amazon specific)
isSponsoredbooleanWhether product is a sponsored/ad listing

Filters

FieldTypeDescription
appliedFiltersarrayCurrently applied filters on the category page
appliedFilters[].filterNamestringName of the applied filter
appliedFilters[].filterValuestringValue of the applied filter

Pagination

FieldTypeDescription
pagination.currentPagenumberCurrent page number
pagination.totalPagesnumberTotal number of pages
pagination.totalResultsnumberTotal number of products in category
pagination.resultsPerPagenumberNumber of products per page
pagination.nextPageUrlstringURL to the next page
pagination.prevPageUrlstringURL to the previous page

Example JSON Output

{
"categoryName": "Headphones",
"categoryUrl": "https://www.amazon.com/b?node=12097479011",
"categoryId": "12097479011",
"description": "Shop headphones from top brands including Sony, Bose, Apple, and more.",
"bannerImage": "https://m.media-amazon.com/images/G/01/Electronics/CategoryPages/Headphones_Banner.jpg",
"breadcrumbs": [
{
"name": "Electronics",
"url": "https://www.amazon.com/electronics/b?node=172282"
},
{
"name": "Audio",
"url": "https://www.amazon.com/audio/b?node=172541"
},
{
"name": "Headphones",
"url": "https://www.amazon.com/b?node=12097479011"
}
],
"subcategories": [
{
"name": "Over-Ear Headphones",
"url": "https://www.amazon.com/b?node=12097480011",
"productCount": 2500
},
{
"name": "In-Ear Headphones",
"url": "https://www.amazon.com/b?node=12097481011",
"productCount": 4200
},
{
"name": "On-Ear Headphones",
"url": "https://www.amazon.com/b?node=12097482011",
"productCount": 1800
}
],
"products": [
{
"name": "Sony WH-1000XM5 Wireless Noise Canceling Headphones",
"url": "https://www.amazon.com/dp/B0BX2L8PCS",
"productId": "B0BX2L8PCS",
"price": 328.00,
"currency": "USD",
"preDiscountPrice": 399.99,
"image": "https://m.media-amazon.com/images/I/51aXvjzcukL._AC_UL320_.jpg",
"rating": 4.6,
"reviewCount": 12543,
"availability": "in_stock",
"brand": "Sony",
"isPrime": true,
"isSponsored": false
},
{
"name": "Bose QuietComfort Ultra Wireless Headphones",
"url": "https://www.amazon.com/dp/B0CCZ1L489",
"productId": "B0CCZ1L489",
"price": 349.00,
"currency": "USD",
"preDiscountPrice": 429.00,
"image": "https://m.media-amazon.com/images/I/51JbsHSktkL._AC_UL320_.jpg",
"rating": 4.4,
"reviewCount": 8921,
"availability": "in_stock",
"brand": "Bose",
"isPrime": true,
"isSponsored": false
}
],
"appliedFilters": [
{
"filterName": "Brand",
"filterValue": "Sony"
}
],
"pagination": {
"currentPage": 1,
"totalPages": 15,
"totalResults": 356,
"resultsPerPage": 24,
"nextPageUrl": "https://www.amazon.com/b?node=12097479011&page=2",
"prevPageUrl": null
}
}

Usage Tips

  • Distinguish from search pages — Category pages are organized by department/category hierarchy, while search pages are driven by search queries. Use the correct scraper type for best results.
  • Subcategory navigation — The scraper extracts subcategory links, which you can use to programmatically crawl deeper into the category hierarchy
  • Filter awareness — The appliedFilters field tells you which filters are active on the current page, useful for tracking filtered vs. unfiltered results
  • Country geotargeting — Set the country to match your target market for localized category listings, prices, and availability
  • Not all fields on every site — Some fields (e.g., isPrime, bannerImage, subcategories) may return empty depending on the website