Walmart Parser
Using the ScrapeOps Parser API you can scrape Walmart Pages without having to maintain your own product parsers.
Simply send the HTML of the Walmart Pages to the Parser API endpoint, and receive the data in structured JSON format.
Walmart Endpoint:
"https://parser.scrapeops.io/v1/walmart"
The Walmart Parser supports the following page types:
- Walmart Product Pages
- Walmart Search Pages
- Walmart Category Pages
- Walmart Shop Pages
- Walmart Browse Pages
- Walmart Reviews Pages
Authorisation - API Key
To use the ScrapeOps Parser API, you first need an API key which you can get by signing up for a free account here.
Your API key must be included with every request using the api_key query parameter otherwise the API will return a 403 Forbidden Access status code.
Walmart Product Page Parser
To use the Parser API without the ScrapeOps Proxy Aggregator, you first need to retrieve the HTML of the page you want to extract the data from.
For example, here we retrieve the HTML from the following Walmart Product Page with a very simple GET request:
import requests
response = requests.get('https://www.walmart.com/ip/Mighty-Patch-Nose-Patch-from-Hero-Cosmetics-XL-Hydrocolloid-Pore-Strips-to-Absorb-Acne-Gunk-8ct/1833409885')
if response.status_code == 200:
html = response.text
print(html)
Next, we send this HTML to the ScrapeOps Parser API for data extraction using a POST request:
import requests
response = requests.get('https://www.walmart.com/ip/Mighty-Patch-Nose-Patch-from-Hero-Cosmetics-XL-Hydrocolloid-Pore-Strips-to-Absorb-Acne-Gunk-8ct/1833409885')
if response.status_code == 200:
html = response.text
data = {
'url': 'https://www.walmart.com/ip/Mighty-Patch-Nose-Patch-from-Hero-Cosmetics-XL-Hydrocolloid-Pore-Strips-to-Absorb-Acne-Gunk-8ct/1833409885',
'html': html,
}
response = requests.post(
url='https://parser.scrapeops.io/v1/walmart',
params={'api_key': 'YOUR_API_KEY'},
json=data
)
print(response.json())
The API will return a JSON response with the following data (status, data, url):
{
"data": {
"product_details": {
"Specifications": [
{
"name": "Brand",
"value": "Hero Cosmetics"
}
],
"directions": [
{
"name": "Instructions",
"value": "Cleanse skin, apply, then smooth down sides."
}
],
"indications": [
{
"name": "Stop Use Indications",
"value": "Stop use if irritation occurs."
},
{
"name": "Skin Care Concern",
"value": "Acne Blemishes"
}
],
"long_description": "<ul> <li>Improves the look of pores</li> <li>Absorbs pimple gunk in 6 to 8 hours</li> <li>XL nose coverage</li> <li>For nose pores, pimples, zits and oil</li> <li>Hero Cosmetics nose patch</li> <li>For acne-prone skin</li> <li>Mighty Patch turns white as the gunk comes out, so you can actually see it’s working</li> </ul>",
"short_description": "All the gunk-absorbing power of Mighty Patch, now in a flexibly thin XL size that’s specially designed for your nose (even the creases). Hero Cosmetics' Mighty Patch Nose is a gentle hydrocolloid nose patch that soaks up oil, traps pimple gunk, and improves the look of pores overnight for acne-prone skin. Flexibly thin, its designed to contour to your nose. Once the patch turns white, peel and watch the gunk come. XL hydrocolloid patches for nose pores, pimples, zits and oil."
},
"product_information": {
"availability": "OUT_OF_STOCK",
"brand": "Hero Cosmetics",
"brand_url": "https://www.walmart.com/search?q=Hero+Cosmetics&facet=brand:Hero+Cosmetics",
"fulfillments": [
{
"location": "Los Angeles, 90012",
"status": "OUT_OF_STOCK",
"type": "SHIPPING"
},
{
"location": "South Gate Supercenter",
"status": "NOT_AVAILABLE",
"type": "PICKUP"
},
{
"location": "Los Angeles, 90012",
"status": "NOT_AVAILABLE",
"type": "DELIVERY"
}
],
"id": "1833409885",
"images": [
"https://i5.walmartimages.com/seo/Mighty-Patch-Nose-Patch-from-Hero-Cosmetics-XL-Hydrocolloid-Pore-Strips-to-Absorb-Acne-Gunk-8ct_d9ab5cfa-d0a8-4811-89a4-21340d203979.38416fb0219739eb6a2502179f5b8a34.jpeg",
"https://i5.walmartimages.com/asr/d71f675b-5327-4a59-adfe-afc78b5eb368.041b6cd589a3d4d151283fcb235148fb.png",
"https://i5.walmartimages.com/asr/dff5918f-0e3d-4faf-95ef-008f8ec0a76d.6d488cef5aab1a410a2d6c72c127888e.jpeg"
...
],
"name": "Mighty Patch by Hero Cosmetics XL Nose Acne & Pimple Treatment Patches with Hydrocolloid, 8 Count",
"rating_average": 4.4,
"reviews_count": 1049,
"sales_unit": "EACH",
"seller_name": "Fortoge Ecom LLC",
"seller_rating": 1,
"seller_reviews": 5,
"seller_type": "EXTERNAL"
},
"related_pages": [
{
"text": "Starface",
"url": "https://www.walmart.com/browse/beauty/starface/1085666_3316357_3475749"
},
{
"text": "Blackhead Removers",
"url": "https://www.walmart.com/browse/beauty/blackhead-removers/1085666_1007039_3369224_4652954"
}
...
],
"related_searches": [
{
"text": "mighty patch",
"url": "https://www.walmart.comsearch?q=mighty%20patch&ip_source=EXTERNAL_IP"
},
{
"text": "hero cosmetics",
"url": "https://www.walmart.comsearch?q=hero%20cosmetics&ip_source=EXTERNAL_IP"
}
...
],
"reviews_info": {
"1_star_count": 89,
"1_star_percent": 8,
"2_star_count": 30,
"2_star_percent": 3,
"3_star_count": 43,
"3_star_percent": 4,
"4_star_count": 139,
"4_star_percent": 13,
"5_star_count": 748,
"5_star_percent": 71,
"media_count": 4,
"rating_average": 4.3603,
"reviews": [
{
"badges": [
"VerifiedPurchaser"
],
"rating": 5,
"text": "This is my first purchase of these nose patches. I wanted to give them a try because the invisible pimple patches work magic %26 and are one of my go to skin routine grabs. I've used these nose patches three times so far from the box (come with 8) and they work amazing! I highly recommend them and I promise you won't regret purchasing some :)",
"time": "3/22/2024",
"title": "Nose patches",
"user_name": 0
},
{
"badges": [
"VerifiedPurchaser",
"PrizeIncentive"
],
"rating": 5,
"text": "Great product but I wish it were a little more cheaper.",
"time": "8/3/2024",
"title": "",
"user_name": 0
}
...
],
"reviews_count": 1049,
"top_negative_review": {
"badges": [
"VerifiedPurchaser"
],
"rating": 1,
"text": "Absolutely not worth the high price. These don't stick well at all. I wouldn't buy them again even if they were only a couple dollars, let alone $13 .",
"time": "3/16/2024",
"title": "Worthless",
"user_name": 0
},
"top_positive_review": {
"badges": [
"VerifiedPurchaser"
],
"rating": 5,
"text": "This is my first purchase of these nose patches. I wanted to give them a try because the invisible pimple patches work magic %26 and are one of my go to skin routine grabs. I've used these nose patches three times so far from the box (come with 8) and they work amazing! I highly recommend them and I promise you won't regret purchasing some :)",
"time": "3/22/2024",
"title": "Nose patches",
"user_name": 0
}
}
},
"status": "parse_successful",
"url": "https://www.walmart.com/ip/Mighty-Patch-Nose-Patch-from-Hero-Cosmetics-XL-Hydrocolloid-Pore-Strips-to-Absorb-Acne-Gunk-8ct/1833409885"
}
A full example JSON response can be found here.
Walmart Search Page Parser
To use the Parser API without the ScrapeOps Proxy Aggregator, you first need to retrieve the HTML of the page you want to extract the data from.
For example, here we retrieve the HTML from the following Walmart Search Page with a very simple GET request:
import requests
response = requests.get('https://www.walmart.com/search?q=phone')
if response.status_code == 200:
html = response.text
print(html)
Next, we send this HTML to the ScrapeOps Parser API for data extraction using a POST request:
import requests
response = requests.get('https://www.walmart.com/search?q=phone')
if response.status_code == 200:
html = response.text
data = {
'url': 'https://www.walmart.com/search?q=phone',
'html': html,
}
response = requests.post(
url='https://parser.scrapeops.io/v1/walmart',
params={'api_key': 'YOUR_API_KEY'},
json=data
)
print(response.json())
The API will return a JSON response with the following data (status, data, url):
{
"data": {
"related_links": [
{
"title": "Shop Wireless Deals",
"url": "https://www.walmart.com/shop/deals/cell-phones-and-wearable-tech?povid=ets_navpill_search_87_phones_cellphone_deals"
},
{
"title": "Straight Talk Phones",
"url": "https://www.walmart.com/browse/cell-phones/straight-talk-phones-plans/1105910_4527935_1072335_5381159_3748859?povid=ets_navpill_search_87_phones_cellphone_straighttalk"
}
...
],
"related_searches": [
{
"text": "iphone",
"url": "https://www.walmart.com/search?q=iphone"
},
{
"text": "straight talk phones",
"url": "https://www.walmart.com/search?q=straight%20talk%20phones"
}
...
],
"search_information": {
"title": "Results for \"phone\"",
"total_count": 366442
},
"search_pagination": [
{
"current": true,
"number": 1,
"url": "https://www.walmart.com/search?q=phone"
},
{
"number": 2,
"url": "https://www.walmart.com/search?q=phone&page=2"
}
...
],
"search_results": [
{
"availability": "In stock",
"flag": "",
"fulfillments": [
"Free shipping, arrives today"
],
"id": "2531329303",
"image": "https://i5.walmartimages.com/seo/AT-T-Motorola-Moto-G-Stylus-2023-128GB-Midnight-Blue-Prepaid-Smartphone_7bcc90b6-021f-451f-b41b-6424f43843a3.e87ddeadf141cfc7af3ec30a8c73b27a.jpeg",
"is_buy_now": false,
"is_eligible": false,
"is_outofstock": false,
"is_show_options": false,
"is_sponsored": true,
"name": "AT&T Motorola Moto G Stylus 2023, 128GB, Midnight Blue - Prepaid Smartphone",
"price": 59.88,
"price_line": "$59.88",
"rating_average": 4,
"reviews_count": 1292,
"salesUnit": "EACH",
"seller_name": "Walmart.com",
"type": "REGULAR",
"url": "https://www.walmart.com/ip/AT-T-Motorola-Moto-G-Stylus-2023-128GB-Midnight-Blue-Prepaid-Smartphone/2531329303?classType=REGULAR"
},
{
"availability": "In stock",
"flag": "Best seller",
"fulfillments": [
"Shipping, arrives in 2 days"
],
"id": "5080177085",
"image": "https://i5.walmartimages.com/seo/Cricket-Wireless-Debut-S2-32GB-3GB-RAM-Deep-Navy-Prepaid-Smartphone_b05f5083-2bd3-46b1-b453-5b6f2943f7f8.9e306eca6f8fb09aa68dde6ec5612dcb.jpeg",
"is_buy_now": false,
"is_eligible": false,
"is_outofstock": false,
"is_show_options": false,
"is_sponsored": true,
"name": "Cricket Wireless Debut S2, 32GB, 3GB RAM, Deep Navy - Prepaid Smartphone",
"price": 34.24,
"price_line": "$34.24",
"rating_average": 3.9,
"reviews_count": 98,
"salesUnit": "EACH",
"seller_name": "Walmart.com",
"type": "REGULAR",
"url": "https://www.walmart.com/ip/Cricket-Wireless-Debut-S2-32GB-3GB-RAM-Deep-Navy-Prepaid-Smartphone/5080177085?classType=REGULAR&athbdg=L1600"
}
...
]
},
"status": "parse_successful",
"url": "https://www.walmart.com/search?q=phone"
}
A full example JSON response can be found here.
Walmart Category Page Parser
To use the Parser API without the ScrapeOps Proxy Aggregator, you first need to retrieve the HTML of the page you want to extract the data from.
For example, here we retrieve the HTML from the following Walmart Category Page with a very simple GET request:
import requests
response = requests.get('https://www.walmart.com/cp/skin-care/1007039')
if response.status_code == 200:
html = response.text
print(html)
Next, we send this HTML to the ScrapeOps Parser API for data extraction using a POST request:
import requests
response = requests.get('https://www.walmart.com/cp/skin-care/1007039')
if response.status_code == 200:
html = response.text
data = {
'url': 'https://www.walmart.com/cp/skin-care/1007039',
'html': html,
}
response = requests.post(
url='https://parser.scrapeops.io/v1/walmart',
params={'api_key': 'YOUR_API_KEY'},
json=data
)
print(response.json())
The API will return a JSON response with the following data (status, data, url):
{
"data": {
"description": "Shop for Skin Care products at Walmart.com and find Moisturizers, Facial Cleansers, Facial Treatments, Oil & Blemish Control and Lip Care. Save money. Live Better.",
"left_navigation": [
{
"categories": [
{
"children": [
{
"name": "New Skin Care",
"url": "https://www.walmart.com/browse/beauty/new-skin-care/1085666_4427759_3591987?povid=Beauty_SkincareCP_LHN_NewSkinCare"
},
{
"name": "Skincare Exclusives",
"url": "https://www.walmart.com/browse/beauty/skincare-exclusives/1085666_5349205_9572637?povid=Beauty_SkincareCP_LHN_SkincareExclusives"
}
],
"name": "New & Exclusive"
},
{
"children": [
{
"name": "Spring break beauty",
"url": "https://www.walmart.com/browse/beauty/spring-beauty-refresh/1085666_5053208_9013773?povid=Beauty_SkincareCP_LHN_Springbreakbeauty_031324"
},
{
"name": "Winter Beauty",
"url": "https://www.walmart.com/browse/beauty/seasonal-beauty/1085666_5053208_8917336?povid=Beauty_SkincareCP_LHN_WinterBeauty_122923"
}
...
],
"name": "Trending"
}
...
],
"heading": "Featured Shops"
}
...
],
"related_navigation": [
{
"heading": "Brands we love",
"links": [
{
"image": "https://i5.walmartimages.com/dfw/4ff9c6c9-cf83/k2-_18e8d00b-2d73-4840-a93f-26d10ea8ae30.v1.jpg",
"name": "Futurewise",
"url": "https://www.walmart.com/browse/0?facet=brand:Futurewise&povid=Beauty_SkincareCP_Hubspoke_Futurewise_081924"
},
{
"image": "https://i5.walmartimages.com/dfw/4ff9c6c9-18a9/k2-_75277b0c-4e5a-4ce5-bf19-8689bcf6ae3e.v1.jpg",
"name": "CeraVe",
"url": "https://www.walmart.com/browse/beauty/cerave/1085666_3316357_9663742?povid=Beauty_SkincareCP_Hubspoke_CeraVe_081924"
}
...
]
},
{
"heading": "More ways to shop",
"links": [
{
"image": "https://i5.walmartimages.com/dfw/4ff9c6c9-b6f3/k2-_076d59c8-3d3e-49f9-8fc4-8d13e218d753.v1.jpg",
"name": "Summer savings",
"url": "https://www.walmart.com/shop/deals/beauty-and-grooming/skincare?povid=Beauty_SkincareCP_Hubspokes_WTS_SummerSavings_081324"
},
{
"image": "https://i5.walmartimages.com/dfw/4ff9c6c9-1230/k2-_a2b78731-4010-4eb0-b0dd-16d36c356d2d.v1.jpg",
"name": "New arrivals",
"url": "https://www.walmart.com/browse/beauty/new-skincare/1085666_4427759_3591987?povid=Beauty_SkincareCP_Hubspokes_WTS_Newarrivals_081324"
}
...
]
}
...
],
"related_searches": [
{
"title": "Beauty Deals",
"url": "https://www.walmart.com/shop/deals/beauty-and-grooming?povid=Beauty_SkincareCP_navpill_BeautyDeals_042524"
},
{
"title": "All Beauty",
"url": "https://www.walmart.com/cp/beauty/1085666?povid=Beauty_SkincareCP_navpill_AllBeauty"
}
...
],
"search_results": [
{
"heading": "New in skincare",
"products": [
{
"availability": "IN_STOCK",
"brand": "Bubble Skincare",
"fulfillments": [
"Pickup today",
"Delivery today",
"Shipping, arrives tomorrow"
],
"id": "5545876097",
"image": "https://i5.walmartimages.com/asr/a0913e05-4c07-4431-9e20-d4e8730ee847.52ab55f883ed23f11f69d165ac54c543.jpeg",
"is_outofstock": false,
"is_sponsored": false,
"name": "Bubble Skincare First Class Oil Cleanser 4 fl oz / 120 ml",
"price": 14.98,
"price_line": "$14.98",
"price_unit": "$3.75/fl oz",
"rating_average": 5,
"reviews_count": 3,
"sales_unit": "EACH",
"show_options": false,
"tags": [
"Save with"
],
"type": "REGULAR",
"url": "https://www.walmart.com/ip/Bubble-Skincare-First-Class-Oil-Cleanser-4-fl-oz-120-ml/5545876097?athcpid=5545876097&athpgid=AthenaContentPage_1007039&athcgid=null&athznid=ItemCarousel_fbd7b371-acae-47cd-bca1-450e16dc5267_items&athieid=v0&athstid=CS020&athguid=4bUCJO7lnDcqk-rOkhKWqBXzV2Iq9utLhi6p&athancid=null&athena=true"
},
{
"availability": "IN_STOCK",
"brand": "Bubble Skincare",
"fulfillments": [
"Shipping, arrives in 2 days"
],
"id": "5728116697",
"image": "https://i5.walmartimages.com/asr/309e623f-e9ca-4342-a72b-e618b3eb1026.6744272181e8117b186f116f10e7d6b6.png",
"is_outofstock": false,
"is_sponsored": false,
"name": "Bubble Skincare Tell All Juicy Secret Lip Balm 0.15 oz / 4.4 g",
"price": 7.98,
"price_line": "$7.98",
"price_unit": "$53.20/oz",
"rating_average": 5,
"reviews_count": 1,
"sales_unit": "EACH",
"show_options": false,
"tags": [
"Save with"
],
"type": "REGULAR",
"url": "https://www.walmart.com/ip/Bubble-Skincare-Tell-All-Juicy-Secret-Lip-Balm-0-15-oz-4-4-g/5728116697?athcpid=5728116697&athpgid=AthenaContentPage_1007039&athcgid=null&athznid=ItemCarousel_fbd7b371-acae-47cd-bca1-450e16dc5267_items&athieid=v0&athstid=CS020&athguid=4bUCJO7lnDcqk-rOkhKWqBXzV2Iq9utLhi6p&athancid=null&athena=true"
}
...
]
},
{
"heading": "Skincare deals",
"products": [
{
"availability": "IN_STOCK",
"brand": "NuFace",
"fulfillments": [
"Shipping, arrives tomorrow"
],
"id": "3641587237",
"image": "https://i5.walmartimages.com/asr/9990d2a8-8ffc-4418-b7a3-4ff8b3e9c71c.6c51d9ae9f40b052ed871d268064fe9c.jpeg",
"is_outofstock": false,
"is_sponsored": false,
"name": "NuFACE Mini Facial Toning Device - Starter Kit with Hydrating Aqua Gel",
"price": 220,
"price_line": "$220.00",
"rating_average": 4,
"reviews_count": 372,
"sales_unit": "EACH",
"show_options": false,
"tags": [
"Save with"
],
"type": "REGULAR",
"url": "https://www.walmart.com/ip/NuFACE-Mini-Facial-Toning-Device-Starter-Kit-with-Hydrating-Aqua-Gel/3641587237?athcpid=3641587237&athpgid=AthenaContentPage_1007039&athcgid=null&athznid=ItemCarousel_30d97f81-cd8b-4ce1-9983-cc25a04ff682_items&athieid=v0&athstid=CS020&athguid=4bUCJO7lnDcqk-rOkhKWqBXzV2Iq9utLhi6p&athancid=null&athena=true"
}
...
]
}
],
"title": "Skin Care - Walmart.com"
},
"status": "parse_successful",
"url": "https://www.walmart.com/cp/skin-care/1007039"
}
A full example JSON response can be found here.
Walmart Shop Page Parser
To use the Parser API without the ScrapeOps Proxy Aggregator, you first need to retrieve the HTML of the page you want to extract the data from.
For example, here we retrieve the HTML from the following Walmart Shop Page with a very simple GET request:
import requests
response = requests.get('https://www.walmart.com/brand/herocosmetics/10016335')
if response.status_code == 200:
html = response.text
print(html)
Next, we send this HTML to the ScrapeOps Parser API for data extraction using a POST request:
import requests
response = requests.get('https://www.walmart.com/brand/herocosmetics/10016335')
if response.status_code == 200:
html = response.text
data = {
'url': 'https://www.walmart.com/brand/herocosmetics/10016335',
'html': html,
}
response = requests.post(
url='https://parser.scrapeops.io/v1/walmart',
params={'api_key': 'YOUR_API_KEY'},
json=data
)
print(response.json())
The API will return a JSON response with the following data (status, data, url):
{
"data": {
"description": "Shop for great Electronics Deals at Walmart.com. Save Money. Live Better.",
"related_links": [
{
"image": "https://i5.walmartimages.com/dfw/4ff9c6c9-7e2c/k2-_91ebcb53-7053-4fbe-af1d-2c83140d9f19.v1.jpg",
"title": "Shop all savings",
"url": "https://www.walmart.com/shop/savings"
},
{
"image": "https://i5.walmartimages.com/dfw/4ff9c6c9-9a91/k2-_5ef7a009-0b18-4a9b-88fc-6c554f060bfa.v1.jpg",
"title": "Apple savings",
"url": "https://www.walmart.com/shop/deals/electronics/apple?povid=ETS_appledeals_dealsfacet_techdeals"
}
...
],
"search_information": {
"query": "Electronics Savings",
"title": "Electronics Savings",
"total_count": 1879
},
"search_pagination": [
{
"current": true,
"number": 1,
"url": "https://www.walmart.com/shop/deals/electronics"
},
{
"number": 2,
"url": "https://www.walmart.com/shop/deals/electronics?page=2"
}
...
],
"search_results": [
{
"availability": "In stock",
"description": "<li>onn. 65 Class 4K UHD (2160P) LED Roku Smart Television HDR (100012587): Roku streaming, crisp 4K (2160p) resolution, 60 Hz refresh rate, DLED display</li>",
"flag": "Rollback",
"fulfillments": [
"Free pickup today",
"Delivery today",
"Free shipping, arrives today"
],
"id": "476550098",
"image": "https://i5.walmartimages.com/asr/0bb63eb4-8c9e-4537-849c-d85b02c82ef9.c84bb47cb11d7d870ad50ae55c4df214.jpeg",
"is_buy_now": false,
"is_eligible": false,
"is_outofstock": false,
"is_show_options": false,
"is_sponsored": false,
"name": "onn. 65 Class 4K UHD (2160P) LED Roku Smart Television HDR (100012587)",
"price": 298,
"price_item": "$348.00",
"price_line": "$298.00",
"price_savings": "SAVE $50.00",
"price_was": "$348.00",
"rating_average": 4.4,
"reviews_count": 18970,
"salesUnit": "EACH",
"seller_name": "Walmart.com",
"type": "REGULAR",
"url": "https://www.walmart.com/ip/onn-65-Class-4K-UHD-2160P-LED-Roku-Smart-Television-HDR-100012587/476550098?classType=REGULAR&athbdg=L1300"
},
{
"availability": "In stock",
"description": "<li>Connect via Class 1 Bluetooth with your device for wireless listening</li><li>The award-winning sound and design you've come to love from Beats</li><li>Up to 40 hours of battery life for multi-day</li>",
"flag": "Rollback",
"fulfillments": [
"Free pickup today",
"Delivery today",
"Free shipping, arrives today"
],
"id": "911276151",
"image": "https://i5.walmartimages.com/seo/Beats-Solo3-Wireless-Headphones-Rose-Gold_b21056ed-f9b8-4c3d-b546-82eb81a3ba8a_1.c78d9ea73cf1bf20fa50c04515ecfbdd.jpeg",
"is_buy_now": false,
"is_eligible": false,
"is_outofstock": false,
"is_show_options": true,
"is_sponsored": false,
"name": "Beats Solo3 Wireless On-Ear Headphones with Apple W1 Headphone Chip, Rose Gold, MX442LL/A",
"price": 119,
"price_item": "$179.00",
"price_line": "$119.00",
"price_range": "Options from $119.00 – $149.95",
"price_savings": "SAVE $60.00",
"price_was": "$179.00",
"rating_average": 4.6,
"reviews_count": 7594,
"salesUnit": "EACH",
"seller_name": "Walmart.com",
"type": "VARIANT",
"url": "https://www.walmart.com/ip/Beats-Solo3-Wireless-Headphones-Rose-Gold/911276151?classType=VARIANT&athbdg=L1300",
"variants": [
{
"image": "https://i5.walmartimages.com/asr/b309e830-3b8b-4818-963c-7aba63dec23a.5bc3a5013daaeb22dc98eddb7e885b42.jpeg?odnHeight=180&odnWidth=180&odnBg=ffffff",
"name": "Gold",
"url": "https://www.walmart.com/ip/Beats-Solo3-Wireless-On-Ear-Headphones-Gold/5319348900?classType=undefined&variantFieldId=actual_color"
},
{
"image": "https://i5.walmartimages.com/asr/e4da6186-b8bd-4581-a7f2-e0d93a52283a_1.8cf85fef4d847c65613ba41118d8b525.jpeg?odnHeight=180&odnWidth=180&odnBg=ffffff",
"name": "Red",
"url": "https://www.walmart.com/ip/Beats-Solo3-Wireless-On-Ear-Headphones-with-Apple-W1-Headphone-Chip-Red-MX472LL-A/902675275?classType=undefined&variantFieldId=actual_color"
},
{
"image": "https://i5.walmartimages.com/asr/b21056ed-f9b8-4c3d-b546-82eb81a3ba8a_1.c78d9ea73cf1bf20fa50c04515ecfbdd.jpeg?odnHeight=180&odnWidth=180&odnBg=ffffff",
"name": "Rose Gold",
"url": "https://www.walmart.com/ip/Beats-Solo3-Wireless-Headphones-Rose-Gold/911276151?classType=undefined&variantFieldId=actual_color"
},
{
"image": "https://i5.walmartimages.com/asr/6dabfd3d-a34c-4e0a-a4f7-295637d53fe0_1.8283fe0376e2934377fb41111b7fbf2c.jpeg?odnHeight=180&odnWidth=180&odnBg=ffffff",
"name": "Satin Silver",
"url": "https://www.walmart.com/ip/Beats-Solo3-Wireless-On-Ear-Headphones-with-Apple-W1-Headphone-Chip-Satin-Silver-MX452LL-A/966537526?classType=undefined&variantFieldId=actual_color"
}
]
}
...
],
"title": "Electronics Deals - Walmart.com"
},
"status": "parse_successful",
"url": "https://www.walmart.com/shop/deals/electronics"
}
A full example JSON response can be found here.
Walmart Browse Page Parser
To use the Parser API without the ScrapeOps Proxy Aggregator, you first need to retrieve the HTML of the page you want to extract the data from.
For example, here we retrieve the HTML from the following Walmart Browse Page with a very simple GET request:
import requests
response = requests.get('https://www.walmart.com/browse/electronics/sony/3944_4131277_7675262')
if response.status_code == 200:
html = response.text
print(html)
Next, we send this HTML to the ScrapeOps Parser API for data extraction using a POST request:
import requests
response = requests.get('https://www.walmart.com/browse/electronics/sony/3944_4131277_7675262')
if response.status_code == 200:
html = response.text
data = {
'url': 'https://www.walmart.com/browse/electronics/sony/3944_4131277_7675262',
'html': html,
}
response = requests.post(
url='https://parser.scrapeops.io/v1/walmart',
params={'api_key': 'YOUR_API_KEY'},
json=data
)
print(response.json())
The API will return a JSON response with the following data (status, data, url):
{
"data": {
"description": "Shop for Sony in Electronics by Brand. Buy products such as Sony PlayStation 5, Digital Edition Video Game Consoles at Walmart and save.",
"populars": [
{
"text": "Sony Essentials",
"url": "https://www.walmart.com/c/kp/sony-essentials"
},
{
"text": "Sony Xm4 Silver",
"url": "https://www.walmart.com/c/kp/sony-xm4-silver"
}
...
],
"search_information": {
"title": "Sony",
"total_count": 13407
},
"search_pagination": [
{
"current": true,
"number": 1,
"url": "https://www.walmart.com/browse/electronics/sony/3944_4131277_7675262"
},
{
"number": 2,
"url": "https://www.walmart.com/browse/electronics/sony/3944_4131277_7675262?page=2"
}
...
],
"search_results": [
{
"availability": "In stock",
"description": "<li>Sony, Entertainment</li><li>Gift Cards, Digital</li><li>Digital Gift Card, Egift</li>",
"flag": "Best seller",
"fulfillments": [
"Email delivery"
],
"id": "5528854496",
"image": "https://i5.walmartimages.com/seo/Sony-PlayStation-Store-Bow-10-Gift-Card-Digital_ba1a5997-da66-4ce6-a870-a715f0eeb9df.8c921549f88a6c58ce20a925ce25b0df.jpeg",
"is_buy_now": false,
"is_eligible": false,
"is_outofstock": false,
"is_show_options": true,
"is_sponsored": false,
"name": "Sony PlayStation Store (Bow) 10 Gift Card [Digital]",
"price": 0,
"rating_average": 4,
"reviews_count": 35,
"salesUnit": "EACH",
"seller_name": "Walmart.com",
"type": "VARIANT",
"url": "https://www.walmart.com/ip/Sony-PlayStation-Store-Bow-10-Gift-Card-Digital/5528854496?classType=VARIANT&athbdg=L1600",
"variants": [
{
"image": "https://i5.walmartimages.com/asr/ba1a5997-da66-4ce6-a870-a715f0eeb9df.8c921549f88a6c58ce20a925ce25b0df.jpeg?odnHeight=180&odnWidth=180&odnBg=ffffff",
"name": "10",
"url": "https://www.walmart.com/ip/Sony-PlayStation-Store-Bow-10-Gift-Card-Digital/5528854496?classType=undefined&variantFieldId=gift_card_amount"
},
{
"image": "https://i5.walmartimages.com/asr/ba1a5997-da66-4ce6-a870-a715f0eeb9df.8c921549f88a6c58ce20a925ce25b0df.jpeg?odnHeight=180&odnWidth=180&odnBg=ffffff",
"name": "25",
"url": "https://www.walmart.com/ip/Sony-PlayStation-Store-Bow-25-Gift-Card-Digital/5526471102?classType=undefined&variantFieldId=gift_card_amount"
},
{
"image": "https://i5.walmartimages.com/asr/ba1a5997-da66-4ce6-a870-a715f0eeb9df.8c921549f88a6c58ce20a925ce25b0df.jpeg?odnHeight=180&odnWidth=180&odnBg=ffffff",
"name": "50",
"url": "https://www.walmart.com/ip/Sony-PlayStation-Store-Bow-50-Gift-Card-Digital/5540759678?classType=undefined&variantFieldId=gift_card_amount"
},
{
"image": "https://i5.walmartimages.com/asr/ba1a5997-da66-4ce6-a870-a715f0eeb9df.8c921549f88a6c58ce20a925ce25b0df.jpeg?odnHeight=180&odnWidth=180&odnBg=ffffff",
"name": "75",
"url": "https://www.walmart.com/ip/Sony-PlayStation-Store-Bow-75-Gift-Card-Digital/5528854497?classType=undefined&variantFieldId=gift_card_amount"
},
{
"image": "https://i5.walmartimages.com/asr/ba1a5997-da66-4ce6-a870-a715f0eeb9df.8c921549f88a6c58ce20a925ce25b0df.jpeg?odnHeight=180&odnWidth=180&odnBg=ffffff",
"name": "100",
"url": "https://www.walmart.com/ip/Sony-PlayStation-Store-Bow-100-Gift-Card-Digital/5395241135?classType=undefined&variantFieldId=gift_card_amount"
}
]
},
{
"availability": "In stock",
"description": "<li>Format:Other</li><li>Publication Date: 2018-12-18</li>",
"flag": "Best seller",
"fulfillments": [
"Pickup today",
"Delivery today",
"Shipping, arrives today"
],
"id": "39443659",
"image": "https://i5.walmartimages.com/asr/8fce8219-ea21-4abd-9e38-b9325d89b4e1.2176e6fad1c709a0cc35a42a737163d1.jpeg",
"is_buy_now": false,
"is_eligible": false,
"is_outofstock": false,
"is_show_options": false,
"is_sponsored": false,
"name": "Sony MDR-ZX110 Wired On-Ear Headphones, Black",
"price": 14.88,
"price_item": "$19.99",
"price_line": "$14.88",
"price_savings": "SAVE $5.11",
"price_was": "$19.99",
"rating_average": 4,
"reviews_count": 497,
"salesUnit": "EACH",
"seller_name": "Walmart.com",
"type": "REGULAR",
"url": "https://www.walmart.com/ip/Sony-MDR-ZX110-Wired-On-Ear-Headphones-Black/39443659?classType=REGULAR&athbdg=L1600"
}
...
],
"title": "Sony - Walmart.com"
},
"status": "parse_successful",
"url": "https://www.walmart.com/browse/electronics/sony/3944_4131277_7675262"
}
A full example JSON response can be found here.
Walmart Reviews Page Parser
To use the Parser API without the ScrapeOps Proxy Aggregator, you first need to retrieve the HTML of the page you want to extract the data from.
For example, here we retrieve the HTML from the following Walmart Reviews Page with a very simple GET request:
import requests
response = requests.get('https://www.walmart.com/reviews/product/1833409885')
if response.status_code == 200:
html = response.text
print(html)
Next, we send this HTML to the ScrapeOps Parser API for data extraction using a POST request:
import requests
response = requests.get('https://www.walmart.com/reviews/product/1833409885')
if response.status_code == 200:
html = response.text
data = {
'url': 'https://www.walmart.com/reviews/product/1833409885',
'html': html,
}
response = requests.post(
url='https://parser.scrapeops.io/v1/walmart',
params={'api_key': 'YOUR_API_KEY'},
json=data
)
print(response.json())
The API will return a JSON response with the following data (status, data, url):
{
"data": {
"frequent_mentions": [
{
"name": "Gunk",
"score": 82,
"snippet_count": 65
},
{
"name": "Blackheads",
"score": 78,
"snippet_count": 41
}
...
],
"product": {
"categories": [
{
"name": "Beauty",
"url": "https://www.walmart.com/cp/beauty/1085666"
},
{
"name": "Beauty by Topic",
"url": "https://www.walmart.com/cp/beauty-by-topic/4820682"
},
{
"name": "Clean Beauty",
"url": "https://www.walmart.com/cp/clean-beauty/8628304"
},
{
"name": "Clean Beauty Skincare",
"url": "https://www.walmart.com/cp/clean-beauty-skincare/8140654"
}
],
"name": "Mighty Patch by Hero Cosmetics XL Nose Acne & Pimple Treatment Patches with Hydrocolloid, 8 Count",
"seller": "Fortoge Ecom LLC",
"type": "",
"url": "https://www.walmart.com/ip/Mighty-Patch-Nose-Patch-from-Hero-Cosmetics-XL-Hydrocolloid-Pore-Strips-to-Absorb-Acne-Gunk-8ct/1833409885"
},
"reviews": [
{
"badges": [
"VerifiedPurchaser"
],
"rating": 5,
"submission_time": "3/22/2024",
"text": "This is my first purchase of these nose patches. I wanted to give them a try because the invisible pimple patches work magic %26 and are one of my go to skin routine grabs. I've used these nose patches three times so far from the box (come with 8) and they work amazing! I highly recommend them and I promise you won't regret purchasing some :)",
"title": "Nose patches",
"user_name": "MariaC"
},
{
"badges": [
"VerifiedPurchaser",
"PrizeIncentive"
],
"rating": 5,
"submission_time": "8/3/2024",
"text": "Great product but I wish it were a little more cheaper.",
"title": "",
"user_name": "WalmartCustomer"
}
...
],
"summary": {
"1_star_count": 89,
"1_star_count_with_text": 64,
"1_star_percent": 8,
"2_star_count": 30,
"2_star_count_with_text": 23,
"2_star_percent": 3,
"3_star_count": 43,
"3_star_count_with_text": 33,
"3_star_percent": 4,
"4_star_count": 139,
"4_star_count_with_text": 120,
"4_star_percent": 13,
"5_star_count": 748,
"5_star_count_with_text": 557,
"5_star_percent": 71,
"aspect_reviews_count": 0,
"avarage_rating": 4.3603,
"negative_count": 0,
"positive_count": 0,
"total_media_count": 4,
"total_reviews_count": 1049,
"total_reviews_count_with_text": 797
},
"top_negative_review": {
"badges": [
"VerifiedPurchaser"
],
"rating": 1,
"submission_time": "3/16/2024",
"text": "Absolutely not worth the high price. These don't stick well at all. I wouldn't buy them again even if they were only a couple dollars, let alone $13 .",
"title": "Worthless",
"user_name": "Nicole"
},
"top_positive_review": {
"badges": [
"VerifiedPurchaser"
],
"rating": 5,
"submission_time": "3/22/2024",
"text": "This is my first purchase of these nose patches. I wanted to give them a try because the invisible pimple patches work magic %26 and are one of my go to skin routine grabs. I've used these nose patches three times so far from the box (come with 8) and they work amazing! I highly recommend them and I promise you won't regret purchasing some :)",
"title": "Nose patches",
"user_name": "MariaC"
}
},
"status": "parse_successful",
"url": "https://www.walmart.com/reviews/product/1833409885"
}
A full example JSON response can be found here.
Proxy API Integration
The ScrapeOps Parser API is integrated into the ScrapeOps Proxy API Aggregator and can be used for free by using the Auto Extract functionality.
So if you already have a Proxy API Aggregator plan then use the Parser API for no extra charge.
The following example shows you how to use the Parser API via a Python Requests based scraper using the Proxy API Aggregator:
import requests
response = requests.get(
url='https://proxy.scrapeops.io/v1/',
params={
'api_key': 'YOUR_API_KEY',
'url': 'https://www.walmart.com/ip/Mighty-Patch-Nose-Patch-from-Hero-Cosmetics-XL-Hydrocolloid-Pore-Strips-to-Absorb-Acne-Gunk-8ct/1833409885',
'auto_extract': 'walmart'
}
)
print(response.json())