Indeed Parser
Using the ScrapeOps Parser API you can scrape Indeed Pages without having to maintain your own product parsers.
Simply send the HTML of the Indeed Pages to the Parser API endpoint, and receive the data in structured JSON format.
Indeed Parser API Endpoint:
"https://parser.scrapeops.io/v1/indeed"
The Indeed Parser supports the following page types:
- Indeed Job Search Pages
- Indeed Job Detail Pages
- Indeed Company Search Pages
- Indeed Top Companies Pages
- Indeed Company Snapshot Pages
- Indeed Company About Pages
- Indeed Company Reviews Pages
- Indeed Company Jobs Pages
Authorisation - API Key
To use the ScrapeOps Parser API, you first need an API key which you can get by signing up for a free account here.
Your API key must be included with every request using the api_key query parameter otherwise the API will return a 403 Forbidden Access status code.
Indeed Job Search Page Parser
To use the Parser API without the ScrapeOps Proxy Aggregator, you first need to retrieve the HTML of the page you want to extract the data from.
For example, here we retrieve the HTML from the following [Indeed Job Search Pages](https://www.indeed.com/jobs?q=golang&l=Los Angeles, CA) with a very simple GET request:
import requests
response = requests.get('https://www.indeed.com/jobs?q=golang&l=Los Angeles, CA')
if response.status_code == 200:
html = response.text
print(html)
Next, we send this HTML to the ScrapeOps Parser API for data extraction using a POST request:
import requests
response = requests.get('https://www.indeed.com/jobs?q=golang&l=Los Angeles, CA')
if response.status_code == 200:
html = response.text
data = {
'url': 'https://www.indeed.com/jobs?q=golang&l=Los Angeles, CA',
'html': html,
}
response = requests.post(
url='https://parser.scrapeops.io/v1/indeed',
params={'api_key': 'YOUR_API_KEY'},
json=data
)
print(response.json())
The API will return a JSON response with the following data (status, data, url):
{
"data": {
"job_detail": {
"attributes": {
"benifits": [
"Health insurance",
"Paid parental leave",
"Parental leave",
"RSU"
],
"educations": [
"Bachelor's degree"
],
"job_types": [
"Full-time"
],
"skills": [
"Git",
"AWS",
"Mac OS"
...
]
},
"company": {
"name": "Snapchat",
"overview_url": "https://www.indeed.com/cmp/Snap-Inc.?campaignid=mobvjcmp&from=mobviewjob&tk=1i6gni0752afv004&fromjk=0861820b85084ec7",
"rating": 3.6,
"review_count": 76,
"review_url": "https://www.indeed.com/cmp/Snap-Inc./reviews?campaignid=mobvjcmp&cmpratingc=mobviewjob&from=mobviewjob&tk=1i6gni0752afv004&fromjk=0861820b85084ec7&jt=Systems+Engineer"
},
"description": "<div>\n <div>\n <div>\n Snap Inc\n </div> is a technology company. We believe the camera presents the greatest opportunity to improve the way people live and communicate. Snap contributes to human progress by empowering people to express themselves, live in the moment, learn about the world, and have fun together. The Company’s three core products are \n <div>\n Snapchat\n </div>, ...",
"location": "Los Angeles, CA 90291",
"remote": "Hybrid work",
"salary": {
"max": 228000,
"min": 129000,
"text": "$129,000 - $228,000 a year",
"type": "YEARLY"
},
"title": "Systems Engineer",
"type": "Full-time"
},
"pagination": [
{
"current": true,
"number": 1,
"url": "https://www.indeed.com/jobs?q=golang&l=Los+Angeles%2C+CA&radius=50"
},
{
"number": 2,
"url": "https://www.indeed.com/jobs?q=golang&l=Los+Angeles%2C+CA&radius=50&start=10"
}
],
"related_searches": [
{
"text": "go",
"url": "https://www.indeed.com/q-go-l-los-angeles,-ca-jobs.html?from=relatedQueries&saIdx=1&rqf=1&parentQnorm=golang"
},
{
"text": "golang developer",
"url": "https://www.indeed.com/q-golang-developer-l-los-angeles,-ca-jobs.html?from=relatedQueries&saIdx=2&rqf=1&parentQnorm=golang"
}
...
],
"search_information": {
"filters": [
{
"name": "Distance",
"value": "Within 50 miles"
}
],
"location": "Los Angeles, CA",
"query": "golang",
"search_title": "golang jobs in Los Angeles, CA",
"sorts": [
"by relevance",
"by date"
],
"total_count": 16
},
"search_results": [
{
"apply_count": 0,
"attributes": {
"benefits": [
"Paid parental leave",
"Health insurance",
"RSU",
"Parental leave"
],
"job_types": [
"Full-time"
],
"remote": [
"Hybrid work"
]
},
"company": {
"name": "Snapchat",
"overview_url": "https://www.indeed.com/cmp/Snap-Inc.",
"rating": 3.6,
"review_count": 76,
"review_url": "https://www.indeed.com/cmp/Snap-Inc./reviews"
},
"create_date": "2024-07-09",
"is_expired": false,
"is_new_job": false,
"is_urgently_hiring": false,
"location": "Los Angeles, CA 90291",
"salary": {
"max": 228000,
"min": 129000,
"text": "$129,000 - $228,000 a year",
"type": "yearly"
},
"snippet": "<ul style=\"list-style-type:circle;margin-top: 0px;margin-bottom: 0px;padding-left:20px;\">\n <li>Collaborate with leadership, engineers, and customers to architect new solutions for On-Premise and IaaS providers (AWS/GCP).</li>\n</ul>",
"title": "Systems Engineer",
"url": "https://www.indeed.com/viewjob?jk=0861820b85084ec7&from=vjs&tk=1i6gni02c2afv02r&viewtype=embedded&xkcb=SoC_67M38QnH3tSl6p0LbzkdCdPP&continueUrl=%2Fjobs%3Fq%3Dgolang%26l%3DLos%2BAngeles%252C%2BCA"
},
{
"apply_count": 0,
"attributes": {
"benefits": [
"Paid parental leave",
"Health insurance",
"RSU",
"Parental leave"
],
"job_types": [
"Full-time"
],
"remote": [
"Hybrid work"
]
},
"company": {
"name": "Snapchat",
"overview_url": "https://www.indeed.com/cmp/Snap-Inc.",
"rating": 3.6,
"review_count": 76,
"review_url": "https://www.indeed.com/cmp/Snap-Inc./reviews"
},
"create_date": "2024-07-18",
"is_expired": false,
"is_new_job": false,
"is_urgently_hiring": false,
"location": "Los Angeles, CA 90291",
"salary": {
"max": 228000,
"min": 129000,
"text": "$129,000 - $228,000 a year",
"type": "yearly"
},
"snippet": "<ul style=\"list-style-type:circle;margin-top: 0px;margin-bottom: 0px;padding-left:20px;\">\n <li>Leverage machine learning, information retrieval and big data processing technologies to empower ranking, recommendation, and content experiences.</li>\n</ul>",
"title": "Software Engineer, ML Infrastructure, 3+ Years of Experience",
"url": "https://www.indeed.com/viewjob?jk=aa0bc63a8ea0b8fc&from=vjs&tk=1i6gni02c2afv02r&viewtype=embedded&xkcb=SoAL67M38QnH3tSl6p0KbzkdCdPP&continueUrl=%2Fjobs%3Fq%3Dgolang%26l%3DLos%2BAngeles%252C%2BCA"
}
...
]
},
"status": "parse_successful",
"url": "https://www.indeed.com/jobs?q=golang&l=Los%20Angeles,%20CA"
}
A full example JSON response can be found here.
Indeed Job Detail Page Parser
To use the Parser API without the ScrapeOps Proxy Aggregator, you first need to retrieve the HTML of the page you want to extract the data from.
For example, here we retrieve the HTML from the following Indeed Job Detail Page with a very simple GET request:
import requests
response = requests.get('https://www.indeed.com/viewjob?jk=3cafe3fd334d65f0')
if response.status_code == 200:
html = response.text
print(html)
Next, we send this HTML to the ScrapeOps Parser API for data extraction using a POST request:
import requests
response = requests.get('https://www.indeed.com/viewjob?jk=3cafe3fd334d65f0')
if response.status_code == 200:
html = response.text
data = {
'url': 'https://www.indeed.com/viewjob?jk=3cafe3fd334d65f0',
'html': html,
}
response = requests.post(
url='https://parser.scrapeops.io/v1/indeed',
params={'api_key': 'YOUR_API_KEY'},
json=data
)
print(response.json())
The API will return a JSON response with the following data (status, data, url):
{
"data": {
"benifits": [
"Employee discount",
"Flexible schedule"
],
"company": {
"name": "Just Kidding Indoor Playground",
"overview_url": "https://www.indeed.com/cmp/Just-Kidding-Indoor-Playground?campaignid=mobvjcmp&from=mobviewjob&tk=1i6gpa6oijn26800&fromjk=3cafe3fd334d65f0",
"rating": 0,
"review_count": 0,
"review_url": "https://www.indeed.com/cmp/Just-Kidding-Indoor-Playground/reviews?campaignid=mobvjcmp&cmpratingc=mobviewjob&from=mobviewjob&tk=1i6gpa6oijn26800&fromjk=3cafe3fd334d65f0&jt=Playground+team+member"
},
"description": "<p>Job Overview</p>\n<p>We are seeking a dedicated Playground Team Member to join our team. The ideal candidate will have a passion for working with children and creating a safe, engaging environment for them to play and learn.</p>\n<p>Responsibilities</p>\n<ul>\n <li>Supervise and engage children in various outdoor activities on the playground</li>\n <li>Implement and lead structured games and sports activities</li>\n ... </ul>\n<p>Work Location: In person</p>",
"job_types": [
"Full-time"
],
"location": "Staten Island, NY 10309",
"salary": {
"max": 22,
"min": 16,
"text": "$16 - $22 an hour",
"type": "HOURLY"
},
"shifts_schedule": [
"8 hour shift",
"10 hour shift",
"Holidays"
],
"skills": [
"Early childhood education",
"Communication skills",
"Classroom experience",
"Sports coaching",
"Classroom management",
"Experience with children",
"Camp",
"Childcare",
"Cleaning",
"Sports"
],
"title": "Playground team member",
"type": "Full-time"
},
"status": "parse_successful",
"url": "https://www.indeed.com/viewjob?jk=3cafe3fd334d65f0"
}
A full example JSON response can be found here.
Indeed Company Search Page Parser
To use the Parser API without the ScrapeOps Proxy Aggregator, you first need to retrieve the HTML of the page you want to extract the data from.
For example, here we retrieve the HTML from the following Indeed Company Search Page with a very simple GET request:
import requests
response = requests.get('https://www.indeed.com/companies/search?q=education')
if response.status_code == 200:
html = response.text
print(html)
Next, we send this HTML to the ScrapeOps Parser API for data extraction using a POST request:
import requests
response = requests.get('https://www.indeed.com/companies/search?q=education')
if response.status_code == 200:
html = response.text
data = {
'url': 'https://www.indeed.com/companies/search?q=education',
'html': html,
}
response = requests.post(
url='https://parser.scrapeops.io/v1/indeed',
params={'api_key': 'YOUR_API_KEY'},
json=data
)
print(response.json())
The API will return a JSON response with the following data (status, data, url):
{
"data": {
"search_information": {
"location": "",
"query": "education"
},
"search_results": [
{
"industries": [
"Restaurants & Cafes"
],
"jobs_url": "https://www.indeed.com/cmp/Chartwells-Higher-Education/jobs",
"name": "Chartwells Higher Education",
"overview_url": "https://www.indeed.com/cmp/Chartwells-Higher-Education",
"rating": 3.4,
"review_count": 2339,
"reviews_url": "https://www.indeed.com/cmp/Chartwells-Higher-Education/reviews",
"salaries_url": "https://www.indeed.com/cmp/Chartwells-Higher-Education/salaries",
"thumbnail": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/64x64/8aa2b1eee1a4c687b365364e06274ae8"
},
{
"industries": [
"Government & Public Administration"
],
"jobs_url": "https://www.indeed.com/cmp/Hawaii-State-Department-of-Education/jobs",
"name": "Hawaii State Department of Education",
"overview_url": "https://www.indeed.com/cmp/Hawaii-State-Department-of-Education",
"rating": 3.6,
"review_count": 181,
"reviews_url": "https://www.indeed.com/cmp/Hawaii-State-Department-of-Education/reviews",
"salaries_url": "https://www.indeed.com/cmp/Hawaii-State-Department-of-Education/salaries",
"thumbnail": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/64x64/294305c93f24b3814c481728248c9051"
}
...
]
},
"status": "parse_successful",
"url": "https://www.indeed.com/companies/search?q=education"
}
A full example JSON response can be found here.
Indeed Top Companies Page Parser
To use the Parser API without the ScrapeOps Proxy Aggregator, you first need to retrieve the HTML of the page you want to extract the data from.
For example, here we retrieve the HTML from the following Indeed Top Companies Page with a very simple GET request:
import requests
response = requests.get('https://www.indeed.com/companies/best-companies?industry=Media-%26-Communication')
if response.status_code == 200:
html = response.text
print(html)
Next, we send this HTML to the ScrapeOps Parser API for data extraction using a POST request:
import requests
response = requests.get('https://www.indeed.com/companies/best-companies?industry=Media-%26-Communication')
if response.status_code == 200:
html = response.text
data = {
'url': 'https://www.indeed.com/companies/best-companies?industry=Media-%26-Communication',
'html': html,
}
response = requests.post(
url='https://parser.scrapeops.io/v1/indeed',
params={'api_key': 'YOUR_API_KEY'},
json=data
)
print(response.json())
The API will return a JSON response with the following data (status, data, url):
{
"data": {
"pagination": {
"next": "https://www.indeed.com/companies/best-companies?industry=Media+%26+Communication&after=OQ%3D%3D"
},
"search_information": {
"industry": "Media & Communication",
"location": ""
},
"search_results": [
{
"description": "Synonymous with quality entertainment and cutting-edge technology, The Walt Disney Company impacts a global audience every day.",
"employees": {
"min": 10000,
"text": "ERv1_10000_PLUS"
},
"industries": [
"Media & Communication"
],
"jobs_url": "https://www.indeed.com/cmp/The-Walt-Disney-Company/jobs",
"name": "The Walt Disney Company",
"overview_url": "https://www.indeed.com/cmp/The-Walt-Disney-Company",
"rating": 4.1,
"review_count": 4950,
"reviews_url": "https://www.indeed.com/cmp/The-Walt-Disney-Company/reviews",
"thumbnail": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/128x128/63fd092b951a8dab33b5a345f74e0fb5"
},
{
"description": "Netflix is a streaming service that offers a wide variety of award-winning TV shows, movies, anime, documentaries and more – on thousands of internet-connected devices.",
"employees": {
"max": 10000,
"min": 5001,
"text": "ERv1_5001_10000"
},
"industries": [
"Media & Communication"
],
"jobs_url": "https://www.indeed.com/cmp/Netflix/jobs",
"name": "Netflix",
"overview_url": "https://www.indeed.com/cmp/Netflix",
"rating": 3.9,
"review_count": 801,
"reviews_url": "https://www.indeed.com/cmp/Netflix/reviews",
"thumbnail": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/128x128/d5553f0897d238145e9d8b9573e3c478"
}
...
]
},
"status": "parse_successful",
"url": "https://www.indeed.com/companies/best-Media-&-Communication-companies"
}
A full example JSON response can be found here.
Indeed Company Snapshot Page Parser
To use the Parser API without the ScrapeOps Proxy Aggregator, you first need to retrieve the HTML of the page you want to extract the data from.
For example, here we retrieve the HTML from the following Indeed Company Snapshot Page with a very simple GET request:
import requests
response = requests.get('https://www.indeed.com/cmp/Nucor-Corporation-7e760088')
if response.status_code == 200:
html = response.text
print(html)
Next, we send this HTML to the ScrapeOps Parser API for data extraction using a POST request:
import requests
response = requests.get('https://www.indeed.com/cmp/Nucor-Corporation-7e760088')
if response.status_code == 200:
html = response.text
data = {
'url': 'https://www.indeed.com/cmp/Nucor-Corporation-7e760088',
'html': html,
}
response = requests.post(
url='https://parser.scrapeops.io/v1/indeed',
params={'api_key': 'YOUR_API_KEY'},
json=data
)
print(response.json())
The API will return a JSON response with the following data (status, data, url):
{
"data": {
"about_company": {
"ceo_approval": 82,
"ceo_name": "Leon Topalian",
"ceo_photo": "https://d2q79iu7y748jz.cloudfront.net/s/_ceophoto/512x512/e37d2790fb367e6e696470dea2814097",
"description": "Ranked #1 in our industry by Fortune Magazine on the list of World’s Most Admired Companies, we are North America’s most diversified steel and steel products company. But we’re also a team forged around a vision for leading our industry by providing unparalleled customer care, building trusted partnerships and creating sustained value.",
"employees_min": 10000,
"founded": 1990,
"headquarters": "1915 Rexford Road\r\nCharlotte, NC 28211",
"industry": "Manufacturing",
"revenue": "more than $10B",
"website_name": "Nucor Corporation website",
"website_url": "https://nucor.com/"
},
"faqs": [
{
"answer": "Yes, Nucor Corporation has 78 open jobs. Before applying to Nucor Corporation, it’s a good idea to research the company, and read reviews from employees working there.",
"question": "Is Nucor Corporation hiring now?"
},
{
"answer": "People have reported that the interview at Nucor Corporation is medium. The interview process takes more than one month. People have rated the overall interview experience as favorable.",
"question": "Is it hard to get a job at Nucor Corporation?"
}
...
],
"interviews_info": {
"questions": [
{
"date": "February 22, 2024",
"job_title": "Bridge Crane Operator",
"location": "Marion, OH",
"text": "Previous work. School. Education. "
},
{
"date": "July 18, 2023",
"job_title": "Lead First Shift Autowelder",
"location": "Terrell, TX",
"text": "Personality questions "
}
...
],
"total_count": 246,
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/faq/what-questions-did-they-ask-during-your-interview-at-nucor-corporation?quid=1esddvuks3oig000"
},
"job_titles": [
{
"job_count": 23,
"name": "Operator",
"rating": 3.9565217,
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/job-titles/Operator"
},
{
"job_count": 23,
"name": "Detailer",
"rating": 4.130435,
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/job-titles/Detailer"
}
...
],
"jobs_info": {
"categories": [
{
"job_count": 23,
"name": "Installation & Maintenance"
},
{
"job_count": 12,
"name": "Sales"
}
...
],
"jobs": [
{
"is_urgent_hire": false,
"location": "Blytheville, AR",
"relative_time": "1 day ago",
"title": "EAF 3rd Helper",
"url": "https://www.indeed.com/viewjob?jk=adf9abc08ff32cb9"
},
{
"is_urgent_hire": false,
"location": "Flowood, MS",
"relative_time": "1 day ago",
"title": "Shipping Crane Operator",
"url": "https://www.indeed.com/viewjob?jk=34dfc10ecdfaf12f"
}
...
],
"locations": [
{
"job_count": 20,
"name": "Blytheville, AR",
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/jobs/l-Blytheville,-AR"
},
{
"job_count": 11,
"name": "Terrell, TX",
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/jobs/l-Terrell,-TX"
}
...
]
},
"locations": [
{
"name": "Memphis, TN",
"rating": 3.7555556,
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/locations/TN/Memphis"
},
{
"name": "Blytheville, AR",
"rating": 4.516129,
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/locations/AR/Blytheville"
}
...
],
"questions_answers": {
"category_questions": [
{
"category": "Popular questions",
"questions": [
{
"answer_count": 31,
"company_name": "Nucor Corporation",
"date": "2022-07-19",
"question": "How often do you get a raise at Nucor Corporation?",
"top_answer": {
"date": "2024-07-03",
"job_title": "Safety Coordinator",
"location": "Blytheville, AR",
"text": "Rarely"
},
"url": "https://www.indeed.comfaq/how-often-do-you-get-a-raise-at-nucor-corporation?quid=1g8c5il18q635801"
},
{
"answer_count": 22,
"company_name": "Nucor Corporation",
"date": "2021-07-22",
"question": "What is the promotion process like at Nucor Corporation?",
"top_answer": {
"date": "2024-08-06",
"job_title": "Buyer",
"location": "Convent, LA",
"text": "For my career path, nonexistent."
},
"url": "https://www.indeed.comfaq/what-is-the-promotion-process-like-at-nucor-corporation?quid=1fb7rnamru3rg800"
}
...
]
}
...
],
"question_count": 157,
"topics": [
"Hiring Process",
"Interviews",
"Drug Test",
"Benefits",
"Salaries",
"Job Opportunities",
"Background Check",
"Working Hours",
"Attire",
"Dress Code",
"Promotion",
"Shifts",
"Working Environment",
"Work from Home",
"CEO"
]
},
"reviews_info": {
"rating_category": {
"compensation_benefits": 4,
"culture": 3.7,
"job_security_advancement": 3.6,
"management": 3.3,
"work_life_balance": 3.3
},
"rating_history": [
{
"rating": 4,
"year": 2024
},
{
"rating": 3.8297873,
"year": 2023
},
{
"rating": 3.548387,
"year": 2022
},
{
"rating": 3.4864864,
"year": 2021
},
{
"rating": 3.7560976,
"year": 2020
}
],
"review_count": 650,
"reviews": [
{
"comment": "no life always having to work only good thing about the company is the pay. leadership team is no good its all a cult if your not the safest teammate in the world you will be gone",
"current_employee": false,
"date": "August 27, 2024",
"job_title": "Utility Worker",
"location": "Berkeley County, SC",
"rating": 1,
"title": "no life",
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/reviews/no-life?id=b0fe18b9986686c7"
},
{
"comment": "Nucor is a great company with a truly remarkable team. They care about each other and really do live their culture. It's a big company, so there's likely to be some pockets that function differently, but my experiences with Nucor have all been positive.",
"current_employee": true,
"date": "August 20, 2024",
"job_title": "Sales Representative",
"location": "United States",
"rating": 5,
"title": "Wonderful company with amazing people",
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/reviews/wonderful-company-with-amazing-people?id=b52ceb7f3a1ddbc3"
}
...
]
},
"similar_companies": [
{
"compare_url": "https://www.indeed.com/companies/compare/Nucor-Corporation-7e760088-vs-Nucor-Harris-Rebar-1-22c718899c11e907-d7c16b43ce40fd0f",
"industries": [
"Construction"
],
"job_count": 11,
"name": "Nucor Harris Rebar",
"rating": 3.5,
"review_count": 273,
"salary_count": 2032,
"thumbnail": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/64x64/997753e2b19760ce648f6868ae338b3e",
"url": "https://www.indeed.com/cmp/Nucor-Harris-Rebar-1"
},
{
"compare_url": "https://www.indeed.com/companies/compare/Nucor-Corporation-7e760088-vs-Big-River-Steel-22c718899c11e907-49f4cce7f81836e6",
"industries": [
"Manufacturing"
],
"job_count": 0,
"name": "Big River Steel",
"rating": 3.6,
"review_count": 16,
"salary_count": 9,
"thumbnail": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/64x64/85ec5a68d4a70eae2067ab794ceefa15",
"url": "https://www.indeed.com/cmp/Big-River-Steel"
}
...
],
"summary": {
"happiness_grade": "GREAT",
"happiness_score": 72,
"links": [
{
"text": "Snapshot",
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088"
},
{
"text": "Why Join Us",
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/about"
},
{
"text": "Reviews",
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/reviews"
},
{
"text": "Salaries",
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/salaries"
},
{
"text": "Jobs",
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/jobs"
},
{
"text": "Q&A",
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/faq"
},
{
"text": "Interviews",
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/interviews"
},
{
"text": "Photos",
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/photos"
}
],
"name": "Nucor Corporation",
"rating": 3.9,
"review_count": 650,
"thumbnail": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/96x96/cf577b80193bafa91ac14537de64889c"
},
"topics": [
{
"description": "Explore skills and training, pay raises and promotions and management and culture.",
"title": "Professional development",
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/topics/professional-development"
},
{
"description": "Explore company values, community, the relevance of the mission and moving on.",
"title": "Mission and values",
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088/topics/company-mission-and-values"
}
...
],
"work_wellbeing": {
"average_grade": "GREAT",
"average_score": 72,
"categories": [
{
"category": "Happiness",
"description": "How enjoyable people find their day-to-day life at work",
"grade": "GOOD",
"score": 71
},
{
"category": "Compensation",
"description": "How fair people feel they are paid",
"grade": "EXCELLENT",
"score": 79
},
{
"category": "Learning",
"description": "How encouraged people feel to learn new skills",
"grade": "GREAT",
"score": 78
}
...
],
"response_count": 364
}
},
"status": "parse_successful",
"url": "https://www.indeed.com/cmp/Nucor-Corporation-7e760088"
}
A full example JSON response can be found here.
Indeed Company About Page Parser
To use the Parser API without the ScrapeOps Proxy Aggregator, you first need to retrieve the HTML of the page you want to extract the data from.
For example, here we retrieve the HTML from the following Indeed Company About Page with a very simple GET request:
import requests
response = requests.get('https://www.indeed.com/cmp/Kaiser-Permanente/about')
if response.status_code == 200:
html = response.text
print(html)
Next, we send this HTML to the ScrapeOps Parser API for data extraction using a POST request:
import requests
response = requests.get('https://www.indeed.com/cmp/Kaiser-Permanente/about')
if response.status_code == 200:
html = response.text
data = {
'url': 'https://www.indeed.com/cmp/Kaiser-Permanente/about',
'html': html,
}
response = requests.post(
url='https://parser.scrapeops.io/v1/indeed',
params={'api_key': 'YOUR_API_KEY'},
json=data
)
print(response.json())
The API will return a JSON response with the following data (status, data, url):
{
"data": {
"company_details": {
"employees": "10,000+",
"facebook_id": "kpthrive/",
"headquarters": "Oakland, CA",
"industry": [
"Healthcare"
],
"links": [
{
"text": "Kaiser Permanente Careers",
"url": "https://www.kaiserpermanentejobs.org/"
},
{
"text": "Kaiser Permanente Website",
"url": "http://kp.org/"
}
...
],
"revenue": "more than $10B (USD)",
"twitter_id": "KPCareers"
},
"company_summary": {
"happiness_grade": "GREAT",
"happiness_score": 73,
"links": [
{
"text": "Snapshot",
"url": "https://www.indeed.com/cmp/Kaiser-Permanente"
},
{
"text": "Why Join Us",
"url": "https://www.indeed.com/cmp/Kaiser-Permanente/about"
},
{
"text": "Reviews",
"url": "https://www.indeed.com/cmp/Kaiser-Permanente/reviews"
},
{
"text": "Salaries",
"url": "https://www.indeed.com/cmp/Kaiser-Permanente/salaries"
},
{
"text": "Jobs",
"url": "https://www.indeed.com/cmp/Kaiser-Permanente/jobs"
},
{
"text": "Q&A",
"url": "https://www.indeed.com/cmp/Kaiser-Permanente/faq"
},
{
"text": "Interviews",
"url": "https://www.indeed.com/cmp/Kaiser-Permanente/interviews"
},
{
"text": "Photos",
"url": "https://www.indeed.com/cmp/Kaiser-Permanente/photos"
}
],
"name": "Kaiser Permanente",
"rating": 4,
"review_count": 13789,
"thumbnail": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/96x96/d303fcd409d6e3d6c4b57ac72f8232db"
},
"custom_contents": [
{
"description": "<p>At Kaiser Permanente, we are relentless in our pursuit of excellence. Driven by our mission to provide the highest quality preventive medicine, we are committed to eliminating health care disparities, and to making lives better through innovation, technology, and research.</p>\n<p>Our desire to deliver the best possible care inspires us to promote wellness among our members, communities, and each other. It also fuels our belief that everyone — regardless of circumstance — deserves access to affordable care, which further drives our motivation to expand our reach.</p>\n<p>Founded nearly 80 years ago, our unique business model sets us apart — positioning us to drive improvements across the industry and around the world.</p>",
"image": "https://d2q79iu7y748jz.cloudfront.net/s/_customcontent/f0e5efca4b7f61c01ad3438357f7f81f",
"source": "GLASSDOOR_EMPLOYER_CENTER",
"title": "The KP Difference"
},
{
"description": "<p>We attend many hiring events across the country. Come meet us face-to-face and establish a connection at an event near you.</p>\n<p>Visit the <a href=\"https://kaiserpermanentejobs.trumba.com/\">Kaiser Permanente Event Calendar</a> to learn more.</p>",
"source": "GLASSDOOR_EMPLOYER_CENTER",
"title": "Our Hiring Events"
}
...
],
"jobs_info": {
"jobs": [
{
"job_count": 361,
"title": "Los Angeles, CA",
"url": "https://www.indeed.com/cmp/Kaiser-Permanente/jobs/l-Los-Angeles,-CA"
},
{
"job_count": 217,
"title": "San Diego, CA",
"url": "https://www.indeed.com/cmp/Kaiser-Permanente/jobs/l-San-Diego,-CA"
},
{
"job_count": 186,
"title": "Clackamas, OR",
"url": "https://www.indeed.com/cmp/Kaiser-Permanente/jobs/l-Clackamas,-OR"
}
...
],
"total_count": 4700,
"url": "https://www.indeed.com/cmp/Kaiser-Permanente/jobs?clearPrefilter=1"
},
"news_updates": {
"image": "https://media.glassdoor.com/companyupdate/o/19466/kaiser-permanente-companyupdate-1718818215073.png?signature=6bc3279e733852e4f1de2e23cd5afc46aed8e7a6c00bfa1369fc99f254743a4f",
"image_link": "https://intsignup.indeed.com/interview/02252f6e-e345-4a09-858e-6fa2bdd9509b?_gl=1",
"image_text": "Kaiser Permanente Los Angeles Medical Center Virtual Nursing Hiring Ev",
"publication_date": "June 19, 2024",
"text": "You are invited to our Los Angeles Medical Center Virtual Nursing Hiring Event. We have the following Registered Nurse opportunities: RN, ICU; RN, Step Down Unit; RN, CSU; RN, Step Down Unit-Oncology; RN, Cardiac and RN, PICU. For more details and to register: https://kaiserpermanentejobs.trumba.com/Kaiser-Permanente-Los-Angeles-Medical-Center-Virtual-Nursing-Indeed-Hiring-Event/E174953664",
"update_count": 21,
"update_url": "https://www.indeed.com/cmp/Kaiser-Permanente/about/updates"
}
},
"status": "parse_successful",
"url": "https://www.indeed.com/cmp/Kaiser-Permanente/about"
}
A full example JSON response can be found here.
Indeed Company Reviews Page Parser
To use the Parser API without the ScrapeOps Proxy Aggregator, you first need to retrieve the HTML of the page you want to extract the data from.
For example, here we retrieve the HTML from the following Indeed Company Reviews Page with a very simple GET request:
import requests
response = requests.get('https://www.indeed.com/cmp/Giant-Food/reviews')
if response.status_code == 200:
html = response.text
print(html)
Next, we send this HTML to the ScrapeOps Parser API for data extraction using a POST request:
import requests
response = requests.get('https://www.indeed.com/cmp/Giant-Food/reviews')
if response.status_code == 200:
html = response.text
data = {
'url': 'https://www.indeed.com/cmp/Giant-Food/reviews',
'html': html,
}
response = requests.post(
url='https://parser.scrapeops.io/v1/indeed',
params={'api_key': 'YOUR_API_KEY'},
json=data
)
print(response.json())
The API will return a JSON response with the following data (status, data, url):
{
"data": {
"company_summary": {
"happiness_grade": "FAIR",
"happiness_score": 67,
"links": [
{
"text": "Snapshot",
"url": "https://www.indeed.com/cmp/Giant-Food"
},
{
"text": "Why Join Us",
"url": "https://www.indeed.com/cmp/Giant-Food/about"
},
{
"text": "Reviews",
"url": "https://www.indeed.com/cmp/Giant-Food/reviews"
},
{
"text": "Salaries",
"url": "https://www.indeed.com/cmp/Giant-Food/salaries"
},
{
"text": "Jobs",
"url": "https://www.indeed.com/cmp/Giant-Food/jobs"
},
{
"text": "Q&A",
"url": "https://www.indeed.com/cmp/Giant-Food/faq"
},
{
"text": "Interviews",
"url": "https://www.indeed.com/cmp/Giant-Food/interviews"
},
{
"text": "Photos",
"url": "https://www.indeed.com/cmp/Giant-Food/photos"
}
],
"name": "Giant Food",
"rating": 3.4,
"review_count": 2803,
"thumbnail": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/96x96/ffdfdddffe3f90c461690227114abed9"
},
"compare_companies": [
{
"compare_url": "https://www.indeed.com/companies/compare/Giant-Food-vs-The-Giant-Company-7b5cfa5863383b33-e377e8ace599aff6",
"name": "The GIANT Company",
"rating": 3.5,
"thumbnail": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/64x64/41f5756ebf138682faa0a5780f84636b",
"url": "https://www.indeed.com/cmp/The-Giant-Company"
},
{
"compare_url": "https://www.indeed.com/companies/compare/Giant-Food-vs-Weis-Markets-7b5cfa5863383b33-9a6b6e96741c242b",
"name": "Weis Markets",
"rating": 3.1,
"thumbnail": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/64x64/1488f0553c1f62172d18ffb8af825f3c",
"url": "https://www.indeed.com/cmp/Weis-Markets"
}
...
],
"pagination": [
{
"current": true,
"number": 1
},
{
"number": 2,
"url": "https://www.indeed.com/cmp/Giant-Food/reviews?start=20"
}
...
],
"pros_cons": {
"cons": [
"Fair pay for job",
"Sense of belonging",
"Overall satisfaction"
],
"pros": [
"Clear sense of purpose",
"Ability to meet personal goals",
"Feeling of personal appreciation"
],
"survey_count": 1828
},
"related_links": {
"jobs": [
{
"location": "Baltimore, MD",
"title": "PT Clerk - Pick From Store",
"url": "https://www.indeed.com/viewjob?jk=1acab322e2ceb984"
},
{
"location": "Owings Mills, MD",
"title": "PT Night Crew Clerk - Grocery",
"url": "https://www.indeed.com/viewjob?jk=ed748561e64ea409"
}
...
],
"locations": [
{
"name": "Washington, DC",
"url": "https://www.indeed.com/cmp/Giant-Food/locations/DC/Washington"
},
{
"name": "Baltimore, MD",
"url": "https://www.indeed.com/cmp/Giant-Food/locations/MD/Baltimore"
}
...
],
"questions": [
{
"answer_count": 85,
"question": "How often do you get a raise at Giant Food?",
"url": "https://www.indeed.comfaq/how-often-do-you-get-a-raise-at-giant-food?quid=1eoul8dqksaaa800"
},
{
"answer_count": 68,
"question": "What is the best part of working at the company?",
"url": "https://www.indeed.comfaq/what-is-the-best-part-of-working-at-the-company?quid=1dtak84ldq3ma800"
}
...
],
"topics": [
{
"description": "Explore skills and training, pay raises and promotions and management and culture.",
"title": "Professional development",
"url": "https://www.indeed.com/cmp/Giant-Food/topics/professional-development"
},
{
"description": "Explore company values, community, the relevance of the mission and moving on.",
"title": "Mission and values",
"url": "https://www.indeed.com/cmp/Giant-Food/topics/company-mission-and-values"
}
...
]
},
"related_searches": {
"reviews_by_jobtitle": [
{
"count": 503,
"name": "Cashier",
"url": "https://www.indeed.com/cmp/Giant-Food/reviews?fjobtitle=Cashier"
},
{
"count": 172,
"name": "Customer Service Associate / Cashier",
"url": "https://www.indeed.com/cmp/Giant-Food/reviews?fjobtitle=Customer+Service+Associate+%2F+Cashier"
}
...
],
"reviews_by_location": [
{
"count": 188,
"name": "Washington, DC",
"url": "https://www.indeed.com/cmp/Giant-Food/reviews?fcountry=US&floc=Washington%2C+DC"
},
{
"count": 145,
"name": "Baltimore, MD",
"url": "https://www.indeed.com/cmp/Giant-Food/reviews?fcountry=US&floc=Baltimore%2C+MD"
}
...
]
},
"review_summary": {
"overall_rating": 3.4,
"rating_category": {
"compensation_benefits": 3.1,
"culture": 3.2,
"job_security_advancement": 3.1,
"management": 3,
"work_life_balance": 3.2
},
"review_count": 2803,
"star_1_count": 340,
"star_1_ratio": 0.36906376,
"star_2_count": 316,
"star_2_ratio": 0.3430122,
"star_3_count": 737,
"star_3_ratio": 0.8000001,
"star_4_count": 721,
"star_4_ratio": 0.7826323,
"star_5_count": 689,
"star_5_ratio": 0.7478969
},
"search_information": {
"filters": {},
"found_count": 2702,
"sort": "",
"total_count": 2803
},
"search_results": [
{
"comment": "One of the most unprofessional companies I have possibly worked for. Managers that abuse their authority. You receive little to no benefits as an employee. Different managers say different things regarding rules and policies. They have a policy where workers with seniority have the ability to “bump” your shift even if the schedule is already out. They had cashiers on register that didn’t do their training necessary for the job and four managers including the general manager knew that information. They make it clear they don’t care about your well being no matter how sick or emotionally drained.",
"cons": "Don’t give 30 minute breaks even if you work 7-9 hours, unprofessional upper management that spread misinformation about policies",
"country": "US",
"date": "August 6, 2024",
"helpful": 0,
"is_current_employee": true,
"job_title": "Cashier/Customer Service",
"location": "Baltimore, MD",
"overall_rating": 1,
"pros": "Weekly paychecks",
"rating_category": {
"compensation_benefits": 1,
"culture": 1,
"job_security_advancement": 1,
"management": 1,
"work_life_balance": 1
},
"title": "Unless you already make end’s meet at another job this isn’t somewhere you should expect a livable wage.",
"unhelpful": 0,
"url": "https://www.indeed.com/cmp/Giant-Food/reviews/unless-you-already-make-end-s-meet-at-another-job-this-isn-t-somewhere-you-should-expect-a-livable-wage?id=ff05192138e1a3f0"
},
{
"comment": "From day one, I felt welcomed and part of a team that truly cares about its employees and customers. I highly recommend Giant to anyone looking for a fulfilling and rewarding career in retail.",
"country": "US",
"date": "August 4, 2024",
"helpful": 0,
"is_current_employee": false,
"job_title": "Team Member",
"location": "Thorndale, PA",
"overall_rating": 5,
"rating_category": {
"compensation_benefits": 0,
"culture": 0,
"job_security_advancement": 0,
"management": 0,
"work_life_balance": 0
},
"title": "Great Place to Work with Excellent Growth Opportunities",
"unhelpful": 0,
"url": "https://www.indeed.com/cmp/Giant-Food/reviews/great-place-to-work-with-excellent-growth-opportunities?id=614a93fd8cc45f03"
}
...
]
},
"status": "parse_successful",
"url": "https://www.indeed.com/cmp/Giant-Food/reviews"
}
A full example JSON response can be found here.
Indeed Company Jobs Page Parser
To use the Parser API without the ScrapeOps Proxy Aggregator, you first need to retrieve the HTML of the page you want to extract the data from.
For example, here we retrieve the HTML from the following Indeed Company Jobs Page with a very simple GET request:
import requests
response = requests.get('https://www.indeed.com/cmp/Indeed/jobs')
if response.status_code == 200:
html = response.text
print(html)
Next, we send this HTML to the ScrapeOps Parser API for data extraction using a POST request:
import requests
response = requests.get('https://www.indeed.com/cmp/Indeed/jobs')
if response.status_code == 200:
html = response.text
data = {
'url': 'https://www.indeed.com/cmp/Indeed/jobs',
'html': html,
}
response = requests.post(
url='https://parser.scrapeops.io/v1/indeed',
params={'api_key': 'YOUR_API_KEY'},
json=data
)
print(response.json())
The API will return a JSON response with the following data (status, data, url):
{
"data": {
"company_summary": {
"happiness_grade": "GREAT",
"happiness_score": 74,
"links": [
{
"text": "Snapshot",
"url": "https://www.indeed.com/cmp/Indeed"
},
{
"text": "Why Join Us",
"url": "https://www.indeed.com/cmp/Indeed/about"
},
{
"text": "Reviews",
"url": "https://www.indeed.com/cmp/Indeed/reviews"
},
{
"text": "Salaries",
"url": "https://www.indeed.com/cmp/Indeed/salaries"
},
{
"text": "Jobs",
"url": "https://www.indeed.com/cmp/Indeed/jobs"
},
{
"text": "Q&A",
"url": "https://www.indeed.com/cmp/Indeed/faq"
},
{
"text": "Interviews",
"url": "https://www.indeed.com/cmp/Indeed/interviews"
},
{
"text": "Photos",
"url": "https://www.indeed.com/cmp/Indeed/photos"
}
],
"name": "Indeed",
"rating": 4.2,
"review_count": 1673,
"thumbnail": "https://d2q79iu7y748jz.cloudfront.net/s/_squarelogo/96x96/ff794fb897747bee7ebc1325d4b7a7da"
},
"search_information": {
"found_count": 4,
"total_count": 38
},
"search_results": [
{
"apply_count": -1,
"attributes": {
"benefits": [
"Paid parental leave",
"Disability insurance",
"Health insurance",
"Unlimited paid time off",
"Dental insurance",
"401(k)",
"RSU",
"Paid time off",
"Parental leave",
"Vision insurance",
"401(k) matching",
"Life insurance"
],
"job_types": [
"Full-time"
]
},
"create_date": "2024-08-27",
"is_expired": false,
"is_new_job": true,
"is_urgently_hiring": false,
"location": "New York, NY",
"pub_date": "2024-08-26",
"salary": {
"max": 130000,
"min": 110000,
"text": "$110,000 - $130,000 a year",
"type": "yearly"
},
"title": "Account Executive - Upper Mid Market",
"url": "https://www.indeed.com/viewjob?jk=076430820c03f17c"
},
{
"apply_count": -1,
"attributes": {
"benefits": [
"Paid parental leave",
"Disability insurance",
"Health insurance",
"Unlimited paid time off",
"Dental insurance",
"401(k)",
"RSU",
"Paid time off",
"Parental leave",
"Vision insurance",
"401(k) matching",
"Life insurance"
],
"job_types": [
"Full-time"
]
},
"create_date": "2024-07-23",
"is_expired": false,
"is_new_job": false,
"is_urgently_hiring": false,
"location": "New York, NY",
"pub_date": "2024-07-22",
"salary": {
"max": 130000,
"min": 110000,
"text": "$110,000 - $130,000 a year",
"type": "yearly"
},
"title": "Account Executive - Enterprise",
"url": "https://www.indeed.com/viewjob?jk=f799d0dd37ccdb44"
}
...
]
},
"status": "parse_successful",
"url": "https://www.indeed.com/cmp/Indeed/jobs"
}
A full example JSON response can be found here.
Proxy API Integration
The ScrapeOps Parser API is integrated into the ScrapeOps Proxy API Aggregator and can be used for free by using the Auto Extract functionality.
So if you already have a Proxy API Aggregator plan then use the Parser API for no extra charge.
The following example shows you how to use the Parser API via a Python Requests based scraper using the Proxy API Aggregator:
import requests
response = requests.get(
url='https://proxy.scrapeops.io/v1/',
params={
'api_key': 'YOUR_API_KEY',
'url': 'https://www.indeed.com/cmp/Nucor-Corporation-7e760088',
'auto_extract': 'indeed'
}
)
print(response.json())