Web scraper / Data Mining Expert

Company Description

Welcome to SmartPriced Analytics, where innovation meets precision in pricing intelligence. We empower Brands and Retailers to navigate the ever-evolving landscape of competitor pricing with confidence and clarity. At SmartPriced, our mission is simple: to equip our clients with the most in-depth competitor pricing intelligence, the highest product-match rate, and unparalleled data accuracy. We leverage a combination of cutting-edge AI / machine learning algorithms and human quality assurance to match competitor products to our clients’ offerings, and find the best-available-similar-match where the exact product is not carried. What sets us apart is our commitment to customization and quality results.

Job Description:

We are seeking a skilled and reliable Data Mining Specialist or a small team of Specialists proficient in conducting and maintaining web scraping at scale. The ideal candidate(s) or teams will be tasked with developing and maintaining web scraping scripts targeting approximately 100+ consumer retailer sites, including major platforms such as Amazon, Walmart, and others. If you are someone who is driven, reliable, and is obsessed with delivering great results with high attention to detail (like we are), and want to build a fruitful long-term relationship, then this post is for you.

Responsibilities:

* Develop robust web scraping scripts tailored to the specific requirements of each retailer site – this will be a highly collaborative process with our team to ensure exact specifications.
* Execute and maintain weekly or up to daily scraping schedules for each site for a minimum duration of 1 year.
* Ensure continuous data flow by promptly addressing and resolving issues that may arise, such as site changes or firewall restrictions.
* Deliver high-quality scripts and code as part of the project deliverables.
* Utilize Python programming language for scripting and coding tasks.
* Employ strategies to bypass sophisticated firewalls and other security measures implemented by target sites.
* Note: Ownership of the scripts need to be transferred to SmartPriced.

Qualifications

* Proficiency in Python programming language for web scraping and scripting purposes.
* Experience in developing and deploying web scraping solutions at scale.
* Strong attention to detail to deliver accurate and reliable data.
* Ability to adhere to project timelines and deliverables.
* Familiarity with IP proxies and other tools to navigate around firewall restrictions.
* Excellent problem-solving skills to address any technical challenges encountered during scraping operations.

Application Notes

This position is open to both individual candidates and small dev teams.
Please EMAIL the following documents to: Click to view
1. Your resume – please highlight specific web scraping / crawling experiences with projects you have worked on before.
2. A sample of a web scraping script you have developed previously.