We are looking for an experienced Web Scraping Developer to join our dynamic team. The successful candidate will be responsible for developing and maintaining a bot designed to extract business and owner information from specific websites ( and ), and integrate this information into our Airtable database. This role requires a combination of programming skills, data mining knowledge, a deep understanding of web technologies and protocols, and proficiency with database integration and management.
Key Responsibilities:
Design, develop, and implement a robust web scraping bot capable of navigating and extracting data from to identify local businesses and service providers.
Extend the bot’s functionality to extract business owner information from using the data obtained from .
Ensure the accuracy and integrity of scraped data by implementing quality checks and data validation processes.
Integrate scraped data seamlessly into our existing Airtable database, ensuring that data structures and relationships are maintained.
Work closely with the data analysis team to format and integrate scraped data into existing databases and systems, specifically focusing on Airtable.
Regularly update and maintain the scraping bot to adapt to changes in website structures and to ensure uninterrupted data collection.
Implement anti-blocking techniques to prevent IP bans and manage request rates to comply with website terms of use and legal requirements.
Document the development process, including code comments, system architecture, and user guides.
Qualifications:
Proven experience in web scraping, data extraction projects, and database integration, specifically with Airtable.
Strong programming skills in Python, including experience with web scraping libraries such as Beautiful Soup, Scrapy, or Selenium.
Familiarity with web technologies (HTML, CSS, JavaScript) and understanding of HTTP/HTTPS protocols.
Demonstrated experience with Airtable, including API usage for data integration and manipulation.
Experience with data processing and storage solutions (e.g., SQL databases, NoSQL databases, Excel).
Knowledge of anti-scraping techniques and ways to navigate around them responsibly.
Excellent problem-solving abilities and attention to detail.
Strong communication skills and ability to work collaboratively in a team environment.
Bachelor’s degree in Computer Science, Information Technology, or a related field is preferred.
How to Apply:
Please contract me through skype: live:b0dfb8178fe3787c Include “Web Scraping Developer Application” in the subject line.
APPLY FOR THIS JOB:
Company: Founders consulant
Name: Michael D Mack
Email: