Web Scraping Specialist

Web Scraping Specialist
Location: Remote
Status: Project based

Job Description
We are looking for a dedicated and proficient Web Scraper to join our data collection team. This role will contribute to our data mining efforts and be responsible for sourcing, scraping, and structuring web data in an organized and efficient manner.

Responsibilities

Data Collection
– Identify relevant websites and online sources to scrape for data, based on project requirements.
– Develop, test, and maintain web scraping scripts to extract data.

Data Quality Assurance
– Ensure data consistency, integrity, and accuracy through quality assurance practices.
– Eliminate duplicates, correct errors, and clean the scraped data.

Data Organization
– Efficiently store, organize, and categorize scraped data in a readily accessible format such as JSON, XML, or CSV.

Automation and Scheduling
– Implement automation tools to schedule and execute scraping tasks at regular intervals.

Monitoring and Maintenance
– Actively monitor the performance and reliability of web scraping tools and scripts.
– Update existing scraping scripts to adapt to changes in website structure and content.

Collaboration and Communication
– Work closely with data analysts and other team members to fulfill data requirements for various projects.
– Communicate progress, updates, and challenges to team members and supervisors.

Compliance and Ethics
– Ensure compliance with laws and regulations relating to web scraping and data collection.

Skills and Qualifications
– Proficiency in web scraping libraries and frameworks such as Scrapy, BeautifulSoup, or Selenium.
– Familiarity with no code web scraping tools such as parsehub, octoparse, and more
– Strong programming skills in Python, Java, or other relevant languages.
– Familiarity with HTML, CSS, JavaScript, and understanding of website structures.
– Experience in working with databases like SQL, MongoDB, or others.
– Strong problem-solving abilities and attention to detail.
– Ability to work independently and as part of a team.
– Excellent communication skills.

Education
– Bachelor’s degree in Computer Science, Information Systems, Data Science, or related field is preferred but not required.

How to apply?
– Submit a PDF copy of your resume and portfolio
– Extract and submit all data from the following source. Place data in google sheet and send the link with your application.
Click to view/opportunity/page/2/?type=fellowship