Job Title: Data Engineer
Position Summary
The Data Engineer will be responsible to perform web-scraping & web-acquisition activities that enable efficient scraping of data from online sources. Build effective & sustainable data-scraping tasks to support continuous data acquisition.
Responsibilities
• Responsible for extracting and ingesting data from websites using web crawling tools.
• Use knowledge and experience of data scraping tools, platforms, services to acquire and filter information from web sources that should continue to sustain data collection efforts.
• Research various web sources to identify the availability of relevant data as well as ensure sustainability of acquiring the data for periods to come using web harvesting applications, tools and techniques
• Discover and extract patterns and structure within the data, data analytics develops models and tests the hypothesis using analytical methods.
• Develop and document SQL Queries to extract and transform data from various data sources
• Organize and store data efficiently in a structured format using a suitable database.
• Set up an automated system for scraping data on a regular schedule.
Required Skills and Qualifications
• Bachelor’s degree (or equivalent) in mathematics, computer science, economics, or statistics
• Hands-on experience with Python based web-scraping as well as comfortable with generic and specialized tools available in the market like, scrapy, mozenda, web watcher, django etc.
• Experience on using Cloud Technologies mainly Amazon Web Services & Google Cloud Platform
• Thorough experience in writing complex scripts for data scraping & strong understanding of data scraping technologies
• Familiar with PowerBI and Tableau.
• Proven analytics skills, including mining, evaluation, and visualization
• Technical writing experience in relevant areas, including queries, reports, and presentations
• Strong SQL or Excel skills, with aptitude for learning other analytics tools
Salary and Benefits:
• Competitive salary
• Flexible scheduling options
How to Apply:
To apply, please submit your resume . Please quote “Data Engineer” in your subject.
APPLY FOR THIS JOB:
Company: Practice Test Geeks LTD
Name: Vivian Niu
Email: