Data Engineering Support using Python, AWS, Apache Kafka, Snowflake for IT Company

Project Description:
We are a fast-growing IT company looking for talented and experienced data engineering personnel to support our existing employees . The ideal candidate will be proficient in a wide range of data engineering technologies, including Python, AWS, Apache Kafka, Snowflake, and AWS Kinesis. The primary responsibility of the support personnel will be to assist our team in managing, optimizing, and scaling their client’s data infrastructure.

Responsibilities:
– Provide support and guidance on data engineering best practices
– Collaborate with our team to develop and maintain data pipelines, ETL processes, and data storage solutions
– Optimize and scale data infrastructure to ensure high performance and reliability
– Debug and resolve data-related issues, and provide recommendations for improvements

Skills Required:
– Strong experience with Python for data engineering tasks
– In-depth knowledge of AWS services, including EC2, S3, RDS, and Kinesis
– Hands-on experience with Apache Kafka for real-time data streaming and processing
– Proficiency in using Snowflake as a cloud-based data warehouse solution
– Familiarity with data modeling, ETL processes, and data warehousing concepts
– Excellent problem-solving skills and the ability to work in a fast-paced, dynamic environment
– Strong communication skills and the ability to collaborate effectively with team members
– A minimum of 5-6 years of experience in a data engineering role

Desired (but not required) Skills:
– Experience with other data processing technologies such as Apache Flink, Apache Beam, or Apache Nifi
– Knowledge of containerization technologies like Docker and Kubernetes
– Familiarity with data visualization tools such as Tableau, Power BI, or Looker
– Understanding of Big Data Tools and technologies like Hadoop, Map Reduce etc

If you have the skills and experience we’re looking for, we’d love to hear from you! Please reach out to us with your CV and experience information. We are looking forward to working with you to help our IT company continue to thrive and innovate in the world of data engineering.