Data Engineer

Job Description (IF INTERESTED KINDLY SEND ME AN EMAIL AT Click to view)
As a Data Engineer at Personetics, you will be a key player in designing, implementing, and optimizing data solutions leveraging Airbyte for data integration, DBT for advanced modeling, and Apache Airflow for workflow orchestration. This role requires a physical presence on-site for 50% of the time, contributing to the success of our AI-driven financial solutions while ensuring the seamless flow and utilization of data. Responsibilities
1. Airbyte Integration:
Design and implement data pipelines using Airbyte connectors to facilitate efficient and reliable data extraction, ingestion, and integration.
Collaborate with cross-functional teams to ensure seamless data flow across our financial data landscape.
2. DBT Modeling and Transformation:
Utilize DBT to create modular and scalable datasets, enabling advanced analytics and reporting tailored to the financial domain.
Work closely with data analysts and scientists to align DBT models with specific business requirements.
3. Apache Airflow Workflow Orchestration:
Design, implement, and optimize workflows using Apache Airflow to automate and schedule critical data tasks.
Ensure the performance and efficiency of Airflow workflows, focusing on the security and compliance requirements of the financial sector.
4. Data Integration and Collaboration:
Collaborate with cross-functional teams to seamlessly integrate data solutions into Personetics’ AI-driven financial applications.
Facilitate smooth data flow between different components of the data infrastructure.
5. Database Management:
Design and implement databases based on data modeling principles, prioritizing optimization for performance, reliability, and security.
Collaborate with database administrators to ensure the integrity and security of financial data storage.
6. Data Quality Assurance:
Implement data quality checks and validation processes within DBT and other tools to maintain high-quality data standards.
Proactively identify and address data quality issues, ensuring compliance with financial regulations.
7. Documentation and Training:
Document implementation processes, configurations, and best practices.
Provide training and support to end-users, analysts, and team members.
?8. Innovation and Continuous Improvement:
Stay abreast of industry trends, emerging technologies, and financial regulations.
Propose and implement improvements to data engineering processes to enhance our AI-driven financial solutions.
Qualification
Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
Proven experience as a Data Engineer with a focus on Airbyte, DBT, and Apache Airflow.
Strong proficiency in SQL and experience with database management systems (e.g., MySQL, PostgreSQL, Oracle).
Hands-on experience with ETL processes and workflow orchestration using Apache Airflow.
Proficiency in DBT for data modeling and transformation.
Experience with Airbyte connectors for data extraction and ingestion.
Familiarity with big data technologies (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS, Azure, Google Cloud).
Proficient in programming languages like Python, Java, or Scala.
Proven experience in customer-facing roles.
Must be able to travel 50% of the time to customers’ sites.
Experience working and collaborating in a diverse and distributed global team environment.
Nice to have:
Certifications in relevant technologies (e.g., Apache Airflow Certified, DBT Fundamentals).
Experience with data visualization tools (e.g., Tableau, Power BI).
Knowledge of data governance, security, and compliance standards in the financial industry.
Strong problem-solving skills, attention to detail, and a proactive approach.