Data Engineer

We are searching for a full time Database engineer that can join our growing Team and help with the following projects/tasks:

Database Project Scoping

Project Overview:

The purpose of this project is to establish a robust and efficient database system to support various integrated platforms, queries, and Power BI reporting requirements. The project will involve the following key phases:

1. **Platform Selection:**

– Evaluate and select the most suitable platform for hosting the database, considering integration requirements, scalability, and performance needs.

– Take into account compatibility with existing systems and tools, including Power BI.

2. **Database Architecture Design:**

– Design the database architecture after the platform is chosen, ensuring it aligns with the project’s objectives and requirements.

– Define the schema, data models, relationships, and any necessary constraints.

3. **Data Migration and Schema Implementation:**

– Migrate existing data into the new database, adhering to the defined schema.

– Implement necessary optimizations, such as indexes, partitions, or other platform-specific techniques, to enhance query performance.

4. **Optimization and Performance Tuning:**

– Conduct performance analysis and apply optimizations as required to improve database responsiveness and efficiency.

– Implement techniques like indexing, partitioning, and other platform-specific strategies to enhance query execution speed.

5. **Integration and Platform Connectivity:**

– Integrate third-party sources specifically for updating and enriching the database.

– Establish secure and reliable connections between the database and integrated systems.

6. **Integration with ActOn, DMS, and QC Data Ingestion:**

– Integrate with platforms like ActOn and DMS to receive updated data about contact behavior.

– Develop secure and reliable connections to ensure seamless data flow between the database and ActOn/DMS.

– Ingest and update the data collected by the Quality Control (QC) team for improved data accuracy and completeness.

7. **Update Dataset According to Webula and XVerify Results:**

– Implement processes to update the dataset based on insights obtained from Webula and XVerify platforms for enhanced data quality.

8. **Automated Jobs, Scripts, and Source Pipelines:**

– Create automated jobs, scripts, or source pipelines to automate queries and format and structure the resulting dataset according to a specific template.

9. **Continuous Monitoring and Stakeholder Collaboration:**

– Establish continuous monitoring mechanisms to ensure the ongoing health and performance of the database.

– Foster close collaboration with stakeholders and team members to provide timely and effective solutions.

10. **Power BI Reporting:**

– Design and develop Power BI reports based on the data stored in the database.

– Ensure that the reports provide valuable insights and meet the reporting needs of the project stakeholders.

Interested individuals should forward a link to a resume (CV) for consideration. Thank you in advance!