Data Engineer

Key Responsibilities:

• Data Integration: Design, develop, and maintain data integration solutions, ensuring seamless data flow from various sources into the data warehouse.
• ETL Processes: Build and manage data ETL processes to consolidate and clean data from multiple sources.
• Data Cleaning and Validation: Perform data cleaning, validation, and transformation to ensure high data quality and accuracy.
• Data Mapping and Transformation: Develop and maintain data mapping logic to transform raw data into meaningful insights.
• Business Intelligence Reporting: Create and maintain BI reports and dashboards.
• Data Analysis: Perform data analysis to identify trends, patterns, and anomalies, supporting data-driven decision-making.
• Performance Optimization: Optimise database and query performance for efficient data retrieval and analysis.
• Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
• Documentation: Document data processes, mapping logic, and BI reports for future reference and knowledge sharing.
• Continuous Improvement: Identify opportunities for process improvements in data workflows and BI reporting.

Qualifications:

• Technical Proficiency: Proficient in SQL, Python, and data integration.
• ETL Development: Proven experience in developing and managing ETL processes.
• Data Quality and Cleaning: Expertise in data cleaning, validation, and transformation techniques.
• Data Mapping: Ability to develop and maintain complex data mapping logic.
• Database Management: Proficiency in working with databases (e.g., MySQL, DynamoDB) and data warehousing solutions.
• Analytical Skills: Strong analytical skills with the ability to perform data analysis and derive insights.
• Performance Tuning: Experience in optimising database and query performance.
• Collaboration and Communication: Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
• Problem-Solving: Strong problem-solving skills and attention to detail.
• Continuous Learning: Willingness to stay updated with the latest trends and advancements in data engineering and BI reporting.

Recruitment Notes for Data Engineer:

• At least 2 years experience in business intelligence with BI and reporting focus

• Also need to know how to code.