Senior Data Engineer

Key roles and responsibilities:

• Design and develop data models, ETL processes, and pipelines to support data ingestion, transformation, and analysis.
• Work with cross-functional teams to identify data requirements, prioritize data initiatives, and drive solutions that enable data-driven decision making.
• Develop and maintain dashboards, reports, and visualizations that provide insights into key business metrics and trends.
• Design and implement data quality and data validation processes to ensure accuracy and consistency of data.
• Develop and maintain documentation for data models, data lineage, and data flow.
• Lead technical delivery within squads and provide oversight of solutions.
• Share knowledge and practical experience with community.
• Challenge and contribute to development of architectural principals and patterns.
• Mentor and coach junior data engineers to develop their skills and expertise

Academic qualifications and certifications:

• A Bachelors Degree in Computer Science, Information Technology or Equivalent Qualification
• Technology Certifications in Databricks, Azure, Data Engineering and other technologies highly advantageous)
• Minimum 5 years experience as a Data Engineer
• Proficiency in SQL, Python and other programming languages commonly used in data engineering.
• Experience with data visualization tools such as Paginated reports (SSRS), Power BI, Tableau or QlikView.
• Experience in developing solutions in cloud technologies including but not limited to Azure, Databricks, SQL and Data Lake
• Experience with distributed computing systems, such as Hadoop and Spark.
• Experience in Dimensional Modeling

Technical Skills Required;

Languages:

• Transact SQL
• Python
• Spark
• Scala

Technologies:

• Azure Data Factory
• Azure Synapse Analytics
• Azure DevOps
• Data Lake
• Power BI
• SQL Server
• Databricks