Senior Data Engineer(IT Consulting, AI Solution Provider)

Responsibilities:

• Engage with clients to understand their business goals, data challenges, and requirements. Collaborate with stakeholders to define project scope, objectives, and deliverables, ensuring alignment with the client's strategic objectives.
• Lead the design and architecture of scalable data solutions, ensuring they meet the client's requirements and align with industry best practices. Leverage your expertise in data engineering to propose innovative approaches and technologies that optimize data ingestion, processing, and analysis.
• Develop and implement robust data engineering processes, including data ingestion, transformation, and integration pipelines. Utilize your expertise in ETL/ELT frameworks, data modeling, and optimization techniques to build efficient and scalable data pipelines.
• Define and implement data quality standards and processes to ensure the accuracy, completeness, and reliability of data. Design and execute data validation and reconciliation procedures to validate data integrity across various systems and sources.
• Collaborate with data analysts and data scientists to provide clean and structured data for analysis. Assist in the development of analytical models, algorithms, and visualizations to derive meaningful insights and support data-driven decision-making.
• Lead project teams, including data engineers, analysts, and developers, to deliver high-quality data solutions within defined timelines and budgets. Monitor project progress, identify risks and issues, and propose mitigation strategies to ensure successful project completion.
• Provide ongoing support to clients, addressing technical issues, answering queries, and resolving data-related challenges. Act as a trusted advisor, providing guidance on data engineering best practices, emerging technologies, and industry trends to help clients maximize the value of their data assets.
• Collaborate with cross-functional teams to leverage expertise from various disciplines and ensure seamless project execution. Mentor and provide technical guidance to junior team members, fostering their professional growth and development.
• Other tasks as assigned.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineer, preferably in a consulting or professional services environment.
• Strong proficiency in programming languages such as Python or Scala with experience in data manipulation, scripting, and automation.
• Solid understanding of data engineering concepts and best practices, including data modeling, ETL/ELT frameworks, and data integration techniques.
• Expertise in designing and implementing scalable data pipelines using tools such as Apache Spark, Apache Kafka, or similar technologies.
• Strong knowledge of relational and non-relational databases, SQL, and query optimization techniques.
• Experience with AWS, Azure, or Google Cloud Platform, including services like S3, Glue, Data Factory, or BigQuery, is a plus.
• Experience in data visualization (Tableau/Power BI) is a plus.
• Familiarity with data governance, data quality, and data security practices.
• Excellent problem-solving and analytical skills, with the ability to analyze complex data scenarios and provide practical solutions.
• Strong communication and interpersonal skills, with the ability to effectively communicate technical concepts to both technical and non-technical stakeholders.
• Project management skills, with the ability to lead teams, manage project timelines, and deliver high-quality results.
• Continuous learning mindset, staying up-to-date with emerging data engineering technologies and trends.