Senior Data Engineer

Sr. Data Engineer - Onsite - Lahore

Company Overview:

Hiring for one of our IT consultancy firm in Lahore.

Key Responsibilities

1. Architect, build, and maintain scalable data pipelines for structured and unstructured data across various sources.
2. Design and optimize OLTP and OLAP data schemas for efficient storage, retrieval, and processing.
3. Develop and manage ETL processes to transform and integrate data from Aurora/MySQL to and from AWS Redshift, and other sources.
4. Implement best practices in data governance, performance optimization, and security across databases.
5. Collaborate with data scientists and analysts to ensure data availability for machine learning and analytical workloads.
6. Utilize Python and ORM frameworks for data modeling, transformation, and workflow automation.
7. Monitor and improve database performance, identifying bottlenecks and implementing optimizations.
8. Work with AWS services such as EC2, ECS, S3, and Lambda for scalable data processing.
9. Ensure data quality, consistency, and compliance with regulatory standards (GDPR, CCPA, etc.).

Required Skills & Experience

1. 5+ years of experience in data engineering, database architecture, or similar roles.
2. Strong expertise in AWS Redshift, Aurora / MySQL, and other relational databases.
3. Proficiency in Python (v3.8+) and experience with ORM frameworks.
4. Experience designing and implementing ETL pipelines for large-scale transactional and analytical data.
5. Familiarity with data modeling best practices for OLTP and OLAP workloads.
6. Experience handling high-throughput OLTP processes with transactional integrity.
7. Strong understanding of SQL query optimization and database indexing strategies.
8. Excellent problem-solving and troubleshooting skills for debugging data inconsistencies and performance issues.

Preferred Qualifications

1. Exposure to machine learning workflows and the integration of ML models into data pipelines is a big plus.
2. Hands-on experience with data warehousing best practices in AWS Redshift.
3. Understanding of server less architectures and cloud-native data solutions.
4. Experience working with large-scale distributed systems

Other Details:

Experience: 7+ years

Location: DHA, Lahore

Timings: Mon to Fri (10 am to 6pm)

About HR Ways: HR Ways is an award-winning Technical Recruitment Firm helping software houses and IT Product companies internationally and locally to find IT Talent. HR Ways is engaged by 300+ Employers worldwide, ranging from the world's biggest SaaS Companies to most competitive Startups. We have entities in Dubai, Canada, the US, the UK, Pakistan, India, Saudi Arabia, Portugal, Brazil, and other parts of the world.