Senior Data Engineer - Hybrid

Role: Senior Data Engineer

Type: Permanent

Location: Westlake - Hybrid

We are seeking an experienced Senior Data Engineer to join our dynamic team. You will play a critical role in designing, building, and optimizing data pipelines to support business campaigns, with a focus on enhancing data processing for client initiatives. As the most senior member in a small, agile team of four, including two DevOps engineers, you will lead efforts in leveraging cutting-edge technologies to deliver high-quality data solutions.

Key Responsibilities

Data Pipeline Development

• Design, build, and maintain robust data pipelines.
• Enhance existing pipelines to optimize campaign performance.

Data Architecture & Integration

• Develop modern data platforms, including data pipelines, integrations, and models.
• Migrate and process data across multiple environments securely and efficiently.

Collaboration & Leadership

• Work closely with internal stakeholders to resolve data-related issues.
• Lead the team in technical initiatives, setting best practices for data engineering processes.

Monitoring & Optimization

• Implement and maintain systems for data quality monitoring and reliability.
• Optimize data workflows to handle large and complex datasets effectively.

Innovation & Scaling

• Design scalable solutions to manage high-volume data and support business intelligence.
• Prepare data for advanced analytics, including prescriptive and predictive modeling.

Tools and Skills

Tech Stack

• AWS Services: Glue, Lambda, EC2, S3
• Databases: Postgres
• Languages: SQL, Python
• Cloud Data Platform: Snowflake (beneficial)
• Bid Data Technologies: Hadoop or Spark
• Data Visualization: Tableau or Power BI
• Containerization: Docker or Kubernetes
• Streaming Data: Apache Kafka or AWS Kinesis

Tools

• Data Modeling: Building and maintaining logical and physical data models.
• Version Control: Git
• Data Management: Best practices for secure and scalable data architecture.

Knowledge, Skills, and Attributes

• Strong problem-solving and analytical skills.
• Ability to lead and mentor team members in a collaborative, agile environment.
• Proficiency in optimizing data workflows for performance and scalability.
• Excellent communication and organizational skills.
• Attention to detail and process-oriented mindset.

Education

• Bachelors Degree in Computer Science, Information Systems, Engineering, or equivalent.
• Relevant certifications (e.g., Certified Data Engineer).

Experience

• 5+ years in data engineering or similar roles.
• Proven expertise in building secure, scalable data systems.
• Experience with AWS Glue and Postgres is essential.
• Demonstrated ability to manage high-volume, complex datasets.
• ETL experience
• Data warehousing
• Data governance
• Data Modelling
• API Integration
• Version Control