Data Engineer (Mid-Senior)

EMPLOYMENT TYPE:

Contract - 12 months with extension possibilities

COMPANY:

Vito Solutions

LOCATION:

Belville, Cape Town

WORKING MODEL:

Hybrid (2 days remote, 3 days in office)

JOB OVERVIEW:

We are looking for an experienced Data Engineer to join a high-performing data engineering team in Cape Town. This is an end-to-end Data Engineering role. You will work across data ingestion, ETL/ELT, transformation, data modelling, pipeline development, testing, deployment and production support. We are looking for someone with strong Data Engineering fundamentals, particularly SQL, Python and ETL/ELT. You do not need to have experience with every cloud platform.

GCP experience is advantageous, but not essential. Strong engineers with AWS, Azure or other cloud experience are encouraged to apply.

The most important thing is that you know how to build, troubleshoot and operate production-grade data solutions.

DESCRIPTION OF POSITION:

• Design and develop scalable data pipelines
• Build ETL/ELT processes from multiple source systems
• Extract, transform and load data into data warehouse and data platform environments
• Develop data transformations using SQL and Python
• Work with structured and semi-structured data
• Design and implement data models
• Build both batch and, where required, real-time data pipelines
• Investigate and resolve data and pipeline failures
• Develop automated data quality and validation processes
• Write production-quality, maintainable code
• Participate in code reviews and technical design discussions
• Work through the full Software Development Lifecycle
• Deploy and support solutions in production
• Monitor pipeline performance, reliability and data quality
• Collaborate with Data Analysts, Data Scientists, Developers and business stakeholders
• Contribute to technical documentation and engineering standards

KNOWLEDGE AND SKILLS:

• Strong SQL skills
• Strong Python skills
• Strong ETL/ELT experience
• Strong understanding of data warehousing and data modelling
• Strong understanding of data quality, reliability and performance

QUALIFICATIONS REQUIRED:

- Relevant tertiary qualification in Computer Science, Information Systems, Data Engineering or related field.

- Cloud platform or data engineering certifications advantageous.

EXPERIENCE REQUIRED:

• 4+ years of commercial Data Engineering experience
• Experience building and maintaining production data pipelines
• Experience integrating data from multiple source systems
• Experience troubleshooting data pipelines and production issues
• Experience working through the full SDLC
• Experience with Git and source control

ADVANTAGEOUS SKILLS:

Experience with any of the following is beneficial:

• BigQuery
• Cloud Storage
• Dataflow
• Cloud Composer / Airflow
• Pub/Sub
• Dataproc
• Airflow or another orchestration platform
• Spark / PySpark
• Databricks
• dbt
• Kafka or other streaming technologies
• REST API integration
• Docker
• CI/CD
• Terraform or Infrastructure as Code
• Data quality and observability
• Data governance and lineage
• Lakehouse architectures
• Real-time data processing
• Retail or high-volume transactional data experience

**Please note: If you have not heard from us within 2 weeks, please consider your application unsuccessful.