Lead Data Engineer

Responsibilities :

Helping to establish industry best practices for the data engineering team, by building the needed capabilities for the organization to become more data-driven.

Evolving our data architecture by determining structural requirements; developing and installing solutions.

Building upon existing data lakes & data warehouses based on structural requirements and in-depth analysis.

Testing and maintaining those databases to ensure their longevity and overall efficiency.

Job requirements

Hands-on 8+ years of experience in Data Engineering and Big Data.

Proven work experience with ETL Development or similar areas.

Advanced knowledge in Database Engines, Data Lakes, Data Practices, and policies.

In-depth understanding of database structure principles, integration, ETL, ELT, data processing, and data management.

Expertise in Data Warehouse & Data Lake technologies. Such as Vertica, Greenplum, Cloudera framework/ecosystems, Apache Kafka, ApacheNiFi, Apache Spark, Impala, etc).

Hands-on experience with programming languages, such as Python, Java, Scala, and SQL.

Experienced in assembling large, complex data sets that meet functional / non-functional business requirements.

Experienced in building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources technologies.

Bachelors degree in a related field.

Analytical skills and strong organizational abilities.