About the job Data Engineer
Programming Language (Python, SQL), Data Technologies (Hadoop,
Spark, Kafka), Orchestration Tools (Jenkins, Airflow), Cloud Platform
AWS (S3, Redshift, EC2, EKS, Glue), Understanding of Data Modeling
Principles (e.g. Star Schema, Snowflake Schema), Version Control
(Github, Gitlab), Knowledge of Best Practices of Data Security &
Compliance
1. Design, develop, and maintain a robust and efficient data
architecture to collect, store, and process data from various sources
in a used car sales website platform.
2. Develop and implement optimal database schemas, and ensure
data integrity and quality to support accurate analysis and decision
making for the development and management teams.
3. Build and manage data workflows (data pipelines) to flow data
efficiently from source to destination, so that relevant information
can be accessed and used quickly by various parts of the company.
4. Collaborate with data scientists, analysts and development teams
to understand data needs and provide solutions that enable
in-depth analysis and application of business intelligence within the
used car sales platform.