Data Engineer

Responsibilities:

• Building data processing based on jointly defined requirements along the data pipelineunder the concern of quality and having alert in place.
• Works closely with both the backend developers as well as the IT data architecture group.

Work with Product Owners to help them leverage data solutions in their products.

• Providing guidance on suitable options, designing, and creating data pipeline for the analytical solutions data lake / data warehouses to specific micro services.
• Supporting the bug fixing and performance analysis along the data pipeline.

• Bring experience of Data Ware Houses, and Data Lakes to development team.
• Be a strong advocate for a culture of process and data quality across development teams.
• Follow an agile development methodology.

Qualifications:

• BS/MS degree in Computer Science, Engineering, Mathematics, Statistics or related subject.
• 3 - 5 years of experience working on Big Data platform like Hadoop (Hortonworks is preferred), HBase, Couch DB, Hive, Pig etc.
• Experience working in start-up environment or organizations with an agile culture.

Professional attitude and service orientation; superb team player.

• Experienced with data modeling, design patterns, building highly scalable and secured analytical solutions.
• Experience with data processing, ETL and workflow and messaging queue like Kafka.

Used SQL, PL/SQL, Spark, Spark SQL and similar languages.

• Has programming skills such as Python, Java, Scala, Spark Streaming, Hive.

• Basic knowledge of Linux and shell scripting.

• Telecom industry and data model knowledge is required.

• Strong analytical and problem-solving skills.