Data Engineer
DescripciĆ³n del puesto:
Data Engineer
Primary mission:
As a Senior Data Engineer, you will contribute to bring data analytics to production at scale.
Establish the core discipline and guidelines. Taking part on data teams building data platforms and data products.
Core activities:
Data Platform, provision infrastructure for other teams to work with.
Data Pipelines Development (Batch + Real Time pipelines)
Data Operations (Exploring, Provisioning, Cleansing and Testing)
Technical stack:
Languages (required): Python, SQL
Languages (appreciated): Java, .NET and others
Experience with Data Ops, infrastructure as Code (Terraform, Ansible, etc)
Experience in data architecture design (Data lakes, Data Warehousing, Event
Streams. Etc)
Big Data Frameworks: Spark, Kafka, Kubernetes, Hive.. strongly appreciated
experience with Databricks.
Data Base: relational (SQL Server) & non-relational (MongoDB, ELK,
Cassandra)
Experience working in cloud environments (Azure appreciated)
Experience in Agile methodology.
As a bonus, knowledge in Machine Learning tools (Scikit-Learn, Pandas, Spark
ML, MLflow)
Soft skills and competencies:
Passion for learning new tools, languages and frameworks
Ability to be creative and innovation-minded, self-motivated and proactive.
Fast adaptation to changing requirements and strong problem-solving skills.
To work in a collaborative model, side by side with the business
Experience:
MSs degree in Computer Science, Engineering, or related field
4+ years experience in software development & Data Frameworks
Proven experience in setting up data infrastructures from scratch