About the job Lead Data Engineer
Based in Portugal, Wire IT is your specialized IT consulting partner with 18 years of experience driven by an experienced and senior team that helps clients make the right decisions in a fast-moving market.
Wire IT's ambition is to grow while keeping true to its nature: agile, people-centered, and fun. As we like to say: Its not only what we do, its how we manage that truly make the difference..
If you're looking for more than just a job - if you're looking for a place where you can truly make a difference - you might be the next person to join WIRE IT.
Role: Lead Data Engineer
Location: Hybrid, Porto, Portugal
Required Skills:
- 8 to 10 years of overall experience in data engineering or closely related disciplines.
- Proven hands-on experience building and operating data pipelines on AWS in production environments.
- Experience with AWS data services: Glue, Lambda, Step Functions, DynamoDB, AWS Batch, and AWS Workflow.
- Solid experience with Lakehouse architectures, specifically Apache Iceberg, including table optimizations such as compaction and Z-Order.
- Strong background in ETL/ELT design and pipeline orchestration using Airflow and/or Step Functions.
- Proficiency in Python (advanced level) and SQL, including complex transformations and pipeline automation.
- Hands-on experience with PySpark and the Spark ecosystem.
- Familiarity with DevOps practices: CI/CD, infrastructure as code (CloudFormation, Terraform), and artifact/vulnerability management.
- Awareness of cloud foundation services: networking, security, storage, and IAM.
- At least one previous experience in a technical leadership capacity (team lead, tech lead, or senior engineer with mentoring responsibilities).
- Preferred: experience with Docker/containers and Linux-based infrastructure.
- Preferred: exposure to Azure or GCP as secondary cloud platforms.
- French is a plus.
We offer:
- No-term full-time contract;
- Health Insurance;
- 22 days of paid vacation;
- 4 extra days annually (Carnival, Christmas Eve, New Year's Eve, Birthday);
- Meal Allowance on card (Coverflex);
- Referral Bonus;
- Special discounts and flex options;
- Training annual budget;
- A great team-oriented culture;
- Chance to become a part of a dynamically growing international company;
- Challenging projects giving the unique opportunity to grow and learn.
Following the EU General Data Protection Regulation No. 2016/679, we inform you that by responding to this announcement, you consent to the use of your data by Wire IT, for as long as necessary. In case of doubt or request for elimination of your personal data, please send an email to info@wireit.pt