Job Openings Data Engineer

About the job Data Engineer

iLabs is a global software product engineering company headquartered in Sri Lanka, with deep roots in the US Silicon Valley. We deliver world-class solutions in Web, eCommerce, Mobile, AI/ML, and Cloud technologies, serving industries such as fintech, edtech, medtech, martech, and hospitality. Guided by our vision “to become a global powerhouse in information technology to push humanity forward” we focus on delivering innovative, impactful solutions that empower businesses and create meaningful change in the world.

With a global talent network, we build agile remote teams for leading tech companies worldwide, including Silicon Valley pioneers. Our in-house ventures include Cloud of Goods, a fast-growing eCommerce rental marketplace, and Xenia, a customizable web platform for modern businesses.

At iLabs, we’re on a mission to advance lifestyles through technology and empower our partners to scale smarter and faster. Our culture is driven by creativity, innovation, ownership, teamwork, and global impact; giving you the opportunity and freedom to challenge the norm, spark change, and make a real difference.

If you’re ready to break boundaries and create your defining moment, we’re here to make it happen. Be part of something bigger. Join iLabs

Responsibilities

  • Design, build, and maintain scalable and reliable data pipelines for batch and real-time workloads.

  • Develop and manage data integration, storage, and processing solutions that support analytics and business needs.

  • Ensure data quality, reliability, and performance across the data platform.

  • Build and maintain APIs and services that make data accessible to internal teams and applications.

  • Write SQL, DDL, and Python code for pipeline development, data validation, troubleshooting, and performance tuning.

  • Define and follow best practices for data modeling, documentation, backup, and recovery.

  • Work with software engineers, DevOps, ML engineers, and data scientists to deliver on organizational goals.

  • Mentor junior team members and contribute to code reviews and engineering standards.


Shift: 9.00am - 6.00pm

Location: Battaramulla (On-Site)


Requirements

  • BS/MS in Computer Science, Engineering, or a related field.

  • 3+ years of experience in a data engineering role.

  • Strong experience with lakehouse architectures and Delta Lake.

  • Hands-on experience with streaming and CDC technologies such as Kafka and Debezium.

  • Proficiency with workflow orchestration tools such as Apache Airflow.

  • Experience with distributed query engines such as Trino/Presto and Hive.

  • Strong Python skills.

  • Advanced SQL, with a strong grasp of data warehousing, relational database theory, and NoSQL databases.

  • Experience building APIs with FastAPI, Django, or Flask.

  • Hands-on experience with AWS.

  • Comfortable working in Linux environments.

  • Excellent communication, interpersonal, and organizational skills.


Nice to Have

  • Experience with Databricks.

  • Exposure to GCP or Azure (e.g., Azure Data Factory).

  • Experience with Spark or other large-scale data processing frameworks.

  • Docker and Kubernetes experience.

  • Knowledge of data modeling and design patterns.

  • Web scraping experience (Selenium, Beautiful Soup, or similar).

  • Familiarity with CI/CD and monitoring tools.


Or refer someone