Job Openings Lead Data Engineer

About the job Lead Data Engineer

Company Description

Our client is a European-based software development and IT service provider company with its development center in Dhaka, Bangladesh. Since its establishment in 2010, it has been at the forefront of digital transformation, working with the latest web, mobile, and cloud stacks, micro-service architecture, and CI/CD pipelines. It exercises industry-standard principles and best practices to build scalable, high-performance, and robust software solutions for some of the big players in Europe. 

Their team comprises 200+ skilled professionals with extensive software engineering, application development, and IT project management expertise. They prioritize quality, innovation, and client satisfaction. They foster a collaborative work environment that encourages creativity and professional growth. Their agile development approach allows them to meet evolving market demands while ensuring that their solutions are robust, scalable, and efficient.

Key Responsibilities

  • Your primary focus will be on building data pipelines and video analysis tools. You will leverage your expertise in Python and video processing libraries (e.g., OpenCV) to extract meaningful insights from video data.
  • You will be responsible for provisioning and managing the necessary infrastructure to support our data-intensive applications.
  • Experienced data pipeline builders and data wranglers who enjoy optimizing data systems and building them from the ground up.
  • Work closely with a diverse team of highly experienced software developers, database experts, data analysts, data scientists, and AI/ML engineers.
  • Ability to work with various data professionals will be crucial in optimizing or even re-designing the company's data architecture to support the next generation of data initiatives.

Skills & Qualifications

  • 6+ years of experience in creating and maintaining data pipeline architecture using Python and related technologies.
  • Must have prior experience working with data pipelines and workflow management tools like Airflow / Mage AI.
  • Must have professional-level experience working with SQL and NoSQL (InfluxDB time-series database).
  • Must have knowledge of container orchestration tools like Docker, Kubernetes, and Elastic Kubernetes Service (EKS).
  • Must have professional-level experience with infrastructure such as Code (IaC) using Terraform/Pulumi.
  • Excellent problem-solving skills and familiarity with software engineering industry best practices, such as SOLID, Design Patterns, Unit Tests, TDD, CI/CD, Clean Code, Refactoring, and Code Review.
  • B.Sc. / M.Sc. in Computer Science & Engineering from any reputed University or equivalent practical experience.
  • Prior experience in OpenCV and Ultralytics YOLOv8 for video analysis will be considered a HUGE plus point.
  • Prior experience in Rust will be considered as a plus point.
  • Strong competence in implementing and managing CI/CD tools (e.g., ArgoCD, GitOps, GitHub actions, etc.).
  • Prior experience with cloud service providers like AWS / Azure / GCP.
  • Good competence with big data tools like Hadoop, Spark, Kafka, etc.
  • Having prior experience with server metrics using Prometheus, Grafana, etc is nice.
  • Fluency in written and spoken English to collaborate with foreign stakeholders and colleagues daily.

Employment Structure

  • Hybrid in Dhaka | Full-time
  • Salary: BDT 250,000 - 350,000
  • Benefits: Life Insurance + Health Insurance (including spouse and children) + Loyalty bonus for the long-tenure employees (similar to PF) + Flexible leave/vacation policy including paternity and maternity leave + 3 weeks of paid leave per year + All the public holidays as declared by the Bangladesh Government + Opportunity to work directly for European customers onsite + International training and traveling + Opportunity to work with cutting-edge tools & technologies in an international work environment + Annual performance evaluation and increment + Office transportation or transpiration allowances + Bottomless foods and drinks for breakfast, lunch, and snacks at the office
  • Work Week: Monday - Friday, 8 Hours (Flexible between 0800 and 1900)

Hiring Process

  1. Conversation with Talvette
  2. Cultural fit interview with the client
  3. Technical interview and assessment with the client
  4. Interview with the client's management
  5. Receive an offer
  6. Join their team full-time