Lahore, Pakistan
Senior GCP Data Engineer
Job Description:
We are looking for a highly skilled Senior GCP Data Engineer with expertise in Terraform Or Packer to design, develop, and optimize cloud-based data solutions. The ideal candidate will have hands-on experience managing infrastructure as code (IaC), automating deployments, and implementing scalable data solutions on Google Cloud Platform (GCP).
Key Responsibilities
- Design, deploy, and maintain scalable data infrastructure on GCP using Terraform Or Packer.
- Build and optimize ETLELT pipelines using GCP services like BigQuery, Dataflow, and Cloud Composer.
- Automate infrastructure provisioning, deployments, and updates using Terraform, Packer, and CICD tools.
- Implement best practices for cloud security, access management, and compliance requirements.
- Ensure system reliability and efficiency through proactive monitoring and troubleshooting.
- Work closely with Data Engineers, DevOps, and cross-functional teams to optimize cloud and data solutions.
Required Skills & Experience
- 5+ years of experience in GCP cloud architecture, data engineering, and automation.
- Expertise in Terraform Or Packer for infrastructure automation and image management.
- Hands-on experience with BigQuery, Dataflow, Cloud Storage, PubSub, and Kubernetes (GKE).
- Strong scripting skills in Python, Bash, or Go for automation.
- Experience with CICD pipelines, Git, and Terraform modules.
- Knowledge of IAM policies, security best practices, and cloud networking.
Good to Have
- Google Cloud Certifications (Professional Data Engineer or Cloud Architect).
- Experience with additional IaC tools like Ansible or Pulumi.
- Background in Machine Learning pipelines (TensorFlow, Vertex AI) is a plus.