Job Openings
#986 - Apache Airflow Consultant
About the job #986 - Apache Airflow Consultant
Job Opportunity only available for professionals located in Latin America.
We are seeking an experienced Apache Airflow Consultant to support and optimize mission-critical workflow orchestration platforms in production environments.
The ideal candidate has strong expertise in Apache Airflow administration, troubleshooting, and security, along with hands-on experience deploying and maintaining containerized solutions on AWS.
This role requires a proactive problem solver who can work directly with clients, resolve complex technical issues within SLA commitments, and collaborate with cross-functional teams to deliver secure, reliable, and scalable data orchestration solutions.
Requirements:
- Advanced English level (B2/C1) to ensure fluent communication across teams.
- 4+ years hands-on with Apache Airflow in production (not just used it in a pipeline) — scheduler, executors, DAG lifecycle, backfills.
- Strong troubleshooting of Airflow failures: restart loops, scheduler lag, task queue issues, executor problems, dependency conflicts.
- AWS production experience, specifically ECS on EC2 (containerized Airflow) — sizing, deployment, networking.
- Security hardening: RBAC, secrets backends, TLS, and reducing Airflow's provider surface / CVE footprint.
- Comfortable with CVE triage and vulnerability justification — assessing exploitability, documenting findings for compliance review.
- Python proficiency (Airflow is Python-native; needed to read/debug DAGs and providers).
- Docker/containerization fundamentals.
- Strong written communication — client-facing support with SLA-bound response/resolution.
Strongly preferred:
- Experience supporting federal / government contractor environments; familiarity with FISMA/NIST 800-53/800-171 concepts (support context, not as a certifier)
- Kubernetes (some clients run Airflow).
- CI/CD, infrastructure-as-code (Terraform/CloudFormation).
- Prior SLA-based support or managed-services experience (vs. pure engineering).
- Monitoring: CloudWatch, Prometheus, Grafana.
Responsibilities:
- Manage and support Apache Airflow production environments, ensuring workflow reliability and platform stability.
- Troubleshoot Airflow issues, including scheduler, executor, task queue, and DAG execution failures.
- Deploy and maintain containerized Airflow on AWS ECS (EC2), optimizing performance and availability.
Implement Airflow security best practices, including RBAC, TLS, secrets management, and CVE risk reduction. - Assess and document security vulnerabilities (CVEs) to support compliance and remediation efforts.
- Develop, review, and debug Python-based DAGs and Airflow integrations.
- Provide SLA-driven client support, perform root cause analysis, and deliver technical documentation.
- Monitor platform health using CloudWatch, Prometheus, and Grafana, and support CI/CD and Infrastructure as Code practices.
What do we offer?
- 100 Remote work.
- Competitive salary in USD.
- Type of contract: Independent Contractor with Venon Solutions LLC.
- Contract duration: from 6 months to 1 year, with possibility of renewal.
- Paid Holidays: from the Client's calendar (USA)
- Working hours: Full-time CST working hours, fully committed.