About the job Senior Data Engineer
A US-based company is redefining the direct mail industry with cutting-edge programmatic solutions. Their innovative platform combines the proven effectiveness of direct mail with the precision and scalability of digital advertising. By building a Demand-Side Platform DSP tailored specifically for physical postal campaigns, they are empowering advertisers to target audiences with unmatched accuracy and efficiency.
Joining the company means you´ll play a pivotal role in pioneering the future of programmatic advertising for direct mail. They value innovation, collaboration, and a passion for solving complex problems, making this an ideal opportunity for professionals who thrive in dynamic, fast-paced environments.
They are seeking an experienced Senior Data Engineer to design, implement, and maintain the data pipelines and systems powering our platform. Youll be responsible for processing real-time and historical data to support our RTB engine, campaign reporting, and analytics tools. This is a chance to work on cutting-edge data infrastructure and shape the technical foundation of a revolutionary product.
Your work will include:
- Design and build real-time data pipelines using Apache Kafka to process bid requests, inventory updates, and delivery confirmations.
- Implement batch ETL workflows for historical campaign performance and inventory analysis using tools like AWS Glue or Apache Spark.
- Data Engineer 2 Collaborate with Backend Engineers to ensure data is accessible and structured for APIs and reporting systems.
- Optimize data storage and retrieval for large-scale datasets using solutions like AWS S3, Redshift, or Snowflake.
- Ensure data quality, consistency, and security across all components of the platform. Monitor and troubleshoot data pipeline performance and reliability.
What You Bring
Required Skills and Experience
- Education: Bachelor's degree in Computer Science, Data Engineering, or a related field (or equivalent practical experience).
Experience: 5+ years in data engineering or related fields.
Expertise in real-time streaming frameworks like Apache Kafka or Flink.
Proficiency in batch processing frameworks such as Apache Spark or AWS Glue.
Strong knowledge of database systems, including PostgreSQL, Redshift, and Snowflake. Proficiency in Python, Java, or Scala for data processing tasks.
Experience with cloud platforms, particularly AWS, and services like S3, Lambda, and Athena.
Preferred Skills
- Experience with geospatial data processing and tools like PostGIS or Elasticsearch.
Familiarity with data warehouse tools like BigQuery.
Understanding of CI/CD processes for deploying and maintaining data pipelines.
What makes this role exciting:
Be a Pioneer: Shape the future of programmatic advertising for direct mail.
- Collaborative Environment: Work alongside a passionate, experienced team solving challenging problems.
- Growth Opportunities: As we grow, so do the opportunities for career advancement.
- Flexible Work: a Remote-first culture with the flexibility to work from anywhere.