We are seeking a highly skilled and experienced Senior Big Data Engineer to join our team. The ideal candidate will play a key role in designing, implementing, and optimizing large-scale data solutions. You will work closely with data scientists, analysts, and other engineers to ensure the efficient handling and analysis of vast datasets, enabling data-driven decision-making and innovation.

Key Responsibilities:

Data Architecture & Design

• Design, develop, and maintain scalable and reliable big data solutions.
• Architect data pipelines and workflows for real-time and batch processing using distributed systems.

Data Processing & Integration

• Extract, transform, and load (ETL) processes for diverse and complex datasets.
• Ensure data quality, integrity, and security throughout the data lifecycle.
• Integrate and process data from various sources, including structured, semi-structured, and unstructured formats.

Performance Optimization

• Optimize data systems for speed, reliability, and scalability.
• Monitor and troubleshoot data pipelines and systems to minimize downtime and improve efficiency.

Collaboration & Leadership

• Collaborate with cross-functional teams, including data scientists, analysts, and product teams, to understand business requirements.
• Mentor and guide junior data engineers in best practices and advanced techniques.

Tooling & Technology

• Implement and leverage big data tools and frameworks such as Hadoop, Spark, Kafka, and Flink.
• Work with cloud-based solutions like AWS, Azure, or Google Cloud Platform to deploy and manage big data environments.

Qualifications:

• Bachelors or Master's degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in big data engineering or a similar role.
• Proficiency in programming languages such as Python, Java, or Scala.
• Hands-on experience with big data technologies (Hadoop, Spark, Hive, HDFS, Kafka, etc.).
• Strong knowledge of SQL and NoSQL databases (e.g., Cassandra, MongoDB).
• Familiarity with data visualization tools (e.g., Tableau, Power BI) is a plus.

Skills:

• Expertise in distributed systems and cloud computing platforms.
• Strong problem-solving and analytical skills.
• Deep understanding of data security, privacy, and governance.
• Excellent communication and teamwork abilities.