Data Engineer (pre-senior)
Job Description:
Job Description:
We are seeking a highly skilled Senior Developer to join our team. The ideal candidate will have strong experience in SQL, Python, and data engineering, with a focus on troubleshooting, documenting, and resolving data issues. You will play a critical role in ensuring the integrity of our data pipelines and will work closely with other teams to address and escalate issues as necessary.
Key Responsibilities:
- Correct and convert SQL queries as needed to meet project requirements.
- Gather and analyze relevant information regarding reported issues.
- Trace and identify the origin of specific issues within our data pipelines.
- Provide initial feedback to the issue reporter, ensuring clear and timely communication.
- Document all aspects of the issue, including actions taken, timelines, time spent, and any impediments encountered.
- Summarize findings and escalate issues to the core Data Engineering (DE) team for further action when necessary.
- Follow existing Standard Operating Procedures (SOPs) or develop new ones to address unique challenges.
- Make intuitive connections between data inputs and outputs to identify and resolve potential issues.
Required Skill Set:
- SQL: Proficiency in writing and optimizing SQL queries is essential.
- Python: Strong experience with Python for data manipulation and automation.
- HANA Studio: Experience with HANA Studio, including working with native SQL.
- Airflow: Experience with Apache Airflow for workflow management and automation.
- Data Issue Tracing: Ability to independently trace and communicate data issues and propose solutions.
- Communication: Strong English communication skills, both written and verbal, are necessary for effective collaboration and documentation.
Additional Qualifications:
Ability to follow detailed SOPs and develop new ones as needed.
Strong problem-solving skills and the ability to make intuitive connections between data inputs and outputs.
Required Skills:
Pipelines Apache Timelines Automation Writing Troubleshooting Documentation Python SQL Engineering English Communication Management