Junior Data Engineer

As a Junior Data Engineer, you will be responsible for supporting the design, development, and maintenance of our data infrastructure. You will work closely with key users to identify efficient data processing and analysis of large datasets.

Key Responsibilities:

• Assist in the design and implementation of data pipelines.

• Develop and maintain PySpark notebooks for data processing and analysis.

• Support the integration and management of data from various sources, including dataflows and data lakes.

• Work with both structured and unstructured data to ensure comprehensive data coverage.

• Collaborate with team members to optimize data workflows and improve data quality.

• Monitor and troubleshoot data processing systems to ensure reliability and performance.

• Document data processes and workflows for future reference.

• Stay updated with the latest industry trends and technologies in data engineering.

Preferred Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.

• Proficiency in PySpark and Python programming.

• Knowledge of Microsoft Fabric components and their application in data engineering.

• Familiarity with SQL and database management systems, including data warehouses.

• Familiarity with data gateways for secure data transfer.

• Strong problem-solving skills and attention to detail.

• Excellent communication and teamwork abilities.