Data Engineer
Job Description:
Role: A motivated entry-level professional aiming for a Junior Data Engineer role to leverage proven technical skills in data warehousing and database management to ensure data accessibility, integrity, and quality. Committed to learning from senior engineers and contributing to the development of robust and efficient data architecture.
Responsibilities:
Development: Assist in the design, development, and maintenance of ETL/ELT data
pipelines to move data efficiently from various sources to the data warehouse or data lake.
Data Quality: Monitor data pipelines and resolve issues to ensure data integrity, quality, and consistency across all systems.
Monitoring & Alerting: Daily monitoring to track pipeline issue, performance, resource utilization, and data flow health. In-time resolving the critical data pipeline issue and informing related parties.
Database Management: Perform basic database tasks such as supporting data models, writing and optimizing complex SQL queries.
Documentation: Create and maintain technical documentation for data flows, data models, and ETL processes.
Collaboration: Work with data analysts to understand their data requirements and ensure the infrastructure supports their needs.
Ad-hoc supporting: User access management on self service portal and assist in daily operational tasks.
Learning & Growth: Stay up-to-date with new technologies and industry best practices in data engineering and cloud computing.
Technical Requirements
SQL skills (Experience with relational databases like PostgreSQL, MySQL, Oracle is highly valuable )
Python and Spark Basic knowledge of ETL/ELT, Data Modelling and Data Warehousing
Basic knowledge of cloud platforms (AWS, GCP, or Azure) is a plus
Job Requirements
1+ years of practical experience or relevant internship in a data-focused role (preferred)
Strong problem-solving skills and attention to details, with a proactive, service-oriented mindset.
Bachelors degree in Computer Science, IT, Mathematics, or a related field (or equivalent practical experience)
Eagerness to learn new technologies and best practices in data engineering
Effective communication and teamwork abilities
Required Skills:
Database Management Data Engineering Analysts BASIC ETL Data Quality Data Warehousing Gcp Technical Documentation Collaboration Accessibility Spark Pipelines Effective Communication Data Integrity Cloud Computing Azure Architecture AWS Infrastructure Mathematics Writing PostgreSQL Databases Oracle Computer Science Documentation MySQL Maintenance Design Teamwork Engineering SQL Python Science Communication Management