About the job Data Analytics-Python Developer
Mandatory skills
1.Python, Dagster, Docker containerization-3 5 years
2.Data Modeling-3 years
Required Qualifications:
· Proven experience as a Python Developer with a focus on data engineering.
· Hands-on experience with Dagster for building and maintaining data pipelines.
· Proficiency in Python libraries (Pandas, Polars, DuckDB) and ETL processes.
· Solid understanding of Docker containerization.
· Experience with Power BI, particularly connecting to Parquet data sources.
· Experience wih Dimentional modeling, start schema, snow-flake schema.
· Strong analytical, problem-solving, and communication skills.
Preferred Qualifications:
· Familiarity with Agile methodologies and a collaborative, team-oriented environment.
Responsibilities:
· Pipeline Development:
o Develop and maintain Dagster pipelines to connect with various data sources and
convert raw data into Parquet format.
o Optimize ETL processes for robust, scalable data workflows.
· Data Analysis & Transformation:
o Analyze different source systems to design efficient integration strategies.
o Modify and manage Parquet datasets to ensure data quality and performance.
· Technical Implementation:
o Utilize Python libraries such as Pandas, Polars, and DuckDB for data processing
and analysis.
o Deploy applications using Docker for seamless containerization and deployment.
· Data Modeling:
o Design innovative data models from source tables to staging, capturing time-series
data for advanced analytics.
· Collaboration:
o Work closely with