RQ11048 - DataOps/Cloud Data Engineer - Senior

RQ11048 - DataOps/Cloud Data Engineer - Senior

Duration: 11+ Months (250 Business Days) + Possible Extension 

Location: 5 Days ONSITE at 777 Bay Street, Toronto

Must Have:

• Experience developing ETL processes with Informatica, Azure Data Factory and Databricks (Python, Lakeflow, and SQL Optimization)
• Experience with solution development with Databricks in Medallion Architecture.
• Experience with Cloud data engineer must be familiar and experienced with different programming languages (Python, SQL, t-SQL, PL/SQL, Informatica, ADF, SSIS. Microsoft Fabric) and be able to integrate with many different platforms to create data pipelines, jobs, automate tasks, and write scripts.
• Experience with Data pipeline and workflow development, orchestration, deployment, and automation and specializing in programming and pipelines to create and managing the dataflow, Delta Lake indexing, parallelism and movement of data.

Description

• Designing, developing, and optimizing Azure Data Factory and Databricks pipelines from Oracle databases to Lakehouses
• Designing and optimizing data models using Medallion Architecture principles
• Designing, developing and optimizing data connections from Databricks Medallion Architecture to on-premises data sources for downstream consumers.
• Designing and optimizing relational data models
• Translating Informatica ETL to Azure Data Factory and Databricks ELT

Knowledge Transfer

• Transfer From DataOps/Cloud Data Engineer to Designated CSC Resource

When Knowledge Will Be Transferred:

• Knowledge transfer must be completed one week prior to the end of the project or one week prior to the consultant leaving the ministry.

What Knowledge Will Be Transferred:

• All deliverables, including design/supporting/release/training documents must be checked into designated version control repositories (for example, git repositories or SharePoint). All final documents and working drafts related to project requirements or solution design must be stored on designated project repositories (for example, SharePoint site, HPQC, TFS, etc.)
• Project manager and designated ministry staff must be regularly informed in writing (by email) of where documentation has been stored and must be provided a minimum of one walk-through of all documentation as part of the final knowledge transfer activities.

How Knowledge Will Be Transferred:

• Knowledge will be transferred through 1 on 1 sessions, emails, document updates and document review with the team.

Note: This position will require the consultant to work from the office location 5 days per week.

AI Disclaimer: Source Code may use artificial intelligence (AI) tools to assist in certain aspects of its recruiting and business operations.

Note: The higher end of the range is intended for absolutely exceptional candidates who meet all must-have requirements and most or all nice-to-have qualifications. The client will evaluate candidates based on both rate expectations and overall skill set when shortlisting.

INCORPORATED RATE RANGE (7.25 billable hours per day)

• $85.35/hr - $102.44/hr Inc.

T4 RATE RANGE (7.25 billable hours per day)

• $68.28/hr - $81.95/hr T4