Data Engineer
Job Description:
Australian Citizens residing in Australia only respond.
Must be able to obtain Baseline
Essential criteria
1. Most of the section is located at Agriculture House in the Canberra CBD. Our standard expectation is for staff to attend the office three (3) working days each week. The section is supportive of flexible arrangements and consideration will be made for individual and collaboration needs, including attendance at important Agile ceremonies and other team / section events.
2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark) Graph Databases Azure SQL
3. Experience working with Engineering, Storage and Analytics services in cloud infrastructure.
Desirable criteria
1. Experience working with Azure Data Factory and Databricks.
2. Experience/Knowledge of working with Data Lake and Lakehouses.
Required Skills:
Spark Agriculture Storage Analytics Infrastructure Databases SQL Engineering