Cloud Admin

Job Description of Cloud Admin in Sydney :

• 5-8 years of hands-on experience in managing Big Data technologies and Hadoop eco system including Hive, Spark, ranger, Oozie, HBase, CDSW, NiFi.
• Responsible for deploying, upgrading, configuring, and managing of Cloudera platforms.
• Responsible to building CDH, upgrade CDH distributions, managing services, backup and disaster recovery.
• Hands on experience in Elastic search platform to manage the cluster. Perform the upgrade of elastic platform and elastic stacks.
• Extensive experience in SSL implementation and renewal of third-party issuer SSL certificates to Big data cluster and Elastic cluster.
• Extensive experience in impala, Hive queries tunning and optimising the load for long running queries.
• Hands on experience in Active directory and Kerberos SSO authentication and troubleshooting.
• Experience in microservices administration, troubleshooting including Kubernetes and docker for data scientists application.
• Identifying ineffective processes proactively and proposing industry best practices before they grow up as actual issues.
• Good at capacity planning, scheduling, evaluating the cluster for different business requirements.
• Configuring High Availability for all Hadoop components, troubleshooting and root cause analysis.
• Should be able to Support both batch processing and real-time data pipeline such as Kafka.
• Automating complex tasks by writing effective pipelines using different Hadoop eco system and documenting the day-to-day business activities.
• Responsible to perform frequent platform health checks and working with product vendors to attain maximum performance.
• Experience in security implementation around the Hadoop clusters using Kerberos, Ranger.
• Good at handling data between Hadoop eco systems.
• Experience across Linux shell scripting and commands, oozie and Crontab jobs along with DevOps tools like Jenkins, Bitbucket.
• Experience with databases like MySQL and Oracle.
• Experience in HAProxy Load balance implementation, management and troubleshooting, for Hadoop eco-system.
• Experience with reporting application tableau, power BI server, Cognos and help reporting team to troubleshooting and tune the reporting queries.
• Good Communication and written skills and attitude.
• Willingness to work in a support role with flexible work hours.