Job Description:
Job: Data Integration Lead
Location: Dublin, Ireland
Hybrid Working Model 2 days in North Dublin Office.
Type: Daily rate contract
Term: 12 months
Rate: 750-800 per day
As a Data Integration Lead, you will be responsible for getting all the data from the business into the data platform. You will be challenged in bringing all of the data from numerous data sources, you will be explicitly focused on that. This involves close collaboration with stakeholders across Business, Technology and Finance to strategies, develop and manage a sophisticated AWS-based data ingestion and integration framework. This position is vital for crafting a scalable, efficient and secure ecosystem, thereby facilitating advanced analytics, machine learning and business intelligence projects.
Ideally you will have the below skillset:
- Coming from a Software Engineering background with a Data focus with strong code management chops, including test driven development kind of experience.
- You should have over 10 years of experience in data engineering or platform roles, with at least 4 years focused on AWS cloud technologies and 3+ years in a leadership capacity.
- Very strong capabilities with APIs, designing how to collect information from APIs in an elegant way.
- Expert at designing, securing and managing APIs with a strong grasp of RESTful services, SOAP, GraphQL and event-driven architectures
- Have a strong understanding in a broad spectrum of other data services and how to collect data from other databases in other clouds, other applications
- Have a good understanding of event driven architectures, because some of the data retrieval are going to be based on the adventure and nature.
- Comprehensive expertise in AWS services for data management and analytics (e.g., S3, Glue, Lambda, kinesis, EMR, etc)
- Proficient in AWS services for API integration, understand authentication mechanisms, data serialisation, API testing and be familiar with CI/CD practices for efficient deployment and management of APIs
- Experience in implementing data security and governance in AWS, including IAM, KMS and CloudTrail
- Proven leadership experience with the ability to manage, inspire and grow a technical team
- Proactive and Outcome-Oriented: Seeks out new opportunities for improvement, driving initiatives with a pragmatic approach to deliver tangible business benefits through data solutions
- Conflict Resolution and Problem-Solving: Demonstrates superior conflict resolution skills by effectively navigating delivery conflicts, underpinned by robust problem-solving and troubleshooting abilities to ensure projects remain on track
- Team Leadership and Development: An exceptional team leader with a track record of building, motivating, and sustaining high-performing teams within the AWS and Spark technology ecosystem, fostering a culture of excellence and continuous learning
- Emotional Intelligence and Influence: Exhibits strong leadership qualities complemented by high emotional intelligence, utilising influencing skills to align cross-functional teams and stakeholders with the data platform vision
- Strategic and Technical Balance: Skilled at maintaining focus on immediate deliverables without losing sight of the long-term technical strategy. Mindful of managing technical debt to ensure sustainable platform growth and innovation
- Organisational Excellence: Possesses outstanding organisational skills, with a hands-on approach and attention to detail, ensuring the data platforms architecture and operations exceed industry standards
- Drive for Excellence: Demonstrates relentless drive and determination to achieve exceptional results, pushing the boundaries of what is possible with AWS and Spark technologies in data management and analytics
Key responsibilities & duties include:
- Architect and execute a comprehensive data integration strategy on AWS, leveraging services like Amazon S3, AWS Glue, AWS Lambda, and AWS Kinesis to facilitate the efficient ingestion and integration of data from varied sources
- Lead the development and implementation of data ingestion services, ensuring the seamless flow of data into the platform, from a diverse set of data sources, systems and interfaces
- Work collaboratively with data scientists, analytics teams and business units to comprehend data needs and incorporate them into the data platform, ensuring data is readily available for analytical and operational purposes
- Develop and promote a strategic vision for the data integration framework within the AWS environment, encouraging company-wide adoption and understanding of the platform to leverage data-driven insights for decision-making
- Work collaboratively with the data governance team to ensure adherence to the data governance framework, QA/data quality programme and ensure data ownership is operationalised
This is a long term contract with excellent career potential. You will work along side a skilled team members on interesting and challenging projects. If you would be interested, please submit your CV to the link provided for immediate consideration.