About the job GCP + Databrick + SQL | 3 to 5 Years | IST Time| Bangalore | Onsite
Job Description:
Role:GCP+DataBricks+ SQL
Key Responsibilities:
· Design and implement scalable data pipelines using Databricks, ensuring optimal data processing and storage.
· Develop complex SQL stored procedures, views, and scripts for efficient data manipulation and retrieval.
· Conduct performance tuning of SQL queries and database systems to ensure high performance and responsiveness.
· Utilize Delta Lake for reliable data storage and management, ensuring data consistency and integrity.
· Work with Google Big Query for large-scale data analytics, optimizing queries for performance and cost-efficiency.
· Collaborate with the reporting team to provide tailored views and tables that support their reporting and analytics requirements.
· Monitor and optimize the performance of data pipelines and infrastructure, ensuring high availability and scalability.
· Implement data governance and security best practices to protect sensitive information and ensure compliance with regulations.
· Stay up to date with emerging technologies and industry trends in data engineering, and recommend improvements to our data architecture and processes.