Data Engineer

Job Description: Data Engineer

We are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure and systems. This position requires a solid background in data engineering or data infrastructure roles, along with expertise in various technologies and tools.

 Responsibilities:

- Utilize your 3+ years of experience in data engineering or data infrastructure roles to design, develop, and maintain our data systems.

- Collaborate with cross-functional teams to understand data requirements and translate them into efficient data pipelines and transformations.

- Work with cloud-based data warehouses and implement ELT (Extract, Load, Transform) processes to ensure the availability and accessibility of data.

- Demonstrate expertise in Spark to process and analyze data at scale.

-  Develop and maintain ELT/ETL (Extract, Load, Transform) processes for efficiently moving and transforming data from source systems to the target data repositories.

- Utilize Rest API to integrate data from various platforms and sources.

- Apply your knowledge and experience in data modeling techniques, including Star schemas, Snowflake schemas, and aggregation tables.

- Utilize your experience with data pipeline technologies to design and build efficient and scalable data pipelines.

- Work with Amazon Glue, S3, AppFlow, Athena, EC2/ECS, Code Commit/Code Pipeline to manage and automate data processing and analytics workflows.

Requirements:

- Bachelor's or master's degree in Business Intelligence, Machine Learning, Business Management, Computer or Data Sciences, or Statistics.

- Strong experience working with cloud-based data warehouses and implementing ELT processes.

- Proficiency in Spark for data processing and analysis.

- Experience with ELT/ETL processes, including moving and transforming data.

- Familiarity with Rest API and ability to integrate data from various platforms.

- Possess advanced Python skills, including PySpark, Pandas, Scikit Learn, Numpy, Boto3, Glue + Spark Context.

- Strong understanding of data modeling techniques, such as Star schemas, Snowflake schemas, and aggregation tables.

- Experience with Amazon Glue, S3, AppFlow, Athena, EC2/ECS, Code Commit/Code Pipeline.

- Excellent problem-solving skills and ability to work in a collaborative team environment.

Plus Factors:

- Experience with Python's Keras/TensorFlow/PyTorch for machine learning tasks.

- Familiarity with Power BI for data visualization and reporting.

If you are a passionate Data Engineer looking for an exciting opportunity to contribute to the development of data infrastructure and analytics capabilities, then we would love to hear from you. Join our team and help shape the future of our data-driven organization!

#DataEngineering

#BigData #DataPipeline #Python #Pandas #Scikit #Numpy #Glue+ #CodeCommit #CodePipeline #Keras #TensorFlow #PyTorch
#ETL #DataProcessing #DatabaseManagement
#DataIntegration #DataOps #DataWarehouse
#DataInfrastructure #DataScience #DataAnalytics
#DataManagement #CloudComputing #DataArchitecture  #ELTprocesses #ETLprocesses #BusinessIntelligence #MachineLearning #BusinessManagement #Computer #DataSciences #Statistics #cloud #DataProcessing #PowerBI #datavisualization #reporting #BigData
#ETL #ELT #DataPipeline #DataIntegration #DataWarehousing
#DataOps #DataInfrastructure #DataArchitecture #DataAnalytics