Data Scientist

Job Description:

Data Scientist

1. Develop and maintain data pipelines for processing large datasets using

Python and relevant libraries such as Pandas and NumPy.

2. Parse log files and other data sources to extract relevant information and

insights.

3. Connect to various databases and APIs to fetch, manipulate and store data

as required.

4. Design and develop efficient data structures and algorithms for data

processing, cleaning, and analysis.

5. Lead projects end-to-end, and collaborate with cross-functional teams,

including data scientists, analysts, and product managers.

6. Write clean, maintainable, and scalable code, with a strong emphasis on

testing and documentation.

7. Set up and manage scheduling tools, such as Airflow, to automate data

processing tasks.

8. Continuously improve the efficiency and effectiveness of data pipelines, by

identifying and implementing best practices and new technologies.

9. Ensure code is version-controlled and collaborate with other team

members using Git.