Job Openings
Sr. Data Engineer
About the job Sr. Data Engineer
Job Title: Senior Data Engineer
(This is not a Data Science role)
This is FTE role. Candidates who currently live within commutable distance from Waltham, MA or Long Island, NY will only be considered.
The company is aggressively transforming into a 21st century data-driven organization for its customers. We are building a team that will be responsible for Data Engineering and MLOps. The team will develop data pipelines, take data science prototype models to production, monitor operations and standup the necessary infrastructure in Azure to perform these functions.
Key Accountabilities
- Work with data scientists to specify data requirements for data science projects.
- Work with data owners to understand the data schema, the nature of data flow within the enterprise, and develop data dictionaries.
- Develop a deep understanding of the ingested data from a business perspective.
- Design robust, scalable, and maintainable data ingestion ETL/ELT pipelines.
- Choose appropriate data models and ensure that ingested data is high quality.
- Write high quality code that has high test coverage.
- Participate in code reviews to help improve code quality.
- Supervisory/Interpersonal- Experience Required
- Experience in project management and stakeholder-based delivery.
Qualifications
- Bachelor’s degree in a computer science or another quantitative field.
- 5+ years of experience in a Data Engineer role
- Minimum of 5 years’ experience in advanced data processing and software development is desired.
- Experience in deploying pipelines using Apache Airflow.
- Proficient/expert level hands-on knowledge of shell scripting, Python, SQL, Azure, or AWS.
- Experience in extracting data using REST APIs and from databases (Oracle, MSSQL)
- Experience with Dockers and Kubernetes are pluses
- Ideally, experience in administering Windows and/or Linux servers.
- Be intellectually curious and enjoy learning