Remote Data Engineer
Job Description:
Job Title: Senior Data Engineer
Primary Location: Remote (Must reside in NY, WDC, BOS or CHI)
Position Type: Direct Hire
Overview
TalentFish is casting a line for a Senior Data Engineer. This is a Direct Hire role that is Remote but must reside in NY, WDC, BOS or CHI.
The Senior Data Engineer is responsible for designing, building, and maintaining modern data pipelines and integration solutions within the Azure Cloud. This position plays a key role in enabling enterprise analytics by delivering clean, timely, and well-structured data to platforms like Power BI.
What You Bring to the Role. (Ideal Experience)
7+ years of data engineering or BI development experience
3+ years building data solutions in Microsoft Azure Cloud
2+ years using Azure DevOps for automated builds, releases, and orchestration
Advanced proficiency in Azure Data Factory, Azure Data Lake Storage (Gen2), and Azure Databricks
Strong SQL and ELT experience; familiarity with data modeling (e.g., star, snowflake)
Hands-on experience with PySpark and Databricks notebooks, including Delta Lake workflows
Experience building and managing CI/CD pipelines using Azure DevOps
Familiarity with Git, branching strategies, and Azure Repos
Understanding of data security and privacy in Azure (RBAC, encryption, managed identities)
Experience with structured and semi-structured data formats (Parquet, JSON, Avro)
Experience with Power BI datasets and refresh configurations (preferred)
Familiarity with Microsoft Purview or other data governance/cataloging tools is a plus
Experience in professional services, legal, or financial industries is preferred
Bachelor's degree in Computer Science, Engineering, or a related field
What You'll Do. (Skills Used in this Position)
Design, build, and manage scalable data pipelines using Azure ADF, ADLS, and Databricks
Develop ELT frameworks to ingest and transform data from on-prem and cloud sources
Implement CI/CD pipelines with Azure DevOps for code versioning and deployment
Monitor and optimize pipeline performance using Azure Monitor and Log Analytics
Support Power BI teams by ensuring performant and structured datasets
Automate environment setup and permissions using infrastructure-as-code
Write modular, testable code using Python/PySpark
Perform root cause analysis and production support for data pipelines
Maintain documentation for data processes and system architecture
Work within Agile teams, participating in sprints, standups, and retrospectives
Mentor junior data engineers and champion best practices in DevOps and development
Compensation Information
The expected salary range for this position is 140,000-160,000 per year, depending on experience and qualifications. This role also qualifies for comprehensive benefits such as health insurance, 401(k), and paid time off.
This role requires authorization to work in the U.S. without current or future visa sponsorship.
All offers are contingent upon the completion of a background check, which may include but is not limited to reference checks, education verification, employment verification, drug testing, criminal records checks, and any required certifications or compliance requirements based on the end client's background check policies and applicable laws.
Required Skills:
CI/CD Production Support Compliance Root Cause Analysis Snowflake Modeling Offers Permissions Analysis Azure Authorization Pipelines Agile Data Modeling ROOT Microsoft Azure Salary Checks Compensation DevOps JSON Storage Architecture Insurance Analytics Power BI Integration Computer Science Security Records Education Git Documentation Testing Python SQL Design Engineering Science