Founding ML Engineer
Job Description:
Founding ML Engineer
Location: Strongly Preferred New York City (4 days/week)
Position Type: Full-Time (Permanent)
Work Policy: Remote, Hybrid, or In-Office (U.S. only)
Start Timeline: ASAP
Work location & travel expectations
Preferred Office: NYC (4 days/week)
Alternate: SF with 1 week/month NYC travel
Remote: U.S. only; must travel to NYC 2 weeks/month during initial ramp-up phase
Compensation
Base Salary: $0 $200,000 (dependent on interview performance, level, and location)
Equity: Competitive
About
A legal AI startup reinventing how in-house legal teams operate by automating slow and repetitive workflows.
Founded: 2025
Stage: Seed (Raised $3M)
Traction: Already has customers and ~10 design partners
Backed by: Sequoia
Platform: Legal intake and automation hub supporting redlining, drafting, and Q&A via customizable AI agents
Public Launch: Planned for Fall 2025
Role summary
Hiring the first ML engineer to productionize legal AI workflows. This is a senior-level role focused on architecting agentic systems using LLMs, building scalable evaluation frameworks, and owning end-to-end deployment. Youll collaborate directly with founders, take full ownership of ML systems, and play a foundational role in shaping the AI stack.
Why join
Join a Sequoia-backed AI startup from the ground floor
Define core ML architecture and ship agentic legal AI products
Grow into Head of AI or CTO as company scales
High-impact technical role with leadership trajectory
Relocation support up to $10K for the right candidate
Tech environment
Core Stack: Node, React, GCP, Postgres
ML Tools: Python, OpenAI, LangChain (or equivalent), cloud ML
Responsibilities
Architect and deploy LLM-based pipelines using OpenAI, Anthropic, Gemini, etc.
Build agentic solutions for document redlining, Q&A, and legal drafting
Collaborate with legal SMEs to refine prompt strategies, evaluation metrics, and feedback loops
Optimize inference for latency, cost, and reliability on GCP
Implement data annotation, model monitoring, and CI/CD for ML
Mentor future ML hires as team scales
Must-have qualifications
4-5 years ML/AI engineering experience, including production LLM work
Proven examples of shipped agentic solutions (e.g., multi-agent systems, tool-enabled agents)
Hands-on expertise with prompt engineering, chain-of-thought, and few-shot techniques
Strong Python engineering skills and experience deploying to cloud (preferably GCP)
Ability to work with non-technical stakeholders and translate needs into ML pipelines
Ownership mentality and ability to thrive in a startup environment
Preferred qualifications
Experience in legal-tech or other regulated industries
Familiarity with LLM evaluation platforms and A/B testing methodologies
Background in NLP fine-tuning or information retrieval
Transitioned from SWE MLE
Must NOT have
Experience limited to research-only ML roles
Career background exclusively at non-tech or legacy companies (e.g., banks, healthcare, Cisco, Oracle, etc.)
Interview process
Founder Intro Call (30m): Informal chat or coffee (Zoom or in-person)
Technical Interview (60m):
30m design/architecture discussion
30m coding assessment (candidate choice of language + IDE)
Half-Day Onsite: Details TBD
Required Skills:
Gcp Coffee A/B Testing Chat CI/CD Pipelines Zoom Ownership Hiring Salary React Healthcare Compensation Metrics Travel Reliability Architecture Automation Oracle Testing Design Engineering Python Leadership
Salary Package:
$ 0.00 - 200,000.00 (US Dollar)