AI Engineer

Summary

Our Compiler R&D team is developing a next generation machine learning compiler that integrates the latest in code generating LLMs into our compilation flow.

We're looking for an AI engineer with experience in code generating LLMs, and a strong background in building and evaluating AI agents.

This job is based in either Gdansk or New York City. Remote work will be considered for exceptional candidates.

About Mako

Mako is a venture-backed tech startup building software infrastructure for high-performance AI inference and training on any hardware. There are three core components:

1. Mako Compiler automatically selects, tunes, and generates GPU kernels for any hardware platform (you'll be working on this!)
2. Mako Runtime serves compiled models at high-performance
3. Mako Platform enables users to easily deploy and manage deployments across clouds

Responsibilities

• Explore and analyze performance of various LLMs in terms of tool use and code generation
• Develop tools and APIs for LLMs to use in the process of generating and augmenting GPU kernels
• Implement programming solutions in C/C++ and Python.

Qualifications

• Strong programming skills in C/C++ and Python.
• Experience developing AI agents that leverage LLMs and external tools
• General experience with the training, fine-tuning, and deployment of LLMs

Bonus Points

• Proven experience with kernel optimizations on CUDA, ROCm, or other accelerators
• Deep understanding and experience in GPU performance optimizations

Our Benefits

• Competitive salary and equity package
• Comprehensive health insurance coverage for you and your family
• Remote work option for exceptional candidates
• Generous vacation and paid time off policy
• Modern and comfortable work environment with state-of-the-art equipment and facilities