RLEE - Low-Level Engineering & Kernel Inference Optimization
location_on24;26, Caselli Avenue, Castro District, San Francisco, California, 94114, United States
Job Description
About the Company
Preference Model is building the next generation of training data to power the future of AI. Today's models are powerful but fail to reach their potential across diverse use cases because so many of the tasks that we want to use these models are out of distribution. Preference Model creates RL environments where models encounter research and engineering problems, iterate, and learn from realistic feedback loops.
Our founding team has previous experience on Anthropic's data team building data infrastructure, tokenizers, and datasets behind the Claude model. We are partnering with leading AI labs to push AI closer to achieving its transformative potential.
The company is backed by Tier 1 Silicon Valley VC.
About the Role
We're hiring Low-Level Engineers to design and build RL environments that teach LLMs kernel development, hardware optimization, and systems programming. The goal is to create realistic feedback loops where models learn to write high-performance code across GPU and CPU architectures.
Work location
Work model: Remote
24;26, Caselli Avenue, Castro District, San Francisco, California, 94114, United States
San Francisco, California
Key Responsibilities
- check_circleDesign and build MLE/SWE environments and diverse tasks
- check_circleSWE environments and diverse tasks
- check_circleTarget a specified language model and satisfy the required difficulty distribution
Requirements
- verifiedStrong Python (engineering-quality, not notebook-only)
- verifiedClear understanding of LLMs and limitations
- verifiedAbility to meet throughput expectations
- verified≥4 hours overlap to PST
- verifiedAdvanced English (C1/C2)
- verifiedRemote contractor role
- verifiedDeep understanding of memory hierarchies
- verifiedThreading models and concurrent programming
- verifiedCache coherence and memory access patterns
- verifiedAOT compilation and optimization passes
- verifiedCompiler and kernel frameworks
- verifiedModern C++
- verifiedAssembly-level programming
- verifiedDebugging and optimizing GPU kernels
- verifiedDeveloping PyTorch custom operators