Research Engineer / Research Scientist, Tokens

About the Role

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. As a Research Engineer, you will work across our code and infrastructure—whether improving cluster reliability for large jobs, increasing throughput and efficiency, designing and running scientific experiments, or building development tooling.

*Note: This is an ongoing, evergreen role. Anthropic evaluates candidates continuously across teams.*

Responsibilities & Representative Projects

• Optimizing the throughput of novel attention mechanisms
• Comparing compute efficiency across Transformer variants
• Preparing large datasets (e.g., Wikipedia) in formats consumable by models
• Scaling distributed training jobs across thousands of GPUs
• Writing design documents for fault tolerance strategies
• Creating interactive visualizations of attention between tokens in language models

Qualifications

Minimum Qualifications

• Significant software engineering experience
• Bachelor’s degree in a relevant field, or an equivalent combination of education, training, and/or experience
• Results-oriented mindset with a bias towards flexibility and high impact
• Interest in pair programming and collaborating across disciplines
• Desire to learn more about machine learning research and care about the societal impacts of AI

Preferred Qualifications

• Experience with high-performance, large-scale ML systems
• Familiarity with GPUs, Kubernetes, PyTorch, or OS internals
• Experience in language modeling with transformers
• Experience with reinforcement learning
• Experience handling large-scale ETL pipelines