研究实习生，前沿投机解码（2027年冬季）
岗位摘要
研究和原型化新的高效投机解码算法与草稿模型架构；训练、微调和蒸馏草稿模型，设计严谨实验验证假设；为服务引擎实现优化版本，以在真实工作负载中展示有效性；向更广泛团队沟通项目计划、进展和结果
岗位职责
- 研究和原型化新的高效投机解码算法与草稿模型架构
- 训练、微调和蒸馏草稿模型，设计严谨实验验证假设
- 为服务引擎实现优化版本，以在真实工作负载中展示有效性
- 向更广泛团队沟通项目计划、进展和结果
- 通过技术文章和博客分享发现，并帮助将成功想法投入生产
任职要求
- Currently pursuing a Master's or Ph.D. degree in Computer Science, Electrical Engineering, or a related field
- Strong knowledge of Machine Learning and Deep Learning fundamentals
- Hands-on experience training or fine-tuning large models with distributed training frameworks (e.g., Megatron-LM, FSDP)
- Familiarity with modern model architectures, such as Mixture-of-Experts and hybrid attention
- Preferred Qualifications
- Prior research experience in speculative decoding, efficient inference, or efficient machine learning
- Publications at leading conferences in machine learning or systems (e.g., NeurIPS, ICML, ICLR, MLSys)
- Experience with knowledge distillation, post-training, or reinforcement learning
- Familiarity with LLM serving engines (e.g., vLLM, SGLang, TensorRT-LLM)
- Contributions to open-source machine learning projects
- About Together AI
- Together AI, the AI Native Cloud, is purpose
- built for AI engineers.
- AI application developers get high
- performance inference that scales reliably, fine
- tuning and reinforcement learning for creating frontier
- level specialized models, and pre
- training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own.
- Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.
- Internship Program Details
- Our internship program runs 12 to 14 weeks, giving you the opportunity to work alongside industry-leading engineers and researchers across multiple teams. This cohort's internship dates span January 4th to April 9th.
- Compensation
- We offer competitive compensation, housing stipends, and other competitive benefits.
- The estimated US hourly rate for this role is $58
- $70 an hour.
- Our hourly rates are determined by location, level and role.
- Individual compensation will be determined by experience, skills, and job
- related knowledge.
- Equal Opportunity