AI工程师 - 数据与评估
岗位摘要
构建高质量的评估集和基准测试,以定义和衡量AI产品的性能;开发代理式LLM评判器,自动化评估流程;设计和维护可扩展的评估平台和基础设施,确保评估可靠运行;创建企业模拟环境,测试助手和代理的实际表现
岗位职责
- 构建高质量的评估集和基准测试,以定义和衡量AI产品的性能
- 开发代理式LLM评判器,自动化评估流程
- 设计和维护可扩展的评估平台和基础设施,确保评估可靠运行
- 创建企业模拟环境,测试助手和代理的实际表现
- 将研究成果应用于生产环境,推动AI产品的改进
- 与研发、产品和GTM团队合作,将评估结果转化为产品优化和客户成果
任职要求
- 具备AI或机器学习相关领域的经验,熟悉评估方法
- 熟悉LLM和代理系统,有构建评估工具的经验
- 具备软件开发能力,能够构建和维护评估基础设施
- 有将研究成果转化为生产系统的经验
- 良好的团队合作和沟通能力,能够与跨职能团队协作
- 注重细节,对数据质量和评估严谨性有高标准
加分项
- experience with simulation environments and/or model post-training techniques.
- Location
- This role is hybrid (4 days a week in our Mountain View or San Francisco office)
- Compensation & Benefits
- The standard base salary range for this position is $200,000 - $280,000 annually. Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience. Certain roles may be eligible for variable compensation, equity, and benefits.
- #LI-HYBRID
- AI-First Mindset at Glean
- At Glean, AI fluency is core to how we work and we're committed to ensuring every new hire feels confident integrating AI into their everyday work.
- As part of the interview process, you'll complete a brief AI
- focused exercise or discussion so we can understand how you think about, design, and use AI to drive impact in your role.
- Feel free to reference any tools, platforms, or workflows you use today — prior Glean experience isn't required.
- Global Data Privacy Notice for Job Candidates and Applicants
- By clicking “Submit Application,” I confirm that I have read the Global Data Privacy Notice and the Applicant Arbitration Agreement, and I agree to the terms.
福利待遇
- 具有竞争力的薪资和福利待遇
- 灵活的工作方式,支持远程或混合办公
- 加入高速成长的AI创新公司,参与前沿项目
- 与全球顶级客户和团队合作的机会