研究员，错位监控负责人
岗位摘要
领导评估和改进前沿AI系统错位监控的研究和技术方向；设计并执行严谨的评估，衡量监控器有效性，识别失败模式，并评估监控信号的可靠性；开发对监控器进行压力测试和红队测试的方法，包括识别逃避检测或暴露现有方法弱点的行为
岗位职责
- 领导评估和改进前沿AI系统错位监控的研究和技术方向
- 设计并执行严谨的评估，衡量监控器有效性，识别失败模式，并评估监控信号的可靠性
- 开发对监控器进行压力测试和红队测试的方法，包括识别逃避检测或暴露现有方法弱点的行为
- 调查误报、漏检和其他监控失败，以提高安全评估的准确性和实用性
- 构建可扩展的评估框架和实验工具，以便随着模型能力演变持续测量监控性能
- 将研究发现转化为可操作的改进，与合作伙伴团队合作加强监控系统并为更广泛的安全决策提供信息
- 确定研究优先级并指导技术执行，平衡基础研究问题与实际部署需求
任职要求
- 在机器学习研究方面有深厚背景，特别是在模型评估、AI安全、对齐、鲁棒性等相关领域
- 已证明有能力领导具有技术挑战性的研究项目，从识别重要问题到设计实验并交付结果
- 具备强大的实验判断力，理解如何设计严谨、可重复且难以被钻空子的评估
- 具有构建或评估机器学习系统的实际经验，包括使用大型语言模型或其他前沿AI系统
- 喜欢调查复杂的失败模式，并开发方法区分有意义的安全信号与误导性测量
- 能够自如地处理开放式研究问题，而正确的方法或成功标准在开始时可能并不明显
- 将强大的研究直觉与实践工程能力相结合，能够独立构建实验、分析结果并快速迭代
- 清晰地沟通技术发现
加分项
- Experience with AI monitoring, automated evaluations, adversarial testing, or red-teaming.
- Research experience in scalable oversight, AI control, model behavior analysis, or interpretability.
- Experience developing monitoring or evaluation systems that are used in real-world deployments.
- A track record of technical research leadership, including mentoring researchers or coordinating cross-functional research initiatives.
- About OpenAI
- For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement https://cdn.openai.com/policies/eeo-policy-statement.pdf.
- Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US
- based candidates.
- For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage
- return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment
- and maintain the confidentiality of proprietary, confidential, and non
- public information.
- In addition, job duties require access to secure and protected information technology systems and related data security obligations.
- To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form https://form.asana.com/?d=57018692298241&k=5MqR40fZd7jlxVUh5J-UeA. No response will be provided to inquiries unrelated to job posting compliance.
- We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link https://form.asana.com/?k=bQ7w9h3iexRlicUdWRiwvg&d=57018692298241.