OpenAI
Researcher, Frontier Risk Mitigations at OpenAI in San Francisco
Job description
ABOUT THE TEAM
Models are becoming increasingly capable—moving from tools that assist humans to agents that can plan, execute, and adapt in the real world. Mitigating the frontier risks resulting from these capabilities is paramount to OpenAI’s ability to continue deploying models safely.
The Preparedness team is dedicated to addressing these critical risks. Our work includes:
1. Measurement. Monitoring and predicting the evolving capabilities of frontier AI systems.
2. Mitigation. Keeping misuse and misalignment safeguards, alignment tools, and security measures on track to adequately address extreme threats that might arise in the future.
3. Coordination. Setting mitigation targets by maintaining OpenAI’s preparedness framework https://openai.com/index/updating-our-preparedness-framework/, and partnering with other staff to achieve these targets.
This is urgent, fast-paced work that has far-reaching implications for the company and for society.
ABOUT THE ROLE
We are seeking exceptional researchers who can push the frontier of safety mitigations. You will help derisk frontier models by developing novel safety mitigations, developing and applying new techniques from domains like interpretability, control, and alignment to ensure the safety of OpenAI’s deployed models. You will play a critical role in defining how a safe AI system should look in the future at OpenAI, making…
This is the opening of the posting. Read the full posting on the OpenAI site ›