OpenAI Blog · Jan 31, 2024
Building an early warning system for LLM-aided biological threat creation
Reviewed by Errol Vogt, Site support technician & online learning analyst · original summary · editorial policy
Building an early warning system for LLM-aided biological threat creation. We’re developing a blueprint for evaluating the risk that a large language model (LLM) could aid someone in creating a biological threat. In an evaluation involving both biology experts and students, we found that GPT-4 provides at most a mild uplift in biological threat creation accuracy. While this uplift is not large enough to be conclusive, our finding is a starting point for continued research and community deliberation. This update is relevant for small-office operators tracking changes in their tools.
Operator takeaway: For operators: review whether 'Building an early warning system for LLM-aided biological threat creation' affects your current setup before relying on it in production.
ai