OpenAI Blog · Mar 6, 2019
Introducing Activation Atlases
Reviewed by Errol Vogt, Site support technician & online learning analyst · original summary · editorial policy
Introducing Activation Atlases. We’ve created activation atlases (in collaboration with Google researchers), a new technique for visualizing what interactions between neurons can represent. As AI systems are deployed in increasingly sensitive contexts, having a better understanding of their internal decision-making processes will let us identify weaknesses and investigate failures. This update is relevant for small-office operators tracking changes in their tools.
Operator takeaway: For operators: review whether 'Introducing Activation Atlases' affects your current setup before relying on it in production.
ai