What would happen if there was alignment failure with a superintelligence?

Most likely, if a misaligned superintelligence comes to exist, the world and universe as we know it would get dismantled for raw materials to create something we wouldn’t find relevant. Most formulations of values, even ones that look good to human eyes, ultimately devolve into this failure mode, because we don’t fully understand what makes an object morally relevant.



AISafety.info

We’re a global team of specialists and volunteers from various backgrounds who want to ensure that the effects of future AI are beneficial rather than catastrophic.

© AISafety.info, 2022—1970

Aisafety.info is an Ashgro Inc Project. Ashgro Inc (EIN: 88-4232889) is a 501(c)(3) Public Charity incorporated in Delaware.