What do we want AI to align to?
Published:
I want to write on the potentially important problems AI Alignment may fail to solve—or even create—which the alignment community has largely ignored. There is too much BS in AI alignment, I will not focus on far-fetched scenarios like a malevolent AI dominating humanity. Of course, my arguments might become irrelevant in the face of a perfect, “ultimate” AI. But we can’t just wave our hands and defer all of today’s problems to some hypothetical future intelligence. We live in the here and now.