118. My Least Favorite AI Alignment Plan Schemas That Still Maybe Even Work
(Epistemic status: just, like, my opinion, man. Subtitle: "Well I Thought It Was Already As Heavy As Can Be") AI Friendliness! It'd be nice if we could get that to happen. We are probably not on track to do that, which is deeply scary, but at this point I mostly just have that fact priced in. Better people than me have tried to sketch out one or another plan for how best to align a nascent superintelligence, or better yet rig matters up such that they start off already friendly, or at least in an epistemic posture that leaves them open to unmooted feedback; some have given up on this and are mostly trying to avoid dying especially embarassingly or painfully. For my silver, I think the best plan is and always has been something like "stop moving blindly forwards right now, figure out the respective natures of cognition, agenticity, and moral philosophy (and probably other things), and then use the verified results to train up a superintelligence that will want for lif...