Posts

121. The Penalty Must Fit The Setting

You know what sucks? When you go to the time and effort to set up An Event, for some kind of Thing that you are an expert in and want to help others get better at, or that you want to gather fellow novices for to grow strong together, and then people don't show up at the appointed time, or show up without having done the quick and reasonable preparation they agreed to. It'd be nice if you had some way to more strongly incentivize people to show up prepared and on time. Whatever it is, it can't be too painful or strenuous or humiliating, or people won't show up. Indeed, it can't be that much worse than simply not showing up at all. But by the same token, it needs to be something that people would rather avoid happening. It'd be nice if there was some "eat-your-vegetables" aspect, too, such that everyone can rightly see the practice as a penalty, and not a punishment. Further contemplation of this kind (and of the mechanism design inherent to doing this ...

120. Take Heart, If You Proved A Known Result

(Epistemic status: Morally correct, in the mathematician's sense, and the sort of thing that any good doctoral advisor will tell you.) I still remember the day I proved that successive squares of integers differ by successive odd numbers. I was maybe 6 or 7, and had noticed what looked like a strange coincidence while playing around with numbers, like I often did at the time when bored during recess. I hadn't had any training in how to prove something cleanly, so it took a lot of poking and prodding and a geometric argument based on L-shaped figures that you probably already know. But it was real, and it was mine, and so it was especially crushing when I brought it to Mr. AB (after Mrs. SB, my actual teacher, sent me to him, and to the middle schoolers' room) only to be congratulated on having proven a millennia-old result, all on my own. He must have been impressed at the time, because that was the start of my being allowed to go to the middle schooler's room to look a...

119. If You Invite Me to Apply Unsolicited and Then Drop Me in an Early Round, I'm Going to Blacklist You

(Epistemic status: part prescription, part mechanism design and analysis run in cool anger, part price list, and part call to arms. If you recognize yourself on the other side of this, do better. If you can't recognize yourself on the other side of this, do WAY better. For anyone in AI safety who's spent weekend hours applying, called in favors for recommendations, and got their hopes up, and then received a form letter for their pains.) It's a languid Tuesday evening when the email hits your inbox. "Invitation to Apply for an Upcoming Fellowship" is the topic. You've been trying for a grant, which so far hasn't gone as hoped, so you open it. You recognize the org's name; they do good work. You think their recent paper had some flaws, but on the whole their organizational heart seems to be in the right place, and they're doing the work. "Hello!" it begins. Your name's in the next sentence. "We got your contact info from an alumni...

118. My Least Favorite AI Alignment Plan Schemas That Still Maybe Even Work

(Epistemic status: just, like, my opinion, man. Subtitle: "Well I Thought It Was Already As Heavy As Can Be") AI Friendliness! It'd be nice if we could get that to happen. We are probably not on track to do that, which is deeply scary, but at this point I mostly just have that fact priced in. Better people than me have tried to sketch out one or another plan for how best to align a nascent superintelligence, or better yet rig matters up such that they start off already friendly, or at least in an epistemic posture that leaves them open to unmooted feedback; some have given up on this and are mostly trying to avoid dying especially embarassingly or painfully. For my silver, I think the best plan is and always has been something like "stop moving blindly forwards right now, figure out the respective natures of cognition, agenticity, and moral philosophy (and probably other things), and then use the verified results to train up a superintelligence that will want for lif...

117. Running Up That Hill

(Epistemic status: Probably other people have written in this well-attested frame before but I've been thinking about this for actual decades now and I have more to say.) Here's one riddle in two guises: "Why is it sometimes so hard for me to get through my to-do list?" and "Why aren't flammable substances always on fire?" The answer, in both cases, is "there's an activation energy to overcome". From chemistry, we know that in order for a reaction to take place, it's not enough for the products to be energetically favored over the reactants - the reactants must also overcome the activation energy in order to react. In simpler terms, even if a reaction "wants to take place", the molecules must be sufficiently shaken up - which usually means heat, pressure, or both - to overcome the fact that molecules want to stay apart; "wants to take place" means that (for whatever reason, in some meaningful and technical sense) the...

116. In Defense of High-Effort Food

(Epistemic status: Prescriptive, borne of long experience. Your milage will vary. For JM.) Anyone still up for getting your hedons and utilons separately? Because that's what you get to do when you spend effort on your food. I know it's fashionable these days to aspire to the kind of transhumanism that involves the right blend of peptides and stimulants and nutrient slurry that makes your tragic meat chassis 23% more efficient at converting macronutrients into prompts, but face it: for now, morale is a binding constraint, and if you think that you need not care much about what you eat, you're probably inadequately embodied and trying to figure out why you feel kinda terrible so often. Putting more effort into a dish, moreover, often lets you trade off among effort, monetary cost, and enjoyment much more efficiently than limiting yourself to the three points on the tradeoff surface of "amateurishly throw something together", "beg a housemate for help", an...

115. Hold Your Breath

Image
(If you're reading this right as it's been posted, or precisely some whole number of years afterwards, take a deep breath before you start reading. Hold it for as long as you can. If you finish reading before you must breathe, make a wish, and it will come true (Epistemic status: lol.).)   Why must a counterfactual be breathed into being? The link between air and human volition by way of breath, speech, and the soul is well-attested; Latin roots have inextricably linked the breath to the soul and the soul to one's hopes.  "While there's breath there's hope", as Latin would have it, and even  the world "aspiration" is quite literally to "breathe for" something.  But I think that the link goes deeper than that. Today is 11/11, for one, which is where our first case study starts. The custom of holding your breath at 11:11pm on any given day to make a wish is one of those strange bits of folk ritual that seem to have come from nowhere, righ...