Joe Carlsmith Audio Thu, 09 Jul 2026 15:27:11 -0400 https://joecarlsmithaudio.buzzsprout.com en-us © 2026 Joe Carlsmith Audio yes 22004d0d-f0d7-5e61-bc1b-8e03602021ac Joe Carlsmith episodic false Buzzsprout (https://www.buzzsprout.com) Joe Carlsmith https://storage.buzzsprout.com/kxwhwzgelp7bmmf2vkilrlfh9ui0?.jpg Joe Carlsmith Audio https://joecarlsmithaudio.buzzsprout.com On restraining AI development for the sake of safety On restraining AI development for the sake of safety My take on slowing down AI. Text version here: https://joecarlsmith.com/2026/03/19/on-restraining-ai-development-for-the-sake-of-safety/

]]> My take on slowing down AI. Text version here: https://joecarlsmith.com/2026/03/19/on-restraining-ai-development-for-the-sake-of-safety/

]]> Joe Carlsmith Buzzsprout-18869440 Thu, 19 Mar 2026 12:00:00 -0400 4941 full false Building AIs that do human-like philosophy Building AIs that do human-like philosophy AIs will face philosophical questions humans can't answer for them. Text version here: https://joecarlsmith.com/2026/01/29/building-ais-that-do-human-like-philosophy/

]]> AIs will face philosophical questions humans can't answer for them. Text version here: https://joecarlsmith.com/2026/01/29/building-ais-that-do-human-like-philosophy/

]]> Joe Carlsmith Buzzsprout-18591342 Thu, 29 Jan 2026 12:00:00 -0500 2013 full false How human-like do safe AI motivations need to be? How human-like do safe AI motivations need to be? AIs with alien motivations can still follow instructions safely on the inputs that matter. Text version here: https://joecarlsmith.com/2025/11/12/how-human-like-do-safe-ai-motivations-need-to-be/

]]> AIs with alien motivations can still follow instructions safely on the inputs that matter. Text version here: https://joecarlsmith.com/2025/11/12/how-human-like-do-safe-ai-motivations-need-to-be/

]]> Joe Carlsmith Buzzsprout-18175429 Wed, 12 Nov 2025 00:00:00 -0500 5012 full false Leaving Open Philanthropy, going to Anthropic Leaving Open Philanthropy, going to Anthropic On a career move, and on AI-safety-focused people working at AI companies. Text version here: https://joecarlsmith.com/2025/11/03/leaving-open-philanthropy-going-to-anthropic/

]]> On a career move, and on AI-safety-focused people working at AI companies. Text version here: https://joecarlsmith.com/2025/11/03/leaving-open-philanthropy-going-to-anthropic/

]]> Joe Carlsmith Buzzsprout-18109395 Mon, 03 Nov 2025 12:00:00 -0500 1929 full false Controlling the options AIs can pursue Controlling the options AIs can pursue On boxing AIs, and on making deals with them. Text version here: https://joecarlsmith.com/2025/09/29/controlling-the-options-ais-can-pursue

]]> On boxing AIs, and on making deals with them. Text version here: https://joecarlsmith.com/2025/09/29/controlling-the-options-ais-can-pursue

]]> Joe Carlsmith Buzzsprout-17909401 Mon, 29 Sep 2025 13:00:00 -0400 3334 full false Giving AIs safe motivations Giving AIs safe motivations A four-step picture. Text version here: https://joecarlsmith.com/2025/08/18/giving-ais-safe-motivations

]]> A four-step picture. Text version here: https://joecarlsmith.com/2025/08/18/giving-ais-safe-motivations

]]> Joe Carlsmith Buzzsprout-17686921 Mon, 18 Aug 2025 04:00:00 -0400 5005 full false The stakes of AI moral status The stakes of AI moral status On seeing and not seeing souls. Text version here: https://joecarlsmith.com/2025/05/21/the-stakes-of-ai-moral-status/

]]> On seeing and not seeing souls. Text version here: https://joecarlsmith.com/2025/05/21/the-stakes-of-ai-moral-status/

]]> Joe Carlsmith Buzzsprout-17201080 Wed, 21 May 2025 13:00:00 -0400 2249 full false Can we safely automate alignment research? Can we safely automate alignment research? It's really important; we've got a real shot; there are a ton of ways to fail. 

Text version here: https://joecarlsmith.com/2025/04/30/can-we-safely-automate-alignment-research/. 

There's also a video and transcript of a talk I gave on this topic here: https://joecarlsmith.com/2025/04/30/video-and-transcript-of-talk-on-automating-alignment-research/

]]> It's really important; we've got a real shot; there are a ton of ways to fail. 

Text version here: https://joecarlsmith.com/2025/04/30/can-we-safely-automate-alignment-research/. 

There's also a video and transcript of a talk I gave on this topic here: https://joecarlsmith.com/2025/04/30/video-and-transcript-of-talk-on-automating-alignment-research/

]]> Joe Carlsmith Buzzsprout-17069901 Wed, 30 Apr 2025 03:00:00 -0400 5378 full false AI for AI safety AI for AI safety We should try extremely hard to use AI labor to help address the alignment problem. Text version here: https://joecarlsmith.com/2025/03/14/ai-for-ai-safety

]]> We should try extremely hard to use AI labor to help address the alignment problem. Text version here: https://joecarlsmith.com/2025/03/14/ai-for-ai-safety

]]> Joe Carlsmith Buzzsprout-16790183 Fri, 14 Mar 2025 01:00:00 -0400 1671 full false Paths and waystations in AI safety Paths and waystations in AI safety On the structure of the path to safe superintelligence, and some possible milestones along the way. Text version here: https://joecarlsmith.substack.com/p/paths-and-waystations-in-ai-safety

]]> On the structure of the path to safe superintelligence, and some possible milestones along the way. Text version here: https://joecarlsmith.substack.com/p/paths-and-waystations-in-ai-safety

]]> Joe Carlsmith Buzzsprout-16768804 Tue, 11 Mar 2025 14:00:00 -0400 1087 full false When should we worry about AI power-seeking? When should we worry about AI power-seeking? Examining the conditions required for rogue AI behavior. Text version here: https://joecarlsmith.substack.com/p/when-should-we-worry-about-ai-power

]]> Examining the conditions required for rogue AI behavior. Text version here: https://joecarlsmith.substack.com/p/when-should-we-worry-about-ai-power

]]> Joe Carlsmith Buzzsprout-16651469 Wed, 19 Feb 2025 13:00:00 -0500 2814 full false What is it to solve the alignment problem? What is it to solve the alignment problem? Also: to avoid it? Handle it? Solve it forever? Solve it completely?

Text version here: https://joecarlsmith.substack.com/p/what-is-it-to-solve-the-alignment

]]> Also: to avoid it? Handle it? Solve it forever? Solve it completely?

Text version here: https://joecarlsmith.substack.com/p/what-is-it-to-solve-the-alignment

]]> Joe Carlsmith Buzzsprout-16617671 Thu, 13 Feb 2025 13:00:00 -0500 2413 full false How do we solve the alignment problem? How do we solve the alignment problem? Introduction to a series of essays about paths to safe and useful superintelligence. 

Text version here: https://joecarlsmith.substack.com/p/how-do-we-solve-the-alignment-problem

]]> Introduction to a series of essays about paths to safe and useful superintelligence. 

Text version here: https://joecarlsmith.substack.com/p/how-do-we-solve-the-alignment-problem

]]> Joe Carlsmith Buzzsprout-16614357 Thu, 13 Feb 2025 12:00:00 -0500 523 full false Fake thinking and real thinking Fake thinking and real thinking When the line pulls at your hand. 

Text version here: https://joecarlsmith.com/2025/01/28/fake-thinking-and-real-thinking/. 


]]> When the line pulls at your hand. 

Text version here: https://joecarlsmith.com/2025/01/28/fake-thinking-and-real-thinking/. 


]]> Joe Carlsmith Buzzsprout-16508960 Tue, 28 Jan 2025 14:00:00 -0500 4727 full false Takes on "Alignment Faking in Large Language Models" Takes on "Alignment Faking in Large Language Models" What can we learn from recent empirical demonstrations of scheming in frontier models? Text version here: https://joecarlsmith.com/2024/12/18/takes-on-alignment-faking-in-large-language-models/

]]> What can we learn from recent empirical demonstrations of scheming in frontier models? Text version here: https://joecarlsmith.com/2024/12/18/takes-on-alignment-faking-in-large-language-models/

]]> Joe Carlsmith Buzzsprout-16299435 Wed, 18 Dec 2024 13:00:00 -0500 5274 full false (Part 2, AI takeover) Extended audio from my conversation with Dwarkesh Patel (Part 2, AI takeover) Extended audio from my conversation with Dwarkesh Patel Extended audio from my conversation with Dwarkesh Patel. This part focuses on the basic story about AI takeover. Transcript available on my website here: https://joecarlsmith.com/2024/09/30/part-2-ai-takeover-extended-audio-transcript-from-my-conversation-with-dwarkesh-patel




]]> Extended audio from my conversation with Dwarkesh Patel. This part focuses on the basic story about AI takeover. Transcript available on my website here: https://joecarlsmith.com/2024/09/30/part-2-ai-takeover-extended-audio-transcript-from-my-conversation-with-dwarkesh-patel




]]> Joe Carlsmith Buzzsprout-15839601 Mon, 30 Sep 2024 15:00:00 -0400 7653 full false (Part 1, Otherness) Extended audio from my conversation with Dwarkesh Patel (Part 1, Otherness) Extended audio from my conversation with Dwarkesh Patel Extended audio from my conversation with Dwarkesh Patel. This part focuses on my series "Otherness and control in the age of AGI." Transcript available on my website here: https://joecarlsmith.com/2024/09/30/part-1-otherness-extended-audio-transcript-from-my-conversation-with-dwarkesh-patel/

]]> Extended audio from my conversation with Dwarkesh Patel. This part focuses on my series "Otherness and control in the age of AGI." Transcript available on my website here: https://joecarlsmith.com/2024/09/30/part-1-otherness-extended-audio-transcript-from-my-conversation-with-dwarkesh-patel/

]]> Buzzsprout-15837885 Mon, 30 Sep 2024 14:00:00 -0400 14318 full false Introduction and summary for "Otherness and control in the age of AGI" Introduction and summary for "Otherness and control in the age of AGI" This is the introduction and summary for my series "Otherness and control in the age of AGI." 

Text version here: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

]]> This is the introduction and summary for my series "Otherness and control in the age of AGI." 

Text version here: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

]]> Joe Carlsmith Buzzsprout-15288085 Fri, 21 Jun 2024 01:00:00 -0400 743 full false Second half of full audio for "Otherness and control in the age of AGI" Second half of full audio for "Otherness and control in the age of AGI" Second half of the full audio for my series on how agents with different values should relate to one another, and on the ethics of seeking and sharing power. 

First half here: https://joecarlsmithaudio.buzzsprout.com/2034731/15266490-first-half-of-full-audio-for-otherness-and-control-in-the-age-of-agi

PDF of the full series here: https://jc.gatspress.com/pdf/otherness_full.pdf
Summary of the series here: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

]]> Second half of the full audio for my series on how agents with different values should relate to one another, and on the ethics of seeking and sharing power. 

First half here: https://joecarlsmithaudio.buzzsprout.com/2034731/15266490-first-half-of-full-audio-for-otherness-and-control-in-the-age-of-agi

PDF of the full series here: https://jc.gatspress.com/pdf/otherness_full.pdf
Summary of the series here: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

]]> Joe Carlsmith Buzzsprout-15272132 Tue, 18 Jun 2024 14:00:00 -0400 15062 full false First half of full audio for "Otherness and control in the age of AGI" First half of full audio for "Otherness and control in the age of AGI" First half of the full audio for my series on how agents with different values should relate to one another, and on the ethics of seeking and sharing power. 

Second half here: https://joecarlsmithaudio.buzzsprout.com/2034731/15272132-second-half-of-full-audio-for-otherness-and-control-in-the-age-of-agi

PDF of the full series here: https://jc.gatspress.com/pdf/otherness_full.pdf
Summary of the series here: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

]]> First half of the full audio for my series on how agents with different values should relate to one another, and on the ethics of seeking and sharing power. 

Second half here: https://joecarlsmithaudio.buzzsprout.com/2034731/15272132-second-half-of-full-audio-for-otherness-and-control-in-the-age-of-agi

PDF of the full series here: https://jc.gatspress.com/pdf/otherness_full.pdf
Summary of the series here: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

]]> Joe Carlsmith Buzzsprout-15266490 Mon, 17 Jun 2024 19:00:00 -0400 11249 full false Loving a world you don't trust Loving a world you don't trust Garden, campfire, healing water.

Text version here: https://joecarlsmith.com/2024/06/18/loving-a-world-you-dont-trust

This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief text summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

]]> Garden, campfire, healing water.

Text version here: https://joecarlsmith.com/2024/06/18/loving-a-world-you-dont-trust

This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief text summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

]]> Joe Carlsmith Buzzsprout-15259745 Sun, 16 Jun 2024 20:00:00 -0400 3834 full false On attunement On attunement Examining a certain kind of meaning-laden receptivity to the world.

Text version here: https://joecarlsmith.com/2024/03/25/on-attunement

This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief text summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

(Though: note that I haven't put the summary post on the podcast yet.)

]]> Examining a certain kind of meaning-laden receptivity to the world.

Text version here: https://joecarlsmith.com/2024/03/25/on-attunement

This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief text summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

(Though: note that I haven't put the summary post on the podcast yet.)

]]> Joe Carlsmith Buzzsprout-14758445 Sun, 24 Mar 2024 20:00:00 -0400 2654 full false On green On green Examining a philosophical vibe that I think contrasts in interesting ways with "deep atheism."

Text version here: https://joecarlsmith.com/2024/03/21/on-green

This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief text summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

(Though: note that I haven't put the summary post on the podcast yet.)

]]> Examining a philosophical vibe that I think contrasts in interesting ways with "deep atheism."

Text version here: https://joecarlsmith.com/2024/03/21/on-green

This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief text summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

(Though: note that I haven't put the summary post on the podcast yet.)

]]> Joe Carlsmith Buzzsprout-14738063 Thu, 21 Mar 2024 12:00:00 -0400 4513 full false On the abolition of man On the abolition of man What does it take to avoid tyranny towards to the future?

Text version here: https://joecarlsmith.com/2024/01/18/on-the-abolition-of-man

This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief text summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

(Though: note that I haven't put the summary post on the podcast yet.)

]]> What does it take to avoid tyranny towards to the future?

Text version here: https://joecarlsmith.com/2024/01/18/on-the-abolition-of-man

This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief text summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

(Though: note that I haven't put the summary post on the podcast yet.)

]]> Joe Carlsmith Buzzsprout-14333032 Thu, 18 Jan 2024 08:00:00 -0500 4162 full false Being nicer than Clippy Being nicer than Clippy Let's be the sort of species that aliens wouldn't fear the way we fear paperclippers.

Text version here: https://joecarlsmith.com/2024/01/16/being-nicer-than-clippy/

This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief text summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

(Though: note that I haven't put the summary post on the podcast yet.)

]]> Let's be the sort of species that aliens wouldn't fear the way we fear paperclippers.

Text version here: https://joecarlsmith.com/2024/01/16/being-nicer-than-clippy/

This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief text summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

(Though: note that I haven't put the summary post on the podcast yet.)

]]> Joe Carlsmith Buzzsprout-14319858 Tue, 16 Jan 2024 11:00:00 -0500 2850 full false An even deeper atheism An even deeper atheism Who isn't a paperclipper?

Text version here: https://joecarlsmith.com/2024/01/11/an-even-deeper-atheism

This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi


]]> Who isn't a paperclipper?

Text version here: https://joecarlsmith.com/2024/01/11/an-even-deeper-atheism

This essay is part of a series I'm calling "Otherness and control in the age of AGI." I'm hoping that individual essays can be read fairly well on their own, but see here for brief summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi


]]> Joe Carlsmith Buzzsprout-14292300 Thu, 11 Jan 2024 11:00:00 -0500 1512 full false Does AI risk "other" the AIs? Does AI risk "other" the AIs? Examining Robin Hanson's critique of the AI risk discourse.

Text version here: https://joecarlsmith.com/2024/01/09/does-ai-risk-other-the-ais

This essay is part of a series of essays called "Otherness and control in the age of AGI." I'm hoping the individual essays can be read fairly well on their own, but see here for brief summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

]]> Examining Robin Hanson's critique of the AI risk discourse.

Text version here: https://joecarlsmith.com/2024/01/09/does-ai-risk-other-the-ais

This essay is part of a series of essays called "Otherness and control in the age of AGI." I'm hoping the individual essays can be read fairly well on their own, but see here for brief summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

]]> Joe Carlsmith Buzzsprout-14279206 Tue, 09 Jan 2024 11:00:00 -0500 795 full false When "yang" goes wrong When "yang" goes wrong On the connection between deep atheism and seeking control. 

Text version here: https://joecarlsmith.com/2024/01/08/when-yang-goes-wrong

This essay is part of a series of essays called "Otherness and control in the age of AGI." I'm hoping the individual essays can be read fairly well on their own, but see here for brief summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

]]> On the connection between deep atheism and seeking control. 

Text version here: https://joecarlsmith.com/2024/01/08/when-yang-goes-wrong

This essay is part of a series of essays called "Otherness and control in the age of AGI." I'm hoping the individual essays can be read fairly well on their own, but see here for brief summaries of the essays that have been released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

]]> Joe Carlsmith Buzzsprout-14271131 Mon, 08 Jan 2024 11:00:00 -0500 1292 full false Deep atheism and AI risk Deep atheism and AI risk On a certain kind of fundamental mistrust towards Nature. 

Text version here: https://joecarlsmith.com/2024/01/04/deep-atheism-and-ai-risk

This is the second essay in my series “Otherness and control in the age of AGI. I’m hoping that the individual essays can be read fairly well on their own, but see here for brief summaries of the essays released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

]]> On a certain kind of fundamental mistrust towards Nature. 

Text version here: https://joecarlsmith.com/2024/01/04/deep-atheism-and-ai-risk

This is the second essay in my series “Otherness and control in the age of AGI. I’m hoping that the individual essays can be read fairly well on their own, but see here for brief summaries of the essays released thus far: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi

]]> Joe Carlsmith Buzzsprout-14246130 Thu, 04 Jan 2024 04:00:00 -0500 2819 full false Gentleness and the artificial Other Gentleness and the artificial Other AIs as fellow creatures. And on getting eaten. 

Link: https://joecarlsmith.com/2024/01/02/gentleness-and-the-artificial-other

This is the first essay in a series of essays that I’m calling “Otherness and control in the age of AGI.” See here for more about the series as a whole: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi.

]]> AIs as fellow creatures. And on getting eaten. 

Link: https://joecarlsmith.com/2024/01/02/gentleness-and-the-artificial-other

This is the first essay in a series of essays that I’m calling “Otherness and control in the age of AGI.” See here for more about the series as a whole: https://joecarlsmith.com/2024/01/02/otherness-and-control-in-the-age-of-agi.

]]> Joe Carlsmith Buzzsprout-14233021 Mon, 01 Jan 2024 23:00:00 -0500 1359 full false In search of benevolence (or: what should you get Clippy for Christmas?) In search of benevolence (or: what should you get Clippy for Christmas?) What is altruism towards a paperclipper? Can you paint with all the colors of the wind at once? 

(This is a recording of an essay originally published in 2021. Text here: https://joecarlsmith.com/2021/07/19/in-search-of-benevolence-or-what-should-you-get-clippy-for-christmas)

]]> What is altruism towards a paperclipper? Can you paint with all the colors of the wind at once? 

(This is a recording of an essay originally published in 2021. Text here: https://joecarlsmith.com/2021/07/19/in-search-of-benevolence-or-what-should-you-get-clippy-for-christmas)

]]> Joe Carlsmith Buzzsprout-14207901 Wed, 27 Dec 2023 00:00:00 -0500 3172 full false Empirical work that might shed light on scheming (Section 6 of "Scheming AIs") Empirical work that might shed light on scheming (Section 6 of "Scheming AIs") This is section 6 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 6 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984952 Thu, 16 Nov 2023 11:00:00 -0500 1680 full false Summing up "Scheming AIs" (Section 5) Summing up "Scheming AIs" (Section 5) This is section 5 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 5 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984949 Thu, 16 Nov 2023 11:00:00 -0500 946 full false Speed arguments against scheming (Section 4.4-4.7 of "Scheming AIs") Speed arguments against scheming (Section 4.4-4.7 of "Scheming AIs") This is section 4.4 through 4.7 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 4.4 through 4.7 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984943 Thu, 16 Nov 2023 11:00:00 -0500 919 full false Simplicity arguments for scheming (Section 4.3 of "Scheming AIs") Simplicity arguments for scheming (Section 4.3 of "Scheming AIs") This is section 4.3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 4.3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984933 Thu, 16 Nov 2023 11:00:00 -0500 1177 full false The counting argument for scheming (Sections 4.1 and 4.2 of "Scheming AIs") The counting argument for scheming (Sections 4.1 and 4.2 of "Scheming AIs") This is sections 4.1 and 4.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is sections 4.1 and 4.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984927 Thu, 16 Nov 2023 11:00:00 -0500 640 full false Arguments for/against scheming that focus on the path SGD takes (Section 3 of "Scheming AIs") Arguments for/against scheming that focus on the path SGD takes (Section 3 of "Scheming AIs") This is section 3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984918 Thu, 16 Nov 2023 11:00:00 -0500 1743 full false Non-classic stories about scheming (Section 2.3.2 of "Scheming AIs") Non-classic stories about scheming (Section 2.3.2 of "Scheming AIs") This is section 2.3.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 2.3.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984902 Thu, 16 Nov 2023 11:00:00 -0500 1474 full false Does scheming lead to adequate future empowerment? (Section 2.3.1.2 of "Scheming AIs") Does scheming lead to adequate future empowerment? (Section 2.3.1.2 of "Scheming AIs") This is section 2.3.1.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 2.3.1.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984895 Thu, 16 Nov 2023 11:00:00 -0500 1374 full false The goal-guarding hypothesis (Section 2.3.1.1 of "Scheming AIs") The goal-guarding hypothesis (Section 2.3.1.1 of "Scheming AIs") This is section 2.3.1.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 2.3.1.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984880 Thu, 16 Nov 2023 11:00:00 -0500 1151 full false How useful for alignment-relevant work are AIs with short-term goals? (Section 2.2.4.3 of "Scheming AIs") How useful for alignment-relevant work are AIs with short-term goals? (Section 2.2.4.3 of "Scheming AIs") This is section 2.2.4.3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 2.2.4.3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984873 Thu, 16 Nov 2023 11:00:00 -0500 561 full false Is scheming more likely if you train models to have long-term goals? (Sections 2.2.4.1-2.2.4.2 of "Scheming AIs") Is scheming more likely if you train models to have long-term goals? (Sections 2.2.4.1-2.2.4.2 of "Scheming AIs") This is sections 2.2.4.1-2.2.4.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is sections 2.2.4.1-2.2.4.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984855 Thu, 16 Nov 2023 11:00:00 -0500 541 full false "Clean" vs. "messy" goal-directedness (Section 2.2.3 of "Scheming AIs") "Clean" vs. "messy" goal-directedness (Section 2.2.3 of "Scheming AIs") This is section 2.2.3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 2.2.3 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984850 Thu, 16 Nov 2023 10:00:00 -0500 1004 full false Two sources of beyond-episode goals (Section 2.2.2 of "Scheming AIs") Two sources of beyond-episode goals (Section 2.2.2 of "Scheming AIs") This is section 2.2.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 2.2.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984837 Thu, 16 Nov 2023 10:00:00 -0500 1285 full false Two concepts of an "episode" (Section 2.2.1 of "Scheming AIs") Two concepts of an "episode" (Section 2.2.1 of "Scheming AIs") This is section 2.2.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 2.2.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984831 Thu, 16 Nov 2023 10:00:00 -0500 728 full false Situational awareness (Section 2.1 of "Scheming AIs") Situational awareness (Section 2.1 of "Scheming AIs") This is section 2.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 2.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984823 Thu, 16 Nov 2023 10:00:00 -0500 567 full false On "slack" in training (Section 1.5 of "Scheming AIs") On "slack" in training (Section 1.5 of "Scheming AIs") This is section 1.5 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 1.5 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984752 Thu, 16 Nov 2023 10:00:00 -0500 432 full false Why focus on schemers in particular? (Sections 1.3-1.4 of "Scheming AIs") Why focus on schemers in particular? (Sections 1.3-1.4 of "Scheming AIs") This is sections 1.3-1.4 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is sections 1.3-1.4 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984742 Thu, 16 Nov 2023 10:00:00 -0500 1877 full false A taxonomy of non-schemer models (Section 1.2 of "Scheming AIs") A taxonomy of non-schemer models (Section 1.2 of "Scheming AIs") This is section 1.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 1.2 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984706 Thu, 16 Nov 2023 10:00:00 -0500 680 full false Varieties of fake alignment (Section 1.1 of "Scheming AIs") Varieties of fake alignment (Section 1.1 of "Scheming AIs") This is section 1.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is section 1.1 of my report “Scheming AIs: Will AIs fake alignment during training in order to get power?” 

Text of the report here: https://arxiv.org/abs/2311.08379
 
Summary of the report here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
 
Audio summary here: https://joecarlsmithaudio.buzzsprout.com/2034731/13969977-introduction-and-summary-of-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13984697 Thu, 16 Nov 2023 10:00:00 -0500 1074 full false Full audio for "Scheming AIs: Will AIs fake alignment during training in order to get power?" Full audio for "Scheming AIs: Will AIs fake alignment during training in order to get power?" This is the full audio for my report "Scheming AIs: Will AIs fake alignment during training in order to get power?"

(I’m also posting audio for individual sections of the report on this podcast, but the ordering was getting messed up on various podcast apps, and I think some people might want one big audio file regardless, so here it is. I’m going to be posting the individual sections one by one, in the right order, over the coming days. )

Full text of the report here: https://arxiv.org/abs/2311.08379
Summary here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> This is the full audio for my report "Scheming AIs: Will AIs fake alignment during training in order to get power?"

(I’m also posting audio for individual sections of the report on this podcast, but the ordering was getting messed up on various podcast apps, and I think some people might want one big audio file regardless, so here it is. I’m going to be posting the individual sections one by one, in the right order, over the coming days. )

Full text of the report here: https://arxiv.org/abs/2311.08379
Summary here: https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power

]]> Joe Carlsmith Buzzsprout-13980105 Wed, 15 Nov 2023 16:00:00 -0500 22397 full false Introduction and summary of "Scheming AIs: Will AIs fake alignment during training in order to get power?" Introduction and summary of "Scheming AIs: Will AIs fake alignment during training in order to get power?" This is a recording of the introductory section of my report "Scheming AIs: Will AIs fake alignment during training in order to get power?".  This section includes a summary of the full report. The summary covers most of the main points and technical terminology, and I'm hoping that it will provide much of the context necessary to understand individual sections of the report on their own. (Note: the text of the report itself may not be public by the time this episode goes live.)

]]> This is a recording of the introductory section of my report "Scheming AIs: Will AIs fake alignment during training in order to get power?".  This section includes a summary of the full report. The summary covers most of the main points and technical terminology, and I'm hoping that it will provide much of the context necessary to understand individual sections of the report on their own. (Note: the text of the report itself may not be public by the time this episode goes live.)

]]> Joe Carlsmith Buzzsprout-13969977 Tue, 14 Nov 2023 10:00:00 -0500 3392 full false In memory of Louise Glück In memory of Louise Glück "It was, she said, a great discovery, albeit my real life."

]]> "It was, she said, a great discovery, albeit my real life."

]]> Joe Carlsmith Buzzsprout-13778055 Sat, 14 Oct 2023 20:00:00 -0400 1282 full false On the limits of idealized values On the limits of idealized values Contra some meta-ethical views, you can't forever aim to approximate the self you would become in idealized conditions. You have to actively create yourself, often in the here and now. 

Originally published in 2021. Text version here: https://joecarlsmith.com/2021/06/21/on-the-limits-of-idealized-values

]]> Contra some meta-ethical views, you can't forever aim to approximate the self you would become in idealized conditions. You have to actively create yourself, often in the here and now. 

Originally published in 2021. Text version here: https://joecarlsmith.com/2021/06/21/on-the-limits-of-idealized-values

]]> Joe Carlsmith Buzzsprout-12833977 Thu, 11 May 2023 23:00:00 -0400 3614 full false Predictable updating about AI risk Predictable updating about AI risk How worried about AI risk will we feel in the future, when we can see advanced machine intelligence up close? We should worry accordingly now. Text version here: https://joecarlsmith.com/2023/05/08/predictable-updating-about-ai-risk 

]]> How worried about AI risk will we feel in the future, when we can see advanced machine intelligence up close? We should worry accordingly now. Text version here: https://joecarlsmith.com/2023/05/08/predictable-updating-about-ai-risk 

]]> Joe Carlsmith Buzzsprout-12809255 Mon, 08 May 2023 16:00:00 -0400 3794 full false Existential Risk from Power-Seeking AI (shorter version) Existential Risk from Power-Seeking AI (shorter version) A shorter version of my report on existential risk from power-seeking AI. Forthcoming in an essay collection from Oxford University Press. Text version here: https://jc.gatspress.com/pdf/existential_risk_and_powerseeking_ai.pdf

]]> A shorter version of my report on existential risk from power-seeking AI. Forthcoming in an essay collection from Oxford University Press. Text version here: https://jc.gatspress.com/pdf/existential_risk_and_powerseeking_ai.pdf

]]> Joe Carlsmith Buzzsprout-12471529 Sun, 19 Mar 2023 18:00:00 -0400 3303 full false Problems of evil Problems of evil Is everything holy? Can reality, in itself, be worthy of reverence? Text version here: https://joecarlsmith.com/2021/04/19/problems-of-evil 

]]> Is everything holy? Can reality, in itself, be worthy of reverence? Text version here: https://joecarlsmith.com/2021/04/19/problems-of-evil 

]]> Joe Carlsmith Buzzsprout-12375237 Sat, 04 Mar 2023 23:00:00 -0500 2142 full false Seeing more whole Seeing more whole On looking out of your own eyes. Text version at joecarlsmith.com.

]]> On looking out of your own eyes. Text version at joecarlsmith.com.

]]> Joe Carlsmith Buzzsprout-12270444 Thu, 16 Feb 2023 20:00:00 -0500 3146 full false Why should ethical anti-realists do ethics? Why should ethical anti-realists do ethics? Who needs a system if you're free? Text version at https://joecarlsmith.com/2023/02/16/why-should-ethical-anti-realists-do-ethics 

]]> Who needs a system if you're free? Text version at https://joecarlsmith.com/2023/02/16/why-should-ethical-anti-realists-do-ethics 

]]> Joe Carlsmith Buzzsprout-12264143 Wed, 15 Feb 2023 22:00:00 -0500 3209 full false Is Power-Seeking AI an Existential Risk? Is Power-Seeking AI an Existential Risk? Audio version of my report on existential risk from power-seeking AI. Text here: https://arxiv.org/pdf/2206.13353.pdf. Narration by Type III audio. 

]]> Audio version of my report on existential risk from power-seeking AI. Text here: https://arxiv.org/pdf/2206.13353.pdf. Narration by Type III audio. 

]]> Joe Carlsmith Buzzsprout-12113681 Tue, 24 Jan 2023 21:00:00 -0500 12062 full false On sincerity On sincerity Nearby is the country they call life. Text version at: https://joecarlsmith.com/2022/12/23/on-sincerity

]]> Nearby is the country they call life. Text version at: https://joecarlsmith.com/2022/12/23/on-sincerity

]]> Joe Carlsmith Buzzsprout-11922489 Fri, 23 Dec 2022 02:00:00 -0500 5702 full false Against meta-ethical hedonism Against meta-ethical hedonism Can the epistemology of consciousness save moral realism and redeem experience machines? No.

]]> Can the epistemology of consciousness save moral realism and redeem experience machines? No.

]]> Joe Carlsmith Buzzsprout-11794630 Thu, 01 Dec 2022 01:00:00 -0500 3749 full false Against the normative realist's wager Against the normative realist's wager If your find a button that gives you a hundred dollars if a certain controversial meta-ethical view is true, but you and your family get burned alive if that view is false, should you press the button? No.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> If your find a button that gives you a hundred dollars if a certain controversial meta-ethical view is true, but you and your family get burned alive if that view is false, should you press the button? No.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> Joe Carlsmith Buzzsprout-11464432 Sun, 09 Oct 2022 04:00:00 -0400 2568 full false On infinite ethics On infinite ethics Infinities puncture the dream of a simple, bullet-biting utilitarianism. But they're everyone's problem.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> Infinities puncture the dream of a simple, bullet-biting utilitarianism. But they're everyone's problem.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> Joe Buzzsprout-11441648 Wed, 05 Oct 2022 01:00:00 -0400 5105 full false Actually possible: thoughts on Utopia Actually possible: thoughts on Utopia Life in the future could be profoundly good. I think this is an extremely important fact, and one that often goes under-estimated.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> Life in the future could be profoundly good. I think this is an extremely important fact, and one that often goes under-estimated.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> Joe Buzzsprout-11441597 Wed, 05 Oct 2022 01:00:00 -0400 1719 full false Against neutrality about creating happy lives Against neutrality about creating happy lives Making happy people is good. Just ask the golden rule.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> Making happy people is good. Just ask the golden rule.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> Joe Buzzsprout-11441531 Wed, 05 Oct 2022 01:00:00 -0400 1399 full false On future people, looking back at 21st century longtermism On future people, looking back at 21st century longtermism I find imagining future people looking back on present-day longtermism (the view that positively influencing the long-term future should be a key moral priority) a helpful intuition pump, especially re: a certain kind of “holy sh**” reaction to existential risk, and to the possible size and quality of the future at stake.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> I find imagining future people looking back on present-day longtermism (the view that positively influencing the long-term future should be a key moral priority) a helpful intuition pump, especially re: a certain kind of “holy sh**” reaction to existential risk, and to the possible size and quality of the future at stake.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> Joe Buzzsprout-11441409 Wed, 05 Oct 2022 00:00:00 -0400 1528 full false Can you control the past? Can you control the past? Sometimes, you can “control” events you have no causal interaction with (for example, if you're a deterministic software twin).

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> Sometimes, you can “control” events you have no causal interaction with (for example, if you're a deterministic software twin).

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> Joe Buzzsprout-11441334 Wed, 05 Oct 2022 00:00:00 -0400 4623 full false Killing the ants Killing the ants If you kill something, look it in the eyes as you do.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> If you kill something, look it in the eyes as you do.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> Joe Buzzsprout-11441225 Tue, 04 Oct 2022 23:00:00 -0400 908 full false On clinging On clinging How can "non-attachment" be compatible with care? We need to distinguish between caring and clinging.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> How can "non-attachment" be compatible with care? We need to distinguish between caring and clinging.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> Joe Buzzsprout-11441156 Tue, 04 Oct 2022 23:00:00 -0400 1068 full false Thoughts on being mortal Thoughts on being mortal You can't keep any of it. The only thing to do is to give it away on purpose.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> You can't keep any of it. The only thing to do is to give it away on purpose.

Text version here.

Edited for Joe Carlsmith by TYPE III AUDIO.

]]> Joe Buzzsprout-11440144 Tue, 04 Oct 2022 22:00:00 -0400 764 full false