<![CDATA[EigenState]]>e02ace6b-d92d-51ec-86cb-46f5eeb05d55Wed, 01 Jul 2026 17:38:51 +0000Captivate.fmShinde Adityahttps://artwork.captivate.fm/2f08331f-0a7d-4c9c-9391-572a3612aa95/EigenState-3.pngEigenStateShinde AdityaShinde AdityaEigenState is a long-form science and technology podcast exploring the physical foundations of intelligence, computation, mathematics, and emerging technologies. Each series investigates a fundamental question shaping the future of civilization: Why does intelligence require energy? Why does AI live inside geometry? What are the limits of computation? And what happens when physics becomes the bottleneck? Through deep narratives, scientific history, and first-principles reasoning, EigenState connects information theory, artificial intelligence, physics, mathematics, robotics, and complex systems into a coherent picture of how reality computes itself. Hosted by Shinde Aditya.https://www.eigenstate.devfalseepisodic9c4da8a0-7573-11f1-a8e0-efbaf07e3a6enopodcastThe Thermodynamics of Intelligence: Why AI Can't Think for FreeThe Thermodynamics of Intelligence: Why AI Can't Think for FreeWhy does the human brain operate on roughly twenty watts while modern artificial intelligence systems consume megawatts?

The answer begins with an unexpected claim: information is physical.

For decades, information was treated as an abstract mathematical object—a sequence of symbols detached from the material world. But twentieth-century physics revealed something deeper. Every bit of information must be embodied in a physical system: a neuron, a transistor, a magnetic domain, a molecule of DNA.

Once information becomes physical, it must obey the laws of physics.

In this episode, we trace the surprising connection between information, entropy, memory, and energy. We explore how Claude Shannon transformed information into a measurable quantity, how Maxwell's Demon challenged the Second Law of Thermodynamics, and how Rolf Landauer discovered the hidden thermodynamic cost of erasing information.

Along the way, we connect these ideas directly to modern artificial intelligence. Training a neural network is not simply a computational process—it is a continuous cycle of correction, revision, and controlled forgetting. Every update rewrites internal states. Every rewrite has a physical cost.

The result is a startling conclusion:

"The universe does not charge for knowing. It charges for forgetting."

Estimated Difficulty: Intermediate

Prerequisites: None

Helpful Background: Basic familiarity with AI, computers, or high-school physics will enhance the experience, but all major concepts are introduced from first principles.

Topics Covered

  • Information Theory
  • Entropy
  • Thermodynamics
  • Claude Shannon
  • Maxwell's Demon
  • Leó Szilárd
  • Rolf Landauer
  • Charles Bennett
  • Landauer's Principle
  • Artificial Intelligence
  • Neural Networks
  • Backpropagation
  • Gradient Descent
  • GPU Architecture
  • Data Center Energy Consumption
  • Silicon vs Biology
  • Reversible Computing
  • Neuromorphic Computing
  • Physics of Intelligence

People Mentioned

  • Claude Shannon (1916-2001) - Founder of modern information theory.
  • James Clerk Maxwell (1831–1879) - Creator of Maxwell's Demon.
  • Leó Szilárd (1898–1964) - Connected information and thermodynamics in 1929.
  • Rolf Landauer (1927–1999) - IBM physicist.
  • Charles Bennett - Extended Landauer's work and helped resolve Maxwell's Demon.

Recommended Reading

Beginner

The Information - James Gleick

A narrative history of information theory and communication.

Link: https://eigenstate.captivate.fm/the-information-james-gleick

How to Create a Mind - Ray Kurzweil

Explores intelligence from biological and computational perspectives.

Link: https://eigenstate.captivate.fm/how-to-create-a-mind-ray-kurzweil

Intermediate

Gödel, Escher, Bach - Douglas Hofstadter

One of the deepest explorations of information, intelligence, and self-reference ever written.

Link: https://eigenstate.captivate.fm/godel-escher-bach-douglas-hofstadter

The Emperor's New Mind - Roger Penrose

A physicist's critique of computational theories of mind.

Link: https://eigenstate.captivate.fm/the-emperors-new-mind-roger-penrose

Advanced

5. Information Theory, Inference and Learning Algorithms - David MacKay

One of the definitive texts connecting information theory and machine learning.

Link: https://eigenstate.captivate.fm/information-theory-david-mackay

PRIMARY SOURCES

  1. Claude Shannon (1948) - A Mathematical Theory of Communication
  2. Rolf Landauer (1961) - Irreversibility and Heat Generation in the Computing Process
  3. Charles Bennett (1982) - The Thermodynamics of Computation
  4. Leó Szilárd (1929) - On the Decrease of Entropy in a Thermodynamic System by the Intervention of Intelligent Beings

These papers form the historical foundation of modern information theory, thermodynamics of computation, and the physics of intelligence.

Support EigenState

EigenState is independently researched, written, recorded, and produced.

If you would like to support future episodes:


Next Episode

The Geometry of Intelligence: Why Thoughts Need Coordinates

In the next episode, we move from the laws of thermodynamics to the laws of geometry and explore why linear algebra became the language of intelligence itself.

Website: https://eigenstate.captivate.fm/website

Newsletter: https://eigenstate.captivate.fm/newsletter

Contact: aditya@eigenstate.dev

]]>Why does the human brain operate on roughly twenty watts while modern artificial intelligence systems consume megawatts?

The answer begins with an unexpected claim: information is physical.

For decades, information was treated as an abstract mathematical object—a sequence of symbols detached from the material world. But twentieth-century physics revealed something deeper. Every bit of information must be embodied in a physical system: a neuron, a transistor, a magnetic domain, a molecule of DNA.

Once information becomes physical, it must obey the laws of physics.

In this episode, we trace the surprising connection between information, entropy, memory, and energy. We explore how Claude Shannon transformed information into a measurable quantity, how Maxwell's Demon challenged the Second Law of Thermodynamics, and how Rolf Landauer discovered the hidden thermodynamic cost of erasing information.

Along the way, we connect these ideas directly to modern artificial intelligence. Training a neural network is not simply a computational process—it is a continuous cycle of correction, revision, and controlled forgetting. Every update rewrites internal states. Every rewrite has a physical cost.

The result is a startling conclusion:

"The universe does not charge for knowing. It charges for forgetting."

Estimated Difficulty: Intermediate

Prerequisites: None

Helpful Background: Basic familiarity with AI, computers, or high-school physics will enhance the experience, but all major concepts are introduced from first principles.

Topics Covered

  • Information Theory
  • Entropy
  • Thermodynamics
  • Claude Shannon
  • Maxwell's Demon
  • Leó Szilárd
  • Rolf Landauer
  • Charles Bennett
  • Landauer's Principle
  • Artificial Intelligence
  • Neural Networks
  • Backpropagation
  • Gradient Descent
  • GPU Architecture
  • Data Center Energy Consumption
  • Silicon vs Biology
  • Reversible Computing
  • Neuromorphic Computing
  • Physics of Intelligence

People Mentioned

  • Claude Shannon (1916-2001) - Founder of modern information theory.
  • James Clerk Maxwell (1831–1879) - Creator of Maxwell's Demon.
  • Leó Szilárd (1898–1964) - Connected information and thermodynamics in 1929.
  • Rolf Landauer (1927–1999) - IBM physicist.
  • Charles Bennett - Extended Landauer's work and helped resolve Maxwell's Demon.

Recommended Reading

Beginner

The Information - James Gleick

A narrative history of information theory and communication.

Link: https://eigenstate.captivate.fm/the-information-james-gleick

How to Create a Mind - Ray Kurzweil

Explores intelligence from biological and computational perspectives.

Link: https://eigenstate.captivate.fm/how-to-create-a-mind-ray-kurzweil

Intermediate

Gödel, Escher, Bach - Douglas Hofstadter

One of the deepest explorations of information, intelligence, and self-reference ever written.

Link: https://eigenstate.captivate.fm/godel-escher-bach-douglas-hofstadter

The Emperor's New Mind - Roger Penrose

A physicist's critique of computational theories of mind.

Link: https://eigenstate.captivate.fm/the-emperors-new-mind-roger-penrose

Advanced

5. Information Theory, Inference and Learning Algorithms - David MacKay

One of the definitive texts connecting information theory and machine learning.

Link: https://eigenstate.captivate.fm/information-theory-david-mackay

PRIMARY SOURCES

  1. Claude Shannon (1948) - A Mathematical Theory of Communication
  2. Rolf Landauer (1961) - Irreversibility and Heat Generation in the Computing Process
  3. Charles Bennett (1982) - The Thermodynamics of Computation
  4. Leó Szilárd (1929) - On the Decrease of Entropy in a Thermodynamic System by the Intervention of Intelligent Beings

These papers form the historical foundation of modern information theory, thermodynamics of computation, and the physics of intelligence.

Support EigenState

EigenState is independently researched, written, recorded, and produced.

If you would like to support future episodes:


Next Episode

The Geometry of Intelligence: Why Thoughts Need Coordinates

In the next episode, we move from the laws of thermodynamics to the laws of geometry and explore why linear algebra became the language of intelligence itself.

Website: https://eigenstate.captivate.fm/website

Newsletter: https://eigenstate.captivate.fm/newsletter

Contact: aditya@eigenstate.dev

]]>f005ed39-605a-4c19-9dd9-e42d4a9b4af4Tue, 23 Jun 2026 05:58:00 -040026:51falsefull1111