Information Theory

Explore recommended reads, summarized by AI

Foundations and Concepts

Explanations of core information theory principles including entropy, Shannon information, and surprise.

Entropy and Shannon Information

Theoretical Frameworks

Original theories connecting information principles to consciousness, quantum mechanics, and physical systems.

Information-Based Models of Physics and Consciousness

Popular this week

David

Probabilistic Record Matching for Linking User Devices

Sep 30

Mathcube

The Shannon Limit, and the Codes Nobody Could Find

Sep 28

MLB Technology Blog

Clint Rorick

Scout Insights — Automating the “Whoa! Didn’t Know That” Feeling

Oct 7

Dhiraj Salian

Information Theory for ML: Entropy, Cross-Entropy, and KL Divergence

Nov 1

Starts With A Bang!

Ethan Siegel

The information paradox at the heart of every black hole

Sep 23

Selected by Medium

Science Spectrum

The armchair quantum physicist

Why Isn’t Nature More Quantum?

Oct 22

Mathcube

The Shannon Limit, and the Codes Nobody Could Find

Sep 28

Starts With A Bang!

Ethan Siegel

The information paradox at the heart of every black hole

Sep 23

Science Spectrum

The armchair quantum physicist

The Best Bit Alice Can Send

Aug 10

The Quantastic Journal

Marco Capriz

Foundations of Sand: The Parallel Crisis of Human and Machine Knowledge

May 19

Latest stories

Devanik Debnath

Life as an Information Channel: Can Proteins Compute, Encode, and Transmit Information Through…

10h ago

Adityamane Empirical

Black Hole Entropy: Is a Black Hole a Container or Creator of Entropy?

1d ago

Don Gunter

Dear Sebastian: Where the Carry Lives, in Your Terms

4d ago

Dhiraj Salian

Information Theory for ML: Entropy, Cross-Entropy, and KL Divergence

Nov 1

Balazs Otto Holczmann

The Cosmic Archive Physics says nothing is ever lost. Theology says someone knows the password.

Nov 1

See more stories

Information Theory

Foundations and Concepts

Entropy and Shannon Information

Theoretical Frameworks

Information-Based Models of Physics and Consciousness

Popular this week

Probabilistic Record Matching for Linking User Devices

The Shannon Limit, and the Codes Nobody Could Find

Scout Insights — Automating the “Whoa! Didn’t Know That” Feeling

Information Theory for ML: Entropy, Cross-Entropy, and KL Divergence

The information paradox at the heart of every black hole

Selected by Medium

Why Isn’t Nature More Quantum?

The Shannon Limit, and the Codes Nobody Could Find

The information paradox at the heart of every black hole

The Best Bit Alice Can Send

Foundations of Sand: The Parallel Crisis of Human and Machine Knowledge

Latest stories

Life as an Information Channel: Can Proteins Compute, Encode, and Transmit Information Through…

Black Hole Entropy: Is a Black Hole a Container or Creator of Entropy?

Dear Sebastian: Where the Carry Lives, in Your Terms

Information Theory for ML: Entropy, Cross-Entropy, and KL Divergence

The Cosmic Archive Physics says nothing is ever lost. Theology says someone knows the password.

Who to follow

Popular this week

Probabilistic Record Matching for Linking User Devices

The Shannon Limit, and the Codes Nobody Could Find

Scout Insights — Automating the “Whoa! Didn’t Know That” Feeling

Information Theory for ML: Entropy, Cross-Entropy, and KL Divergence

The information paradox at the heart of every black hole

Selected by Medium

Why Isn’t Nature More Quantum?

The Shannon Limit, and the Codes Nobody Could Find

The information paradox at the heart of every black hole

The Best Bit Alice Can Send

Foundations of Sand: The Parallel Crisis of Human and Machine Knowledge

Latest stories

Life as an Information Channel: Can Proteins Compute, Encode, and Transmit Information Through…

Black Hole Entropy: Is a Black Hole a Container or Creator of Entropy?

Dear Sebastian: Where the Carry Lives, in Your Terms

Information Theory for ML: Entropy, Cross-Entropy, and KL Divergence

The Cosmic Archive Physics says nothing is ever lost. Theology says someone knows the password.

Who to follow