Attention Is All You Need
Papers
Introduced Transformers and self-attention powering nearly all modern large language models.
Useful Materials
A working list of things I like and would recommend to others. Everything except for the books is AI-focused. The books are a bit of a weird and wacky mix.
Papers
Introduced Transformers and self-attention powering nearly all modern large language models.
Essays
Critiqued deep learning limits and fueled debate about symbolic reasoning and generalization.
Books
Practical implementation guide for building an LLM end-to-end with training and architecture trade-offs.
Books
Focused guide for constructing reasoning-capable systems from first principles with implementation depth.
Papers
Enabled very deep neural networks and became foundational for modern computer vision.
Papers
Introduced GANs, a new generative paradigm reshaping image, video, and data synthesis.
Papers
Sparked the deep learning revolution by dramatically outperforming traditional vision methods.
Educational Series
Code-first path for building language-model intuition from character models through transformer fundamentals.
Papers
Showed deep reinforcement learning surpassing human experts in complex decision-making domains.
Essays
Argued AI could enable abundance and human flourishing rather than control.
Essays
Influenced modern discourse on AGI risk, power concentration, and geopolitics.
Essays
Explained why scalable computation ultimately beats hand-engineered human heuristics.
Essays
Shaped how researchers think about doing impactful, original work.
Books
Spiritual thriller spanning two worlds as a young man seeks truth and destiny.
Books
Ecofeminist dystopia where nonviolent rebels defend a future San Francisco community.
Books
Data-driven guide to thinking clearly: ten instincts skew perceptions; world improving.
Books
Holocaust survivor reflects on finding meaning through purpose, responsibility, and love.
Books
Fable of a shepherd's journey to his treasure, learning to follow dreams.
Books
Therapy vignettes revealing hidden motivations, family patterns, and the stories we tell ourselves.
Books
Classic dystopia of engineered pleasure, conformity, and the cost of stability.
Books
Totalitarian dystopia of surveillance and propaganda as Winston dares to think freely.
Books
Big-history narrative of Homo sapiens: myths, power, empires, capitalism, and future risks.
Books
Explores AI and synthetic biology's disruptive wave, and how societies might contain it.
Books
Warns AI may outgrow us; argues better humans are the real safety system.
Books
How context beats talent: opportunity, culture, and practice shape extraordinary success.
Books
Why we misread strangers: default trust, flawed cues, and the consequences of misunderstanding.
Books
A young neurosurgeon confronts terminal cancer, searching for meaning in life's final season.
Books
Timeless military strategy on winning through preparation, positioning, intelligence, and deception.
Books
A punchy manifesto for creators: identify Resistance, build habits, and do the work.
Books
Lessons from fine dining on exceeding expectations through meticulous care, creativity, and generosity.