Thoughts on AI, technology, and physics and math.
Quantum computing exploits two phenomena with no classical analog, superposition and entanglement, to perform certain calculations faster than any known classical algorithm, and super-polynomially faster in the case of factoring. The mathematics requires only linear algebra over the complex numbers; …
Read more →The transformer architecture, introduced in the 2017 paper Attention Is All You Need, changed how we process sequences. Unlike recurrent networks that process tokens one at a time, transformers process entire sequences in parallel using a mechanism called self-attention. Input …
Read more →Quantum Electrodynamics (QED) is the quantum field theory that describes how light and matter interact. It underlies electricity, magnetism, and light, and it is among the most precisely tested theories in science: its prediction for the electron's magnetic moment matches …
Read more →String theory is an ambitious and controversial project in the history of physics. Its central claim is simple: the fundamental constituents of nature are tiny one-dimensional objects called strings, in place of point-like particles. Whether those strings are open (with …
Read more →AI capabilities are advancing quickly, and that makes one question urgent: how do we make sure these systems are good for people? What Does Responsible AI Mean? Responsible AI is a cluster of practices, values, and commitments that cut across …
Read more →Large language models (LLMs) like GPT-4 and Claude have become household names, while the mechanics behind them stay opaque to most people. It All Starts with Text An LLM is a machine that predicts the next word, or more precisely …
Read more →