# The Beyond Podcast - Jacob Cole Interview (2021) ## Complete Idea Extraction & Highlight Guide Host: Javier Ideami | Guest: Jacob Cole (CEO, IdeaFlow) Additional participants: Linus (programmer/polymath), Ben, Miles --- ## 1. ARTIFICIAL INTELLIGENCE & THE FUTURE OF COGNITION ### Deep Learning vs. Program Synthesis [01:48] **The Universal Duality: Discrete vs. Continuous** - Francois Chollet's theory that deep learning fails on discrete tasks (like addition/multiplication) the way Fourier transforms produce glitches at the corners of a square wave. The future of AI requires a hybrid of continuous (deep learning/System 1) and discrete (program synthesis/System 2) approaches. [04:04] **Humanistic Understanding as Program Synthesis** - Jacob's insight that much of humanistic understanding is more like program synthesis than deep learning, while aesthetics are more like deep learning. This reframes the humanities as fundamentally discrete/logical rather than fuzzy. [04:31] **English as a Programming Language** - Original idea that English can be treated as a weakly-typed programming language (like Python), where sentences can be rewritten in prefix notation. "Jacob threw the ball to Linus" becomes `threw(Jacob, ball, Linus)` with optional arguments. This enables rigorous semantic comparison. [06:50] **The Strange Loop Alternative to Three-Layer AI** - Rather than Chollet's three-layer sandwich (perception -> reasoning -> intuition), Jacob proposes it may be a two-layer system with a strange loop (Godel, Escher, Bach-style feedback), where the output of reasoning feeds back into perception recursively. [08:29] **IDE for English (PyCharm for Natural Language)** - Proposal to build an IDE like PyCharm but for English, where you can hover over pronouns to see antecedents, "decompile" English into its semantic structure, and make rigorous comparisons between texts that say the same thing differently. [09:54] **Decompiling English for Semantic Comparison** - The key insight that written English is like compiled bytecode. To compare meaning across texts, you must "decompile" it back into higher-level semantic structures, enabling dimensionality reduction on meaning. [11:28] **Paraphrase Detection as the Tip of the Iceberg** - Paraphrase detection (recognizing two texts say the same thing) is just the beginning. The deeper problem is recognizing structural isomorphisms - like realizing Avatar is "Dances with Wolves with aliens." [38:00] **GPT-3's Brittleness Problem** - The word "brittle" perfectly captures deep learning's limitation: like using Fourier transforms on discontinuous functions, it works 95% of the time but the missing 5% represents "a completely different level" of capability. [40:42] **Building Companies Forces Hybrid AI** - Market forces will naturally push AI companies toward hybrid approaches (combining deep learning with other tools) because real-world products demand solutions that actually work, not just research demos. ### Intelligence as Analogy [03:19] **Intelligence as Analogy-Finding (Chollet/Hofstadter)** - Intelligence is the ability to find analogies between concepts. We can extrapolate (unlike deep learning which interpolates) because the universe is composed of repeated patterns at different scales, and finding commonalities between them is what advanced intelligence does. [12:22] **Isomorphisms All the Way Down** - Douglas Hofstadter's insight applied: the universe consists of isomorphisms at every level. The mind itself is part of the universe and becomes a metaphor for other parts of the universe - the model is part of the world it models. [30:00] **The Universe as a Giant Fractal** - The universe is composed of pieces that repeat at different scales and levels of abstraction, like a giant fractal. Particle/wave duality, discrete/continuous, abstract/concrete - these patterns recur everywhere. --- ## 2. CONSCIOUSNESS, SELF & REALITY ### The Nature of Self [42:35] **Awareness IS You; Atoms Are Along for the Ride** - "The real self is right there in this conversation. And the atoms are along for the ride." Direct perception is more real than atomic models (which we know are wrong). You are not a body having experiences; you are awareness, and the material substrate tags along. [43:25] **All Reality as Ripples on a Cosmic Medium** - Everything - atoms, ocean waves, emotions - are ripples on a universal medium. Emotions are ripples on the brain, but the brain is continuous with the cosmos, so emotions are really ripples on the cosmic medium. This explains why no sensation, "no matter how bad or how good, is you." [46:26] **Witness Consciousness and the Cosmic Medium** - The ability to say "I feel cold, but I am not that cold" is grounded in physics: cold is a ripple on the medium, and you are the medium. Since there's no wall between the brain and the universe, you are fundamentally the cosmic medium itself. [56:05] **The Buoyant Mind (Chinese Medicine on Sleep)** - The mind is buoyant - always trying to float upward like a beach ball. Sleep happens when the pericardium (heart energy) pulls the mind down to rest. Insomnia occurs when the pericardium is drained and can't reach up to grab the mind. "Your mind is never going to say, I'm done being a mind." [58:33] **Self-Realization in Three Points** - (1) You have a mind, but you are not a mind. (2) Direct perception (like qi/energy) is more real than atomic models. (3) "It's not that you have an aura - you ARE an aura, and the atoms are along for the ride." [79:04] **You Are the Universe Speaking** - "No matter which way you slice it, tautologically, you are the universe speaking." Every utterance, every action is the cosmos expressing itself through you. This is not mystical hand-waving but a logical necessity. [135:40] **The No-Self Concept** - At any moment, either the nature of the universe/your original nature is speaking, or conditioning is speaking. If those are the only two sources, where is the "self"? The ego is just a tool - "an imaginary friend" that Buddhist traditions recognize as constructed, not fundamental. [139:01] **The Ego as a Tool / Imaginary Friend** - In Buddhism, the self/ego is considered a tool, like an imaginary friend. Some meditation traditions even cultivate "tulpas" (secondary personas). When your ego gets hurt, it's "an imaginary friend got hurt, but it's not you." ### Conditioning vs. Original Nature [79:27] **Two Forces Inside You** - At any moment, there are two forces: (1) your original curious, innocent, kind nature (which is the universe's nature reflected through you), and (2) conditioning/karma - "a bot in your head" formed by past experiences. The crucial skill is distinguishing which one is speaking. [82:00] **Conditioning as a Bot in Your Head** - Habitual behavioral patterns (samskaras) are like little intelligent bots running in your brain. They're not you. They're grooves of behavior. "If you're not clear on who you are, you'll conflate the message for you" - just as a child conflates a critical parent's voice with their own inner voice. [85:33] **The Most Important Question** - "What do we have to do to stop living on autopilot?" Studies show we make ~30,000 decisions daily, 98% unconsciously. The yogic answer: adopt a zero-tolerance policy for unclear thinking. [124:04] **Knowing vs. Grokking** - Knowing something conceptually versus truly grokking it (embodying it so it becomes inextricable from you). You can learn "I am not my thoughts" as a concept, but it takes years to grok it so deeply that it interpenetrates your whole being. --- ## 3. YOGA PHILOSOPHY & PRACTICAL WISDOM ### Avidya and Vidya [91:21] **Avidya: The Yogic Alternative to Temptation** - Western Christianity frames the struggle as fighting temptation. Yogis reject internal conflict entirely. Instead they use Vidya (right knowledge) and Avidya (that which is other than right knowledge). "Sin" in yoga is something that goes against yourself. Laziness and impatience are forms of Avidya - they're not real. If you poke them with your brain, they dissolve. [93:04] **A Conflicted Person Is Not a Real Person** - Internal conflict means you're "not even being." Being requires coherence and authenticity. If you're internally conflicted, "you're just a mask... a shell... it's just not a thing." This isn't moral judgment but ontological observation. [126:04] **Yoga Stretching as a Mirror of Inner Conflict** - When a muscle fights you during a yoga pose, it's the physical embodiment of inner forces fighting you. Releasing unnecessarily held physical tension is the same practice as releasing Avidya. The body and mind mirror each other. [128:04] **The Only Rule of Yoga: No Inner Conflict** - "You can do anything you want, but with no conflict about it." You could eat all the candy you want - if you had zero inner conflict about it, yogis would be fine. The problem is never the action; it's the conflict around the action. ### The Desikachar Tradition [86:04] **Yoga Philosophy's Essential Question** - This is "the most important question, maybe in existence": how to distinguish between clear thinking and conditioned autopilot. Desikachar (son of the father of modern yoga) wrote about it with engineering precision - no mystical fluff, just matter-of-fact clarity. [99:00] **Sanskrit as a Therapeutic Language** - Sanskrit partially achieves what a therapeutic constructed language would need. It embeds profound concepts like Avidya/Vidya directly into the vocabulary. Patanjali, who wrote the Yoga Sutras, was also a grammarian who formalized Sanskrit grammar - philosopher and language designer in one person. [101:08] **The Etymology of Yoga** - "Yoga" comes from Sanskrit root "yuj" meaning to unite/yoke. The English word "yoke" and the astronomical term "syzygy" share this root. Yoga means: to unite mind and body, to resolve conflicts in the mind, to converge scattered parts into coherence. --- ## 4. TAOISM & NON-ATTACHMENT ### The Tao [54:03] **What Is Taoism?** - Two fundamental recognitions: (1) Things happen in the universe - time ticks forward, and that's mysterious. (2) Things behave according to their nature. Taoism is accepting that things will behave according to their nature and then aligning yourself accordingly. [20:24] **Assimilating to the Structure of the Cosmic Order** - The goal of Taoism: to assimilate the structure of the cosmic order and embody the qualities of the universe so they no longer hold you back. Non-attachment is the gateway - "if you're attached, if you're hard, you can't be reshaped by the cosmic order." [107:09] **Taoist Non-Action (Wu Wei) and Productivity** - Taoism says: do nothing, be non-attached, and things will happen through you. When the fire alarm goes off, an unattached person naturally moves. "Your productivity may just be the universe itself moving you." Including the parts of the universe inside your brain. ### Non-Attachment [22:06] **Non-Attachment as Blast-Off** - The soul/awareness is like a hot air balloon wanting to fly free; attachments are ropes holding it down. A master of non-attachment can achieve "blast off" comparable to powerful psychedelics at any moment. This is how one can be peaceful in the face of great pain - not by distracting from it, but by transcending it. [47:04] **Two Levels of Being Molded by the Universe** - Level 1: Internal annealing - your experiences rearrange themselves into greater harmony (like dreams as simulated annealing). Level 2: External field - there may be a cosmic field influencing the rearrangement, like a magnet under a table reorganizing iron filings in glass. [136:00] **Walking Into Pain Without Stress** - A truly aware person can be hurt 1,000 times by something and walk in the 1,001st time with zero aversion. Even wilder: they can walk in knowing they WILL get hurt and still have no stress. This is the practical result of recognizing conditioning as "not you." --- ## 5. LANGUAGE, CONSTRUCTED LANGUAGES & PSYCHOTHERAPY [94:19] **A Constructed Language as Psychotherapy** - Proposal to create a language that removes words like "laziness" and "impatience" and replaces them with "I am confused" or "I am in conflict with myself." The language would force speakers to identify the SOURCE of every desire: "my physical self wants food" vs. "my emotional pain wants to eat to drown itself." [95:19] **Linus's Language: Being Instead of Doing** - Linus's constructed language has no "doing" - only "being." Instead of "I am shouting at someone," it's "I am being the kind of emotion that shouts." This reframes all action as embodiment, naturally producing self-awareness. [97:19] **Language Shapes Thought; Better Language Shapes Better Thought** - "The language that we use is really constraining us and creating boundaries around all the possibilities in dramatic ways." A group that adopted a precision language for emotions would be fundamentally transformed - "this will transform your brain." [96:28] **Motivation as Misalignment Detector** - "If you're finding it difficult to get motivated, maybe you're chasing somebody else's goals." Difficulty maintaining motivation is a signal that what you're pursuing doesn't resonate with who you actually are. --- ## 6. COSMOLOGY & SPECULATIVE HYPOTHESES ### Three Hypotheses About Order in the Universe [13:00] **The Inner Language Hypothesis** - Language evolved not for communication between people, but for specialized core systems in the brain to communicate with each other. The leap to inter-brain communication was then trivial. Evidence: the Munduruku tribe has no words for numbers >4, and literally cannot count above 4 - language bridges the gap between the hardwired counting module (up to 4) and the relative quantity estimation module. [47:52] **Dreams as Simulated Annealing** - Dreams shake up all the ingredients in your subconscious (like shaking a drawer of bar magnets) and let them settle into a lower-energy, more ordered configuration. Problems that seemed intractable can resolve overnight because dreaming is literally an optimization process. [63:43] **Annealing with a Cosmic Field** - Beyond internal optimization, there may be an external field (like a magnet under a table) that nudges the "coin flips" of randomness toward order. This would explain synchronicity, intuition, and the persistent human sense of "receiving messages from the cosmos." ### Reality and Simulation [60:29] **Donald Hoffman's Case Against Reality** - We may be conscious entities living inside a virtual reality headset. The moon isn't "there" when we're not looking, just as a video game road isn't rendered when the camera faces elsewhere. The underlying circuitry (not the rendered objects) is what's real. [62:06] **Simulation Theory and the Divine** - Even if we're in a simulation, there must be a "top level," and you're still left with "why is there something instead of nothing?" That question is where you start to tap into ideas of the divine. [67:40] **Godel's Incompleteness and the Limits of Explanation** - You can never say with certainty you've found all the reasons something happened. Godel's theorem means any sufficiently powerful model contains true statements that can't be proven. "Maybe we have statements in our reality that are true, but you can't prove them." [70:44] **Telephone Telepathy and Subtle Variations** - Research showing people can guess who's calling at 55% accuracy (vs. 50% chance). Jacob proposes a systematic search for these subtle "variations in a coin flip" - analogous to the search for gravitational waves - to test whether a cosmic field is nudging randomness. --- ## 7. HOMEOSTASIS, LOVE & HUMAN CONNECTION [115:26] **Homeodynamics, Not Homeostasis** - All pleasure comes from desire to maintain homeostasis, but the center is always moving. It's really "homeodynamic" - maintaining balance in an ever-changing universe where you yourself are part of the change. [114:46] **When People Fall in Love, They Are the Same Thing** - Not "like" the same thing - they ARE the same thing at that moment. Their centers momentarily coincide. As Javier articulates: "At that very same express point, they are the same. The center is the same." [116:02] **Having a Child Changes the Center of the Universe** - When you have a kid or commit to an idea worth dying for, you don't just move to a new center - you actively change what the center of the universe IS by creating something new that reorganizes everything around it. [113:26] **Meeting Through Shared Ideas** - Jacob and Ben knew each other for years through a mutual friend but didn't truly connect until they found a shared idea on Jacob's public idea list. "It's possible to meet people and know them for years and then not really know each other." [119:27] **To Grok: Drinking Knowledge Until It's Inseparable From You** - From Heinlein's "Stranger in a Strange Land": to grok means to grasp something so deeply it becomes an inextricable lens through which you see everything. "The rest of your life just comes down to embodying that insight." --- ## 8. NOTABLE QUOTES [22:19] "An attachment is like a rope holding down a hot air balloon. If you let go, you can achieve blast off." [32:13] "The mind itself is part of the universe and becomes a metaphor for other parts of the universe." [32:37] "The cloth woven of its own unraveling, circling endlessly through the loom to create a changing whole." [42:51] "When we have a conversation, it's not like we're holding back any piece of ourselves. The real self is right there in this conversation." [47:01] "In truth, we are that cosmic medium, and the pain is just a ripple on it." [56:07] "The mind is buoyant. It's always trying to float upwards like a beach ball." [57:25] "Your mind is never going to say, I'm done being a mind. It's going to behave according to its nature." [59:15] "Atoms are just a concept, but a feeling - you know that for sure." [79:07] "No matter which way you slice it, tautologically, you are the universe speaking." [83:55] "If the doors of perception were cleansed, we would see everything as it is: infinite." (William Blake, quoted by Jacob) [84:33] "Is it a bot in your head speaking, or is it the original nature speaking?" [93:04] "A conflicted person is not a type of person to be." [96:42] "If you're finding it difficult to get motivated, maybe you're chasing somebody else's goals." [108:36] "If I am not attached, what I consider my productivity may just be the universe itself moving me." [114:24] "Bruce Lee didn't say 'be like water.' His instruction was: BE water." [128:11] "The only rule of yoga: no inner conflict." [129:35] "Don't eat bad ice cream." (Famous yogi, quoted by Jacob) [130:56] "Good heavens, don't worry about what you eat. It will make you sick." (Jacob's great-grandmother) --- ## 9. FRAMEWORKS & MENTAL MODELS | Framework | Timestamp | Description | |-----------|-----------|-------------| | **Chollet's Three-Layer Sandwich** | [06:15] | Perception (deep learning) -> Reasoning (program synthesis) -> Intuition (deep learning on abstract elements) | | **Strange Loop Alternative** | [07:40] | Not three layers but two layers in a recursive feedback loop (Hofstadter-style) | | **English as Compiled Bytecode** | [09:54] | Written English is compiled output; understanding requires decompiling to semantic prefix notation | | **Iron Filings in Glass** | [63:43] | Reality as iron filings in glass: internal forces (magnetism) + possible external field (magnet under table) | | **Simulated Annealing for Dreams** | [47:52] | Shaking up a drawer of magnets then slowly cooling = dreams optimizing our mental configurations | | **Hot Air Balloon of Awareness** | [22:06] | Soul = balloon wanting to fly; attachments = ropes; non-attachment = blast off | | **Buoyant Mind Model** | [56:05] | Mind floats up (alertness); pericardium pulls down (sleep); insomnia = drained pericardium | | **Ripples on Cosmic Medium** | [43:25] | All reality = ripples; atoms, waves, emotions all have same ontological status as ripples | | **Two Voices Model** | [79:27] | At any moment: original nature (universe) speaking OR conditioning (karma/bot) speaking | | **Homeodynamics** | [115:26] | Not static homeostasis but dynamic balance with a constantly shifting center | | **Avidya/Vidya** | [91:21] | Right knowledge vs. "other than right knowledge" - replaces temptation/sin framework with clarity/confusion | | **Grok vs. Know** | [119:27] | Conceptual understanding vs. embodied knowing that becomes inextricable from your being | --- ## 10. HIGHLIGHT SECTIONS (Best Exchanges) ### Must-Listen Segments **[01:18-12:30] The AI Architecture Deep Dive** - Jacob and Javier go deep on discrete vs. continuous systems, English as a programming language, prefix notation for natural language, and the strange loop hypothesis. Dense with original ideas about the future of AI. **[13:00-19:30] The Inner Language Hypothesis** - Fascinating discussion of language evolving for intra-brain communication, the Munduruku tribe who can't count above 4, and the hardware counting module in mammalian brains. **[20:00-23:30] Non-Attachment as Blast-Off** - Jacob's vivid metaphor of awareness as a hot air balloon held down by ropes of attachment, and how non-attachment enables transcendent experience comparable to psychedelics. **[43:00-47:15] Ripples on the Cosmic Medium** - The most philosophically original section. Jacob develops the idea that all reality consists of ripples, emotions and atoms have equal ontological status, and witness consciousness is grounded in the fact that you are the medium, not the ripple. **[47:15-53:00] Dreams as Simulated Annealing** - Beautiful analogy connecting metallurgy, optimization, dreaming, and problem-solving. The drawer of magnets metaphor makes abstract optimization theory intuitive. **[56:00-58:30] The Buoyant Mind** - Chinese medicine's model of sleep as the mind descending from head to heart. Memorable and unusual - most listeners won't have heard this framing. **[85:30-93:10] Avidya, Autopilot & The Only Rule of Yoga** - The densest practical wisdom section. Covers the 30,000 daily unconscious decisions, zero-tolerance for unclear thinking, and the revolutionary reframe of laziness/impatience as simply "confusion." **[94:00-98:00] Language as Psychotherapy** - The constructed language idea where grammar forces you to identify the source of every desire. Linus, Jacob, and Javier all riff on this with increasing excitement. Genuinely novel proposal. **[119:00-124:00] Grokking and Falling in Love** - The concept of "grok" leads to the insight that when people fall in love, they don't become "like" each other - they momentarily ARE the same thing. Beautiful convergence of epistemology and romance. **[126:00-131:00] Don't Eat Bad Ice Cream** - The Warren Buffett/McDonald's example, the famous yogi quote, and Jacob's great-grandmother's wisdom all converge on the same truth: it's not what you do but the inner conflict around it that causes harm. --- ## 11. PEOPLE & REFERENCES MENTIONED | Person/Work | Context | |-------------|---------| | **Francois Chollet** | AI researcher; intelligence as analogy; deep learning limitations; three-layer hybrid model | | **Douglas Hofstadter** | Isomorphisms all the way down; strange loops; Godel, Escher, Bach | | **Elizabeth Spelke** | Harvard professor; Origins of Knowledge course; child development psychology | | **Donald Hoffman** | "The Case Against Reality"; conscious entities in virtual reality | | **Desikachar** | Son of father of modern yoga; wrote "Religiousness in Yoga"; engineer-turned-yogi | | **Patanjali** | Wrote Yoga Sutras AND formalized Sanskrit grammar; ultimate polymath | | **Roger Cole (Jacob's father)** | Iyengar yoga teacher; sleep researcher; Yoga Journal columnist | | **William Blake** | "If the doors of perception were cleansed..." | | **Robert Heinlein** | Coined "grok" in "Stranger in a Strange Land" | | **Bruce Lee** | "Be water" (not "be like water") | | **Warren Buffett** | Eats McDonald's daily but lives without stress | | **Ian Stevenson** | UVA psychiatrist; children's past-life memories research; Scientific American article | | **Yann LeCun** | Energy models as generalization of optimization | | **Linus** | Jacob's collaborator at IdeaFlow; programmer, musician, artist; creator of a constructed language | --- ## 12. RESOURCES MENTIONED - **yoga.jacobcole.net** - Jacob's posting of "the best six pages of philosophy ever" from Desikachar's "Religiousness in Yoga" - **Religiousness in Yoga** by T.K.V. Desikachar - Donated to Internet Library for free access - **Shambhala: The Sacred Path of the Warrior** - Book on warrior spirituality - **Stealing Fire** - Book on ecstatic experience as humanity's ultimate goal - **Scientific American blog** - "Ian Stevenson's Case for the Afterlife" (children's past-life memories) - **IdeaFlow** - Jacob's collaborative ideation platform (the company discussed throughout)