Mathematical model that is based on axioms
POPULARITY
In the last episode, Jimmy Soni introduced Dr Claude Shannon, whose work laid the foundation for the technologies we use today. In this episode, Jimmy dives into the significance of Dr Shannon’s 1948 paper “A Mathematical Theory of Communication” to the creation of information theory. Resources and links: Jimmy Soni’s website Jimmy Soni on X Jimmy Soni on Instagram Connect: Simplifying Complexity on Twitter Sean Brady on Twitter Sean Brady on LinkedIn Brady Heywood website This show is produced in collaboration with Wavelength Creative. Visit wavelengthcreative.com for more information.
We're experimenting and would love to hear from you!In today's episode of Discover Daily, we begin with a development for artificial intelligence research. Harvard University has unveiled a comprehensive AI training dataset, marking a significant step forward in democratizing AI education and development. This innovative release provides researchers and developers with high-quality, ethically sourced data that will accelerate the advancement of machine learning applications while addressing crucial concerns about data privacy and bias in AI systems.Google has revolutionized the AI landscape with the launch of Gemini 2.0, their most powerful and versatile AI model to date. This next-generation model demonstrates unprecedented capabilities in multimodal understanding, complex reasoning, and real-world problem-solving, setting new benchmarks in natural language processing and computational efficiency. Gemini 2.0's enhanced architecture represents a quantum leap in AI technology, promising to transform industries from healthcare to creative content generation.Mathematicians have made a remarkable discovery in the field of infinity, identifying two entirely new types that challenge our fundamental understanding of mathematical concepts. This breakthrough expands the hierarchy of infinite numbers, building upon Cantor's groundbreaking work and opening new avenues for research in set theory and mathematical logic. The discovery has profound implications for both pure mathematics and theoretical computer science, potentially influencing how we approach computational limits and mathematical modeling.From Perplexity's Discover Feed: https://www.perplexity.ai/page/harvard-releases-ai-training-d-iDxkgfrfQZO79hEZ_5Ogdghttps://www.perplexity.ai/page/google-releases-gemini-2-0-.8X4jPJYT7CayycbJ5aBrQhttps://www.perplexity.ai/page/two-new-types-of-infinity-R4h9JUauS0OvbMKosWRH9wPerplexity is the fastest and most powerful way to search the web. Perplexity crawls the web and curates the most relevant and up-to-date sources (from academic papers to Reddit threads) to create the perfect response to any question or topic you're interested in. Take the world's knowledge with you anywhere. Available on iOS and Android Join our growing Discord community for the latest updates and exclusive content. Follow us on: Instagram Threads X (Twitter) YouTube Linkedin
Prof. Mark Solms, a neuroscientist and psychoanalyst, discusses his groundbreaking work on consciousness, challenging conventional cortex-centric views and emphasizing the role of brainstem structures in generating consciousness and affect. MLST is sponsored by Brave: The Brave Search API covers over 20 billion webpages, built from scratch without Big Tech biases or the recent extortionate price hikes on search API access. Perfect for AI model training and retrieval augmentated generation. Try it now - get 2,000 free queries monthly at http://brave.com/api. Key points discussed: The limitations of vision-centric approaches to consciousness studies. Evidence from decorticated animals and hydranencephalic children supporting the brainstem's role in consciousness. The relationship between homeostasis, the free energy principle, and consciousness. Critiques of behaviorism and modern theories of consciousness. The importance of subjective experience in understanding brain function. The discussion also explored broader topics: The potential impact of affect-based theories on AI development. The role of the SEEKING system in exploration and learning. Connections between neuroscience, psychoanalysis, and philosophy of mind. Challenges in studying consciousness and the limitations of current theories. Mark Solms: https://neuroscience.uct.ac.za/contacts/mark-solms Show notes and transcript: https://www.dropbox.com/scl/fo/roipwmnlfmwk2e7kivzms/ACjZF-VIGC2-Suo30KcwVV0?rlkey=53y8v2cajfcgrf17p1h7v3suz&st=z8vu81hn&dl=0 TOC (*) are best bits 00:00:00 1. Intro: Challenging vision-centric approaches to consciousness * 00:02:20 2. Evidence from decorticated animals and hydranencephalic children * 00:07:40 3. Emotional responses in hydranencephalic children 00:10:40 4. Brainstem stimulation and affective states 00:15:00 5. Brainstem's role in generating affective consciousness * 00:21:50 6. Dual-aspect monism and the mind-brain relationship 00:29:37 7. Information, affect, and the hard problem of consciousness * 00:37:25 8. Wheeler's participatory universe and Chalmers' theories 00:48:51 9. Homeostasis, free energy principle, and consciousness * 00:59:25 10. Affect, voluntary behavior, and decision-making 01:05:45 11. Psychoactive substances, REM sleep, and consciousness research 01:12:14 12. Critiquing behaviorism and modern consciousness theories * 01:24:25 13. The SEEKING system and exploration in neuroscience Refs: 1. Mark Solms' book "The Hidden Spring" [00:20:34] (MUST READ!) https://amzn.to/3XyETb3 2. Karl Friston's free energy principle [00:03:50] https://www.nature.com/articles/nrn2787 3. Hydranencephaly condition [00:07:10] https://en.wikipedia.org/wiki/Hydranencephaly 4. Periaqueductal gray (PAG) [00:08:57] https://en.wikipedia.org/wiki/Periaqueductal_gray 5. Positron Emission Tomography (PET) [00:13:52] https://en.wikipedia.org/wiki/Positron_emission_tomography 6. Paul MacLean's triune brain theory [00:03:30] https://en.wikipedia.org/wiki/Triune_brain 7. Baruch Spinoza's philosophy of mind [00:23:48] https://plato.stanford.edu/entries/spinoza-epistemology-mind 8. Claude Shannon's "A Mathematical Theory of Communication" [00:32:15] https://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf 9. Francis Crick's "The Astonishing Hypothesis" [00:39:57] https://en.wikipedia.org/wiki/The_Astonishing_Hypothesis 10. Frank Jackson's Knowledge Argument [00:40:54] https://plato.stanford.edu/entries/qualia-knowledge/ 11. Mesolimbic dopamine system [01:11:51] https://en.wikipedia.org/wiki/Mesolimbic_pathway 12. Jaak Panksepp's SEEKING system [01:25:23] https://en.wikipedia.org/wiki/Jaak_Panksepp#Affective_neuroscience
Prof. Subbarao Kambhampati argues that while LLMs are impressive and useful tools, especially for creative tasks, they have fundamental limitations in logical reasoning and cannot provide guarantees about the correctness of their outputs. He advocates for hybrid approaches that combine LLMs with external verification systems. MLST is sponsored by Brave: The Brave Search API covers over 20 billion webpages, built from scratch without Big Tech biases or the recent extortionate price hikes on search API access. Perfect for AI model training and retrieval augmentated generation. Try it now - get 2,000 free queries monthly at http://brave.com/api. TOC (sorry the ones baked into the MP3 were wrong apropos due to LLM hallucination!) [00:00:00] Intro [00:02:06] Bio [00:03:02] LLMs are n-gram models on steroids [00:07:26] Is natural language a formal language? [00:08:34] Natural language is formal? [00:11:01] Do LLMs reason? [00:19:13] Definition of reasoning [00:31:40] Creativity in reasoning [00:50:27] Chollet's ARC challenge [01:01:31] Can we reason without verification? [01:10:00] LLMs cant solve some tasks [01:19:07] LLM Modulo framework [01:29:26] Future trends of architecture [01:34:48] Future research directions Youtube version: https://www.youtube.com/watch?v=y1WnHpedi2A Refs: (we didn't have space for URLs here, check YT video description instead) Can LLMs Really Reason and Plan? On the Planning Abilities of Large Language Models : A Critical Investigation Chain of Thoughtlessness? An Analysis of CoT in Planning On the Self-Verification Limitations of Large Language Models on Reasoning and Planning Tasks LLMs Can't Plan, But Can Help Planning in LLM-Modulo Frameworks Embers of Autoregression: Understanding Large Language Models Through the Problem They are Trained to Solve "Task Success" is not Enough Partition function (number theory) (Srinivasa Ramanujan and G.H. Hardy's work) Poincaré conjecture Gödel's incompleteness theorems ROT13 (Rotate13, "rotate by 13 places") A Mathematical Theory of Communication (C. E. SHANNON) Sparks of AGI Kambhampati thesis on speech recognition (1983) PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Change Explainable human-AI interaction Tree of Thoughts On the Measure of Intelligence (ARC Challenge) Getting 50% (SoTA) on ARC-AGI with GPT-4o (Ryan Greenblatt ARC solution) PROGRAMS WITH COMMON SENSE (John McCarthy) - "AI should be an advice taker program" Original chain of thought paper ICAPS 2024 Keynote: Dale Schuurmans on "Computing and Planning with Large Generative Models" (COT) The Hardware Lottery (Hooker) A Path Towards Autonomous Machine Intelligence (JEPA/LeCun) AlphaGeometry FunSearch Emergent Abilities of Large Language Models Language models are not naysayers (Negation in LLMs) The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A" Embracing negative results
The Cognitive Crucible is a forum that presents different perspectives and emerging thought leadership related to the information environment. The opinions expressed by guests are their own, and do not necessarily reflect the views of or endorsement by the Information Professionals Association. During this episode, US Air Force Captain Jose Davis discusses his paper, which is entitled: "Leveraging AI for Operations in the Information Environment: 3 Demonstrations in Disinformation, Social Media, and Entropy." The paper focuses on the application of Artificial Intelligence (AI) in the realm of Operations in the Information Environment (OIE), particularly for the Air Force. The paper presents three case studies demonstrating how AI can positively impact OIE and advocates for direct AI research in this area. Additionally, he'll recap an information campaign that US Air Forces in Europe conducted to assure Baltic NATO Allies, following the Russian invasion of Ukraine in 2022. Recording Date: 24 April 2024 Research Questions: Jose Davis suggests as interested student examine: What other common metrics can be developed or researched for assessing the Information Environment, tailor-made for the national security needs and useful for IO and PA operators? What are the practical outcomes in the Information Environment (a complex system) when entropy is influenced, pushed either higher or lower? e.g. Hypothetically, when high entropy is present, humans deploy simplifying heuristics, so this should help improve Key Leader Engagements' (KLE) timing and improve KLE dossiers. Or with PA/IO, high entropy hypothetically may demand a simplified messaging campaign. In what other ways can AI be leveraged to combat nefarious AI use for disinformation? The ideas of watermarking or safeguarding content from manipulation from nefarious Generative AI are a form of immunization, advancing Inoculation Theory as a whole. What other preventative measures along the lines of immunization can be taken to combat disinformation? Resources: Cognitive Crucible Podcast Episodes Mentioned #46 Pat Ryder on Public Affairs and Strategic Communications #174 Kara Masick on Assessment Insights from Program Evaluation #183 Julie Janson on Air Force IO Talent and Strategy Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence Universal adversarial perturbations by Seyed-Mohsen Moosavi-Dezfooli, Alhussein Fawzi, Omar Fawzi, and Pascal Frossard Pre-trained Adversarial Perturbations by Yuanhao Ban, Yinpeng Dong Automating OIE with Large Language Models by Cpt Alexander Sferrella, Cpt Joseph Conger, and Maj Kara Masick Claude Shannon AI 2041: Ten Visions for Our Future by former Google technologist Kai-Fu Lee and science fiction writer Chen Qiufan. I'm a huge advocate of using story to educate. For those new to AI or wanting to understand AI's societal impact, this is my go-to book. Written in a series of fictional short stories with in-depth essay analysis at the end of each, the book teaches AI while making it entertaining. A Mind at Play: How Claude Shannon Invented the Information Age by Jimmy Soni and Rob Goodman. I think every Information Warfare professional should know who Claude Shannon is and read his “magna carta” of the Information Age, The Mathematical Theory of Communication. My intellectual hero, this exceptional biography brings the man to life — a polymath, a tinkerer, an innovator. “Attention is all You Need” by Ashish Vaswani et al. This is the seminal paper advancing the Transformer architecture which made Generative AI like ChatGPT possible. Liken this paper to Einstein's book on Relativity or Newton's Principia. Information Theory: Structural Models for Qualitative Data by Klaus Krippendorff Link to full show notes and resources Guest Bio: Jose is a Public Affairs Officer for Headquarters U.S. Air Forces in Europe - Air Forces Africa at Ramstein Air Base, Germany. He has over 14 years of experience in integrated communications, both in the public and private sectors. He is accredited in Public Relations and Military Communications through the Public Relations Society of America. In his current role, he ensures the strategic communication of accurate and timely information about the command's 104-country area of operations. He played a pivotal role at NATO in combating misinformation before, during and after the 2022 Russian invasion of Ukraine. He just finished a rigorous six-month fellowship at a DoD-sponsored AI Accelerator at the Massachusetts Institute of Technology, gaining exposure to some of the brightest and best minds in AI and Machine Learning technologies. As part of his fellowship, Jose was required to apply his newly acquired AI foundational knowledge to produce a research paper addressing a problem or issue facing the U.S. Air Force. The paper is slated for publication in the U.S. Air Force's Air and Space Operations Review journal. About: The Information Professionals Association (IPA) is a non-profit organization dedicated to exploring the role of information activities, such as influence and cognitive security, within the national security sector and helping to bridge the divide between operations and research. Its goal is to increase interdisciplinary collaboration between scholars and practitioners and policymakers with an interest in this domain. For more information, please contact us at communications@information-professionals.org. Or, connect directly with The Cognitive Crucible podcast host, John Bicknell, on LinkedIn. Disclosure: As an Amazon Associate, 1) IPA earns from qualifying purchases, 2) IPA gets commissions for purchases made through links in this post.
What's going on with deep learning? What sorts of models get learned, and what are the learning dynamics? Singular learning theory is a theory of Bayesian statistics broad enough in scope to encompass deep neural networks that may help answer these questions. In this episode, I speak with Daniel Murfet about this research program and what it tells us. Patreon: patreon.com/axrpodcast Ko-fi: ko-fi.com/axrpodcast Topics we discuss, and timestamps: 0:00:26 - What is singular learning theory? 0:16:00 - Phase transitions 0:35:12 - Estimating the local learning coefficient 0:44:37 - Singular learning theory and generalization 1:00:39 - Singular learning theory vs other deep learning theory 1:17:06 - How singular learning theory hit AI alignment 1:33:12 - Payoffs of singular learning theory for AI alignment 1:59:36 - Does singular learning theory advance AI capabilities? 2:13:02 - Open problems in singular learning theory for AI alignment 2:20:53 - What is the singular fluctuation? 2:25:33 - How geometry relates to information 2:30:13 - Following Daniel Murfet's work The transcript: https://axrp.net/episode/2024/05/07/episode-31-singular-learning-theory-dan-murfet.html Daniel Murfet's twitter/X account: https://twitter.com/danielmurfet Developmental interpretability website: https://devinterp.com Developmental interpretability YouTube channel: https://www.youtube.com/@Devinterp Main research discussed in this episode: - Developmental Landscape of In-Context Learning: https://arxiv.org/abs/2402.02364 - Estimating the Local Learning Coefficient at Scale: https://arxiv.org/abs/2402.03698 - Simple versus Short: Higher-order degeneracy and error-correction: https://www.lesswrong.com/posts/nWRj6Ey8e5siAEXbK/simple-versus-short-higher-order-degeneracy-and-error-1 Other links: - Algebraic Geometry and Statistical Learning Theory (the grey book): https://www.cambridge.org/core/books/algebraic-geometry-and-statistical-learning-theory/9C8FD1BDC817E2FC79117C7F41544A3A - Mathematical Theory of Bayesian Statistics (the green book): https://www.routledge.com/Mathematical-Theory-of-Bayesian-Statistics/Watanabe/p/book/9780367734817 In-context learning and induction heads: https://transformer-circuits.pub/2022/in-context-learning-and-induction-heads/index.html - Saddle-to-Saddle Dynamics in Deep Linear Networks: Small Initialization Training, Symmetry, and Sparsity: https://arxiv.org/abs/2106.15933 - A mathematical theory of semantic development in deep neural networks: https://www.pnas.org/doi/abs/10.1073/pnas.1820226116 - Consideration on the Learning Efficiency Of Multiple-Layered Neural Networks with Linear Units: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4404877 - Neural Tangent Kernel: Convergence and Generalization in Neural Networks: https://arxiv.org/abs/1806.07572 - The Interpolating Information Criterion for Overparameterized Models: https://arxiv.org/abs/2307.07785 - Feature Learning in Infinite-Width Neural Networks: https://arxiv.org/abs/2011.14522 - A central AI alignment problem: capabilities generalization, and the sharp left turn: https://www.lesswrong.com/posts/GNhMPAWcfBCASy8e6/a-central-ai-alignment-problem-capabilities-generalization - Quantifying degeneracy in singular models via the learning coefficient: https://arxiv.org/abs/2308.12108 Episode art by Hamish Doodles: hamishdoodles.com
The Le Random team of thefunnyguys, Peter Bauman (Monk Antony) and Conrad House (Nemo Cake) spoke to special guest and acclaimed gallerist Kate Vass about a whirlwind one hundred years of generative art history (1850-1949),the Modern Era. This episode corresponds with: Generative Art Timeline: Chapter 2 10 Significant Modern Era Moments (Covered in the talk) The Great Exhibition of London Lights Early Spark of the Arts & Crafts Movement (1851) Modern art Begins: Manet's Work Rejected by Paris Salon (1863) + Cézanne's Mont Sainte-Victoire Series (1870-1906) Les Demoiselles d'Avignon by Picasso kicks off Cubism (1907) The Ten Biggest, No 7 by Hilma af Klint (1907) Tatlin and Rodchenko Found Constructivism and Malevich Stages the 0.10 Exhibition with Black Square. (1915) Walter Gropius Founds Bauhaus (1919) Marcel Duchamp and Man Ray Create Rotary Glass Plates (1920) Gunta Stölzl Named Director of Bauhaus Weaving Workshop (1927) Birth of digital computing: Konrad Zuse Completes the Z3 (1941) + ENIAC (1945) 10. Cybernetics Is Born: Norbert Wiener's Cybernetics + Claude Shannon's "A Mathematical Theory of Communication.” (1948)
My wife recently bought me an old book. It's called The Mathematical Theory of Investment. It was written in 1913 and it's as dry and boring as it sounds (but the old weathered cover looks awesome on a bookshelf). I flipped through it and thought, "Does any of this matter?" These formulas, these charts, this data?Well, yes. But not nearly as much as the soft, behavioral side of investing. This episode shares 10 of what I think are the most critical financial skills -- none of which you'll find in a 100-year-old academic text.
Ogi Ogas is a Mathematical Neuroscientist and Author. He attained his PhD in Computational Neuroscience at Boston University. He was a United States Department of Homeland Security Fellow during his graduate studies, and is the director of the Dark Horse Project in the Laboratory for the Science of Individuality at the Harvard Graduate School of Education. His the author of several books including "A Billion Wicked Thoughts" (2011), "This is What It Sounds Like: What the Music You Love Says About You" (2022), "Journey of the Mind: How Thinking Emerged from Chaos" (2022) among several others. His work focuses on a unified account of the mind that explains how consciousness, language, the Self, and civilization emerged incrementally out of chaos. A Grand Unified Theory of Consciousness. EPISODE LINKS: - Ogi's Website: https://www.ogiogas.com/ - Ogi's Books: https://www.amazon.com/Books-Ogi-Ogas/s?rh=n%3A283155%2Cp_27%3AOgi+Ogas - Journey of the Mind: https://thejourneyofthemind.com/ CONNECT: - Website: https://tevinnaidu.com - Instagram: https://instagram.com/drtevinnaidu - Facebook: https://facebook.com/drtevinnaidu - Twitter: https://twitter.com/drtevinnaidu - LinkedIn: https://linkedin.com/in/drtevinnaidu TIMESTAMPS: 0:00 - Introduction 0:38 - The Dynamic Mind ("Mistaking Things for Activity") 4:36 - Stephen Grossberg's Mathematical Model of the Mind ("The Greatest Living Scientist") 10:58 - How to know when a Theory is on the right track (Integrations & Unifying) 14:03 - An Unexpected Twist (Communicating with Intelligent Extraterrestrials?!) 16:04 - "Cosmic Cycle"/"Ladder of Purpose" (Mathematics shared with Ogi by "Intex") 19:57 - The Attention Dilemma & Resonance Theory 24:22 - "Super Minds" 27:15 - "Hyper Minds" & "Axiomized Minds" 30:11 - There is a Cosmic Purpose: Love 33:37 - Ogi's first ET experience & how it guided him towards a Mathematical Theory of Consciousness 38:16 - Skepticism vs Curiosity 41:46 - Predictions the Dynamic/Resonance Theory can make 46:20 - The "Failsafe Supreme" & Ogi's description of his ET experiences 56:48 - Why Ogi is opening up about this now 1:00:36 - Similarities with Srinivasa Ramanujan ("The Man Who Knew Infinity") 1:03:22 - How Ogi now perceives Psychosis (Suggestible States of Consciousness) from an Autistic perspective 1:12:18 - Countries are Conscious (Why America is Conscious & Russia is not) 1:19:20 - Consciousness is not the pinnacle (evolutionary arch) 1:23:32 - Why we should fear Analog Artificial Intelligence 1:30:43 - Ogi's view on Philosophy of Mind & Different Theories of Consciousness 1:40:32 - Against Essentialism and for Holism 1:46:47 - Evolutionary Psychology is a dead-end 1:53:41 - Facilitating Hyper Minds with respect & diversity 1:57:00 - Where are these "Intex"/"Axiomized Minds"? 2:01:57 - Important takeaways: The Universe is Designed by Minds, for Love 2:14:27 - Ogi's Forthcoming Book: "Large Gods for Small Children" 2:16:38 - Conclusion
Is a bit just a 0 or 1?What's the difference between a bit and qubit...and why should you care?Join Adam and Tai-Danae as they discuss the history of ‘bits' and explore both the concept and physicality of qubits, including examples and applications.Want to get in touch? Write us at faq-podcast@sandboxaq.com Chapters: 00:00 Introductions 01:15 What are bits? 02:45 Wait, why are we talking about bits?! 04:21 Concepts of bits vs physical bits 05:55 Etymology of the word 'bit' 11:25 Bits as physical objects 14:37 What is computation, really? 18:24 How are qubits similar to bits? 19:50 Etymology of the word 'qubit' 22:25 Tai-Danae's notes on qubits 28:08 Qubits as physical objects 30:10 Quantum engineering is amazing! 32:07 Superconducting qubits 34:58 NV Centers 39:53 Qubits are not just for quantum computing 41:42 Qubits are fragile...is that bad? 44:01 Other examples of qubits 44:47 How do you make qubits? 47:51 Superposition! More next time! Resources mentioned in the show: A Mathematical Theory of Communication by C. E. Shannon: https://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf The Pattern On The Stone by W. Daniel Hillis https://www.basicbooks.com/titles/w-daniel-hillis/the-pattern-on-the-stone/9780465066933/ Learn more about different types of qubits on this great site hosted by the University of Waterloo: https://uwaterloo.ca/institute-for-quantum-computing/quantum-101/quantum-information-science-and-technology/what-qubit And can you spot the point where it's clear Tai-Danae can see into the future?! Comment below! Keep in mind this was recorded weeks ago :-) Want to learn more about what SandboxAQ does? Check out our blog: https://www.sandboxaq.com/blog
Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: On Developing a Mathematical Theory of Interpretability, published by Spencer Becker-Kahn on February 9, 2023 on The AI Alignment Forum. If the trajectory of the deep learning paradigm continues, it seems plausible to me that in order for applications of low-level interpretability to AI not-kill-everyone-ism to be truly reliable, we will need a much better-developed and more general theoretical and mathematical framework for deep learning than currently exists. And this sort of work seems difficult. Doing mathematics carefully - in particular finding correct, rigorous statements and then finding correct proofs of those statements - is slow. So slow that the rate of change of cutting-edge engineering practices significantly worsens the difficulties involved in building theory at the right level of generality. And, in my opinion, much slower than the rate at which we can generate informal observations that might possibly be worthy of further mathematical investigation. Thus it can feel like the role that serious mathematics has to play in interpretability is primarily reactive, i.e. consists mostly of activities like 'adding' rigour after the fact or building narrow models to explain specific already-observed phenomena. My impression however, is that the best applied mathematics doesn't tend to work like this. My impression is that although the use of mathematics in a given field may initially be reactive and disunited, one of the most lauded aspects of mathematics is a certain inevitability with which our abstractions take on a life of their own and reward us later with insight, generalization, and the provision of predictions. Moreover - remarkably - often those abstractions are found in relatively mysterious, intuitive ways: i.e. not as the result of us just directly asking "What kind of thing seems most useful for understanding this object and making predictions?" but, at least in part, as a result of aesthetic judgement and a sense of mathematical taste. One consequence of this (which is a downside and also probably partly due to the inherent limitations of human mathematics) is that mathematics does not tend to act as an objective tool that you can bring to bear on whatever question it is that you want to think about. Instead, the very practice of doing mathematics seeks out the questions that mathematics is best placed to answer. It cannot be used to say something useful about just anything; rather it finds out what it is that it can say something about. Even after taking into account these limitations and reservations, developing something that I'm clumsily thinking of as 'the mathematics of (the interpretability of) deep learning-based AI' might still be a fruitful endeavour. In case it is not clear, this is roughly speaking, because a) Many people are putting a lot of hope and resources into low-level interpretability; b) Its biggest hurdles will be making it 'work' at large scale, on large models, quickly and reliably; and c) - the sentiment I opened this article with - doing this latter thing might well require much more sophisticated general theory. In thinking about some of these themes, I started to mull over a couple of illustrative analogies or examples. The first - and more substantive example - is algebraic topology. This area of mathematics concerns itself with certain ways of assigning mathematical (specifically algebraic) information to shapes and spaces. Many of its foundational ideas have beautiful informal intuitions behind them, such as the notion that a shape my have enough space in it to contain a sphere, but not enough space to contain the ball that that sphere might have demarcated. Developing these informal notions into rigorous mathematics was a long and difficult process and learning this material - even now when it is presented in its ...
Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: On Developing a Mathematical Theory of Interpretability, published by Spencer Becker-Kahn on February 9, 2023 on LessWrong. If the trajectory of the deep learning paradigm continues, it seems plausible to me that in order for applications of low-level interpretability to AI not-kill-everyone-ism to be truly reliable, we will need a much better-developed and more general theoretical and mathematical framework for deep learning than currently exists. And this sort of work seems difficult. Doing mathematics carefully - in particular finding correct, rigorous statements and then finding correct proofs of those statements - is slow. So slow that the rate of change of cutting-edge engineering practices significantly worsens the difficulties involved in building theory at the right level of generality. And, in my opinion, much slower than the rate at which we can generate informal observations that might possibly be worthy of further mathematical investigation. Thus it can feel like the role that serious mathematics has to play in interpretability is primarily reactive, i.e. consists mostly of activities like 'adding' rigour after the fact or building narrow models to explain specific already-observed phenomena. My impression however, is that the best applied mathematics doesn't tend to work like this. My impression is that although the use of mathematics in a given field may initially be reactive and disunited, one of the most lauded aspects of mathematics is a certain inevitability with which our abstractions take on a life of their own and reward us later with insight, generalization, and the provision of predictions. Moreover - remarkably - often those abstractions are found in relatively mysterious, intuitive ways: i.e. not as the result of us just directly asking "What kind of thing seems most useful for understanding this object and making predictions?" but, at least in part, as a result of aesthetic judgement and a sense of mathematical taste. One consequence of this (which is a downside and also probably partly due to the inherent limitations of human mathematics) is that mathematics does not tend to act as an objective tool that you can bring to bear on whatever question it is that you want to think about. Instead, the very practice of doing mathematics seeks out the questions that mathematics is best placed to answer. It cannot be used to say something useful about just anything; rather it finds out what it is that it can say something about. Even after taking into account these limitations and reservations, developing something that I'm clumsily thinking of as 'the mathematics of (the interpretability of) deep learning-based AI' might still be a fruitful endeavour. In case it is not clear, this is roughly speaking, because a) Many people are putting a lot of hope and resources into low-level interpretability; b) Its biggest hurdles will be making it 'work' at large scale, on large models, quickly and reliably; and c) - the sentiment I opened this article with - doing this latter thing might well require much more sophisticated general theory. In thinking about some of these themes, I started to mull over a couple of illustrative analogies or examples. The first - and more substantive example - is algebraic topology. This area of mathematics concerns itself with certain ways of assigning mathematical (specifically algebraic) information to shapes and spaces. Many of its foundational ideas have beautiful informal intuitions behind them, such as the notion that a shape my have enough space in it to contain a sphere, but not enough space to contain the ball that that sphere might have demarcated. Developing these informal notions into rigorous mathematics was a long and difficult process and learning this material - even now when it is presented in its best form - i...
Il mio libro "Capire il tempo e lo spazio": https://amzn.to/2UYMToT Il mio libro "A cavallo di un protone": https://amzn.to/2LIkz5x In questo episodio capiamo cosa è un Qubit (o Qbit) e le due proprietà quantistiche fondamentali che lo governano: la sovrapposizione di stati e il collasso dello stato durante la misura. Si tratta di due leggi della meccanica quantistica e che stanno alla base del Qubit e dei computer quantistici. Alla fine del video saremo anche in grado di vedere la più semplice applicazione di un Qubit che i computer classici non possono realizzare: la generazione di numeri casuali. Il canale YouTube di Pepite: https://www.youtube.com/c/NuggetsofScience La web di Pepite: www.pepitediscienza.it Per approfondire il tema della teoria dell'informazione: C.E. Shannon, "A Mathematical Theory of Communication", Bell System Technical Journal, vol. 27, luglio-ottobre (1948)
Il mio libro "Capire il tempo e lo spazio": https://amzn.to/2UYMToT Il mio libro "A cavallo di un protone": https://amzn.to/2LIkz5x In questo episodio iniziamo il nostro viaggio verso la comprensione dei computer quantistici. Iniziamo con il concetto base: il concetto di bit di informazione. I computer quantistici utilizzano sia i bit (classici) sia i Qbit (ovvero i bit di informazione quantistica). In questo video capiamo cosa è un bit attraverso quattro esempi intuitivi. Il canale YouTube di Pepite: https://www.youtube.com/c/NuggetsofScience La web di Pepite: www.pepitediscienza.it Per approfondire il tema della teoria dell'informazione: C.E. Shannon, "A Mathematical Theory of Communication", Bell System Technical Journal, vol. 27, luglio-ottobre (1948)
WERU 89.9 FM Blue Hill, Maine Local News and Public Affairs Archives
Producer/Host: Jim Campbell Artificial Intelligence – AI – is already a big part of our world and will be even more prevalent in our everyday lives as we move forward. Today, let’s look at some books that might help us get our heads around what AI is and is not – at least not yet – and how AI will quite probably affect all of our lives in our Information Age world. Here are the books mentioned on today’s program: Wiener, Norbert, The Human Use of Human Beings: Cybernetics and Society Shannon, Claude E. and Weaver, Warren, The Mathematical Theory of Communication Brockman, John, ed., Possible Minds: 25 Ways of Looking at AI Kissinger, Henry A., Schmidt, Eric, and Huttenlocher, Daniel, The Age of AI and Our Human Future About the host: Jim Campbell has a longstanding interest in the intersection of digital technology, law, and public policy and how they affect our daily lives in our increasingly digital world. He has banged around non-commercial radio for decades and, in the little known facts department (that should probably stay that way), he was one of the readers voicing Richard Nixon's words when NPR broadcast the entire transcript of the Watergate tapes. Like several other current WERU volunteers, he was at the station's sign-on party on May 1, 1988 and has been a volunteer ever since doing an early stint as a Morning Maine host, and later producing WERU program series including Northern Lights, Conversations on Science and Society, Sound Portrait of the Artist, Selections from the Camden Conference, others that will probably come to him after this is is posted, and, of course, Notes from the Electronic Cottage. The post Notes from the Electronic Cottage 12/29/22: AI Books 2 first appeared on WERU 89.9 FM Blue Hill, Maine Local News and Public Affairs Archives.
Producer/Host: Jim Campbell Artificial Intelligence – AI – is already a big part of our world and will be even more prevalent in our everyday lives as we move forward. Today, let’s look at some books that might help us get our heads around what AI is and is not – at least not yet – and how AI will quite probably affect all of our lives in our Information Age world. Here are the books mentioned on today’s program: Wiener, Norbert, The Human Use of Human Beings: Cybernetics and Society Shannon, Claude E. and Weaver, Warren, The Mathematical Theory of Communication Brockman, John, ed., Possible Minds: 25 Ways of Looking at AI Kissinger, Henry A., Schmidt, Eric, and Huttenlocher, Daniel, The Age of AI and Our Human Future About the host: Jim Campbell has a longstanding interest in the intersection of digital technology, law, and public policy and how they affect our daily lives in our increasingly digital world. He has banged around non-commercial radio for decades and, in the little known facts department (that should probably stay that way), he was one of the readers voicing Richard Nixon's words when NPR broadcast the entire transcript of the Watergate tapes. Like several other current WERU volunteers, he was at the station's sign-on party on May 1, 1988 and has been a volunteer ever since doing an early stint as a Morning Maine host, and later producing WERU program series including Northern Lights, Conversations on Science and Society, Sound Portrait of the Artist, Selections from the Camden Conference, others that will probably come to him after this is is posted, and, of course, Notes from the Electronic Cottage. The post Notes from the Electronic Cottage 12/29/22: AI Books 2 first appeared on WERU 89.9 FM Blue Hill, Maine Local News and Public Affairs Archives.
Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Epistemic Artefacts of (conceptual) AI alignment research, published by Nora Ammann on August 19, 2022 on The AI Alignment Forum. Tl;dr In this post, I describe four types of insights - what I will call Epistemic Artefacts - that we may hope to acquire through (conceptual) AI alignment research. I provide examples and briefly discuss how they relate to each other and what role they play on the path to solving the AI alignment problem. The hope is to add some useful vocabulary and reflective clarity when thinking about what it may look like to contribute to solving AI alignment. Four Types of Epistemic Artefacts Insofar as we expect conceptual AI alignment research to be helpful, what sorts of insights (here: “epistemic artefacts”) do we hope to gain? In short, I suggest the following taxonomy of potential epistemic artefacts: Map-making (de-confusion, gears-level models, etc.) Characterising risk scenarios Characterising target behaviour Developing alignment proposals (1) Map-making (i.e. conceptual de-confusion, gears-level understanding of relevant phenomena, etc.) First, research can aim to develop a gears-level understanding of phenomena that appear critical for properly understanding the problem as well as for formulating solutions to AI alignment (e.g. intelligence, agency, values/preferences/intents, self-awareness, power-seeking, etc.). Turns out, it's hard to think clearly about AI alignment without having a good understanding of and “good vocabulary” for phenomena that lie at the heart of the problem. In other words, the goal of "map-making" is to dissolve conceptual bottlenecks holding back progress in AI alignment research at a the moment. Figuratively speaking, this is where we are trying to draw more accurate maps that help us better navigate the territory. Some examples of work on this type of epistemic artefact include Agency: What it is and why it matters, Embedded Agency, What is bounded rationality?, The ground of optimization, Game Theory, Mathematical Theory of Communication, Functional Decision Theory and Infra-Bayesianism—among many others. (2) Identifying and specifying risk scenarios We can further seek to identify (new) civilizational risk scenarios brought about by advanced AI and to better understand the mechanisms leading to risk scenarios. Figuratively speaking, this is where we try to identify and describe the monsters hiding in the territory, so we can circumvent them when navigating the territory. Why does a better understanding of risk scenarios represent useful progress towards AI alignment? In principle, one way of guaranteeing a safe future is by identifying every way things could go wrong and finding ways to defend against each of them. (We could call this a “via negativa” approach to AI alignment.) I am not actually advocating for adopting this approach literally, but it still provides a good intuition for why understanding the range of risk scenarios and their drivers/mechanisms is useful. (More thoughts on this later, in "How these artefacts relate to each other".) In identifying and understanding risk scenarios, like in many other epistemic undertakings, we should seek to apply a diverse set of epistemic perspectives on how the world works in order to gain a more accurate, nuanced, and robust understanding of risks and failure stories and avoid falling prey to blind spots. Some examples of work on this type of epistemic artefact include What failure looks like, What Multipolar Failure Looks Like, The Parable of Predict-O-Matic, The Causes of Power-seeking and Instrumental Convergence, Risks from Learned Optimization, Thoughts on Human Models, Paperclip Maximizer, and Distinguishing AI takeover scenarios—among many others. (3) Characterising target behaviour Thirdly, we want to identify and characterize, from within the space ...
We're not an etymology podcast even though we sometimes make up our own words. Nevertheless, if you follow our blog you've recently read about the origins of the words "robot" and "robotics." Asimov has been known to make up his own words too. In fact, he's credited in the Oxford English Dictionary as the originator of the word "robotics." In this episode, we learn the origin of the word "Asenion" through a miraculous combination of brilliance, scholarship, and real-time detective work which the uninitiated might dismiss as mere Google-fu. Did the Great and Glorious Az invent the word "Asenion?" You'll have to listen to find out! Meanwhile, we ruminate over the second section of the Caves of Steel in which Baley throws around some wild theories, learns the sinister, not-so-sinister, or not-sinister-at-all designs of Spacetown, and sees an object eerily similar to a slide rule. If you think that sounds like fun, you're in for a wild ride! Join us!
Welcome to the Instant Trivia podcast episode 512, where we ask the best trivia on the Internet. Round 1. Category: Old School Thai 1: Until 1939 Thailand was known by this name. Siam. 2: Known as the "Venice of the East", this Thai city was modernized by King Mongkut in the 1800s. Bangkok. 3: Thailand is an important source of these blue September birthstones. sapphires. 4: About 95% of Thais practice the Theravada form of this religion. Buddhism. 5: (Hi, I'm Jeff Probst [in Thailand]) Tarutao means "old, mysterious and primitive" in this language, also the name of a nearby peninsula. Malay. Round 2. Category: World Flags 1: This Caribbean country adopted France's tricolor flag but removed the central white stripe. Haiti. 2: Libya's national flag is solid green and represents this religion. Islam. 3: In the middle of this country's flag, you'll find the Star of David. Israel. 4: During its modern history, this country has had several flags, most depicting the temple of Angkor Wat. Cambodia. 5: Its flag colors stand for Bohemia and Moravia. the Czech Republic. Round 3. Category: Iii 1: This president's father was William Jefferson Blythe III, but he took office as President under this name. Clinton. 2: Ruling Muscovy from 1462 to 1505, he was "The Great"; it was the IV who was the terrible one. Ivan (III). 3: This rich guy was the first president of Lincoln Center. John D. Rockefeller III. 4: The first Hanoverian king born in England, he ruled for 60 years, from 1760 to 1820. George III. 5: In 1948 Marshall Field III merged II Chicago papers into this I. the Sun-Times. Round 4. Category: Fire! 1: Though the 1871 Chicago fire began in this family's barn, their house suffered only minor damages. the O'Learys. 2: The first successful print of this future partner of James Ives was of a fire in Manhattan. (Nathaniel) Currier. 3: This general was blamed for the fire that destroyed Columbia, South Carolina, but he denied setting it and tried to put it out. (William Tecumseh) Sherman. 4: Genesis 19 says, "the Lord rained upon" these 2 cities "brimstone and fire ...out of heaven". Sodom and Gomorrah. 5: The 1911 fire in the NYC shirtwaist factory with this geometric name led to improvements in working conditions. the Triangle Shirtwaist Factory. Round 5. Category: "Amp" It Up 1: It's the and in this clue. an ampersand. 2: Oval auditorium with tiers of seats around a central open area. an amphitheater. 3: Describes military forces trained to fight on both land and sea. amphibious. 4: By definition, your AM radio modulates it. amplitude. 5: Scientist who wrote "Memoir on the Mathematical Theory of Electrodynamic Phenomena". (André-Marie) Ampère. Thanks for listening! Come back tomorrow for more exciting trivia!
The FitMind Podcast: Mental Health, Neuroscience & Mindfulness Meditation
Donald Hoffman, PhD is a cognitive scientist and author of The Case Against Reality: Why Evolution Hid the Truth from Our Eyes. He is currently a professor at UC Irvine, where he studies consciousness, visual perception and evolutionary psychology. On this episode, we “take the red pill” and hear Dr. Hoffman's theory on why reality is not what it seems. He explains this complex topic by comparing reality to a user interface. We discuss many topics, such as his mathematical theory of consciousness, questioning beliefs, and how the mind forms new mental models. FitMind Neuroscience-Based App: http://bit.ly/afitmind Website: www.fitmind.co Show Notes 0:00 | Introduction to Donald Hoffman, PhD 2:23 | Why Reality Isn't as It Seems 7:30 | Reality as a User Interface 13:51 | Adapting to Evolving Technology 16:06 | Creating New Mental Models 18:31 | Moving Beyond Spacetime 23:06 | Consciousness is Fundamental 25:26 | Ancient Wisdom & Science of Consciousness 30:00 | Conversation with the Dalai Lama (starting at 54:40) 30:15 | Reality Transcends Concepts 36:39 | Questioning Beliefs 38:56 | A New Worldview 45:04 | Mathematical Theory of Consciousness 45:39 | Rapid Fire Questions
Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Relative Impact of the First 10 EA Forum Prize Winners, published by NunoSempere on the AI Alignment Forum. Summary We don't normally estimate the value of small to medium-sized projects. But we could! If we could do this reliably and scalably, this might lead us to choose better projects Here is a small & very speculative attempt My estimates are very uncertain (ranging several orders of magnitude), but they still seem useful for comparing projects. Nonetheless, the reader is advised to not take them too seriously. Introduction The EA forum—and local groups—have been seeing a decent amount of projects, but few are evaluated for impact. This makes it difficult to choose between projects beforehand, beyond using personal intuition (however good it might be), a connection to a broader research agenda, or other rough heuristics. Ideally, we would have something more objective, and more scalable. As part of QURI's efforts to evaluate and estimate the impact of things in general, and projects QURI itself might carry out in particular, I tried to evaluate the impact of 10 projects I expected to be fairly valuable. Methodology I chose the first 10 posts which won the EA Forum Prize, back in 2017 and 2018, to evaluate. For each of the 10 posts, each estimate has a structure like the one below. Note that not all estimates will have each element: Title of the post Background information: What are some salient facts about the post? Theory of change: If this isn't clear, how is this post aiming to have an impact? Reasoning about my estimate: How do I arrive at my estimate of impact given what I know about the world? Guesstimate model: Verbal reasoning can be particularly messy, so I also provide a guesstimate model Ballpark: A verbal estimate Estimate: A numerical estimate of impact If a writeup refers to a project distinct from the writeup, I generally try to estimate the impact of both the project and the writeup. Where possible, I estimated their impact in an ad-hoc scale, Quality Adjusted Research Papers (QARPs for short), whose levels correspond to the following: Value Description Example ~0.1 mQARPs A thoughtful comment A thoughtful comment about the details of setting up a charity ~1 mQARPs A good blog post, a particularly good comment What considerations influence whether I have more influence over short or long timelines? ~10 mQARPs An excellent blog post Humans Who Are Not Concentrating Are Not General Intelligences ~100 mQ A fairly valuable paper Categorizing Variants of Goodhart's Law. ~1 QARPs A particularly valuable paper The Vulnerable World Hypothesis ~10-100 QARPs A research agenda The Global Priorities Institute's Research Agenda. ~100-1000+ QARPs A foundational popular book on a valuable topic Superintelligence, Thinking Fast and Slow ~1000+ QARPs A foundational research work Shannon's "A Mathematical Theory of Communication." Ideally, this would both have relative meaning (i.e., I claim that an average thoughtful comment is worth less than an average good post), and absolute meaning (i.e., after thinking about it, a factor of 10x between an average thoughtful comment and an average good post seems roughly right). In practice, the second part is a work in progress. In an ideal world, this estimate would be cause-independent, but cause comparability is not a solved problem, and in practice the scale is more aimed towards long-term focused projects. To elaborate on cause independence, upon reflection we may find out that a fairly valuable paper on AI Alignment might be 20 times as a fairly valuable paper on Food Security, and give both of their impacts in a common unit. But we are uncertain about their actual relative impacts, and they will not only depend on uncertainty, but also on moral preferences and values (e.g., weight given to animals, weight given to pe...
What is the nature of innovation? Is it overhearing a conversation as with Morse and the telegraph? Working with the deaf as with Bell? Divine inspiration? Necessity? Science fiction? Or given that the answer to all of these is yes, is it really more the intersectionality between them and multiple basic and applied sciences with deeper understandings in each domain? Or is it being given the freedom to research? Or being directed to research? Few have as storied a history of innovation as Bell Labs and few have had anything close to the impact. Bell Labs gave us 9 Nobel Prizes and 5 Turing awards. Their alumni have even more, but those were the ones earned while at Bell. And along the way they gave us 26,000 patents. They researched, automated, and built systems that connected practically every human around the world - moving us all into an era of instant communication. It's a rich history that goes back in time from the 2018 Ashkin Nobel for applied optical tweezers and 2018 Turing award for Deep Learning to an almost steampunk era of tophats and the dawn of the electrification of the world. Those late 1800s saw a flurry of applied and basic research. One reason was that governments were starting to fund that research. Alessandro Volta had come along and given us the battery and it was starting to change the world. So Napolean's nephew, Napoleon III, during the second French Empire gave us the Volta Prize in 1852. One of those great researchers to receive the Volta Prize was Alexander Graham Bell. He invented the telephone in 1876 and was awarded the Volta Prize, getting 50,000 francs. He used the money to establish the Volta Laboratory, which would evolve or be a precursor to a research lab that would be called Bell Labs. He also formed the Bell Patent Association in 1876. They would research sound. Recording, transmission, and analysis - so science. There was a flurry of business happening in preparation to put a phone in every home in the world. We got the Bell System, The Bell Telephone Company, American Bell Telephone Company patent disputes with Elisha Gray over the telephone (and so the acquisition of Western Electric), and finally American Telephone and Telegraph, or AT&T. Think of all this as Ma' Bell. Not Pa' Bell mind you - as Graham Bell gave all of his shares except 10 to his new wife when they were married in 1877. And her dad ended up helping build the company and later creating National Geographic, even going international with International Bell Telephone Company. Bell's assistant Thomas Watson sold his shares off to become a millionaire in the 1800s, and embarking on a life as a Shakespearean actor. But Bell wasn't done contributing. He still wanted to research all the things. Hackers gotta' hack. And the company needed him to - keep in mind, they were a cutting edge technology company (then as in now). That thirst for research would infuse AT&T - with Bell Labs paying homage to the founder's contribution to the modern day. Over the years they'd be on West Street in New York and expand to have locations around the US. Think about this: it was becoming clear that automation would be able to replace human efforts where electricity is concerned. The next few decades gave us the vacuum tube, flip flop circuits, mass deployment of radio. The world was becoming ever so slightly interconnected. And Bell Labs was researching all of it. From physics to the applied sciences. By the 1920s, they were doing sound synchronized with motion and shooting that over long distances and calculating the noise loss. They were researching encryption. Because people wanted their calls to be private. That began with things like one-time pad cyphers but would evolve into speech synthesizers and even SIGSALY, the first encrypted (or scrambled) speech transmission that led to the invention of the first computer modem. They had engineers like Harry Nyquist, whose name is on dozens of theories, frequencies, even noise. He arrived in 1917 and stayed until he retired in 1954. One of his most important contributions was to move beyond printing telegraph to paper tape and to helping transmit pictures over electricity - and Herbert Ives from there sent color photos, thus the fax was born (although it would be Xerox who commercialized the modern fax machine in the 1960s). Nyquist and others like Ralph Hartley worked on making audio better, able to transmit over longer lines, reducing feedback, or noise. While there, Hartley gave us the oscillator, developed radio receivers, parametric amplifiers, and then got into servomechanisms before retiring from Bell Labs in 1950. The scientists who'd been in their prime between the two world wars were titans and left behind commercializable products, even if they didn't necessarily always mean to. By the 40s a new generation was there and building on the shoulders of these giants. Nyquist's work was extended by Claude Shannon, who we devoted an entire episode to. He did a lot of mathematical analysis like writing “A Mathematical Theory of Communication” to birth Information Theory as a science. They were researching radio because secretly I think they all knew those leased lines would some day become 5G. But also because the tech giants of the era included radio and many could see a day coming when radio, telephony, and aThey were researching how electrons diffracted, leading to George Paget Thomson receiving the Nobel Prize and beginning the race for solid state storage. Much of the work being done was statistical in nature. And they had William Edwards Deming there, whose work on statistical analysis when he was in Japan following World War II inspired a global quality movement that continues to this day in the form of frameworks like Six Sigma and TQM. Imagine a time when Japanese manufacturing was of such low quality that he couldn't stay on a phone call for a few minutes or use a product for a time. His work in Japan's reconstruction paired with dedicated founders like Akio Morita, who co-founded Sony, led to one of the greatest productivity increases, without sacrificing quality, of any time in the world. Deming would change the way Ford worked, giving us the “quality culture.” Their scientists had built mechanical calculators going back to the 30s (Shannon had built a differential analyzer while still at MIT) - first for calculating the numbers they needed to science better then for ballistic trajectories, then with the Model V in 1946, general computing. But these were slow; electromechanical at best. Mary Torrey was another statistician of the era who along with Harold Hodge gave us the theory of acceptance sampling and thus quality control for electronics. And basic electronics research to do flip-flop circuits fast enough to establish a call across a number of different relays was where much of this was leading. We couldn't use mechanical computers for that, and tubes were too slow. And so in 1947 John Bardeen, Walter Brattain, and William Shockley invented the transistor at Bell Labs, which be paired with Shannon's work to give us the early era of computers as we began to weave Boolean logic in ways that allowed us to skip moving parts and move to a purely transistorized world of computing. In fact, they all knew one day soon, everything that monster ENIAC and its bastard stepchild UNIVAC was doing would be done on a single wafer of silicon. But there was more basic research to get there. The types of wires we could use, the Marnaugh map from Maurice Karnaugh, zone melting so we could do level doping. And by 1959 Mohamed Atalla and Dawon Kahng gave us metal-oxide semiconductor field-effect transistors, or MOSFETs - which was a step on the way to large-scale integration, or LSI chips. Oh, and they'd started selling those computer modems as the Bell 101 after perfecting the tech for the SAGE air-defense system. And the research to get there gave us the basic science for the solar cell, electronic music, and lasers - just in the 1950s. The 1960s saw further work work on microphones and communication satellites like Telstar, which saw Bell Labs outsource launching satellites to NASA. Those transistors were coming in handy, as were the solar panels. The 14 watts produced certainly couldn't have moved a mechanical computer wheel. Blaise Pascal and would be proud of the research his countries funds inspired and Volta would have been perfectly happy to have his name still on the lab I'm sure. Again, shoulders and giants. Telstar relayed its first television signal in 1962. The era of satellites was born later that year when Cronkite televised coverage of Kennedy manipulating world markets on this new medium for the first time and IBM 1401 computers encrypted and decrypted messages, ushering in an era of encrypted satellite communications. Sputnik may heave heated the US into orbit but the Telstar program has been an enduring system through to the Telstar 19V launched in 2018 - now outsourced to a Falcon 9 rocket from Space X. It might seem like Bell Labs had done enough for the world. But they still had a lot of the basic wireless research to bring us into the cellular age. In fact, they'd plotted out what the cellular age would look like all the way back in 1947! The increasing use of computers to do the all the acoustics and physics meant they were working closely with research universities during the rise of computing. They were involved in a failed experiment to create an operating system in the late 60s. Multics influenced so much but wasn't what we might consider a commercial success. It was the result of yet another of DARPA's J.C.R. Licklider's wild ideas in the form of Project MAC, which had Marvin Minsky and John McCarthy. Big names in the scientific community collided with cooperation and GE, Bell Labs and Multics would end up inspiring many a feature of a modern operating system. The crew at Bell Labs knew they could do better and so set out to take the best of Multics and implement a lighter, easier operating system. So they got to work on Uniplexed Information and Computing Service, or Unics, which was a pun on Multics. Ken Thompson, Dennis Ritchie, Doug McIllroy, Joe Assana, Brian Kernigan, and many others wrote Unix originally in assembly and then rewrote it in C once Dennis Ritchie wrote that to replace B. Along the way, Alfred Aho, Peter Weinber, and Kernighan gave us AWSK and with all this code they needed a way to keep the source under control so Marc Rochkind gave us the SCCS, or Course Code Control System, first written for an IBM S/3370 and then ported to C - which would be how most environments maintained source code until CVS came along in 1986. And Robert Fourer, David Gay, and Brian Kernighan wrote A Mathematical Programming Language, or AMPL, while there. Unix began as a bit of a shadow project but would eventually go to market as Research Unix when Don Gillies left Bell to go to the University of Illinois at Champaign-Urbana. From there it spread and after it fragmented in System V led to the rise of IBM's AIX, HP-UX, SunOS/Solaris, BSD, and many other variants - including those that have evolved into the macOS through Darwin, and Android through Linux. But Unix wasn't all they worked on - it was a tool to enable other projects. They gave us the charge-coupled device, which resulted in yet another Nobel Prize. That is an image sensor built on the MOS technologies. While fiber optics goes back to the 1800s, they gave us attenuation over fiber and thus could stretch cables to only need repeaters every few dozen miles - again reducing the cost to run the ever-growing phone company. All of this electronics allowed them to finally start reducing their reliance on electromechanical and human-based relays to transistor-to-transistor logic and less mechanical meant less energy, less labor to repair, and faster service. Decades of innovation gave way to decades of profit - in part because of automation. The 5ESS was a switching system that went online in 1982 and some of what it did - its descendants still do today. Long distance billing, switching modules, digital line trunk units, line cards - the grid could run with less infrastructure because the computer managed distributed switching. The world was ready for packet switching. 5ESS was 100 million lines of code, mostly written in C. All that source was managed with SCCS. Bell continued with innovations. They produced that modem up into the 70s but allowed Hayes, Rockewell, and others to take it to a larger market - coming back in from time to time to help improve things like when Bell Labs, branded as Lucent after the breakup of AT&T, helped bring the 56k modem to market. The presidents of Bell Labs were as integral to the success and innovation as the researchers. Frank Baldwin Jewett from 1925 to 1940, Oliver Buckley from 40 to 51, the great Mervin Kelly from 51 to 59, James Fisk from 59 to 73, William Oliver Baker from 73 to 79, and a few others since gave people like Bishnu Atal the space to develop speech processing algorithms and predictive coding and thus codecs. And they let Bjarne Stroustrup create C++, and Eric Schmidt who would go on to become a CEO of Google and the list goes on. Nearly every aspect of technology today is touched by the work they did. All of this research. Jon Gerstner wrote a book called The Idea Factory: Bell Labs and the Great Age of American Innovation. He chronicles the journey of multiple generations of adventurers from Germany, Ohio, Iowa, Japan, and all over the world to the Bell campuses. The growth and contraction of the basic and applied research and the amazing minds that walked the halls. It's a great book and a short episode like this couldn't touch the aspects he covers. He doesn't end the book as hopeful as I remain about the future of technology, though. But since he wrote the book, plenty has happened. After the hangover from the breakup of Ma Bell they're now back to being called Nokia Bell Labs - following a $16.6 billion acquisition by Nokia. I sometimes wonder if the world has the stomach for the same level of basic research. And then Alfred Aho and Jeffrey Ullman from Bell end up sharing the Turing Award for their work on compilers. And other researchers hit a terabit a second speeds. A storied history that will be a challenge for Marcus Weldon's successor. He was there as a post-doc there in 1995 and rose to lead the labs and become the CTO of Nokia - he said the next regeneration of a Doctor Who doctor would come in after him. We hope they are as good of stewards as those who came before them. The world is looking around after these decades of getting used to the technology they helped give us. We're used to constant change. We're accustomed to speed increases from 110 bits a second to now terabits. The nature of innovation isn't likely to be something their scientists can uncover. My guess is Prometheus is guarding that secret - if only to keep others from suffering the same fate after giving us the fire that sparked our imaginations. For more on that, maybe check out Hesiod's Theogony. In the meantime, think about the places where various sciences and disciplines intersect and think about the wellspring of each and the vast supporting casts that gave us our modern life. It's pretty phenomenal when ya' think about it.
Recap of the business books that we have read Shoedog: Autobiography of Phil Knight, founder of Nike The lean startup, Eric Ries: How to build a startup, the antifragile way Ben Horowits The Hard thing about hard things helps throw light at the challenges a CEO goes through. The Messy Middle - Scott Belsky: Talks about stuff between the most romantic parts of a venture, from starting in a garage or college dorm to successfully doing a multi-billion dollar IPO. Obviously Awesome - April Dunford positioning framework that actually works, because she sees that positioning is often misunderstood, and can be really powerful, especially for saas startups Hooked - Nir Eyal how to build habit-forming products Venture Deals - Brad Feld and Jason Mendelson Good Strategy, Bad Strategy - Richard Rumelt Strategy =/= ambitious goal setting, vision, charisma Good strategy identifies the key challenge to overcome Good strategy includes actions to take to overcome Top 3 The Lean Startup Hooked Venture Deals Wildcard: The 7 habits of highly effective people by stephen covey What to expect on the next season - Human Body series If our bodies could talk by James Hamblin If our bodies could talk is a guide that tackles about different human stories James Hamblin, a doctor and a journalist at Atlantic, created a video turned into a book that respond to the common medical questions of people. Endless curiosity lead us to seek new knowledge especially when it comes to our body. If our bodies could talk, a guide that tackles and give clarity how human treat his body and how it should be. Author dropped some of the frequently asked questions such as: • Can I "boost" my immune system? • Does caffeine make me live longer? • Do we still not know if cell phones cause cancer? • How much sleep do I actually need? • Is there any harm in taking a multivitamin? • Is life long enough? It focuses on body functions starting with the body's superficial parts — eyes, and skin. Then, body actions such as eating, feeling, drinking, and even dying. His approach is interesting and straightforward. He intends to inform the reader's to live a healthy lifestyle and worry less about the things that don't matter. His context explain the misconceptions versus marketing-based facts. WHY WE SLEEP by Matthew Walker Why we sleep, a New York times bestseller written by Matthew Walker, a professor of neuroscience and has contributed over 100 scientific studies. Why we sleep thoroughly explain the essence of sleep. It is described as one of the most important activity that people shouldn't take advantage because it has a short and long-term effect on our physical, mental, and emotional health. Since most people are sleep- deprived, Matthew clearly states that it can linked to serious health diseases such as cancer, diabetes and even death. Part 1: This Thing Called Sleep 1. To sleep 2. Caffeine, Jet Lag, and Melatonin: Losing and Gaining Control of Your Sleep Rhythm 3. Defining and Generating Sleep 4. Ape Beds, Dinosaurs, and Napping with Half a Brain: Who Sleeps, How Do We Sleep, and How Much? 5. Changes in Sleep Across the Life Span Part 2: Why Would You Sleep? 6. Your Mother and Shakespeare Knew 7. Too Extreme for the Guinness Book of World Records 8. Cancer, Heart Attacks, and a Shorter Life Part 3: How and Why We Dream 9. Routinely Psychotic 10. Dreaming as Overnight Therapy 11. Dream Creativity and Dream Control Part 4: From Sleeping Pills to Society Transformed 12. Things That Go Bump in the Night 13. iPads, Factory Whistles, and Nightcaps 14. Hurting and Helping Your Sleep 15. Sleep and Society: What Medicine and Education Are Doing Wrong; What Google and NASA Are Doing Right. 16. A New Vision for Sleep in the Twenty-First Century Part 5: Twelve Tips for Healthy Sleep Basically, Walker aims to warn us about lack of sleep and beauty of dreams that will give you longevity. Breath by James Nestor Breath, written by James Nestor, author and journalist who has written for New York Times, BBC, National Public Radio, gives you a transformation that changes your body and mind. It all starts with breathing. It is one of the underrated body activities yet the pillar of healthy lifestyle. Nestor stated that to breathe is not just taking the air in and letting it out, it has an art. He reveal the basic truth how the art of breathing occurs. There are many ways to breathe — the 5.5 symmetry, 5.5 second inhales followed by 5.5 second exhales which equals to 5.5 breaths a minute is the most efficient breathing rhythm. When your heartbeat speeds up, exhale slowly. To exhale is a parasympathetic response which calms your mental state. The misconception of being “less nature, more nurture” is far from truth. Workout exercises can increase your lung's capacity. He used free divers as an example, diving down thousands of feet, made their lungs larger. Nose breathing is always better than mouth breathing. It lowers your blood pressure, heart rate and helps preserve memories that keep your body balanced. Lifespan by David. A Sinclair Lifespan written by David Sinclair, professor of genetics at Harvard Medical School. In this book, author explains why an individual undergo aging. Aging causes stem cell loss and genetic instability. Through his research, David created a theory that aging is a “loss of information” based by the Mathematical Theory of Communication by Claude Shannon. In this theory, there are two types that transmits information — digital and analog. Analog is continuous and interrupted by a noise while digital is discrete. Both serve as the genetic and epigenetic code respectively which distinguishes which genes are present in the cell. David concluded that noise destroys the gene expression and other processes which results to malfunctioning and aging of an individual. This self-help books is somehow a wake-up call for everyone about how the science of aging takes place. GUT by Giulia Enders Gut, sold over million copies written by Giulia Enders, two-time scholarship winner of the Heraeus Foundation. Author states that treating your guts well, will treat your body well in return. She wants the readers to explore how digestive system works and explains step by step. From a food which enters the mouth to gastric bubble to stomach to small intestine. Ender shows also microbes as part of the process and also produce nutrients that is being absorbed by our body. These bacteria occupy space and latch at specific locations. She also shares how important cleanliness is, the best position to defecate, vomiting and washing of fruits and vegetables. Her book serve as a good source and a user-friendly type which can be useful to anyone. Burn Herman Ponser Burn, written by Herman Pontzer, anthropologist at Duke University. This book is an eye-opener who loves to exercise and lose weight, be physically fit. Pontzer shows how metabolism works and manage our desired weight. He implies that exercising doesn't burn your calories, diet does. He said “Use diet to watch your weight, and exercise for everything else”. Pontzer believes that we're not in control of our metabolism but you have control on your diet. His observation states that the more you exercise, more your body manage energy. Exercise will lead you a healthy well-being but doesn't give you're body huge changes. He also offers explanations about the role of foods is essential in maintaining your desired body status and won't lead you on overconsume. Death by food Pyramid Denise MInger Nutrition, written by Denise Minger,. A book that reveals the truth about nutrition. Her book needs an extensive reading in order to absorb the content because it contains a lot of data that will surely serve as your primary source in terms of your human nutrition. It is divided into three major parts — Shady Politics, Slippery Science, and New Geometry. Minger exposed the politics that led the USDA Food Pyramid of Nutrition that is responsible in promoting agriculture problems. She describes how low-fat diet is important in improving one's nutrition. She even debunked the early research due to poor methodology. Being aware about nutrition will become very useful instead of being dependent on doctors. She gave tips on how to evaluate who to trust and who to recognize as an authority. She also gave an overview about “muscle meats” and how to cook meats to lessen the carcinogenic properties. Whether you're a beginner, athlete, professional, nutrionist, this is perfect for everyone. If our bodies could talk (James Hamblin) Why We Sleep (Matthew Walker) Breath (James Nestor) Lifespan (Dr a Sinclair) Gut (Julia Enders) Burn (Herman Ponser) Death by food pyramid (Denise Minger)
Transcript http://nav.al/substrate
Our topic this week is Claude Shannon, a mathematician and engineer known as the Father of Information theory for his landmark paper "A Mathematical Theory of Communication", which he published in 1948. Shannon's seminal work and discoveries ushered in the digital age, and for that alone, his life is worthy of study, but Shannon also had this other remarkable quality to his life – a very playful and creative mind. Shannon was always curious, and he devoted his considerable intellect to a diverse range of activities and interests, that included juggling, unicycles, artificial intelligence, chess playing machines, wearable computers – he even built a chairlift on his property. He was both a mathematical and creative genius.My guests today are Jimmy Soni and Mark Levinson. Jimmy co-authored a biography of Shannon titled A Mind at Play and Mark directed a documentary about Shannon called The Bit Player which is available on Amazon Prime. In both of these works, Jimmy and Mark seek to explore the incredible mind of Claude Shannon. In this episode we seek to distill the secrets to Shannon's creativity, and we talk about how we can apply these lessons to our own lives.What You'll Learn:· The importance of Information Theory and Shannon's significant contribution to the digital computer and the information age· How Shannon relied on intuition as a guide when solving mathematical problems· How Shannon would take a complex problem, simplify it down to its essence, and then build it back up to uncover deep hidden truths that eluded his colleagues· How Shannon's disregard for prestige and awards freed up his time and mind for creative work· How pursuing “trivial” and “whimsical” projects would often lead Shannon to profound insights· How Shannon used creative dissatisfaction to drive innovation· How we can apply Shannon's creative techniques to our own livesResourcesA Mind at Play by Jimmy Soni & Rob GoodmanThe Bit Player directed by Mark Levinson11 Life Lessons from History's Most Underrated Genius by Soni & Goodman“A Mathematical Theory of Communication” by Claude ShannonConnect with Jimmy Soni & Mark LevinsonLinkedIn for Jimmy: https://www.linkedin.com/in/jimmysoni/LinkedIn for Mark: https://www.linkedin.com/in/mark-levinson-b400475/Connect with Sean MurrayEmail: seanm@realtimeperformance.comTwitter: @seanpmurray111LinkedIn: https://www.linkedin.com/in/seanpmurray/Website: www.seanpmurray.netNewsletter: https://www.realtimeperformance.com/newsletter/See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.
Further Watching Overview: https://www.youtube.com/watch?v=OY1JsGFZprc Further Reading Shannon, Claude E, and Warren Weaver. The Mathematical Theory of Communication. Illinois, University Of Illinois Press, 1949.
Learn more about everything referenced in this episode by clicking the links below:2019 InterPlanetary Festival's “Game Design Panel,” moderated by FrankInterPlanetary Transmissions. Volume 2: Stardust, featuring an introduction to the Game Design panel by FrankNYU Game CenterClaude Shannon's “A Mathematical Theory of Communication.”Alien Crash Site interviews with GPT-3Frank's Universal PaperclipsDavid ChapmanMarcel DuchampCaitlin's favorite Jonathan Richman performanceMonday begins on Saturday by Arkady and Boris StrugatskyHard to Be a God also by the Strugatsky BrothersStanislaw LemPhilip K. DickJ.G. BallardSCP WikiAntimemeticsqntm
This prefix “cyber” is pretty common in our vernacular today. Actually it was in the 90s and now seems reserved mostly for governmental references. But that prefix has a rich history. We got cyborg in 1960 from Manfred Clynes and Nathan S. Kline. And X-Men issue 48 in 1968 introduced a race of robots called Cybertrons, likely the inspiration for the name of the planet the Transformers would inhabit as they morphed from the Japanese Microman and Diaclone toys. We got cyberspace from William Gibson in 1982 and cyberpunk from the underground art scene in the 1980s. We got cybersex in the mid-90s with AOL. The term cybercrime rose to prominence in that same timeframe, being formalized in use by the G8 Lyons Group on High-Tech Crime. And we get cybercafes, cyberstalking, cyberattack, cyberanarchism, cyberporn, and even cyberphobia of all those sound kinda' ick. And so today, the word cyber is used to prefix a meaning around the culture of computers, information technology, and virtual reality and the meaning is pretty instantly identifiable. But where did it come from? The word is actually short for cybernetic, which is greek for skilled in steering or governing. And Cybernetics is a multi-disciplinary science, or psuedo-science according to who you talk to, that studies systems. And it's defined in its most truest form with the original 1948 definition from the author who pushed it into the mainstream, Norbert Wiener: “the scientific study of control and communication in the animal and the machine.” Aaaactually, let's back up a minute. French physicist André-Marie Ampère coined the term cybernétique in 1934, which he called his attempt to classify human knowledge. His work on electricity and magnetism would result in studies that would earn him the honor of having the Amp named after him. But jump forward to World War Two and after huge strides in General Systems Theory and negative feedback loops and the amazing work done at Bell Labs, we started getting MIT's Jay Forrester (who would invent computer memory) and Gordon Brown, who defined automatic-feedback control systems and solidified servomechanisms, or servos in engineering applying systems thinking all over the place, which also resulted in Forrester applying that thinking to Management, resulting in the MIT Sloan School of Management. And Deming applied these concepts to process, resulting in Total Quality Management which has been a heavy influence on what we call Six Sigma today. And John Boyd would apply systems thinking and feedback loops into military strategy. So a lot of people around the world were taking a deeper look at process and feedback and loops and systems in general. During World War II, systems thinking was on the rise. And seeing the rise of the computer, Norbert Wiener worked on anti-aircraft guns and was looking into what we now call information theory at about the same time Claude Shannon was. Whereas Claude Shannon went on to formalize Information Theory, Wiener formalized his work as cybernetics. He had published “A simplification in the logic of relations” in 1914, so he wasn't new to this philosophy of melding systems and engineering. But things were moving quickly. ENIAC had gone live in 1947. Claud Shannon published a paper in 1948 that would emerge as a book called “A Mathematical Theory of Communication” by 1949. So Wiener published his book called Cybernetics, or the Control and Communication in the Animal and the Machine, in 1948. And Donald Mackay was releasing his book on Multiplication and division by electronic analogue methods in 1948 in England. Turing's now infamous work during World War II had helped turn the tides and after the war he was working on the Automatic Computing Engine. John von Neumann had gone from developing game theory to working on the Manhattan Project and nuclear bombs and working with ENIAC to working on computing at Princeton and starting to theorize on cellular automata. J.C.R. Licklider was just discovering the computer while working on psychoacoustics research at Harvard - work that would propel him to become the Johnny Appleseed of computing and the instigator at the center of what we now call the Internet and personal computers. Why am I mentioning so many of the great early thinkers in computing? Because while Wiener codified, he was not alone responsible for Cybernetics. In fact, the very name Cybernetics had been the name of a set of conferences held from 1946 to 1953 and organized by the Josiah Macy, Jr foundation. These conferences and that foundation are far more influential in Western computing in the 50s and 60s, and the principals that sprang from that and went around the world than credit is usually given. All of those people mentioned and dozens of others who are responsible for so many massive, massive discoveries were at those conferences and in the clubs around the world that sprang up from their alumni. They were looking for polymaths who could connect dots and deep thinkers in specialized fields to bring science forward through an interdisciplinary lens. In short, we had gone beyond a time when a given polymath could exceed at various aspects of the physical sciences and into a world where we needed brilliant specialists connected with those polymaths to gain quantum leaps in one discipline, effectively from another. And so Wiener took his own research and sprinkled in bits from others and formalized Cybernetics in his groundbreaking book. From there, nearly every discipline integrated the concept of feedback loops. Plato, who the concept can be traced back to, would have been proud. And from there, the influence was massive. The Cold War Military-Industrial-University complex was coming into focus. Paul Baran from RAND would read McCullough and Pitts' work from Cybernetcs and neural nets and use that as inspiration for packet switching. That work and the work of many others in the field is now the basis for how computers communicate with one another. The Soviets, beginning with Glushkov, would hide Cybernetics and dig it up from time to time restarting projects to network their cities and automate the command and control economy. Second order cybernetics would emerge to address observing systems and third order cybernetics would emerge as applied cybernetics from the first and second order. We would get system dynamics, behavioral psychology, cognitive psychology, organizational theory, neuropsychology, and the list goes on. The book would go into a second edition in 1965. While at MIT, Wiener was also influential in early theories around robotics and automation. Applied cybernetics. But at the Dartmouth workshop in 1956, John McCarthy along with Marvin Minsky and Claude Shannon would effectively split the field into what they called artificial intelligence. The book Emergence is an excellent look at applying the philosophies to ant colonies and analogizing what human enterprises can extract from that work. Robotics is made possible by self-correcting mechanisms in the same way learning organizations and self-organization factor in. Cybernetics led to control theory, dynamic systems, and even chaos theory. We've even grown to bring biocybernetics into ecology, and synthetic and systems biology. Engineering and even management. The social sciences have been heavily inspired by cybernetics. Attachment theory, the cognitive sciences, and psychovector analysis are areas where psychology took inspiration. Sociology, architecture, law. The list goes on. And still, we use the term artificial intelligence a lot today. This is because we are more focused on productivity gains and the truths the hard sciences can tell us with statistical modeling than with the feedback loops and hard study we can apply to correcting systems. I tend to think this is related to what we might call “trusting our guts.” Or just moving so fast that it's easier to apply a simplistic formula to an array to find a k-nearest neighbor than it is to truly analyze patterns and build feedback loops into our systems. It's easier to do things because “that's the way we've always done that” than to set our ego to the side and look for more efficient ways. That is, until any engineer on a production line at a Toyota factory can shut the whole thing down due to a defect. But even then it's easier to apply principles from lean manufacturing than to truly look at our own processes, even if we think we're doing so by implementing the findings from another. I guess no one ever said organizational theory was easy. And so whether it's the impact to the Internet, the revolutions inspired in applied and sciences, or just that Six Sigma Blackbelt we think we know, we owe Wiener and all of the others involved in the early and later days of Cybernetics a huge thank you. The philosophies they espoused truly changed the world. And so think about this. The philosophies of Adam Smith were fundamental to a new world order in economics. At least, until Marx inspired Communism and the Great Depression inspired English economist John Maynard Keynes to give us Keynesian economics. Which is still applied to some degree, although one could argue incorrectly with Stimulus checks when compared to the New Deal. Necessity is the mother of invention. So what are the new philosophies emerging from the hallowed halls of academia? Or from the rest of the world at large? What comes after Cybernetics and Artificial Intelligence? Is a tough economy when we would expect the next round of innovative philosophy that could then be applied to achieve the same kinds of productivity gains we got out of the digitization of the world? Who knows. But I'm an optimist that we can get inspired - or I wouldn't have asked. Thank you for tuning in to this episode of the history of computing podcast. We are so lucky to have you. Have a great day.
Link to bioRxiv paper: http://biorxiv.org/cgi/content/short/2020.09.09.290601v1?rss=1 Authors: George, D., Lazaro-Gredilla, M., Lehrach, W., Dedieu, A., Zhou, G. Abstract: Understanding the information processing roles of cortical circuits is an outstanding problem in neuroscience and artificial intelligence. Theory-driven efforts will be required to tease apart the functional logic of cortical circuits from the vast amounts of experimental data on cortical connectivity and physiology. Although the theoretical setting of Bayesian inference has been suggested as a framework for understanding cortical computation, making precise and falsifiable biological mappings need models that tackle the challenge of real world tasks. Based on a recent generative model, Recursive Cortical Networks, that demonstrated excellent performance on visual task benchmarks, we derive a family of anatomically instantiated and functional cortical circuit models. Efficient inference and generalization guided the representational choices in the original computational model. The cortical circuit model is derived by systematically comparing the computational requirements of this model with known anatomical constraints. The derived model suggests precise functional roles for the feed-forward, feedback, and lateral connections observed in different laminae and columns, assigns a computational role for the path through the thalamus, predicts the interactions between blobs and inter-blobs, and offers an algorithmic explanation for the innate inter-laminar connectivity between clonal neurons within a cortical column. The model also explains several visual phenomena, including the subjective contour effect, and neon-color spreading effect, with circuit-level precision. Our work paves a new path forward in understanding the logic of cortical and thalamic circuits. Copy rights belong to original authors. Visit the link for more info
Cristine works in technical sales and support in the wireless industry. She has spent much of her career doing technical education, training, and documentation. She capitalizes on her insatiable curiosity and need to thoroughly understand things both in her career as an educator and in her role as a mom. Cristine also shares her childhood and educational experience growing up in Brazil.Episode NotesMusic used in the podcast: Higher Up, Silverman Sound StudioAcronyms and DefinitionsComputer Engineering - the branch of engineering that integrates electronic engineering with computer sciences. Computer engineers design and develop computer systems and other technological devices.Russian School of Mathematics - an after school program that provides mathematics education for children attending K–12 of public and private schools. The school provides children the opportunity to advance in mathematics beyond the traditional school curriculum. The founder of RSM is Inessa Rifkin and co-founder is Irene Khavinson (wikipedia)GSM - Global System for Mobile Communications - a standard developed by the European Telecommunications Standards Institute (ETSI) to describe the protocols for second-generation (2G) digital cellular networks used by mobile devices such as mobile phones and tablets. (wikipedia)GPRS - General Packet Radio Service - a packet oriented mobile data standard on the 2G and 3G cellular communication network's global system for mobile communications(GSM). (wikipedia)3GPP - The 3rd Generation Partnership Project - unites [Seven] telecommunications standard development organizations (ARIB, ATIS, CCSA, ETSI, TSDSI, TTA, TTC), known as “Organizational Partners” and provides their members with a stable environment to produce the Reports and Specifications that define 3GPP technologies. (www.3gpp.org)Fact CheckWhen did wireless come to Brazil? The history of mobile telephony in Brazil began on 30 December 1990, when the Cellular Mobile System began operating in the city of Rio de Janeiro, with a capacity for 10,000 terminals. According to Anatel (the national telecommunications agency), there were 667 devices in the country. The number of devices rose to 6,700 in the next year, to 30,000 in 1992. In November 2007 3G services were launched, and increased rapidly to almost 90% of the population in 2012 and the agreements signed as part of the auction specify a 3G coverage obligation of 100% of population by 2019. (wikipedia)Claude Shannon - (April 30, 1916 – February 24, 2001) was an American mathematician, electrical engineer, and cryptographer known as "the father of information theory". Shannon is noted for having founded information theory with a landmark paper, "A Mathematical Theory of Communication", that he published in 194
This is Lecture 4 (out of 6) in the Based Deleuze lecture course. You can get the whole series at gum.co/deleuze. ➡️If you'd like to join my Discord server, request an invitation here. ➡️Big thanks to my patrons who help me keep the lights on. Consider becoming one here. Works Cited Deleuze, Gilles. “Postscript on the Societies of Control.” October 59 (1992): 3–7. Foucault, Michel. The Courage of Truth (The Government of Self and Others II). Edited by Frédéric Gross. Translated by Graham Burchell. Basingstoke: Palgrave Macmillan, 2011. Foucault, Michel. Discipline and Punish: The Birth of the Prison. Translated by Alan Sheridan. New York: Vintage Books, 1995. Murphy, Justin. “Parrhesia and the Future of Honesty (Talk given at the Invisible College, London).” Other Life (blog), October 11, 2019. https://plnk.to/otherlife/e/1000453126804 Navia, Luis. Diogenes the Cynic: The War Against the World. Amherst, NY: Humanity Books, 2005. Shannon, Claude E. “A Mathematical Theory of Communication.” The Bell System Technical Journal 27, no. 3 (October 1948). https://doi.org/10.1002/j.1538-7305.1948.tb01338.x
You’ve heard me talk about the Mathematical Theory of Communication a time or two. Okay, it’s probably more than that. But it’s for good reason, as you’ll see in today’s episode. We talk about being at cause, about living the life you want to live, about creating your own reality essentially...and all that stems from harnessing your 50 to 60 bits of information. What 50 to 60 bits? Here’s a quick refresher. Your unconscious mind processes 2 to 11 million bits of information per second while your conscious mind only processes 50 to 60 of those bits. Only 50 to 60 of those bits reach your awareness. Here’s the kicker -- you get to choose which 50 to 60 bits reach your awareness. This is powerful, because your internal representations -- how you interpret outside events -- is determined by those 50 to 60 bits. Now, we all have a negativity bias. Our brain is designed to protect us, to look out for the bad stuff, to anticipate worst-case scenarios. If we want to see the positive, we’ve got to focus on the positive. And we need to work at it to counter that negativity bias. By consistently shifting your focus, you’ll notice positive change in your overall life experience. It all begins with focusing the conscious mind on what you want, which, when repeated often enough, directs the unconscious mind to reflect in your experience the object of the focus. The bottom line -- the unconscious mind will filter to your conscious mind what you’ve been focusing on. In essence, you’ll be choosing those 50 to 60 bits that come into your consciousness. Where to start? Watch your language. The things you hear that come into your consciousness are a reflection of negative talk on the inside. Focus on what you want instead of what you don’t want. Watch what you say to others. Your unconscious mind takes everything personally, and complaints are just an invitation for more negative things to come into your awareness. So keep it positive. Watch what you say and believe about yourself. It all starts and ends with you. The people in our lives are merely a reflection of what we believe about ourselves. When you see beauty and awesomeness in others, it’s a reflection of what’s inside of you. Pause and bask in that reality. Notice your environment. After all, it’s a reflection of your inward state. When things aren’t going well, shift your focus. When things are going great, recognize that you did it! Choose your trance. As Milton Erickson said, “Everybody is in a trance.” We’re all filtering life through a set of beliefs. Get in rapport with yourself and decide what you want to believe. You can choose your trance! Doing the above will help you control the controllables -- those 50 to 60 bits coming to your consciousness each second. When you’re controlling the controllables, you can see the best in your children, find the positive things in that once annoying coworker, see the love in your partner’s gaze, and stop blaming external factors when things go awry. No one else can choose those powerful bits for you but you. It has to come from you. Thanks for listening! To share your thoughts: Leave a note in the comment section below Use the “I have a question” button Share this show on Twitter, Facebook, and LinkedIn Links from today’s episode: Episode 2 -- We learned about internal representations Episode 3 -- We learned about perception is projection Have you taken the purely positive quiz yet? To help out the show: Leave a positive review on iTunes. Your ratings and reviews help, and I read each and every one. Subscribe on iTunes or Stitcher or Libsyn
Welcome to the History of Computing Podcast, where we explore the history of information technology. Because understanding the past prepares us to innovate of the future! Todays episode is is on the microphone. Now you might say “wait, that's not a computer-thing. But given that every computer made in the past decade has one, including your phone, I would beg to differ. Also, every time I record one of these episodes, I seem to get a little better with wielding the instruments, which has led me to spend way more time than is probably appropriate learning about them. So what exactly is a microphone? Well, it's a simple device that converts mechanical waves of energy into electrical waves of energy. Microphones have a diaphragm, much as we humans do and that diaphragm mirrors the sound waves it picks up. So where did these microphones come from? Well, Robert Hooke got the credit for hooking a string to a cup in 1665 and suddenly humans could push sound over distances. Then in 1827 Charles Wheatstone, who invented the telegraph put the word microphone into our vernacular. 1861 rolls around and Johan Philipp Reis build the Reis telephone, which electrified the microphone using a metallic strip that was attached to a vibrating membrane. When a little current was passed through it, it reproduced sound far away. Think of this as more of using electricity to amplify the effects of the string on the cup. But critically, sound had been turned into signal. In 1876, Emile Berliner built a modern microphone while working on the gramophone. He was working with Thomas Edison at the time and would go on to sell the patent for the Microphone to The Bell Telephone Company. Now, Alexander Graham Bell had designed a telephone transmitter in 1876 but ended up in a patent dispute with David Edward Hughes. And as he did with many a great idea, Thomas Edison made the first practical microphone in 1886. This was a carbon microphone that would go on to be used for almost a hundred years. It could produce sound but it kinda' sucked for music. It was used in the first radio broadcast in New York in 1910. The name comes from the cranes of carbon that are packed between two metal plates. Edison would end up introducing the diaphragm and the carbon button microphone would become the standard. That microphone though, often still had a built0-in amp, strengthening the voltage that was the signal sound had been converted to. 1915 rolls around and we get the vacuum tube amplifier. And in 1916, E.C. Wente of Bell Laboratories designed the condenser microphone. This still used two plates, but each had an electrical charge and when the sound vibrations moved the plates, the signal was electronically amplified. Georg Neumann then had the idea to use gold plated PVC and design the mic such that as sound reached the back of the microphone it would be cancelled, resulting in a cardioid pattern, making it the first cardioid microphone and an ancestor to the microphone I'm using right now. In the meantime, other advancements were coming. Electromagnets made it possible to add moving coils and ribbons and Wente and A.C. Thuras would then invent the dynamic, or moving-coil microphone in 1931. This was much more of an omnidirectional pattern and It wasn't until 1959 that the Unidyne III became the first mic to pull in sound from the top of the mic, which would change the shape and look of the microphone forever. Then in 1964 Bell Labs brought us the electrostatic transducer mic and the microphone exploded with over a billion of these built every year. Then Sennheiser gave us clip-on microphones in the 80s, calling their system the Mikroport and releasing it through Telefunken. No, Bootsie Collins was not a member of Telefunken. He'd been touring with James Brown for awhile ad by then was with the Parliament Funkadelic. Funk made a lot of use of all these innovations in sound though. So I see why you might be confused. Other than the fact that all of this was leading us up to a point of being able to use microphones in computers, where's the connection? Well, remember Bell Labs? In 1962 they invented the electret microphone. Here the electrically biased diaphragms have a capacitor that changes with the vibrations of sound waves. Robert Noyce had given us the integrated circuit in 1959 and of microphones couldn't escape the upcoming Moore's law, as every electronics industry started looking for applications. Honeywell came along with silicon pressure sensors, and by 65 Harvey Nathanson gave us a resonant-gated transistors. That would be put on a Monolithic chip by 66 and through the 70s micro sensors were developed to isolate every imaginable environmental parameter, including sound. At this point, computers were still big hulking things. But computers and sound had been working their way into the world for a couple of decades. The technologies would evolve into one another at some point obviously. In 1951, Geoff Hill pushed pules to a speaker using the Australian CSIRAC and Max Mathews at Bell Labs had been doing sound generation on an IBM 704 using the MUSIC program, which went a step further and actually created digital audio using PCM, or Pulse-Code Modulation. The concept of sending multiplexed signals over a wire had started with the telegraph back in the 1870s but the facsimile, or fax machine, used it as far back as 1920. But the science and the math wasn't explaining it all to allow for the computer to handle the rules required. It was Bernard Oliver and Claude Shannon that really put PCM on the map. We've mentioned Claude Shannon on the podcast before. He met Alan Turing in 43 and went on to write crazy papers like A Mathematical Theory of Cryptography, Communication Theory of Secrecy Systems, and A Mathematical Theory of Communications. And he helped birth the field of information theory. When the math nerds showed up, microphones got way cooler. By the way, he liked to juggle on a unicycle. I would too if I could. They documented that you could convert audio to digital by sampling audio and modulation would be mapping the audio on a sine wave at regular intervals. This analog-to-digital converter could then be printed on a chip that would output encoded digital data that would live on storage. Demodulate that with a digital to analog converter, apply an amplification, and you have the paradigm for computer sound. There's way more, like anti-aliasing and reconstruction filters, but someone will always think you're over-simplifying. So the evolutions came, giving us multi-track stereo casettes, the fax machines and eventually getting to the point that this recording will get exported into a 16-bit PCM wave file. PCM would end up evolving to LPCM, or Linear pulse-control modulation and be used in CDs, DVDs, and Blu-ray's. Oh and lossleslly compressed to mp3, mpeg4, etc. By the 50s, MIT hackers would start producing sound and even use the computer to emit the same sounds Captain Crunch discovered the tone for, so they could make free phone calls. They used a lot of paper tape then, but with magnetic tape and then hard drives, computers would become more and more active in audio. By 61 John Kelly Jr and Carol Lockbaum made an IBM 7094 mainframe sing Daisy Bell. Arthur C. Clarke happened to see it and that made it into 2001: A Space Odyssey. Remember hearing it sing that when it was getting taken apart? But the digital era of sound recording is marked as starting with the explosion of Sony in the 1970s. Moore's Law, they got smaller, faster, and cheaper and by the 2000s microelectromechanical microphones web mainstream, which are what are built into laptops, cell phones, and headsets. You see, by then it was all on a single chip. Or even shared a chip. These are still mostly omnidirectional. But in modern headphones, like Apple AirPods then you're using dual beam forming microphones. Beamforming uses multiple sensor arrays to extract sounds based on a whole lot of math; the confluence of machine learning and the microphone. You see, humans have known to do many of these things for centuries. We hooked a cup to a wire and sound came out the other side. We electrified it. We then started going from engineering to pure science. We then analyzed it with all the math so we better understood the rules. And that last step is when it's time to start writing software. Or sometimes it's controlling things with software that gives us the necessary understanding to make the next innovative leap. The invention of the microphone doesn't really belong to one person. Hook, Wheatstone, Reis, Alexander Graham Bell, Thomas Edison, Wente, Thuras, Shannon, Hill, Matthews, and many, many more had a hand in putting that crappy mic in your laptop, the really good mic in your cell phone, and the stupidly good mic in your headphones. Some are even starting to move over to Piezoelectric. But I think I'll save that for another episode. The microphone is a great example of that slow, methodical rise, and iterative innovation that makes technologies truly lasting. It's not always shockingly abrupt or disruptive. But those innovations are permanently world-changing. Just think, because of the microphone and computer getting together for a blind date in the 40s you can now record your hit album in Garage Band. For free. Or you call your parents any time you want. Now pretty much for free. So thank you for sticking with me through all of this. It's been a blast. You should probably call your parents now. I'm sure they'd love to hear from you. But before you do, thank you for tuning in to yet another episode of the History of Computing Podcast. We're so lucky to have you. Have a great day!
One in a series of talks from the 2019 Models of Consciousness conference. Pedro Resende Técnico Lisboa I present a mathematical definition of qualia from which a toy model of consciousness is derived, partly as an attempt to provide a mathematical formulation of the theory of qualia and concepts put forward by C.I. Lewis in 1929. This formulation is guided by the identification of basic principles that convey abstract aspects of the behavior of physical devices that “detect” qualia, such as brains of animals seem to do. The ensuing notion of space of qualia consists of a topological space Q equipped with additional algebraic structure that yields a notion of subjective time and makes Q a so-called stably Gelfand quantale. This leads to interesting conceptual consequences. For instance, “stable observers” emerge naturally and relate closely to the perception of space, which here, contrary to time, is not a primitive notion; and logical versions of quantum superposition and complementarity are obtained. Indeed a mathematical relation exists to quantum theory via operator algebras, due to which a space of qualia can also be regarded as an algebraic and topological model of quantum measurements. Filmed at the Models of Consciousness conference, University of Oxford, September 2019.
The more we learn about the nature of information, the more deep connections we discover. It seems like it is sometimes useful to see the universe as information rather than matter.In this pilot episode of Codexpanse we will discuss the implications of Claude Shannon's seminal paper "A Mathematical Theory of Communication", talk about the connection between entropy in physics and in information, and fantasize about the future of AI-based communication.Related links:A Mathematical Theory of Communication (original paper)The Misunderstood Nature of Entropy, video by PBS Space TimeWhy Information Grows: The Evolution of Order, from Atoms to Economies, book by Cesar HidalgoMusic: Intro by Air Apparent
The University of Singapore creatures an artificial skin that can sense temperature, pressure, and humidity. The International Center for Ethics in the Sciences and Humanities releases its Evaluation of (AI) Guidelines. A report from FutureGrasp takes a global look at the AI initiatives (or lack thereof) of States. Hayden Klok and Yoni Nazarathy release a draft of Statistics with Julia. Metaacademy provides learning plans and resources for learning about topics, from beginner to advanced. Claude Shannon’s 1948 paper “A Mathematical Theory of Communication” makes Andy’s Classic Paper for the week. Stephen Wolfram’s testimony on AI before the US Senate Commerce Committee becomes available, including his blog write-up about the testimony. And Fedor Kitashov publishes an essay on using AI to restore and colorize photos. Click here to leave a testimonial for the 100th episode! Click here to visit our website and explore the links mentioned in the episode.
Arlie Petters is a mathematician and physicist who has created and pioneered the Mathematical Theory of gravitational lensing. His research has been expanded over the years to include many other aspects and he continues to expand in his theory. He is very active in the Black Community. --- This episode is sponsored by · Anchor: The easiest way to make a podcast. https://anchor.fm/app --- Send in a voice message: https://anchor.fm/EverydayBlackHistory/message Support this podcast: https://anchor.fm/EverydayBlackHistory/support
Claude Shannon made our modern digital world possible. He wrote a landmark paper called "The Mathematical Theory of Communication" which gave birth to computer networks, cell phones, compact discs, digital recording and video. It also lent huge insights into genetics and biology. Rob Goodman & Jimmy Soni have written the first full biography of Claude Shannon and it’s great. It’s called "A Mind at Play: How Claude Shannon Invented the Information Age". In this video, we discuss the quirky world of one of the 20th Century's great geniuses. See acast.com/privacy for privacy and opt-out information.
In Episode 47 of Hidden Forces, Demetri Kofinas speaks with Jimmy Soni about the father of Information Theory, Claude Shannon, and Shannon’s foundational work, A Mathematical Theory of Communication. The 20th century is known as the information age, and for a good reason. It is a period that is dominated by knowledge and data. It’s an era in which the economy is no longer driven by traditional industries — such as construction, manufacturing, or agriculture — but by advanced information technologies that store, retrieve, transmit, and manipulate data. This revolution finds its roots in Information Theory. And remarkably, it is a theory that was developed by one man: Claude Shannon. Before Shannon, society had a rather immature understanding of what information was. Information was understood as something immaterial and intangible. It was not seen as something that could be touched or manipulated. It was assumed that the only way to send information (intelligence, as it was then referred to) across a greater distance was to “boost” the signal by using more power. This was a notoriously imperfect system, as it increased the amount of “noise” that was received and made the message more difficult to discern. In his foundational work, A Mathematical Theory of Communication, Shannon solved this issue and presented a completely new way of understanding information. He showed that information isn’t insubstantial, but something that we can measure and manipulate — something that has physical characteristics and can be quantified. Shannon also created a diagram which showed that all information has certain, set components — such as a source, a transmitter, a recipient, and so on. As such, not only did he show that information is something that can be made material, through his work, Shannon proved that all information (be it a radio signal, a photo, or a song) can be governed through a set of common laws. In short, he turned information into something that can be computed and reliably transmitted, laying the foundation for the digital revolution. Producer & Host: Demetri Kofinas Editor & Engineer: Stylianos Nicolaou Join the conversation on Facebook, Instagram, and Twitter at @hiddenforcespod
A few days ago, I started watching a Netflix documentary on how fractal mathematics helped start Pixar. (Yes, I watch really boring stuff on Netflix, but in my defense, I was watching it in bed, at night, trying to go to sleep. It worked.) We have always had a fantastic success teaching people how to design presentations that are based on just a few (three to five) main points. However, the documentary explained how the structure of this type of presentation works and why it works so well. So, in this episode, we’ll show how the techniques that we cover in our classes work… mathematically. We also have a Techfind that will help you add local humor to your presentations.TechFind: Use Google to Add Humor to Any PresentationWhen I first started speaking and writing, I was always looking for ways to add humor to my presentations. At the time, Dr. Phil was a regular on the Prah Winfrey show, and eventually, he got his own daytime TV show. Whenever he made an appearance on Oprah, he always got a lot of laughs because he added a lot of Texas idioms to his speech. (In fact, Dr. Phil was the first person to ever use the phrase “Open up a can of whoop-ass” on national television.) So, I figured that since I am also from Texas, if I added some uniquely Texas sayings into my presentations, my speeches might get even funnier. It worked.The great news, now, is that Google (or any other search engine) can makes finding the perfect idiom for your speech pretty easy. Just type your region into the search engine and add the word Idiom. When I typed up Texas Idiom, I got a bunch of funny saying such as…If you cut your own firewood, it’ll warm you twice.He can strut sitting down.She’d charge hell with a bucket of ice water.Busy as a stump-tailed bull in fly season.Okay, this technique doesn’t work for every state or region, but you’d be surprised by how funny regional humor can be. For instance, when I typed in “Alaskan Idioms”, I got…You know you’re in Alaska when your snowblower gets stuck on the roof.You know you’re in Alaska when you know that bear insurance is being with someone that you know you can outrun.You know you’re in Alaska when you have more miles on your snowblower than you do your car.Just for fun, let’s try Midwest Idioms.That makes as much sense as government cheese.Slow as molasses in January.He’s got a hollow tail. (Is angry.)The point is that these are a fun way to add just a spark of humor to your presentation.A Great Presentation has a Fractal StructureAs I mentioned in the introduction above, I came across the term Fractal Mathematics from a Netflix documentary. (Which documentary doesn’t really matter.) The more that the host explained about this division of math, though, the more sense the three-point talk makes. Without going into all of the boring explanations Fractals are infinitely complex patterns that are self-similar across different scales. An example of a natural fractal is a mountain range. When you look at a mountain from a distance, it is very difficult to judge how far away from the mountain you are. In fact, if you take a close up photograph of a bolder, it will be very difficult to judge whether the bolder is one foot tall or thousands of feet tall.Another example of a fractal is a triangle. Try this. Draw a triangle. Then put a dot in the exact middle of each side of the triangle. Now connect the three dots. You will create four new triangles that all look exactly like the first one, but on a smaller scale. You can do the process again and again, and you will always end up with smaller versions of the original shape.Pixar Realized that this Mathematical Theory had Other ApplicationsIn 1980, Loren Carpenter was working for Boeing in their computer graphics department. The executives at Boeing wanted their marketing posters to have realistic mountains in the background, so Carpenter wanted to try to make the mountain ranges using computer graphics. The problem was, tho
TeamClearCoat - An Automotive Enthusiast Podcast by Two Car Nerds
Episode 117-Because that's why everyone listens...for math. We live in the era of the Hot Take. Since one of the hallmarks of this era is how wrong everyone is on their first draft, we're all about bad first Hot Takes this week. Everyone will probably change their mind one way or another about the new Aston Martin Vantage, Ian thought Dave got arrested, and we both encounter a karting bro who was very wrong about his driving abilities. Also, Dave continues to see the weirdest stuff in traffic, the Veloster lover affair continues, and we define the Sticker Proximity Index. TeamClearCoat website AutoWerkz Blog TeamClearCoat Drivetribe TeamClearCoat YouTube Channel TeamClearCoat Instagram TeamClearCoat Twitter TeamClearCoat Facebook TeamClearCoat Video Game Recommendations on Steam
with Jimmy Soni, Rob Goodman, and Steven Sinofsky Modern technology owes much to the introduction of the binary digit or "bit", first proposed by Claude Shannon in "A Mathematical Theory of Communication”, a paper published in 1948. The bit would go on to transform analog to digital, making Shannon the father of the information age. His contemporaries (and collaborators) included Vannevar Bush, Alan Turing, and other architects of the digital era. In this podcast, moderated by a16z board partner Steven Sinofsky, the authors of the new book about Shannon, A Mind at Play -- Jimmy Soni and Rob Goodman -- discuss the life and mind of the mathematician, engineer, and cryptographer from his roots as a precocious tinkerer in Gaylord, Michigan to the halls of MIT and Bell Labs. But this conversation is also, more broadly, about how genius and innovation happens... beginning with play.
Strömungen beobachten wir fast jeden Tag. Die Meeresbrandung fasziniert uns und eine gut funktionierende Klimaanlage ist ein wunderbarer Luxus, egal ob sie wärmt oder kühlt. Strömungen zu beherrschen ist aber auch in vielen verfahrenstechnischen Zusammenhängen wichtig. Insofern haben Gleichungen, die Strömungen beschreiben, eine große praktische Relevanz und gleichzeitig eine fast emotionale Anziehungskraft. Das einfachste mathematische Modell, das auch für viele Computersimulationen genutzt wird, sind die inkompressiblen Navier-Stokes Gleichungen (INS). Hier ist die strömende Substanz dem Wasser ähnlich genug, dass nur in der Materialkonstante Viskosität verschiedene Fließfähigkeiten unterschieden werden. Als Lösungen des Systems von partiellen Differentialgleichungen suchen wir das Geschwindigkeitsfeld und den Druck als Funktionen von Raum und Zeit . Im 3d-Fall ist das ein System von vier Gleichungen. Drei davon sind eine Vektorgleichung, die aus der Impulserhaltung abgeleitet wird und die vierte ist die Erhaltung der Masse. Im inkompressiblen Fall vereinfacht sich diese aus die Forderung, dass die Divergenz des Geschwindigkeitsfeldes verschwindet. Die komplexer aussehende Gleichung ist die Vektorgleichung, weil hier die zweiten räumlichen Ableitungen des Geschwindigkeitsfeldes, der Druckgradient, die zeitliche Ableitung der Geschwindigkeit und ein nichtlinearer Term vorkommen. Die Gleichungen müssen im Strömungsgebiet gelten. Die Lösungen müssen sich aus dem Anfangszustand entwickeln (Anfangsbedingung) und am räumlichen Rand vorgeschriebenen Werten, den Randwerten (meist fordert man, dass die Geschwindigkeit Null ist) genügen. Dieses Modell ist in einem längeren Prozess entwickelt worden. Ein großer Durchbruch bei der mathematischen Analyse gelang dem französischen Mathematiker Leray im Jahr 1934. Er hatte die geniale Idee, sich von dem Wunsch zu verabschieden, für diese komplizierte Gleichung eine punktweise zutreffende Lösung zu konstruieren. Statt dessen verallgemeinerte er den Lösungsbegriff und führte den Begriff der schwachen Lösung ein. Diese erfüllt die Gleichung nur im Sinne eines ausgeklügelten Systems von unendlich vielen Integralgleichungen. Er zeigte mit Hilfe von abstrakten Argumenten, dass die INS immer solche schwachen Lösungen haben. Heute ist bekannt, dass falls eine punktweise Lösung existiert (sogenannte starke Lösung), diese eindeutig ist (also insbesondere mit der schwachen übereinstimmt), es in 2d immer eine punktweise Lösung gibt, die für alle Zeiten existiert (unter geringfügigen Bedingungen an den Rand), und es unter Kleinheitsbedingungen an die Daten und bei glattem geometrischen Rand des Gebietes auch in 3d punktweise Lösungen gibt.Wir wissen jedoch in 3d nicht, ob die gefundenen schwache Lösung regulär bzw. stark ist (d.h. eine punktweise Lösung ist.) In Vorbereitung auf den Jahrtausendwechsel gab es in der Mathematik die Bestrebung, so wie dies 100 Jahre zuvor von Hilbert geschehen war, die wichtigsten mathematischen Problemstellungen in den Fokus zu nehmen. Das Ergebnis waren sieben sogenannte Milleniumsprobleme der Clay Foundation, für deren Lösung jeweils ein Preisgeld von einer Millionen Dollar ausgelobt wurde. Eines dieser für so wichtig angesehenen Probleme ist die offene Frage der Regularität der schwachen Lösungen der INS. Woran liegt das? Eine Eigenschaft der INS, die sie schwierig macht, ist ihre Nichtlinearität. Sie ist nur quadratisch und hat eine besondere Struktur. Diese Struktur verdanken wir es z.B., dass die schwache Theorie erfolgreich ist. Es besteht Hoffnung, dass wir auch die Lücke zur starken Theorie unter Ausnutzung der Struktur schließen können. Der Standardweg im linearen Fall (z.B. beim Laplace-Problem) ist es, für die schwachen Lösungen mit einem Münchhausen-Prinzip (Elliptic Bootstrapping) Stück für Stück mehr Regularität zu zeigen. Man kann so zeigen, dass die Lösung immer so gut ist, wie die es Daten erlauben. Man nennt das maximale Regularität. Leider ist für die INS das Wachstum in der Nichtlinearität zu schnell, um im 3d-Fall mit diesen Standardmethoden zu argumentieren (im 2d Fall geht es aber). Im 3d-Fall geht es aber unter bestimmten Zusatzbedingungen, z.B. einer höheren Integrierbarkeit des Geschwindigkeitsfeldes als die schwachen Lösungen von vornherein haben. Man fand dies über Skalierungs-Eigenschaften der Gleichung heraus. Grob gesagt, muss man fordern dass die Lösung zu einem Raum gehört, der Skalierungsinvariant ist. Eine weitere zusätzliche Forderung ist die Gültigkeit der Energiegleichung (Erhaltung der kinetischen Energie), denn leider weiß man bisher von schwachen Lösungen nur, dass sie eine Energieungleichung erfüllen. Eine zweite Schwierigkeit der INS ist der Zusammenhang zwischen Druck und Divergenzgleichung. Ein Trick der schwachen Theorie ist, dass wir uns von Anfang an auf Funktionen beschränken, die schwach divergenzfrei sind (also die Gleichung in Integralmittel erfüllen. Was in der Theorie sehr gut funktioniert, ist blöd für die Numerik, weil man Divergenzfreiheit immer wieder herstellen muss wegen der Rechenfehler im Prozess. Unter den Forschern gibt es zwei Richtungen: Entweder man sucht nach Blow-up Lösungen, also schwachen Lösungen, die keine punktweisen Lösungen sein können, oder man versucht die Zusatzforderungen aufzuweichen (um sie am Ende ganz weglassen zu können). Dabei gibt es ständig kleine Fortschritte. Es gibt auch zwei Wege, für allgemeinere Modelle Theorien zu entwickeln, die dann im Spezialfall auch etwas über INS sagen. Ein durch O.A. Ladyzenskaya vorgeschlagener Zugang geht über den p-Laplace-Operator. Hier findet man starke Lösungen für alle p>2,5, die INS ist jedoch der Fall p=2. Als Materialgesetz interessant für Ingenieure ist aber der noch schwierigere Fall 1
Linguistic Contributions To The Formal Theory Of Big-Game Hunting; by R. Mathiesen; From Lingua Pranca, June, 1978 — The Mathematical Theory of Big-Game Hunting must surely be ranked among the major scientific achievements of the twentieth century. That this is so is largely the work of one man, H. Pétard, in whose fundamental paper (1938) certain recent advances in mathematics and physics were employed with great skill to create a theory of unmatched—not to say unmatchable!—power and elegance. One must not, of course, dismiss Pétard’s predecessors totally out of hand: the field had a long and distinguished history as a technology, was raised to the rank of a science by the Mysore and Nairobi schools during the nineteenth century, and finally achieved the exalted status of a professional discipline at the seminal First International Congress of Elephantology (held at London in 1910), where delegates from many nations discovered that they shared not only a common set of goals, aims, and targets, but also a common set of methods, theoretical predispositions and indispositions, and preferences in hard drink. Nevertheless, the fact remains that Pétard was the first to treat any aspect of the field with full mathematical rigor mortis. (Read by Les Strabismus.)
Jens Babutzka hat Anfang 2016 seine Promotion an der KIT-Fakultät für Mathematik verteidigt. Das Gespräch dreht sich um einen Teil seiner Forschungsarbeit - dem Nachweis der Gültigkeit der sogenannten Helmholtz Zerlegung im Kontext von Gebieten mit einer sich periodisch wiederholenden Geometrie. Das lässt sich für die Untersuchung von photonischen Kristallen ausnutzen unter der Wirkung einer Zeit-harmonischen Wellengleichung. Für die Untersuchung von partiellen Differentialgleichungen auf Lösbarkeit, Eindeutigkeit der Lösungen und deren Regularität gibt es verschiedene Grundwerkzeuge. Eines ist die Helmholtz Zerlegung. Falls sie in einem Raum möglich ist, kann man jedes Vektorfeld des Raumes eindeutig aufteilen in zwei Anteile: einen Gradienten und einen zweiten Teil, der unter der Anwendung der Divergenz das Ergebnis Null hat (man nennt das auch divergenzfrei). Wann immer Objekte miteinander skalar multipliziert werden, von denen eines ein Gradient ist und das andere divergenzfrei, ist das Ergebnis Null. Anders ausgedrückt: sie stehen senkrecht aufeinander. Die Untersuchung der partiellen Differentialgleichung lässt sich dann vereinfachen, indem eine Projektion auf den Teilraum der divergenzfreien Funktionen erfolgt und erst im Anschluss die Gradienten wieder "dazu" genommen, also gesondert behandelt werden. Da die Eigenschaft divergenzfrei auch physikalisch als Quellenfreiheit eine Bedeutung hat und alle Gradienten wirbelfrei sind, ist für verschiedene Anwendungsfälle sowohl mathematisch als auch physikalisch motivierbar, dass die Aufteilung im Rahmen der Helmholtz Zerlegung hilfreich ist. Im Kontext der Strömungsmechanik ist die Bedingung der Divergenzfreiheit gleichbedeutend mit Inkompressibilität des fließenden Materials (dh. Volumina ändern sich nicht beim Einwirken mechanischer Kräfte). Für das Maxwell-System kann es sowohl für das magnetische als auch für das elektrische Feld Divergenzfreiheitsbedingungen geben. Ob die Helmholtz Zerlegung existiert, ist im Prinzip für viele Räume interessant. Grundbausteine für die Behandlung der partiellen Differentialgleichungen im Kontext der Funktionalanalysis sind die Lebesgue-Räume . Eine (verallgemeinerte) Funktion ist in , wenn das Integral (des Betrags) der q-ten Potenz der Funktion über Omega existiert. Eine Sonderrolle spielt hier der Fall , weil dieser Raum ein Skalarprodukt hat. Das gibt ihm eine sehr klare Struktur. Darüber hinaus ist er zu sich selbst dual. Unter anderem führt das dazu, dass die Helmholtz Zerlegung in für beliebige Gebiete mit genügend glattem Rand immer existiert. Wenn nicht ist, sind Gebiete bekannt, in denen die Helmholtz Zerlegung existiert, aber auch Gegenbeispiele. Insbesondere bei der Behandlung von nichtlinearen Problemen reicht es aber häufig nicht, sich auf den Fall zu beschränken, sondern die Helmholtz Zerlegung für möglichst viele wird eine wesentliche Voraussetzung für die weitere Theorie. Das liegt u.a. an der dann verfügbaren Einbettung in Räume mit punktweisen Eigenschaften. Jens Babutzka hat in seiner Promotion unter anderem bewiesen, dass die Helmholtz Zerlegung für -Räume für die Gebiete mit einer sich periodisch wiederholenden Struktur gilt. Mathematisch muss er hierfür nachweisen, dass das schwache Neumannproblem immer eine (bis auf Konstanten) eindeutige Lösung hat in . Dabei hilft ihm die periodische Struktur der Geometrie. Mithilfe eines erst kürzlich bewiesenen Theorems von Bernhard Barth über Blochoperatoren kann er das Problem auf eine Familie von Phasenoperatoren auf der (beschränkten) periodischen Zelle reduzieren. Falls diese Operatoren regulär genug sind, lassen sie sich fortsetzen von auf . Anschließend überprüft er, ob die so erzeugte Abbildung auch wirklich die Helmhotz Zerlegung ist. Hier ist ein wesentliches Hilfsmittel, dass unendlich glatte Funktionen mit kompaktem Träger dicht in den Teilräumen liegen. Außerdem ist die Fouriertheorie in der besonderen Form der Blochoperatoren hilfreich. Sie hilft später auch beim Auffinden des Spektrums des betrachteten Wellenoperators. Für beschränkte Gebiete hängt es im Wesentlichen von der Glattheit des Randes ab, ob die Helmholtz Zerlegung in gilt. Das liegt u.a. daran, dass man in der Lage sein muss, eine eindeutige Normalenrichtung für jeden Punkt des Randes zu finden. Für Knicke im Rand kann es hier Probleme geben, die dazu führen, dass das schwache Neumann Problem nur noch für in einem kleineren Intervallbereich lösbar ist, und nicht mehr für alle zwischen und wie das bei glattem Rand der Fall ist. Literatur und weiterführende Informationen A. Figotin and P. Kuchment: Band-Gap Structure of Spectra of Periodic Dielectric and Acoustic Media. II. Two-Dimensional Photonic Crystals, SIAM J. Appl. Math., 56, 1561–1620, 1995. P. Galdi: An Introduction to the Mathematical Theory of the Navier-Stokes Equations - Steady-State Problems, Springer, 2011. B. Barth: The Bloch Transform on Lp-Spaces, KIT-Dissertation, 2013. W. Dörlfer e.a: Photonic Crystals: Mathematical Analysis and Numerical Approximation, Birkhäuser, 2011. M. Geissert e.a.: Weak Neumann implies Stokes, Journal für die reine und angewandte Mathematik 669, 75–100, 2012. Quellen für physikalische Grundlagen A. Birner e.a.: Photonische Kristalle, Physikalische Blätter 55 (1999), 27-33, 1999. Photonische Kristalle
Code Contracts let you express predicates in C# code. This Visual Studio plug in and associated library checks your assertions. It can perform tests at run time, and even prove the predicates at compile time. Leonhard Euler solved the Seven Bridges problem. In so doing, he established graph theory, one of the foundations of computer science. Reason through his proof, and discover how many bridges it will take to solve the problem. Claude E. Shannon defined Information Theory in "A Mathematical Theory of Communication". Review the first part of his paper, where he analyzes the capacity of a noiseless channel. Then find out how we can transmit faster than that capacity will allow, given information about the language.
Notes, References, and Links for further study: Tragedy and Hope dot com March's Invitation to the Tragedy and Hope online community (link expires monthly) Log in page for the Tragedy and Hope online community Peace Revolution primary site (2009-2012) Peace Revolution backup stream(2006-2012) Includes the 9/11 Synchronicity Podcast (predecessor to Peace Revolution) These 2 podcasts amount to 250+ hours of commercial-free educational content, which formulate a comprehensive and conscious curriculum. The Ultimate History Lesson dot com The Ultimate History Lesson Official Playlist (on YouTube) The Ultimate History Lesson (Torrents) (Video) The Ultimate History Lesson (5+ hours / 1080p HD mp4) (Audio) The Ultimate History Lesson + Commentary (16+ hours / mp3) i. If you're interested in downloading the torrent versions, please send an email to: Editors@TragedyandHope.com with the word “torrent” in the subject line. ii. What is a Torrent?(on Wikipedia) uTorrent (software to create and download torrent files) Lew Rockwell discussing The Ultimate History Lesson with Mark Carbonaro (of radio station KION in Monterey, CA) 10. Peg Luksik “Who Controls our Children? How Public Schools Dumb Down Students” 1992 NEA: A Trojan Horse in American Education by Samuel Blumenfeld (1984) 11. Corbett Report Radio 096: In the Labyrinth of the Psychopath with Thomas Sheridan 12. School Sucks Podcast 130: Logic Saves Lives / Empowerment and Intellectual Self-Defense with Richard Grove and Tony Myers 13. Trivium Method of Critical Thinking and Creative Problem Solving “Trivium” menu at the top of Tragedy and Hope dot com 14. Definition of existence (or reality): Reality/Existence is every substance, action, relationship, and attribute which is, was, or ever will be. This sentence describes the ENTIRETY of language, inclusive of Aristotle's Ten Categories of Being (relates to proofs of that which exists, i.e “reality”). Now re-read the sentence, replacing the words with the Grammar equivalents: “Reality/Existence is every noun, verb, adjective/adverb, and prepositonal phrase/conjunction that is, was, or ever will be.” 15. Definition of compulsory: Depending on or produced by compulsion; compelled, forced, enforced, obligatory. In special collocations, as compulsory education. (source: Oxford English Dictionary) 16. Definition of volition: An act of willing or resolving; a decision or choice made after due consideration or deliberation; a resolution or determination. (source: Oxford English Dictionary) 17. Definition of irrationality: The quality of being devoid of reason. (source: Oxford English Dictionary) 18. Definition of sophism: A specious but fallacious argument, either used deliberately in order to deceive or mislead, or employed as a means of displaying ingenuity in reasoning. (source: Oxford English Dictionary) 19. Definition of solipsism: The view or theory that self is the only object of real knowledge or the only thing really existent. Also, = egoism 1, and in weakened sense. (source: Oxford English Dictionary) 20. Definition of fallacy: Deception, guile, trickery; a deception, trick; a false statement, a lie. Deceitfulness (obs.). b.2.b Deceptiveness, aptness to mislead, unreliability. (source: Oxford English Dictionary) Latin: Fallax, n. “deception”; and Fallere, v. “to deceive” Summary: Fallacies are errors in logical thinking, which you should refrain from integrating into your own mindset; when integrated, fallacies dissolve your freedom. Fallacy (on Wikipedia) 21. Definition of belief: The mental action, condition, or habit, of trusting to or confiding in a person or thing; trust, dependence, reliance, confidence, faith. Const. in (to, of obs.) a person. (source: Oxford English Dictionary) 22. Definition of occult: Hidden (from sight); concealed (by something interposed); not exposed to view. (source: Oxford English Dictionary) How to Free Your Mind: The Occulted Keys of Wisdom 23. Definition of education: Education: to bring out, to extract, to produce from a state of occultation (Johnson's Dictionary, 1854); from the Latin verb educo, to lead or draw out. To un-occult information 24. The Trivium (on Wikipedia) Grammar (or Knowledge), as your input Logic (or Understanding), the process of thinking to remove contradictions Rhetoric (or Wisdom), as the output 25. The Ultimate History Lesson dot com Purchase the film (Coupon Code: SCHOOLSUCKS) Read the Transcript and Investigate the References Listen to the 16+ hour version with Commentary and Analysis i. Peace Revolution episodes 041-045 26. Charles Darwin and his marriage into the Wedgewood Pottery fortune 27. Definition of Religion: 3a. Action or conduct indicating a belief in, reverence for, and desire to please, a divine ruling power; the exercise or practice of rites or observances implying this. (source: Oxford English Dictionary) Latin: religare (to bind or tie-back), the opposite of liberty Argumentum ad Ignorantium: appeal to ignorance fallacy Appeal to authority fallacy Appeal to tradition fallacy Appeal to popularity fallacy 28. Listing of Logical Fallacies (under the top menu “Trivium” entry) 29. Ad baculum fallacy: (Latin for argument to the cudgel or appeal to the stick), also known as appeal to force, is an argument where force, coercion, or the threat of force, is given as a justification for a conclusion. It is a specific case of the negative form of an argument to the consequences. 30. Deepest Secrets of Secret Societies Read and listen to: “How to Free Your Mind: The Occulted Keys of Wisdom” Albert Pike page 861 of Morals and Dogma i. 3-4-5 Pythagorean Triangle ii. 3 = The Trivium iii. 4 = The Quadrivium iv. 5 = Your 5-Senses 31. Fallacy of the Neglected Aspect(s): to present evidence in support of one side of an issue to the exclusion of relevant evidence to the contrary. The withholding of evidence hostile to the conclusion at hand may be malicious and intentional or due to unawareness. 32. Definition of chanting: The action of the verb chant; singing, musical recitation, etc. (In early usage, also: Incantation, enchantment.) (source: Oxford English Dictionary) 33. Definition of psittacism: The mechanical repetition of previously received ideas or images that reflects neither true reasoning nor feeling; repetition of words or phrases parrot-fashion, without reflection, automatically. Hence ˈpsittacist; psittaˈcistically adv. (source: Oxford English Dictionary) Latin: psitta = parrot 34. Gatto: Daughters of the Barons of Runnemede (Chapter 12) The Underground History of American Education 35. Antony Sutton: America's Secret Establishment: An Introduction to Skull and Bones 36. Charlotte Iserbyt: The Deliberate Dumbing Down of America 37. The Brain Model Organizational Software @ Tragedy and Hope The “Brain” tab on the top menu of Tragedy and Hope dot com This model contains thousands of connections between major topics, personalities, and events in modern history; trailing the origins of cause-and-effect back for thousands of years. 38. Free State Project 39. Larken Rose: The Most Dangerous Superstition (a must-read) 40. Herbert Spencer (on Wikipedia) “survival of the fittest” concept 41. Social Darwinism (on Wikipedia) 42. Eugenics (on Wikipedia) 43. Beatrice Webb (on Wikipedia) 44. Sun Tzu (on Wikipedia) 45. Machiavelli (on Wikipedia) 46. Von Clausewitz (on Wikipedia) 47. American History Association (on Wikipedia) 48. Fabius Maximus (on Wikipedia) 49. Fabian Socialism (on Wikipedia) Logo = Wolf in Sheep's Clothing Fabian Stained Glass Window (shaping the world in their image) Brain Model: connections between Fabian Socialism and the Rothschild Banking Empire 50. Definition of predator: An animal that preys upon another. (source: Oxford English Dictionary) 51. Edward R. Pease: “ History of the Fabian Society” 52. Justified Sinning: the belief without evidence, of illusions, and portraying fiction as fact; as a function of some underlying irrationality (i.e. authority has given them permission to rule over others and violate volition) 53. “Babylonian Woe” by David Astle 54. “The Republic” by Plato (on Wikipedia) Caste structure 55. “Sic Itur Ad Astra” by Dr. Andrew Galambos Volitional Science Lectures 56. Fallacy of Argument from Authority (on Wikipedia) Ad Verecundiam 57. Immanuel Kant (on Wikipedia) Solipsism: The view or theory that self is the only object of real knowledge or the only thing really existent. Also, = egoism 1, and in weakened sense. b. Using logic and reason to “refute” logic and reason 58. The Fallacy of the Stolen Concept: The “stolen concept” fallacy, first identified by Ayn Rand, is the fallacy of using a concept while denying the validity of its genetic roots, i.e., of an earlier concept(s) on which it logically depends. 59. Argument (on Wikipedia) Declarative sentence Clear Terms True Premises Valid Argument 60. Collectivism: The sacrifice of the individual rights as the function of powering the State. 61. Definition of democide: death by government 62. Definition of dialectic (logic): the process of asking substantial questions and finding valid answers which eliminates contradiction and ascertains identity, also known as “thinking”, this is the use of ratios to compare and contrast which creates rational and reasonable clarity in the mind. When Gatto says he “argues with himself about what he believes”, this is what he's doing. 63. “Against Schooling” by John Taylor Gatto, published by Harpers Magazine 64. “On Sophistical Refutations” by Aristotle Contains the list of errors in thinking, a.k.a. “fallacies” Contains the gist of intellectual self-defense in terms of fallacies 65. Colin Powell's speech to the United Nations, genesis of the 2nd invasion of Iraq in 2003 Full-text of Powell's fallacy-ridden speech in The Guardian (London News) Powell's infamous speech (on YouTube) 66. Socrates (on Wikipedia) 67. Maslow's hierarchy of needs (on Wikipedia) 68. Definition of conspiracy: The action of conspiring; combination of persons for an evil or unlawful purpose. (source: Oxford English Dictionary) 69. Definition of “Conspiracy Theory”: “Additions 1997 Add: 4.4 Special Combs. conspiracy theory, the theory that an event or phenomenon occurs as a result of a conspiracy between interested parties; spec. a belief that some covert but influential agency (typically political in motivation and oppressive in intent) is responsible for an unexplained event; so conspiracy theorist. “ (source: Oxford English Dictionary) 70. Definition of Psittacism: The mechanical repetition of previously received ideas or images that reflects neither true reasoning nor feeling; repetition of words or phrases parrot-fashion, without reflection, automatically. (source: The Oxford English Dictionary) 71. The Mathematical Theory of Communication by Claude Shannon (on Wikipedia) 72. Autodidactic (on Wikipedia) 73. Didactic (on Wikipedia) 74. Thinking = non-contradictory identification = Logic The process of which is also Reason by way of Rationality (compare and contrast ratios) 75. Appeal to Laughter/Ridicule fallacy (on Wikipedia) 76. Definition of diffidence: Want of confidence or faith; mistrust, distrust, misgiving, doubt. (source: Oxford English Dictionary); opposite of confidence 77. Fallacy of Argument from Authority (on Wikipedia) Ad Verecundiam 78. Religare: to tie back, to bind, to prevent from growing 79. Amptssprache fallacy Fallacy of Authority Eichmann @ Nuremberg, “only following orders” defense Milgram Experiment (on Wikipedia) Zimbardo's Stanford Prison Experiment (on Wikipedia) “Just doing my job” fallacy 80. Definition of naïve: Natural, unaffected, simple, artless. (source: Oxford English Dictionary) 81. Would you like to Know More? Tragedy and Hope dot com Trivium(tab on top menu) How to Free Your Mind List of Fallacies The Brain(tab on top menu) Critical Thinking Taken out of Public Schooling The Rothschild Banking Empire Pop-Up Fallacies dot com i. Obama 9 fallacies per minute Jan Irvin's Gnostic Media podcast episodes investigating the Fallacies with Dr. Michael LaBossiere 82. Corbett Report Interview 475: Curing Statism with Stefan Molyneux 83. FreeDomainRadio 669: Dr. No – Friend or Foe by Stefan Molyneux Peace Revolution partner podcasts: Corbett Report dot com Media Monarchy dot com Gnostic Media Podcast School Sucks Project Podcast Meria dot net Other productions by members of the T&H network: The Ultimate History Lesson: A Weekend with John Taylor Gatto (2012) a journey into the dark heart of public schooling, revealing how America became incoherent, one student at a time. Navigating Netflix (2011) our video series wherein we conduct a critical analysis of films you might have missed; Navigating Netflix is available for free on YouTube. "Memories of a Political Prisoner", an interview with Professor Chengiah Ragaven, graduate of Oxford, Cambridge, and Sussex; AFTER he was a political prisoner, who was exiled from South Africa, during Apartheid. (2011) What You've Been Missing! (2011) is our video series focusing in on the history of corruption in our public education system. Top Documentary Films dot com: Hijacking Humanity by Paul Verge (2006) Top Documentary Films dot com: Exposing the Noble Lie (2010) Top Documentary Films dot com: The Pharmacratic Inquisition by Jan Irvin (2007) THANK YOU FOR YOUR SUPPORT! If you would like to donate so that we can continue producing independent media without commercial advertising, simply click the button below for a one-time donation: Alternatively, You can become a Member and Support our ability to create media for the public (while You make new friends and enjoy educating yourself along the way) by subscribing to the Tragedy and Hope Community: Monthly @ $14.95 / month Yearly @ $120.00 / year *Subscription details on Subscribe page in the Top Menu.
Notes, References, and Links for further study: Tragedy and Hope dot com March's Invitation to the Tragedy and Hope online community (link expires monthly) Log in page for the Tragedy and Hope online community Peace Revolution primary site (2009-2012) Peace Revolution backup stream (2006-2012) Includes the 9/11 Synchronicity Podcast (predecessor to Peace Revolution) These 2 podcasts amount to 250+ hours of commercial-free educational content, which formulate a comprehensive and conscious curriculum. The Ultimate History Lesson dot com The Ultimate History Lesson Official Playlist (on YouTube) The Ultimate History Lesson (Torrents) (Video) The Ultimate History Lesson (5+ hours / 1080p HD mp4) (Audio) The Ultimate History Lesson + Commentary (16+ hours / mp3) i. If you're interested in downloading the torrent versions, please send an email to: Editors@TragedyandHope.com with the word “torrent” in the subject line. ii. What is a Torrent? (on Wikipedia) uTorrent (software to create and download torrent files) Lew Rockwell discussing The Ultimate History Lesson with Mark Carbonaro (of radio station KION in Monterey, CA) 10. Peg Luksik “Who Controls our Children? How Public Schools Dumb Down Students” 1992 NEA: A Trojan Horse in American Education by Samuel Blumenfeld (1984) 11. Corbett Report Radio 096: In the Labyrinth of the Psychopath with Thomas Sheridan12. School Sucks Podcast 130: Logic Saves Lives / Empowerment and Intellectual Self-Defense with Richard Grove and Tony Myers13. Trivium Method of Critical Thinking and Creative Problem Solving “Trivium” menu at the top of Tragedy and Hope dot com 14. Definition of existence (or reality): Reality/Existence is every substance, action, relationship, and attribute which is, was, or ever will be. This sentence describes the ENTIRETY of language, inclusive of Aristotle's Ten Categories of Being (relates to proofs of that which exists, i.e “reality”). Now re-read the sentence, replacing the words with the Grammar equivalents: “Reality/Existence is every noun, verb, adjective/adverb, and prepositonal phrase/conjunction that is, was, or ever will be.” 15. Definition of compulsory: Depending on or produced by compulsion; compelled, forced, enforced, obligatory. In special collocations, as compulsory education. (source: Oxford English Dictionary)16. Definition of volition: An act of willing or resolving; a decision or choice made after due consideration or deliberation; a resolution or determination. (source: Oxford English Dictionary)17. Definition of irrationality: The quality of being devoid of reason. (source: Oxford English Dictionary)18. Definition of sophism: A specious but fallacious argument, either used deliberately in order to deceive or mislead, or employed as a means of displaying ingenuity in reasoning. (source: Oxford English Dictionary)19. Definition of solipsism: The view or theory that self is the only object of real knowledge or the only thing really existent. Also, = egoism 1, and in weakened sense. (source: Oxford English Dictionary)20. Definition of fallacy: Deception, guile, trickery; a deception, trick; a false statement, a lie. Deceitfulness (obs.). b.2.b Deceptiveness, aptness to mislead, unreliability. (source: Oxford English Dictionary) Latin: Fallax, n. “deception”; and Fallere, v. “to deceive” Summary: Fallacies are errors in logical thinking, which you should refrain from integrating into your own mindset; when integrated, fallacies dissolve your freedom. Fallacy (on Wikipedia) 21. Definition of belief: The mental action, condition, or habit, of trusting to or confiding in a person or thing; trust, dependence, reliance, confidence, faith. Const. in (to, of obs.) a person. (source: Oxford English Dictionary)22. Definition of occult: Hidden (from sight); concealed (by something interposed); not exposed to view. (source: Oxford English Dictionary) How to Free Your Mind: The Occulted Keys of Wisdom 23. Definition of education: Education: to bring out, to extract, to produce from a state of occultation (Johnson's Dictionary, 1854); from the Latin verb educo, to lead or draw out. To un-occult information 24. The Trivium (on Wikipedia) Grammar (or Knowledge), as your input Logic (or Understanding), the process of thinking to remove contradictions Rhetoric (or Wisdom), as the output 25. The Ultimate History Lesson dot com Purchase the film (Coupon Code: SCHOOLSUCKS) Read the Transcript and Investigate the References Listen to the 16+ hour version with Commentary and Analysis i. Peace Revolution episodes 041-045 26. Charles Darwin and his marriage into the Wedgewood Pottery fortune27. Definition of Religion: 3a. Action or conduct indicating a belief in, reverence for, and desire to please, a divine ruling power; the exercise or practice of rites or observances implying this. (source: Oxford English Dictionary) Latin: religare (to bind or tie-back), the opposite of liberty Argumentum ad Ignorantium: appeal to ignorance fallacy Appeal to authority fallacy Appeal to tradition fallacy Appeal to popularity fallacy 28. Listing of Logical Fallacies (under the top menu “Trivium” entry)29. Ad baculum fallacy: (Latin for argument to the cudgel or appeal to the stick), also known as appeal to force, is an argument where force, coercion, or the threat of force, is given as a justification for a conclusion. It is a specific case of the negative form of an argument to the consequences.30. Deepest Secrets of Secret Societies Read and listen to: “How to Free Your Mind: The Occulted Keys of Wisdom” Albert Pike page 861 of Morals and Dogma i. 3-4-5 Pythagorean Triangle ii. 3 = The Trivium iii. 4 = The Quadrivium iv. 5 = Your 5-Senses 31. Fallacy of the Neglected Aspect(s): to present evidence in support of one side of an issue to the exclusion of relevant evidence to the contrary. The withholding of evidence hostile to the conclusion at hand may be malicious and intentional or due to unawareness.32. Definition of chanting: The action of the verb chant; singing, musical recitation, etc. (In early usage, also: Incantation, enchantment.) (source: Oxford English Dictionary)33. Definition of psittacism: The mechanical repetition of previously received ideas or images that reflects neither true reasoning nor feeling; repetition of words or phrases parrot-fashion, without reflection, automatically. Hence ˈpsittacist; psittaˈcistically adv. (source: Oxford English Dictionary) Latin: psitta = parrot 34. Gatto: Daughters of the Barons of Runnemede (Chapter 12) The Underground History of American Education 35. Antony Sutton: America's Secret Establishment: An Introduction to Skull and Bones36. Charlotte Iserbyt: The Deliberate Dumbing Down of America37. The Brain Model Organizational Software @ Tragedy and Hope The “Brain” tab on the top menu of Tragedy and Hope dot com This model contains thousands of connections between major topics, personalities, and events in modern history; trailing the origins of cause-and-effect back for thousands of years. 38. Free State Project39. Larken Rose: The Most Dangerous Superstition (a must-read)40. Herbert Spencer (on Wikipedia) “survival of the fittest” concept 41. Social Darwinism (on Wikipedia)42. Eugenics (on Wikipedia)43. Beatrice Webb (on Wikipedia)44. Sun Tzu (on Wikipedia)45. Machiavelli (on Wikipedia)46. Von Clausewitz (on Wikipedia)47. American History Association (on Wikipedia)48. Fabius Maximus (on Wikipedia)49. Fabian Socialism (on Wikipedia) Logo = Wolf in Sheep's Clothing Fabian Stained Glass Window (shaping the world in their image) Brain Model: connections between Fabian Socialism and the Rothschild Banking Empire 50. Definition of predator: An animal that preys upon another. (source: Oxford English Dictionary)51. Edward R. Pease: “ History of the Fabian Society”52. Justified Sinning: the belief without evidence, of illusions, and portraying fiction as fact; as a function of some underlying irrationality (i.e. authority has given them permission to rule over others and violate volition)53. “Babylonian Woe” by David Astle54. “The Republic” by Plato (on Wikipedia) Caste structure 55. “Sic Itur Ad Astra” by Dr. Andrew Galambos Volitional Science Lectures 56. Fallacy of Argument from Authority (on Wikipedia) Ad Verecundiam 57. Immanuel Kant (on Wikipedia) Solipsism: The view or theory that self is the only object of real knowledge or the only thing really existent. Also, = egoism 1, and in weakened sense. b. Using logic and reason to “refute” logic and reason 58. The Fallacy of the Stolen Concept: The “stolen concept” fallacy, first identified by Ayn Rand, is the fallacy of using a concept while denying the validity of its genetic roots, i.e., of an earlier concept(s) on which it logically depends.59. Argument (on Wikipedia) Declarative sentence Clear Terms True Premises Valid Argument 60. Collectivism: The sacrifice of the individual rights as the function of powering the State.61. Definition of democide: death by government62. Definition of dialectic (logic): the process of asking substantial questions and finding valid answers which eliminates contradiction and ascertains identity, also known as “thinking”, this is the use of ratios to compare and contrast which creates rational and reasonable clarity in the mind. When Gatto says he “argues with himself about what he believes”, this is what he's doing. 63. “Against Schooling” by John Taylor Gatto, published by Harpers Magazine64. “On Sophistical Refutations” by Aristotle Contains the list of errors in thinking, a.k.a. “fallacies” Contains the gist of intellectual self-defense in terms of fallacies 65. Colin Powell's speech to the United Nations, genesis of the 2nd invasion of Iraq in 2003 Full-text of Powell's fallacy-ridden speech in The Guardian (London News) Powell's infamous speech (on YouTube) 66. Socrates (on Wikipedia)67. Maslow's hierarchy of needs (on Wikipedia)68. Definition of conspiracy: The action of conspiring; combination of persons for an evil or unlawful purpose. (source: Oxford English Dictionary)69. Definition of “Conspiracy Theory”: “Additions 1997 Add: 4.4 Special Combs. conspiracy theory, the theory that an event or phenomenon occurs as a result of a conspiracy between interested parties; spec. a belief that some covert but influential agency (typically political in motivation and oppressive in intent) is responsible for an unexplained event; so conspiracy theorist. “ (source: Oxford English Dictionary)70. Definition of Psittacism: The mechanical repetition of previously received ideas or images that reflects neither true reasoning nor feeling; repetition of words or phrases parrot-fashion, without reflection, automatically. (source: The Oxford English Dictionary)71. The Mathematical Theory of Communication by Claude Shannon (on Wikipedia)72. Autodidactic (on Wikipedia)73. Didactic (on Wikipedia)74. Thinking = non-contradictory identification = Logic The process of which is also Reason by way of Rationality (compare and contrast ratios) 75. Appeal to Laughter/Ridicule fallacy (on Wikipedia)76. Definition of diffidence: Want of confidence or faith; mistrust, distrust, misgiving, doubt. (source: Oxford English Dictionary); opposite of confidence77. Fallacy of Argument from Authority (on Wikipedia) Ad Verecundiam 78. Religare: to tie back, to bind, to prevent from growing79. Amptssprache fallacy Fallacy of Authority Eichmann @ Nuremberg, “only following orders” defense Milgram Experiment (on Wikipedia) Zimbardo's Stanford Prison Experiment (on Wikipedia) “Just doing my job” fallacy 80. Definition of naïve: Natural, unaffected, simple, artless. (source: Oxford English Dictionary)81. Would you like to Know More? Tragedy and Hope dot com Trivium (tab on top menu) How to Free Your Mind List of Fallacies The Brain (tab on top menu) Critical Thinking Taken out of Public Schooling The Rothschild Banking Empire Pop-Up Fallacies dot com i. Obama 9 fallacies per minute Jan Irvin's Gnostic Media podcast episodes investigating the Fallacies with Dr. Michael LaBossiere 82. Corbett Report Interview 475: Curing Statism with Stefan Molyneux83. FreeDomainRadio 669: Dr. No – Friend or Foe by Stefan MolyneuxPeace Revolution partner podcasts:Corbett Report dot comMedia Monarchy dot comGnostic Media PodcastSchool Sucks Project PodcastMeria dot netOther productions by members of the T&H network:The Ultimate History Lesson: A Weekend with John Taylor Gatto (2012) a journey into the dark heart of public schooling, revealing how America became incoherent, one student at a time.Navigating Netflix (2011) our video series wherein we conduct a critical analysis of films you might have missed; Navigating Netflix is available for free on YouTube."Memories of a Political Prisoner", an interview with Professor Chengiah Ragaven, graduate of Oxford, Cambridge, and Sussex; AFTER he was a political prisoner, who was exiled from South Africa, during Apartheid. (2011)What You've Been Missing! (2011) is our video series focusing in on the history of corruption in our public education system.Top Documentary Films dot com: Hijacking Humanity by Paul Verge (2006)Top Documentary Films dot com: Exposing the Noble Lie (2010)Top Documentary Films dot com: The Pharmacratic Inquisition by Jan Irvin (2007)THANK YOU FOR YOUR SUPPORT! If you would like to donate so that we can continue producing independent media without commercial advertising, simply click the button below for a one-time donation: Alternatively, You can become a Member and Support our ability to create media for the public (while You make new friends and enjoy educating yourself along the way) by subscribing to the Tragedy and Hope Community: Monthly @ $14.95 / month Yearly @ $120.00 / year *Subscription details on Subscribe page in the Top Menu.
1948 begründete Claude Shannon mit seinem Aufsatz "A Mathematical Theory of Communication" die Informationstheorie und damit die Grundlage der gesamten Telekommunikation. Seine revolutionäre Arbeit eröffnete eine neue Wissenschaft, zu der heute u.a. die Quellencodierung, die Kanalcodierung und die Kryptographie gehören.
McDowell, Jack - Fitting Equations to Data: A Case Study in Mathematical Theory Testing - Classic matching theory consists of four equations entailing two parameters. Three of these equations apply to concurrent schedules, one to single schedules. Modern matching theory consists of five equations entailing eight parameters; four equations apply to concurrent schedules, one to single schedules. The three concurrent-schedule equations of classic matching theory can be fitted simultaneously to a single data set by minimizing an appropriate combination of residual sums of squares obtained from the separate sources of variance to which the individual equations apply. The overall percentage of variance accounted for by the ensemble, combined with an examination of the residuals left the fit. constitute a test of classic matching theory. The four concurrent schedule equations of modem matching theory can be tested in the same way. This method of theory testing is illustrated using a large data set from four human subjects responding on concurrent VI VI schedules. The data provide two, ten, and twenty individual sources of variance for the ensemble fits, thereby illustrating the suitability of this method for both elementary and elaborate sets of data. Testing classic and modern matching theory's account of behavior on single schedules often entails the special problems of equation degeneracy and parameter indeterminacy. It is important to recognize these conditions when they occur because they make y testing impossible. The methods and problems discussed here are applicable in general to mathematical theory testing in behavior analysis.