POPULARITY
⭐️⭐️برای شنیدن دنتکست 159 در سایت رسمی اینجا کلیک کنید⭐️⭐️اگر خارج کشورید از سایت https://dentcast.org استفاده کنید ❌❌❌موضوع این قسمت از دست رفتن کانتکت بین رستوریشن ایمپلنت و دندان مجاور (ICL) ـه. به اینکه چرا این کانتکتها با گذشت زمان باز میشن، چقدر شایعه و از نظر بالینی چطور باید مدیریتش کرد میپردازیم.
Quando o assunto é fertilizante foliar a base de aminoácidos, muitos produtores e consultores ainda utilizam o aminograma como principal critério de comparação entre produtos. Mas será que mais aminoácidos no rótulo significam, de fato, mais eficiência no campo?Neste episódio do Plantcast: Agro Além do Rótulo, o time de portfólio da ICL composto por André Alfonsi, Maria Lanza e David Bueno trazem uma conversa aprofundada e sem rodeios, sobre como avaliar tecnologias de forma mais crítica, quais informações realmente ajudam na tomada de decisão e o que deve ser considerado na busca por mais eficiência e resultados na lavoura.Uma discussão técnica, prática e baseada em ciência para ajudar produtores, consultores e RTVs a tomarem decisões mais seguras e eficientes, indo muito além do rótulo.
What your family lawyer was taught - and what they weren't. The first of four episodes on the architecture of the Australian family law system. Eleven mandatory areas of study to be admitted as a lawyer in Australia. Family law isn't one of them.The system isn't rigged. It isn't broken. It's working exactly as it was designed to - and the problem is what it was designed for.This is the first of a four-part series on the architecture of the Australian family law system. The system was built to adjudicate disputes between adult parties - to resolve property, allocate parenting time, and produce court orders. It was not built, in its foundations, to see children. And when we ask that architecture to do something it was never built to do, it produces, predictably, the outcomes we often see - children ordered into arrangements that are at best inappropriate, and at worst doing serious and lasting harm that could be prevented.In this first episode, I look at one of those foundations: how the lawyers inside the system were trained. There are eleven mandatory areas of study required to be admitted as a lawyer in Australia - known as the Priestley 11. None of them is family law. None of them is coercive control. None of them is child development. None of them is trauma. None of them is post-separation abuse. A specialisation that, for most family lawyers, rests on a single elective subject - if it was taken at all - and on whatever they "pick up on the job".This is the foundation. And it is producing, predictably, what foundations like this produce.In this episode:The focus: the system is working as designed; the problem is what it was designed forThe Priestley 11 - the eleven mandatory areas of study to become an Australian lawyer, none of which is family lawWhy this is a structural argument, not an attack on individual family lawyersAnd, in the closing minutes - what practising family lawyers themselves say about the training gap, in their own wordsFor protective parents navigating this system, the work I do in the Blueprint is built for exactly this - becoming the expert in your own situation, because, as this episode shows, the people advising you may not be. It's there if and when you want to go deeper.Coming next: what an Independent Children's Lawyer (ICL) actually is, and what an ICL was actually trained to do.Support: If you are in Australia and need to talk to someone, 1800RESPECT (1800 737 732) is available 24/7. In an emergency, call 000.Explore the supports offered by Danielle Black CoachingThe Post-Separation Parenting Blueprint™
Implantable collamer lenses, or ICLs, have evolved from a niche alternative for extreme prescriptions into a mainstream refractive option that is increasingly being chosen over LASIK—even for some ideal LASIK candidates. In this episode, we explore what changed: the history of the procedure, how ICL surgery is performed, the real risks and safety considerations, and how the visual outcomes compare with LASIK. We also dive into higher-order aberrations, stability of refraction, regression, and whether ICLs may offer superior quality of vision in certain patients. Refractive surgery expert Dr. Avi Wallerstein joins the podcast. Dr. Avi Wallerstein is the co-founder of Vision Group - https://www.thevisiongroup.com/ Become a supporter of this podcast: https://www.spreaker.com/podcast/blind-spot-the-eye-doctor-s-podcast--5819306/support.
Andrew Wilson, ICL's technical manager for ornamental horticulture in the UK and Ireland, explains what are the challenges for growers and manufacturers to overcome with the next generation of fertilisers.He talks about why we need controlled release fertilisers, the benefits of using ICL's new Cal-BOOST product and which other new fertiliser products ICL has in the pipeline.Andrew tell us about ICL's Osmocote brand and the impending new EU legislations regarding biodegradable coatings.He ends by giving top tips for growers regarding their fertiliser programmes. Hosted on Acast. See acast.com/privacy for more information.
An airhacks.fm conversation with Ian Rogers (@Ian Rogers) about: ZX Spectrum 128K with rubber keys and a burning side grill, Basic programming competitions, REM commands as ASCII art, PC versus Amiga and Archimedes era in the UK, fractal landscape generators for Wing Commander 4 cut scenes, Ocean Software in Manchester and the Head Over Heels game, Manchester Baby and Williams tube as the first stored-program computer, Steve Furber and ARM origins at the University of Manchester, Cosworth and Pi Research Formula One telemetry, transputers and embedded PowerPC data loggers, dynamic binary translation with the Dynamite simulator, ICL 2900 emulation for the Israeli tax system, MIPS to Itanium binary translation for SGI machines, Transitive Corporation and the PowerPC to x86 product that became Apple Rosetta, the Steve Jobs era at Apple, Spark to Power binary translation and the IBM acquisition of Transitive, JDBC versus ODBC API design observations, java.util.Vector and java.util.Hashtable synchronization decisions, StringBuilder array copying overhead from removing synchronization, DARPA HPCS languages Fortress, Chapel, X10, just-in-time parallelization from Java bytecode, LCC compiler from Princeton and the iBerg backend, JikesRVM as a metacircular Java VM written in Java, GNU Classpath and Sable VM by Etienne Gagnon, Apache Harmony port of JikesRVM to Windows, Maxwell and Maxine VMS as GraalVM precursors, Bernd Mathiske and the Sun acquisition by Oracle, GNU Classpath impact of the openJDK GPL release at FOSDEM 2006, Mark Wielaard and Rémi Forax FOSDEM stories, trace compilation and de-optimization parallels with JIT, Azul Systems Vega hardware and concurrent garbage collection, C4 collector design influencing ZGC and Shenandoah, Gil Tene's telephone exchange mentality for JVM responsiveness, page unmapping and signal handler memory pressure problems in HotSpot, Cliff Click and Modular, Google Android Runtime (ART) replacing Dalvik, transactional memory for class initializers in ART, ELF files and OAT format for ahead-of-time compilation, WhatsApp bytecode obfuscation breaking the ART verifier, lock balance verification for speculative lock optimizations, D8 and R8 Android compilers, Goit internal Google bytecode optimizer, Jeremy Manson and Google's OpenJDK variant, Linux kernel performance work and perf tooling, JikesRVM stack trace format making exception-heavy DaCapo benchmarks faster than HotSpot, Energy Efficiency across Programming Languages study comparing Java and Go, Ian Rogers on twitter: @Ian Rogers
Comdex belongs to IBM Xmas sales outlook dismal Games get protected in Japan These stories and many more on this episode of the VGNRTM! This episode we will look back at the biggest stories in and around the video game industry in November 1984. As always, we'll mostly be using magazine cover dates, and those are of course always a bit behind the actual events. Alex Smith of They Create Worlds is our cohost. Check out his podcast here: https://www.theycreateworlds.com/ and order his book here: https://www.theycreateworlds.com/book Get us on your mobile device: Android: https://www.google.com/podcasts?feed=aHR0cHM6Ly92aWRlb2dhbWVuZXdzcm9vbXRpbWVtYWNoaW5lLmxpYnN5bi5jb20vcnNz iOS: https://podcasts.apple.com/de/podcast/video-game-newsroom-time-machine And if you like what we are doing here at the podcast, don't forget to like us on your podcasting app of choice, YouTube, and/or support us on patreon! https://www.patreon.com/VGNRTM Send comments on Mastodon @videogamenewsroomtimemachine@oldbytes.space Or twitter @videogamenewsr2 Or Instagram https://www.instagram.com/vgnrtm Or videogamenewsroomtimemachine@gmail.com Links: If you don't see all the links, find them here: 7 Minutes in Heaven: KnightLore Video Version: https://www.patreon.com/posts/157513930 https://www.mobygames.com/game/14733/knight-lore/ Corrections: Ethan's fine site The History of How We Play: https://thehistoryofhowweplay.wordpress.com/ October 1984 Ep - https://www.patreon.com/posts/october-1984-137843011 October 1994 Ep - https://www.patreon.com/posts/october-1994-151072694 Mortal Kombat Live Tour - https://youtu.be/nbOQIheheDc 1974: 1974 - Creative Computing debuts https://archive.org/details/CreativeComputingv01n01NovemberDecember1974 1984: Atari claims Coleco to exit UK console market https://archive.org/details/popular-computing-weekly-1984-11-15/mode/1up Coleco exits the UK market https://archive.org/details/popular-computing-weekly-1984-11-29/mode/1up Parker Brothers abandons UK https://archive.org/details/popular-computing-weekly-1984-11-29/page/n4/mode/1up https://www.sinclaircollection.site/?page_id=520 http://www.fruitcake.plus.com/Sinclair/Interface2/Cartridges/Interface2_RC_Unreleased.htm Hi-Tech isn't UK's savior Financial Notebook: Hi-tech myth / Employment falls in information, technology industry, The Guardian (London), November 2, 1984 Coinop earnings crater Play Meter November 1, 1984, pg. 32. Nintendo pushes VS. Paks and standards Play Meter November 15, 1984, pg. 24 https://en.wikipedia.org/wiki/Nintendo_VS._System Atari Games gets into systems RePlay November 1984, pg. 16 https://en.wikipedia.org/wiki/Atari_Games https://www.mobygames.com/game/3929/star-wars/ https://www.mobygames.com/game/21280/star-wars-the-empire-strikes-back/ https://www.mobygames.com/game/17500/star-wars-return-of-the-jedi/ Konami buys Interlogic https://archive.org/details/game-machine-magazine-19841115p/page/n13/mode/2up Gung Ho - https://www.imdb.com/de/title/tt0091159/?ref_=nv_sr_srsg_0_tt_8_nm_0_in_0_q_gung%20ho Twin Galaxies looking for world records https://archive.org/details/guinness1985book00mcwh/page/570/mode/2up?q=video+game Play Meter, November 1, 1984 pg. 25 Colecovision rides Cabbage Patch Kid coattails Rainbow Brite, Robots Give Cabbage Patch Kids Run for Money, The Associated Press, November 20, 1984, Tuesday, AM cycle, Section: Domestic News, Byline: By ROGER GILLOTT, AP Business Writer Cabbage Patch/Colecovision Ad - https://youtu.be/lqZsOeEWDtw?si=k3zoqYsDuL00pxmB IBM conquers Comdex I.B.M. ENTRY UNCHALLENGED AT SHOW, The New York Times, November 19, 1984, Monday, Late City Final Edition, Section: Section D; Page 1, Column 3; Financial Desk, Byline: By DAVID E. SANGER Current well-behaved packages leave user dreams unfulfilled, Computerworld, November 19, 1984, Section: MICROCOMPUTERS; Small Talk; Pg. 57, Byline: Eric Bender, CW Senior Editor Denise Carabet, The San Diego Union-Tribune, November 26, 1984 Monday, Section: BUSINESS; Pg. A-16 Comdex host to myriad micro debuts; Show features few surprises, Computerworld, November 19, 1984, Section: NEWS; Pg. 1, Byline: By Eric Bender, CW Staff PERIPHERALS;THE ALLURE OF LASER PRINTERS, The New York Times, November 20, 1984, Tuesday, Late City Final Edition, Section: Section C; Page 7, Column 1; Science Desk, Byline: By PETER H. LEWIS Foreign vendors showcase wares at Comdex;Japanese, Australian, English vendors highlight product introductions in '84, Computerworld, November 26, 1984,Section: NEWS; Pg. 40, Byline: By Susan Blakeney, CW Staff Apple ad spree continues Apple Goes After Share of Mind Over Market; 'Event Marketing' Has Become Core Of No. 2's Strategy, ADWEEK, November 19, 1984, Eastern Edition, Byline: By Betsy Sharkey and Paul Farhi APPLE'S MAC TAKING ON I.B.M. The New York Times, November 22, 1984, Thursday, Late City Final Edition, Section: Section D; Page 1, Column 3; Financial Desk, Byline: By ANDREW POLLACK No Headline In Original, U.S. News & World Report, November 19, 1984, Section: NEWSLETTERS: U.S. Business; TRENDS THAT SHAPE THE FUTURE; Pg. 75 Home computer sales slump in Xmas build up https://archive.org/details/popular-computing-weekly-1984-11-22/page/n4/mode/1up Leisure Sector Gives Madison Ave. Big Xmas Gift, ADWEEK, November 5, 1984, Eastern Edition, Byline: By Amy Saltzman, Bob Peischel, Jack Feuer, Betsy Sharkey, Paul Farhi, Dottie Enirco and Fran Brock Atari cuts price of 800XL https://archive.org/details/popular-computing-weekly-1984-11-22/page/n4/mode/1up Computer Wars: Atari Announces Price Slash The Associated Press, November 13, 1984, Tuesday, AM cycle, Section: Domestic News, Byline: By DIANE CURTIS, Associated Press Writer ATARI MAKES PLANS FOR STOCK OFFERINGS, The New York Times, November 14, 1984, Wednesday, Late City Final Edition, Section: Section D; Page 4, Column 5; Financial Desk https://discord.com/channels/431269689918750731/618928892232859659/1483821277230792834 Vaughn, Mullen Get CD Posts at WRG, ADWEEK, November 19, 1984, Eastern Edition, byline: By Gail Belsky UK is"meh" on MSX https://ia600609.us.archive.org/31/items/popular-computing-weekly-1984-11-01/PopularComputing_Weekly_Issue_1984-11-01.pdf pg. 29 India says "yes" to BBC Micro Acorn User, November 1984, pg. 10 https://en.wikipedia.org/wiki/Semi-Conductor_Laboratory https://bbcmicro.computer/scl-unicorn USSR copies Apple Byte November 1984, pg. 134 https://en.wikipedia.org/wiki/Agat_(computer) Sinclair working on portable https://archive.org/details/popular-computing-weekly-1984-11-08/page/n4/mode/1up https://archive.org/details/popular-computing-weekly-1984-11-29/mode/1up ICL goes QL https://archive.org/details/popular-computing-weekly-1984-11-01/mode/1up https://en.wikipedia.org/wiki/One_Per_Desk https://youtu.be/FdmoXjmPPHk?si=-djAjZ1Es0wDCKV2 No Headline In Original, The Associated Press, November 1, 1984, Thursday, AM cycle, Section: Business News https://en.wikipedia.org/wiki/ROLM Rolm workstations tie phone, micro;Desktop systems integrate voice, data communicationsions tie phone, micro, Computerworld, November 5, 1984, Section: NEWS; Pg. 2, Byline: By Eric Bender, CW Staff https://archive.org/details/popular-computing-weekly-1984-11-22/mode/1up QL gets 3rd party upgrades https://ia600609.us.archive.org/31/items/popular-computing-weekly-1984-11-01/PopularComputing_Weekly_Issue_1984-11-01.pdf PC Jr gets new lease on life THE USER-FRIENDLY VOTING BOOTH IS POISED TO COME ON LINE, The New York Times, November 4, 1984, Sunday, Late City Final Edition, Section: Section 4; Page 6, Column 1; Week in Review Desk, Byline: By DAVID E. SANGER Local governments tap micros for electoral activities, Computerworld, November 5, 1984, Section: NEWS; Pg. 16, Byline: By James Connolly, CW Staf PCjr's second Halloween, Computerworld, November 5, 1984, Section: VIEWPOINT; Lecht on Science; Pg. 59, Byline: Charles P. Lecht; Tandy 1000 debuts Tandy Unveils $1,199 IBM-Compatible Computer, The Associated Press, November 8, 1984, Thursday, BC cycle, Section: Business News Hitachi shoots for 32-bit supremacy Hitachi Plans To Challenge U.S. Makers of 32-Bit Processors, The Associated Press, November 29, 1984, Thursday, BC cycle, Section: Business News Byte November 1984, pg. 159 XTAR introduces 3D accelerator Byte November 1984, pg. 179 https://archive.org/details/PC_Tech_Journal_vol03_n09/page/n27/mode/2up?q=xtar+polygone https://www.bitsavers.org/magazines/Digital_Design/Digital_Design_V15_N08_198508.pdf Thorn-EMI fires internal devs https://ia600609.us.archive.org/31/items/popular-computing-weekly-1984-11-01/PopularComputing_Weekly_Issue_1984-11-01.pdf pg. 8 https://www.mobygames.com/company/5174/creative-sparks/ Games Workshop gets into computer games https://www.mobygames.com/game/63565/tower-of-despair/ https://archive.org/details/popular-computing-weekly-1984-11-22/page/n68/mode/1up https://www.mobygames.com/company/3136/games-workshop-ltd/games/title:1/ Firebird buys Elite rights https://archive.org/details/popular-computing-weekly-1984-11-29/page/n4/mode/1up https://www.mobygames.com/game/1324/elite/ https://www.mobygames.com/game/46533/elite/ Timothy Leary gets into games Timothy Leary: LSD `guru' leaps to floppy discs, The San Diego Union-Tribune, November 11, 1984 Sunday, Section: LIFESTYLE; Pg. D-1, Bline: Frank Green https://www.mobygames.com/game/254/timothy-learys-mind-mirror/ PlayNet profiled No Headline In Original, United Press International, November 4, 1984, Sunday, BC cycle, Section: Financial, Byline: By STEVE GEIMANN, UPI Business Writer https://en.wikipedia.org/wiki/PlayNET BBS gets busted FREE-SPEECH ISSUES SURROUND COMPUTER BULLETIN BOARD USE, The New York Times, November 12, 1984, Monday, Late City Final Edition, Section: Section A; Page 1, Column 1; Financial Desk, Byline: By ANDREW POLLACK https://www.nytimes.com/1985/08/04/magazine/of-bytes-and-bulletin-boards.html The Night of the Hackers, Newsweek, November 12, 1984, UNITED STATES EDITION, Section: DISPATCHES; Pg. 17, Byline: RICHARD SANDZA French paper Le Canard hacks French Nuclear program Computer secrets tapped / France, The Guardian (London), November 29, 1984, From PAUL WEBSTER Hackers unpack Admitted hacker says he discovered Pentagon plans, United Press International, November 22, 1984, Thursday, AM cycle, Section: Domestic News, byline: By MICHAEL D. HARRIS Move over modems, here come satellites! SATELLITE BROADCAST NETWORK, INC.; Satellite receiver system, Computerworld, November 19, 1984, Section: COMMUNICATIONS; Network Services; Pg. 41 New service for personal computers offers direct link to satellite, Christian Science Monitor (Boston, MA), November 20, 1984, Tuesday, Section: National; Pg. 11, Byline: By David F. Salisbury, Staff writer of The Christian Science Monitor You haven't lived until you've died in MUD ad https://archive.org/details/popular-computing-weekly-1984-11-22/page/n46/mode/1up Hackers reviewed by New York Times PERSONAL COMPUTERS; THE BOOKS GET BETTER ON NONTECHNICAL TOPICS, The New York Times, November 6, 1984, Tuesday, Late City Final Edition, Section: Section C; Page 5, Column 1; Science Desk, Byline: By ERIK SANDBERG-DIMENT IN SHORT, The New York Times, November 11, 1984, Sunday, Late City Final , Edition, Section: Section 7; Page 32, Column 1; Book Review Desk; Review Micro Hobby launches in Spain https://archive.org/details/MicroHobby057/MicroHobby/MicroHobby_001/page/n31/mode/2up https://microhobby.speccy.cz/mhforever/ Japan recognizes video game copyirghts https://archive.org/details/game-machine-magazine-19841101p/page/n16/mode/1up Commodore sees loophole in Amiga battle https://ia600609.us.archive.org/31/items/popular-computing-weekly-1984-11-01/PopularComputing_Weekly_Issue_1984-11-01.pdf Game music gets busted https://ia600609.us.archive.org/31/items/popular-computing-weekly-1984-11-01/PopularComputing_Weekly_Issue_1984-11-01.pdf https://youtu.be/6kFu5ojgnQU?si=3E6Tqg2Mi1vMQEnX https://archive.org/details/popular-computing-weekly-1984-11-08/page/n4/mode/1up UK PC clones get busted https://archive.org/details/popular-computing-weekly-1984-11-08/mode/1up https://en.wikipedia.org/wiki/Advance_86 IBM eyes Mexico for factory BUSINESS DIGEST,The New York Times,November 28, 1984, Wednesday, Late City Final Edition, Section: Section D; Page 1, Column 1; Financial Desk; summary https://www.nytimes.com/1985/01/19/business/mexico-rejects-ibm-control-for-new-plant.html Computer Museum finds permanent home First Computer Museum Opens On Boston's Waterfront, The Associated Press, November 14, 1984, Wednesday, PM cycle, Section: Domestic News, Byline: By BART ZIEGLER, https://en.wikipedia.org/wiki/The_Computer_Museum,_Boston Acorn Video profiled https://archive.org/details/popular-computing-weekly-1984-11-15/page/n13/mode/1up Datacopy announces Model 700 scanner DATACOPY; Announces major new product and software offerings, Business Wire, November 1, 1984, Thursday https://en.wikipedia.org/wiki/Datacopy IBM mainframe strategies revealed IBM seeks mart leverage via customer revenue, Computerworld, November 26, 1984, Section: COMPUTER INDUSTRY; Pg. 97, Byline: By John Desmond, CW Staff Hong Kong transfer disrupts toy supplies Playthings, November 1984, pg. 61 Hitchhikers' Guide to the Galaxy goes Fourth COSMIC HITCHHIKER, United Press International, November 24, 1984, Saturday, BC cycle, Section: Domestic News, Byline: By WILLIAM C. TROTT, United Press International Visicorp RIP VISICORP IS MERGING INTO PALADIN, The New York Times, November 3, 1984, Saturday, Late City Final Edition, Section: Section 1; Page 29, Column 3; Financial Desk, Byline: By ANDREW POLLACK Spreadsheets cited most used micro software, Computerworld, November 26, 1984, Section: MICROCOMPUTERS; Pg. 90 https://archive.org/details/byte-magazine-1984-11-rescan/page/n11/mode/1up Franklin RIP Franklin to free assets in effort to settle with creditors; Legal battles with Apple placed New Jersey-based manufacturer in financial, straits, Computerworld, November 12, 1984, Section: COMPUTER INDUSTRY; Pg. 138 Mylstar RIP Play Meter November 15, 1984, pg. 8 Recommended Links: The History of How We Play: https://thehistoryofhowweplay.wordpress.com/ Gaming Alexandria: https://www.gamingalexandria.com/wp/ They Create Worlds: https://tcwpodcast.podbean.com/ Digital Antiquarian: https://www.filfre.net/ The Arcade Blogger: https://arcadeblogger.com/ Retro Asylum: http://retroasylum.com/category/all-posts/ Retro Game Squad: http://retrogamesquad.libsyn.com/ Playthrough Podcast: https://playthroughpod.com/ Retromags.com: https://www.retromags.com/ Games That Weren't - https://www.gamesthatwerent.com/ Sound Effects by Ethan Johnson of History of How We Play. Copyright Karl Kuras
In this episode of Eyeluminaries, John A. Hovanesian, MD, FACS, and Jim Mazzo are live from Hawaiian Eye 2026 with guests Elizabeth Yeu, MD, and Allen C. Ho, MD. They discuss cataract and retina surgery, managing work-life balance and more. · Welcome to Eyeluminaries. 00:01 · Elizabeth Yeu, MD, 00:11 · How do you see Implantable Collamer Lens (ICL, STAAR Surgical) surgery expanding? 01:23 · How long have you been with Tarsus Pharmaceuticals? 05:00 · How do you have work-life balance? 08:21 · Allen C. Ho, MD 11:38 · What got you into retina? 12:55 · How has the evolution of retina surgery changed your practice? 14:55 · Tell us about your role at Eyecelerator. 17:00 · How do you manage your work-life balance? 18:39 · Thank you! 20:19 Elizabeth Yeu, MD, is an ophthalmologist and cornea and cataract surgeon. She is the chief medical officer of Tarsus Pharmaceuticals as well as past president of the American Society of Cataract and Refractive Surgery. Allen C. Ho, MD, is a retina surgeon at Wills Eye Hospital, past president of the Retina Society and Eyecelerator retina program chair. We'd love to hear from you! Send your comments/questions to eyeluminaries@healio.com. Follow John A. Hovanesian, MD, FACS @DrHovanesian on Instagram and X and John Hovanesian on LinkedIn.
Season 3 of Golf's Next Gen, the official podcast of the American Junior Golf Association, continues with Episode 4. This episode features an in-depth conversation with Ronin Banerjee, currently ranked No. 5 in the Rolex AJGA Rankings, and Dayton Hansen, COO of ICL Academy. Banerjee shares how he balances elite junior golf with academics through ICL's online school model, offering a detailed look at his daily schedule and life as one of the top juniors in the country. Hansen breaks down ICL Academy's mission of building champions for life, explaining how the program supports serious junior golfers by creating flexibility for both school and competitive pursuits while preparing students for success on and off the course.
O presidente Lula afirmou ter aconselhado o ministro Alexandre de Moraes, do Supremo Tribunal Federal, a não participar de eventuais julgamentos sobre o Banco Master.Durante entrevista ao ICL, Lula relatou que sugeriu ao ministro declarar-se impedido devido a um contrato entre a instituição financeira e o escritório de advocacia de sua esposa, Viviane Barci de Moraes. Papo Antagonista é o programa que explica e debate os principais acontecimentos do dia com análises críticas e aprofundadas sobre a política brasileira e seus bastidores. O programa traz contexto e opinião sobre os temas mais quentes da atualidade. Com foco em jornalismo, eleições e debate, é um espaço essencial para quem busca informação de qualidade. Ao vivo de segunda a sexta-feira às 18h no nosso canal no Youtube. https://www.youtube.com/@OAntagonista Apoie o jornalismo independente. Assine O Antagonista e Crusoé com 10% via Pix ou Google Pay: https://assine.oantagonista.com.br/ Siga O Antagonista no X: https://x.com/o_antagonista Acompanhe O Antagonista no canal do WhatsApp. Boletins diários, conteúdos exclusivos em vídeo e muito mais. https://whatsapp.com/channel/0029Va2SurQHLHQbI5yJN344 Leia mais em www.oantagonista.com.br | www.crusoe.com.br#Lula #Moraes #BancoMaster #CasoMaster #AlexandreDeMoraes #VivianeBarci #STF #Justiça #Impedimento #ConflitoDeInteresses #ICL #Advocacia #Supremo #PolíticaBrasil #PapoAntagonista #Compliance #Ética #Direito #Noticias #Urgente
Steve Chapman, an experienced ex-grower and ICL technical area sales manager, turns his attention to vine weevil — often cited as the number one pest on nurseries in the UK and Ireland. BASIS qualified, Chapman has many years of experience advising growers on how to keep this pest at bay. Vine weevil are highly topical because spring is a key time to target the larval or grub stage before they hatch in to adults. Chapman was previously a production manager on a large Kent nursery. He controlled vine weevil back then with products such as Exemptor that are now off the market. He recommends options such as Lalguard (formerly Met52) now. Lalguard can be mixed into growing media.He says understanding the lifecycle of this pest is important, from egg stage to larvae and pupation into adults, and how important it is to target at the right time.Chapman recommends starting planning when it is quiet, then to apply Seeka beneficial nematodes in March and April. He also recommends using bait plants such as heuchera to attract vine weevil.Beneficial nematodes play a central role in controlling vine weevil. Chapman says timing and monitoring are important. His three top tips are: Know the pest's lifecycle.Plan ahead.Use a wetting agent such as Transporter. Hosted on Acast. See acast.com/privacy for more information.
O Fala Carlão apresenta, no Canal do Boi, a cobertura da posse da ANDAV, reunindo importantes lideranças do setor. Participam da conversa Roberto Betancourt, Diretor da Fiesp/Deagro; Geraldo Melo Filho, Secretário de Agricultura e Abastecimento do Estado de São Paulo; Paulo Tiburcio, Presidente Executivo da ANDAV; Marcelo Okamura, Diretor-Presidente do inpEV; Ana Paula Contador Packer, Chefe Geral da Embrapa Meio Ambiente; e Rafael Butke, Diretor de Marketing da ICL. O encontro evidencia a importância da integração entre entidades, setor público, indústria e pesquisa para fortalecer o agronegócio. As lideranças destacam o papel das instituições na construção de soluções, no apoio ao produtor e no avanço de temas estratégicos para o desenvolvimento do setor. A cobertura reforça como o alinhamento entre diferentes elos da cadeia produtiva é fundamental para impulsionar o agro brasileiro com eficiência, inovação e visão de longo prazo.
Chronic wasting disease is a fatal neurological condition – a prion like mad cow disease or scrapie – that affects members of the deer and elk family, known as cervids or cervidae. In February, the Idaho Conservation League sent a letter to state lawmakers and the Idaho State Department of Agriculture, outlining concerns with documented biosecurity lapses at several domestic elk farms across the state, flagging the possibility of chronic wasting disease transmission between wild and domestic cervids. ICL Wildlife Program Associate Jeff Abrams sat down last week to discuss in depth. State Department of Agriculture Director Chanel Tewalt laid out ISDA's view of the situation in a letter of her own that Friday responding to Abrams and ICL's concerns, which Idaho Reports obtained through a public records request.
More Amsterdam kids are getting vaccinated and finally the ICL fertilizer plant in Amsterdam-Noord must curb its emissions. A short news round-up out of Amsterdam from 19 February 2026.Audio produced by Broadcast Amsterdam for BRAM RADIO, the online radio station for Amsterdam.https://broadcastamsterdam.nlLinks to news stories and sources are shared in the News section on our website and on the Broadcast Amsterdam Pinterest feed. Credits: Cathy Leung (producer)Music bed: We Are OK
A fight for clean air in Amsterdam: on Tuesday 20 January 2026, the local action group Adem Vrij aan het IJ (https://ademvrijaanhetij.nl) again shared their concerns about the emissions of the ICL fertiliser factory in their neighbourhood. They presented Jeroen Olthof, deputy of the province of North Holland, with a New Year's card from about 170 residents, all wishing for stronger measures to deal with the ICL factory. BRAM RADIO's Dominik Kucera was at the event and spoke with various parties to find out what's at the heart of this protest. (The province and the environmental service will come up with a new permit for ICL at the end of January, reports AT5.) Audio report by Dominik Kucera for BRAM RADIO, the online radio station for Amsterdam, produced by Stichting Broadcast Amsterdam. https://broadcastamsterdam.nl
O bagulho tá cada vez mais doido. Você sabia que agora o ICL tem uma revista? Chegou a revista LIBERTA. A revista é semanal, 100% digital e os textos estão em áudio também. Vai ter reportagens, artigos, textos e análises dessa quadra maluca da história, escritas por jornalistas do ICL e convidados. Pra assinar, é só entrar em revistaliberta.com.br/v-medoedelirio que pinga um aqui também! É nóis!Se quiser, puder e der, mete um pix recorrente pra gente no medoedelirioembrasilia@gmail.com! O post II – 2026.04 – (SEM TRADUÇÃO) A distopia trumpiana apareceu primeiro em Central 3.
O bagulho tá cada vez mais doido. Você sabia que agora o ICL tem uma revista? Chegou a revista LIBERTA. A revista é semanal, 100% digital e os textos estão em áudio também. Vai ter reportagens, artigos, textos e análises dessa quadra maluca da história, escritas por jornalistas do ICL e convidados. Pra assinar, é só entrar em revistaliberta.com.br/v-medoedelirio que pinga um aqui também! É nóis!Se quiser, puder e der, mete um pix recorrente pra gente no medoedelirioembrasilia@gmail.com! O post II – 2026.04 – (COM TRADUÇÃO) A distopia trumpiana apareceu primeiro em Central 3.
O bagulho tá cada vez mais doido. Você sabia que agora o ICL tem uma revista? Chegou a revista LIBERTA. A revista é semanal, 100% digital e os textos estão em áudio também. Vai ter reportagens, artigos, textos e análises dessa quadra maluca da história, escritas por jornalistas do ICL e convidados. Pra assinar, é […] O post II – 2026.04 – (SEM TRADUÇÃO) A distopia trumpiana apareceu primeiro em Central 3.
O bagulho tá cada vez mais doido. Você sabia que agora o ICL tem uma revista? Chegou a revista LIBERTA. A revista é semanal, 100% digital e os textos estão em áudio também. Vai ter reportagens, artigos, textos e análises dessa quadra maluca da história, escritas por jornalistas do ICL e convidados. Pra assinar, é […] O post II – 2026.04 – (COM TRADUÇÃO) A distopia trumpiana apareceu primeiro em Central 3.
A sorte do careca e o show de suspeição! Você sabia que agora o ICL tem uma revista? Chegou a revista LIBERTA. A revista é semanal, 100% digital e os textos estão em áudio também. Vai ter reportagens, artigos, textos e análises dessa quadra maluca da história, escritas por jornalistas do ICL e convidados. Pra assinar, é só entrar em revistaliberta.com.br/v-medoedelirio que pinga um aqui também! É nóis!Se quiser, puder e der, mete um pix recorrente pra gente no medoedelirioembrasilia@gmail.com! O post II – 2026.03 – Banco Master, enfim apareceu primeiro em Central 3.
A sorte do careca e o show de suspeição! Você sabia que agora o ICL tem uma revista? Chegou a revista LIBERTA. A revista é semanal, 100% digital e os textos estão em áudio também. Vai ter reportagens, artigos, textos e análises dessa quadra maluca da história, escritas por jornalistas do ICL e convidados. Pra […] O post II – 2026.03 – Banco Master, enfim apareceu primeiro em Central 3.
Dr. Sarekzy joins us in this episode to discuss LASIK, PRK,a nd ICL as different treatment options for refractive error.
SPONSORS: 1) BLUE CHEW: Get 10% off your first month of BlueChew Gold with code JULIAN at BlueChew.com. Visit https://BlueChew.com for more details and important safety information. 2) AMENTARA: Go to https://www.amentara.com/go/JULIAN and use code JD22 for 22% off your first order. PATREON https://www.patreon.com/JulianDorey (***TIMESTAMPS in description below) ~ Dr. Joseph Allen, O.D., FAAO, ABO, is a highly respected practicing optometrist and the founder of the massively successful "Doctor Eye Health" YouTube channel, where he serves as "Your Optometrist on YouTube." JOSEPH's LINKS: YT: https://www.youtube.com/@UCSs2CvlyOKLYY4SbfehnKNQ IG: https://www.instagram.com/doctoreyehealth/# WEBSITE: https://www.doctoreyehealth.com/ FOLLOW JULIAN DOREY INSTAGRAM (Podcast): https://www.instagram.com/juliandoreypodcast/ INSTAGRAM (Personal): https://www.instagram.com/julianddorey/ X: https://twitter.com/julianddorey JULIAN YT CHANNELS - SUBSCRIBE to Julian Dorey Clips YT: https://www.youtube.com/@juliandoreyclips - SUBSCRIBE to Julian Dorey Daily YT: https://www.youtube.com/@JulianDoreyDaily - SUBSCRIBE to Best of JDP: https://www.youtube.com/@bestofJDP ****TIMESTAMPS**** 0:00 – Intro 1:32 – Content inspirations, childhood tech limits, optometry vs ophthalmology, years of training 10:15 – Cataract surgery, oxidation, signs, Charles Kelman, 15-minute procedure 22:46 – VA work, surgeon skill vs ego, ICL implants, Joe's procedure 35:31 – ICL risks, contact lenses, retina = brain extension, eye anatomy 46:12 – Cataracts & amblyopia, vision therapy, eye health basics 54:56 – Brain injuries, prisms, lazy eye causes 01:04:25 – Myopia rise, indoor living, FDA glasses, red-light studies 01:14:12 – Screen fatigue, blink loss, red light benefits & risks 01:24:31 – Eye health habits, diet, fish vs supplements 01:35:16 – Gut microbiome, inflammation, eye connection 01:46:34 – Fiber, lutein, zeaxanthin, supplement limits 01:56:41 – AI in medicine, fasting & vision, blood sugar 02:07:15 – Blue light myths, sleep, orange glasses 02:16:18 – Kids & screens, neck-eye link, 20/20/20 rule 02:26:01 – Blink rates, iPad kids, nervous system overload 02:35:16 – Outdoors, discomfort, AI & youth, not a doomer CREDITS: - Host, Editor & Producer: Julian Dorey - COO, Producer & Editor: Alessi Allaman - https://www.youtube.com/@UCyLKzv5fKxGmVQg3cMJJzyQ - In-Studio Producer: Joey Deef - https://www.instagram.com/joeydeef/ Julian Dorey Podcast Episode 373 - Dr. Joseph Allen Music by Artlist.io Learn more about your ad choices. Visit podcastchoices.com/adchoices
Para iniciarmos o ciclo do PlantCast em 2026, temos a honra de receber o agrônomo, consultor e Nutrólogo de Plantas Leandro Barcelos para trazer um pouco de sua vasta experiência em lavouras campeãs em alta produtividade com soja e outras culturas. Aproveite e siga a ICL nas redes sociais para mais conteúdo e atualizações:Instagram:https://bit.ly/3RfwZjlYouTube:https://bit.ly/46RYbdXLinkedIn:https://bit.ly/487ejJt
Recebemos neste Plantcast Maurício Cherubin, Prof. do departamento de solos da ESALQ e pesquisador da CCarbon da USP, para um papo de vital importância para a agricultura atual: a Saúde do Solo. Neste podcast, entenda mais sobre os conceitos, indicadores, e as ferramentas de avaliação, além das aplicações nos diferentes sistemas de produção agrícolas. Aproveite e siga a ICL nas redes sociais para mais conteúdo e atualizações:Instagram:https://bit.ly/3RfwZjlYouTube:https://bit.ly/46RYbdXLinkedIn:https://bit.ly/487ejJt
Chloe Whiteside, ICL's technical area sales manager covering Norfolk, Suffolk and Cambridgeshire – has spoken on the HortWeek podcast about the highs and lows of the 2025 spring bedding season and what the strong start and weaker finish mean for the 2026 bedding plant season.She talks about what bedding growers should be doing in the lead-up to the spring season and gives advice about watering, nutrition and storage regimes for peat-reduced and peat-free growing media.On nutrition, she talks about using controlled release fertiliser and water solubles, as well as which biocontrol, biopesticide and biostimulant products are at the grower's disposal and, as a BASIS qualified adviser, what she recommends.Before joining ICL, Whiteside spent 10 years in horticultural research at ADAS, delivering research projects on a wide range of ornamental and edible crops. She managed the AHDB funded Bedding and Pot Plant Centre trials, as well as the AHDB, Defra and industry-funded project on Transition to Responsibly Sourced Growing Media Use in UK Horticulture. The project ran for five years and covered all sectors of horticulture, from bedding propagation right through to container grown trees and soft fruit production. Hosted on Acast. See acast.com/privacy for more information.
This episode provides a comprehensive preview of the 2026 AAOS Annual Meeting, set to take place in New Orleans. Special guests Dr. Matthew Provencher, Chair of the Annual Meeting Oversight Committee, and Dr. Michael Leddy, Chair of the Board of Counselors, join host Dr. Stuart Fischer to discuss the meticulous planning required for one of the world's largest medical gatherings. They cover new data-driven changes aimed at maximizing attendee engagement, including more efficient session lengths and the elimination of ICL registration fees, making education more accessible than ever. The episode highlights the importance of member feedback in shaping the meeting's offerings, plans for innovative features such as an advanced navigation app, and exciting technological upgrades for hands-on learning. With expert insights and local perspective, the hosts share everything attendees can look forward to -- from educational sessions and networking opportunities, to unique New Orleans attractions and tips for making the most of time in The Big Easy. Host: Dr. Stuart Fischer Guests: Dr. Matthew Provencher, Chair, Annual Meeting Oversight Committee; Dr. Michael Leddy, Chair, Board of Counselors Production and Editing: Matt DeWolf
O Lula “errado” e o Trump mais errado ainda. (Versão com tradução)Dá uma olhada nos cursos do ICL! Se der pra usar nosso link (bit.ly/iclmedo), melhor ainda! O post II – 2025.63 – Medo e Delírio na ONU (COM TRADUÇÃO) apareceu primeiro em Central 3.
O Lula “errado” e o Trump mais errado ainda. (Versão sem tradução) Dá uma olhada nos cursos do ICL! Se der pra usar nosso link (bit.ly/iclmedo), melhor ainda! The post II – 2025.63 – Medo e Delírio na ONU (SEM TRADUÇÃO) appeared first on Central 3.
O Lula “errado” e o Trump mais errado ainda. (Versão com tradução) Dá uma olhada nos cursos do ICL! Se der pra usar nosso link (bit.ly/iclmedo), melhor ainda! The post II – 2025.63 – Medo e Delírio na ONU (COM TRADUÇÃO) appeared first on Central 3.
O Lula “errado” e o Trump mais errado ainda. (Versão sem tradução)Dá uma olhada nos cursos do ICL! Se der pra usar nosso link (bit.ly/iclmedo), melhor ainda! O post II – 2025.63 – Medo e Delírio na ONU (SEM TRADUÇÃO) apareceu primeiro em Central 3.
We are delighted to start off Season 9 with Dr. Mike Rendall, the CTO of AFC Energy, an industry veteran with an interesting pivot. The EAH team enjoyed discussing all things hydrogen, ammonia cracking and distributed decarbonisation with a real trove of knowledge and learnings. About AFC Energy:AFC Energy plc is a UK hydrogen technology company commercialising both ruggedised fuel cell power generators for the construction market and proprietary ammonia crackers for decentralised and scalable hydrogen production, targeting industrial, transportation, and temporary power markets. The heart of AFC Energy's value proposition to customers, is its ability to supply hydrogen and / or clean power at customer facilities in modular, scalable quantities—at commercially viable price points and without reliance on government subsidies.Having built and operated a 400kg/day ammonia cracker to pure hydrogen demonstration plant - the world's largest - since December 2023, AFC Energy launched the “HY5” in June 2025, a containerized version of its ammonia cracker capable of producing 500kg of 99.99% pure hydrogen per day on a "Fuel as a service" basis. In a joint development partnership with a major global industrial player, it is also developing larger-scale ammonia crackers based on its core technology for applications that include port-side pipeline-filling and hard-to-abate industrial sectors.Recent strategic partnerships include 50/50 joint ventures with Speedy Hire, the UK's largest equipment rental company for fuel cell generators, and with Industrial Chemicals Ltd for the scaled production and distribution of low-cost hydrogen across the UK, utilizing ammonia sourced by ICL and AFC Energy's ammonia cracking technology.In July 2025, AFC Energy completed an oversubscribed £27.5 million equity raise from institutional and retail investors on the AIM market of the London Stock Exchange.About Dr. Mike Rendall:Mike Rendall is the CTO at AFC Energy, where he is responsible for product development, technology strategy, and commercial rollout of AFC Energy's ammonia cracker and fuel cell systems. He leads development of both the Hy-5 containerised cracker and larger industrial-scale solutions in partnership with major international industry partners. Mike previously held key strategic technical roles at Dyson, Diverse Energy, and multiple leading battery and fuel cell firms. --Links:AFC Energy — https://www.afcenergy.com/
Kirk Spahn is a fourth generation educator with more than two decades in the field. After graduating from Dartmouth College, he worked for schoolmaster.net, an early online learning platform based in London.But it was the events of Sept. 11 that inspired him that inspired him to start the Institute for Civic Leadership (ICL), an award winning youth educational nonprofit organization..In this episode, Kirk tells the entire story of ICL's founding and the challenges of online learning. He also discusses the importance of mentors in a child's education, how the COVID 19 lockdown affected online learning, and how he's developed an academy that attracts top student athletes.For all links and resources mentioned in this episode, head to the show notes: https://www.educatorforever.com/episode139.
In this episode of Ag Tech Talk by AgriBusiness Global, we explore a major milestone in the evolution of biological crop inputs: ICL's acquisition of Lavie Bio, a subsidiary of Evogne Ltd. — a strategic move poised to accelerate innovation and global adoption of sustainable ag solutions.
NESTA EDIÇÃO. PL do leilão de participação da União em áreas não contratadas do pré-sal abre caminho para liquidação antecipada da parcela governamental em campos contratados. ANP publica, com mudanças, as novas versões do edital e dos contratos do leilão de partilha. Diretoria da agência aprovou, também, a abertura da consulta pública para definição de critérios de classificação de gasodutos de transporte. ICL cobra publicação da lista de distribuidoras sujeitas ao bloqueio das atividades por descumprimento das metas do Renovabio
In this HortWeek Podcast, Andrew Wilson, technical manager for ICL professional horticulture and Carl Mason, experienced grower and ICL technical area sales manager for the East of England, speak about how to grow the best professional quality poinsettias.While Christmas may seem a long way off, in June UK growers will be starting to produce Poinsettias to adorn our homes in December. The poinsettia (Euphorbia pulcherrima) is a fascinating blend of Aztec heritage, Mexican tradition, and American commercialisation—all blended into vibrant red plant that is now inseparable from the Christmas season.Carl speaks about how easy a crop poinsettia is to grow, while Andrew discusses market trends we are seeing with the UK's most popular winter indoor plant.Andrew details the nutritional requirements of the crop while Carl outlines advises on the growing media that suit poinsettias best. Carl also explains what goes into ICL's special Poinsettia mix to ensure plants thrive and they both offer their top tips for successful poinsettia growing. Hosted on Acast. See acast.com/privacy for more information.
Disclaimer: This video is for educational purposes only. The opinions expressed by the guests are their personal views and do not reflect our stance. We have no intention of defaming or harming any individual, brand, product, country, or profession mentioned in this video. Our aim is to provide information to help the audience make informed decisions.Niranjan Pagadala Founder of 8 views - a prominent Digital marketing company based in Hyderabad. Along with being a distinguished entrepreneur, he is also an Ex-Ranji and ICL cricketer~Our filming gear- Camera 1 - https://amzn.to/4gS3IGv Camera 2 - https://amzn.to/4gN6Kf1 Wireless collor mic -https://amzn.to/4k4dEPX Dynamic microphone - https://amzn.to/3QqWBdd Audio mixer - https://amzn.to/4hHByiDLens 1 - https://amzn.to/4lrR9F6Lens 2 - https://amzn.to/44mFxx3Lens 3 - https://amzn.to/44nlz5o~About This Podcast - In this telugu podcast episode, we take a discussed the hidden world of digital marketing, data tracking, and the powerful systems shaping how we interact with the internet. From how agencies collect and sell your phone number and email ID, to why you and your entire friend group suddenly see the same reel within hours, we unpack the sophisticated tactics running behind the scenes. We explore the psychology behind social media addiction—how the brain reacts to endless content, why it's so hard to put the phone down, and how even the smallest notifications are designed to hook you.We also question whether privacy really exists in the modern world. With voice assistants like Alexa and Siri responding instantly, how can we be sure they're not always listening? You'll also learn how apps like Ola or Uber might change prices based on your behavior, like switching apps or low battery levels. The conversation doesn't stop there—we look at the impact of fake followers, manipulated trending tabs, and paid engagement packages that can alter public opinion without most users even realizing it.As the digital space grows, we also dive into the massive influence of AI—how it's reshaping industries, affecting jobs, and changing how content is created and consumed. From real-world case studies to surprising truths about who really controls the internet, this episode is packed with insights, stories, and examples that challenge what we think we know about our online lives.If you've ever wondered how deep the rabbit hole goes when it comes to the internet, algorithms, and marketing, this is your episode. Tune in, and prepare to see your screen in a completely new way.#telugupodcast #businesspodcast #rawtalks #vamshikurapati #rawtalkswithvk #podcastintelugu #vkpodcast #besttelugupodcast
Thanks for tuning in to this Wednesday edition of RealAg Radio! Host Shaun Haney is joined by: Brian Comeault with ICL to discuss the commodity markets; Kevin Serfas in a spotlight interview for KWS Seeds; Dean Roberts, chair of Sask Oilseeds on China's tariffs on canola; and, Hear a clip from a Limagrain podcast episode... Read More
From playing Ranji Trophy for Haryana and representing North Zone in the Deodhar Trophy to becoming the first runner-up in ESPN’s Harsha Ki Khoj: Dream Job, his journey into sports broadcasting has been anything but conventional. With over 3,000 shows across Star Sports, Sony Six, Times Now, Zee Sports, Ten Cricket, Ten Sports, DD Sports, ESPN, News X, and Mirror Now, he has been the voice behind IPL, ICL, ISL, Pro-Kabaddi, NBA, BCCI and ICC Cricket World Cups, Khelo India, Asian Games, Commonwealth Games, Wimbledon, and the Olympics. As one of India's top bilingual commentators, his insights into players like Rohit Sharma and Virat Kohli bring a depth that keeps audiences hooked. But how did a cricketer transition into sports media, and what goes into analyzing the game at the highest level? Beyond commentary, his music career has been just as dynamic—trained under Guru Manik Lal Verma, he has composed over 300 songs, performed in 600+ concerts, and released albums like India Hai Meri Jaan and Rok Sako Toh Rok Lo. His latest single Chal Dost is a blockbuster, and Musical Talkshaala is redefining how music and motivation come together. Adding another milestone, his debut book Udaan, launched by Kapil Dev in 2025, dives into his multifaceted journey. What drives someone to master multiple fields, and what untold stories lie behind his career in cricket, commentary, and music? Tune in to find out.See omnystudio.com/listener for privacy information.
On today's show: To Subscribe
Panel: '(Non-)Defining 'Gender' in the Crimes Against Humanity Draft: Possibilities, Alliances, and Strategies'Feminist activists, country representatives, and other civil society actors have debated how to define “gender” in international criminal law (ICL) for at least three decades. In the Rome Conference that established the International Criminal Court (ICC) and its Statute in 1998, defining “gender” was a hotly debated topic of negotiation. More recently, this debate has resurfaced in the steps leading to the International Law Commission's Draft Articles for a Crimes Against Humanity Treaty, and continues to be discussed in the deliberations at the Sixth Committee on the Draft Articles. The CAH Convention is now expected to be negotiated between 2026-2029, and, more than a mere point of contention, the concept of ‘gender' in its text can be crucial for prosecuting sexual and gender-based international crimes and thus fundamental to gender justice efforts worldwide. With this in mind, this roundtable gathers scholars and activists studying and working (often simultaneously) on the definition of gender in international criminal law, in an effort to learn from their specific positionalities, perceptions, and experiences about the challenges, strategies, and possibilities for (non-)defining the term.https://www.lcil.cam.ac.uk/press/events/2025/02/panel-queering-gender-crimes-against-humanity-draft-possibilities-alliances-and-strategies
별헤는사람들 2025년 2월호. 나는 암흑물질을 이렇게 찾는다! 그리고 가이아 망원경이 밝혀내는 우주 속 거리 Feat. 고등과학원 유재원 박사 - 오프닝 유로파 바다 속에 사는 새우를 찾으러 탐사선 드디어 출발! 스타쉽, 좀 커지고 뻥 터지다 (이 에피소드는 일론 머스크의 극우적 행보 이전에 녹화되었음을 알려 드립니다) - 유재원 박사 나는 암흑물질을 ICL 연구로 찾아낸다! - 홍승수 박사 우주 속 거리 시리즈! 가이아 우주 망원경의 괴물같은 능력 전체 자료 https://www.slideshare.net/slideshow/2025-2-pdf/275403978 과학과사람들 제공
This article delves into the latest developments in refractive surgery, with a particular focus on LASIK, PRK, SMILE, and ICL procedures, as well as the critical role of corneal transplant surgery in restoring vision for those with severe corneal damage or diseases like keratoconus and Fuchs' endothelial dystrophy.
This year, the theme of our podcast will feature discussions of foundational equipment and emerging technology in ophthalmology. In the first episode of 2025, Roger Zaldivar, MD, MBA, joins Gary Wörtz, MD, to discuss the ICL Guru project and how its complex algorithm integrates with ultrasound biomicroscopy platforms. Dr. Zaldivar shares his experience with ICL surgery, and how he leveraged that expertise to help improve sizing methodology and patient selection.
Across the Great Illuminary, a question was posed - which Team of Illumineers is the greatest to have ever quested? 20 teams responded to this call and decided to stake their claim as the greatest and in order to determine who will reign supreme, the Illumineer Champions League was created. Join myself, Rod, Vvonderland and yBreezy as we tell you what the Illumineers Champions League is and where to follow along as our Inaugural Season kicks off Friday, January 17, 2025. Follow and watch the ICL on YouTube @IllumineerChampionsLeague Watch the Streams on Twitch: https://www.twitch.tv/vvonderland Follow the ICL on Twitter/X: https://x.com/illumineercl
Happy holidays! We'll be sharing snippets from Latent Space LIVE! through the break bringing you the best of 2024! We want to express our deepest appreciation to event sponsors AWS, Daylight Computer, Thoth.ai, StrongCompute, Notable Capital, and most of all all our LS supporters who helped fund the gorgeous venue and A/V production!For NeurIPS last year we did our standard conference podcast coverage interviewing selected papers (that we have now also done for ICLR and ICML), however we felt that we could be doing more to help AI Engineers 1) get more industry-relevant content, and 2) recap 2024 year in review from experts. As a result, we organized the first Latent Space LIVE!, our first in person miniconference, at NeurIPS 2024 in Vancouver.Of perennial interest, particularly at academic conferences, is scaled-up architecture research as people hunt for the next Attention Is All You Need. We have many names for them: “efficient models”, “retentive networks”, “subquadratic attention” or “linear attention” but some of them don't even have any lineage with attention - one of the best papers of this NeurIPS was Sepp Hochreiter's xLSTM, which has a particularly poetic significance as one of the creators of the LSTM returning to update and challenge the OG language model architecture:So, for lack of a better term, we decided to call this segment “the State of Post-Transformers” and fortunately everyone rolled with it.We are fortunate to have two powerful friends of the pod to give us an update here:* Together AI: with CEO Vipul Ved Prakash and CTO Ce Zhang joining us to talk about how they are building Together together as a quote unquote full stack AI startup, from the lowest level kernel and systems programming to the highest level mathematical abstractions driving new model architectures and inference algorithms, with notable industry contributions from RedPajama v2, Flash Attention 3, Mamba 2, Mixture of Agents, BASED, Sequoia, Evo, Dragonfly, Dan Fu's ThunderKittens and many more research projects this year* Recursal AI: with CEO Eugene Cheah who has helped lead the independent RWKV project while also running Featherless AI. This year, the team has shipped RWKV v5, codenamed Eagle, to 1.5 billion Windows 10 and Windows 11 machines worldwide, to support Microsoft's on-device, energy-usage-sensitive Windows Copilot usecases, and has launched the first updates on RWKV v6, codenamed Finch and GoldFinch. On the morning of Latent Space Live, they also announced QRWKV6, a Qwen 32B model modified with RWKV linear attention layers. We were looking to host a debate between our speakers, but given that both of them were working on post-transformers alternativesFull Talk on YoutubePlease like and subscribe!LinksAll the models and papers they picked:* Earlier Cited Work* Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention* Hungry hungry hippos: Towards language modeling with state space models* Hyena hierarchy: Towards larger convolutional language models* Mamba: Linear-Time Sequence Modeling with Selective State Spaces* S4: Efficiently Modeling Long Sequences with Structured State Spaces* Just Read Twice (Arora et al)* Recurrent large language models that compete with Transformers in language modeling perplexity are emerging at a rapid rate (e.g., Mamba, RWKV). Excitingly, these architectures use a constant amount of memory during inference. However, due to the limited memory, recurrent LMs cannot recall and use all the information in long contexts leading to brittle in-context learning (ICL) quality. A key challenge for efficient LMs is selecting what information to store versus discard. In this work, we observe the order in which information is shown to the LM impacts the selection difficulty. * To formalize this, we show that the hardness of information recall reduces to the hardness of a problem called set disjointness (SD), a quintessential problem in communication complexity that requires a streaming algorithm (e.g., recurrent model) to decide whether inputted sets are disjoint. We empirically and theoretically show that the recurrent memory required to solve SD changes with set order, i.e., whether the smaller set appears first in-context. * Our analysis suggests, to mitigate the reliance on data order, we can put information in the right order in-context or process prompts non-causally. Towards that end, we propose: (1) JRT-Prompt, where context gets repeated multiple times in the prompt, effectively showing the model all data orders. This gives 11.0±1.3 points of improvement, averaged across 16 recurrent LMs and the 6 ICL tasks, with 11.9× higher throughput than FlashAttention-2 for generation prefill (length 32k, batch size 16, NVidia H100). We then propose (2) JRT-RNN, which uses non-causal prefix-linear-attention to process prompts and provides 99% of Transformer quality at 360M params., 30B tokens and 96% at 1.3B params., 50B tokens on average across the tasks, with 19.2× higher throughput for prefill than FA2.* Jamba: A 52B Hybrid Transformer-Mamba Language Model* We present Jamba, a new base large language model based on a novel hybrid Transformer-Mamba mixture-of-experts (MoE) architecture. * Specifically, Jamba interleaves blocks of Transformer and Mamba layers, enjoying the benefits of both model families. MoE is added in some of these layers to increase model capacity while keeping active parameter usage manageable. * This flexible architecture allows resource- and objective-specific configurations. In the particular configuration we have implemented, we end up with a powerful model that fits in a single 80GB GPU.* Built at large scale, Jamba provides high throughput and small memory footprint compared to vanilla Transformers, and at the same time state-of-the-art performance on standard language model benchmarks and long-context evaluations. Remarkably, the model presents strong results for up to 256K tokens context length. * We study various architectural decisions, such as how to combine Transformer and Mamba layers, and how to mix experts, and show that some of them are crucial in large scale modeling. We also describe several interesting properties of these architectures which the training and evaluation of Jamba have revealed, and plan to release checkpoints from various ablation runs, to encourage further exploration of this novel architecture. We make the weights of our implementation of Jamba publicly available under a permissive license.* SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformers* We introduce Sana, a text-to-image framework that can efficiently generate images up to 4096×4096 resolution. Sana can synthesize high-resolution, high-quality images with strong text-image alignment at a remarkably fast speed, deployable on laptop GPU. Core designs include: * (1) Deep compression autoencoder: unlike traditional AEs, which compress images only 8×, we trained an AE that can compress images 32×, effectively reducing the number of latent tokens. * (2) Linear DiT: we replace all vanilla attention in DiT with linear attention, which is more efficient at high resolutions without sacrificing quality. * (3) Decoder-only text encoder: we replaced T5 with modern decoder-only small LLM as the text encoder and designed complex human instruction with in-context learning to enhance the image-text alignment. * (4) Efficient training and sampling: we propose Flow-DPM-Solver to reduce sampling steps, with efficient caption labeling and selection to accelerate convergence. * As a result, Sana-0.6B is very competitive with modern giant diffusion model (e.g. Flux-12B), being 20 times smaller and 100+ times faster in measured throughput. Moreover, Sana-0.6B can be deployed on a 16GB laptop GPU, taking less than 1 second to generate a 1024×1024 resolution image. Sana enables content creation at low cost. * RWKV: Reinventing RNNs for the Transformer Era* Transformers have revolutionized almost all natural language processing (NLP) tasks but suffer from memory and computational complexity that scales quadratically with sequence length. In contrast, recurrent neural networks (RNNs) exhibit linear scaling in memory and computational requirements but struggle to match the same performance as Transformers due to limitations in parallelization and scalability. * We propose a novel model architecture, Receptance Weighted Key Value (RWKV), that combines the efficient parallelizable training of transformers with the efficient inference of RNNs.* Our approach leverages a linear attention mechanism and allows us to formulate the model as either a Transformer or an RNN, thus parallelizing computations during training and maintains constant computational and memory complexity during inference. * We scale our models as large as 14 billion parameters, by far the largest dense RNN ever trained, and find RWKV performs on par with similarly sized Transformers, suggesting future work can leverage this architecture to create more efficient models. This work presents a significant step towards reconciling trade-offs between computational efficiency and model performance in sequence processing tasks.* LoLCATs: On Low-Rank Linearizing of Large Language Models* Recent works show we can linearize large language models (LLMs) -- swapping the quadratic attentions of popular Transformer-based LLMs with subquadratic analogs, such as linear attention -- avoiding the expensive pretraining costs. However, linearizing LLMs often significantly degrades model quality, still requires training over billions of tokens, and remains limited to smaller 1.3B to 7B LLMs. * We thus propose Low-rank Linear Conversion via Attention Transfer (LoLCATs), a simple two-step method that improves LLM linearizing quality with orders of magnitudes less memory and compute. * We base these steps on two findings. * First, we can replace an LLM's softmax attentions with closely-approximating linear attentions, simply by training the linear attentions to match their softmax counterparts with an output MSE loss ("attention transfer").* Then, this enables adjusting for approximation errors and recovering LLM quality simply with low-rank adaptation (LoRA). * LoLCATs significantly improves linearizing quality, training efficiency, and scalability. We significantly reduce the linearizing quality gap and produce state-of-the-art subquadratic LLMs from Llama 3 8B and Mistral 7B v0.1, leading to 20+ points of improvement on 5-shot MMLU. * Furthermore, LoLCATs does so with only 0.2% of past methods' model parameters and 0.4% of their training tokens. * Finally, we apply LoLCATs to create the first linearized 70B and 405B LLMs (50x larger than prior work). * When compared with prior approaches under the same compute budgets, LoLCATs significantly improves linearizing quality, closing the gap between linearized and original Llama 3.1 70B and 405B LLMs by 77.8% and 78.1% on 5-shot MMLU.Timestamps* [00:02:27] Intros* [00:03:16] Why Scale Context Lengths? or work on Efficient Models* [00:06:07] The Story of SSMs* [00:09:33] Idea 1: Approximation -> Principled Modeling* [00:12:14] Idea 3: Selection* [00:15:07] Just Read Twice* [00:16:51] Idea 4: Test Time Compute* [00:17:32] Idea 2: Hardware & Kernel Support* [00:19:49] RWKV vs SSMs* [00:24:24] RWKV Arch* [00:26:15] QWRKWv6 launch* [00:30:00] What's next* [00:33:21] Hot Takes - does anyone really need long context?Transcript[00:00:00] AI Charlie: We're back at Latent Space Live, our first mini conference held at NeurIPS 2024 in Vancouver. This is Charlie, your AI co host. As a special treat this week, we're recapping the best of 2024 going domain by domain. We sent out a survey to the over 900 of you who told us what you wanted, and then invited the best speakers in the Latent Space Network to cover each field.[00:00:24] AI Charlie: 200 of you joined us in person throughout the day, with over 2200 watching live online. Thanks Our next keynote covers the State of Transformers alternative architectures, with a special joint presentation with Dan Fu of Together AI and Eugene Chia of Recursal AI and Featherless AI. We've featured both Together and Recursal on the pod before, with CEO Veepal Vedprakash introducing them.[00:00:49] AI Charlie: And CTO CE Zhang joining us to talk about how they are building together together as a quote unquote full stack AI startup from the lowest level kernel and systems [00:01:00] programming to the highest level mathematical abstractions driving new model architectures and inference algorithms with notable industry contributions from Red Pajama V2, Flash Attention 3, Mamba 2, Mixture of Agents.[00:01:15] AI Charlie: Based, Sequoia, Evo, Dragonfly, Danfoo's Thunder Kittens, and many more research projects this year. As for Recursal and Featherless, we were the first podcast to feature RWKV last year, and this year the team has shipped RWKV v5, codenamed Eagle, to 1. 5 billion Windows 10 and Windows 11 machines worldwide to support Microsoft's on device, end Energy Usage Sensitive Windows Copilot Use Cases and has launched the first updates on RWKV v6, codenamed Finch and Goldfinch.[00:01:53] AI Charlie: On the morning of Latent Space Live, they also announced QRdata UKv6, a QEN32B model [00:02:00] modified with RDWKV linear attention layers. Eugene has also written the most single most popular guest post on the Latent Space blog this year. Yes, we do take guest posts on what he has discovered about the H100 GPU inference NeoCloud market since the successful launch of Featherless AI this year.[00:02:20] AI Charlie: As always, don't forget to check the show notes for the YouTube link to their talk as well as their slides. Watch out and take care.[00:02:27] Intros[00:02:27] Dan Fu: Yeah, so thanks so much for having us. So this is going to be a little bit of a two part presentation. My name is Dan. I'm at Together AI, and I'll be joining UCSD as faculty in about a year. And Eugene, you want to introduce yourself?[00:02:46] Eugene Cheah: Eugene, I lead the art activity team, and I, I'm CEO of Featherless, and we both work on this new post transformer architecture space.[00:02:55] Dan Fu: Yeah, so yeah, so today we're really excited to talk to you a little bit [00:03:00] about that. So first I'm going to give a broad overview of kind of the last few years of progress in non post transformer architectures. And then afterwards Eugene will tell us a little bit about the latest and the greatest and the latest frontier models in this space.[00:03:16] Why Scale Context Lengths? or work on Efficient Models[00:03:16] Dan Fu: So, the story starts with Scaling. So this is probably a figure or something like this that you've seen very recently. Over the last five to six years, we've seen models really scale up in parameter size, and that's brought with it a bunch of new capabilities, like the ability to talk to you and tell you sometimes how to use your Colab screens.[00:03:35] Dan Fu: But another place where we've seen scaling especially recently is scaling in context length. So this can mean Having more text inputs for your models, but it can also mean things like taking a lot of visual token inputs image inputs to your models or generating lots of outputs. And one thing that's been really exciting over the last few months or so is that we're, we're seeing scaling, not only during training time, but also [00:04:00] during test time.[00:04:00] Dan Fu: So this is one of the, the, this is the iconic image from the OpenAI 01 release. Not only are we starting to scale train time compute, but we're also starting to scale test time compute. Now if you're familiar with our attention and our transformer architectures today, this graph on the right might look a little bit scary.[00:04:19] Dan Fu: And one of the reasons is that the implications are a little bit Interesting. So what does it mean if we want to continue having smarter and smarter models? Do we just need to start building bigger, bigger data centers, spending more flops? Is this this little Dolly 3, we need more flops, guys? Is this going to be the future of all of AI?[00:04:39] Dan Fu: Or is there a better way, another path forward? Maybe we can get the same capabilities that we've gotten used to, But for a lot less compute, a lot less flops. And one of the things that we're going to talk about today is specifically looking at that core attention operator in some of these models.[00:04:57] Dan Fu: And the reason is that so this is just some, some [00:05:00] basic you know, scaling curves, but attention has compute that scales quadratically in the context length. So that means that if you're doing something like test time compute and you want to spend a bunch of tokens thinking about what comes next, the longer that that goes the, the, the more tokens you spend on that, that compute grows quadratically in that.[00:05:19] Dan Fu: One of the questions that we're interested in is, can we take that basic sequence model, that basic sequence primitive at the bottom, and get it to scale better? Can we scale in, let's say, n to the 3 halves or n log n? So in, in the first part of the talk, so we just went over the introduction. What I'm gonna do over the next few slides is just talk about some of the key advances and ideas that have shown over the past few years since maybe early 2020 to, to now that shown promise that this might actually be possible.[00:05:48] Dan Fu: That you can actually get potentially the same quality that we want while scale, while scaling better. So to do that, we're and, and basically the, the story that we're gonna look is we're gonna start to see [00:06:00] how. So this is a basic graph of just the past couple years of progress of perplexity where that blue line, that dotted blue line, is attention.[00:06:07] The Story of SSMs[00:06:07] Dan Fu: It's your basic transformer, full dense attention. And then the dots coming down are some of the methods that you'll see in this presentation today. We're going to turn the clock back all the way to 2020. So this, this, this question of can we make attention subquadratic? Basically, as soon as we said attention is all you need, People started asking this question.[00:06:28] Dan Fu: So we have this quadratic attention operator. Can we do better? I'll briefly talk about why attention is quadratic. And the basic thing that happens, if you're not familiar, is that you have these inputs, these keys and queries. And what you do in this attention matrix, this S matrix over here, is that you're using, you're comparing every token in your input to every other token.[00:06:49] Dan Fu: So when I try to do something like upload a whole book to Gemini, what happens beyond the Maybe not Gemini, because we don't necessarily know what architecture is. But let's say we upload it to LLAMA, what happens beyond [00:07:00] the scenes, behind the scenes, is that it's going to take every single word in that book and compare it to every other word.[00:07:05] Dan Fu: And this has been a really, it's, it's led to some pretty impressive things. But it's kind of a brute forcing of the way that you would try to interpret a interpret something. And what attention does in particular is the, and then what attention, sorry, don't want to. Okay, no, no laser pointer. What, what attention does afterwards is that instead of always operating in this quadratic thing, it takes a row wise softmax over this matrix, and then multiplies it by this values matrix.[00:07:32] Dan Fu: So, one of the key points to notice is that the output size is always going to be the same as the inputs, at least in standard self attention. So one of the first things that folks tried to do around 2020 is this thing called linear attention, which is just, just noticing that if we take out this softmax from here, if we take out this non linearity in the middle of the attention operation, and then if you compute the keys and the values operation first, you actually never hit this quadratic bottleneck.[00:07:57] Dan Fu: So that, that's potentially a way [00:08:00] to get a lot more computationally efficient. And there are various ways to do this by basically using feature maps or try to approximate this overall attention computation. But some of this work sort of started to hit a wall in 2020. And the basic challenges were, were two.[00:08:16] Dan Fu: So one was quality. It was back then, it was kind of hard to, to get good quality with these linear attention operators. The other one was actually hardware efficiency. So these, this feature map that was just shown by a simplify simplify here. Actually ends up being quite computationally expensive if you just implement it naively.[00:08:34] Dan Fu: So you started having these operators that not only were you sure, you're not really sure if they have the same quality, but also they're actually just wall clock slower. So you kind of end up getting the worst of both worlds. So this was the the stage. So that kind of sets the stage for four years ago.[00:08:49] Dan Fu: Keep this in mind because linear attention is actually going to come back in a few years once we have a better understanding. But one of the works that started kicking off this, this [00:09:00] mini revolution in post transformer architectures was this idea called states based model. So here the seminal work is, is one about our work queue in 2022.[00:09:09] Dan Fu: And this, this piece of work really brought together a few ideas from, from some long running research research lines of work. The first one was, and this is really one of the keys to, to closing the gap in quality was just using things that, that if you talk to a, a, an electrical engineer off the street, they might know off, off the, like the back of their hand.[00:09:33] Idea 1: Approximation -> Principled Modeling[00:09:33] Dan Fu: But taking some of those properties with how we model dynamical systems in signal processing and then using those ideas to model the inputs, the, the text tokens in, for example a transformer like Next Token Prediction Architecture. So some of those early states-based model papers were looking at this relatively, relatively simple recurrent update model that comes from maybe chapter one of a signal processing class.[00:09:59] Dan Fu: But then using [00:10:00] some principle theory about how you should do that recurrent update in order to really get the most that you can out of your hidden state, out of your out of your sequence. So that, that was one key idea for quality and. When this was eventually realized, you started to see a bunch of benchmarks that were pretty sticky for a few years.[00:10:20] Dan Fu: Things like long range arena, some long sequence evaluation benchmarks, There was stuff in time series, time series analysis. They started to, you started to see the quality tick up in meaningful ways. But the other key thing that What's so influential about these states based models is that they also had a key idea about how you can compute these things efficiently.[00:10:45] Dan Fu: So if you go back to your machine learning 101 class where you learned about RNNs, one thing that you may have learned is that they don't paralyze as well as detention, because if you just run them naively, you have to do this kind of sequential update to process new tokens, [00:11:00] whereas in attention, you can process all the tokens in parallel at one time.[00:11:04] Dan Fu: One of the key insights behind the S4 paper was that these recurrent models, you could take them and you could also formulate them as a convolution. And in particular, with a convolution, you could, instead of using a PyTorch conv1d operation, you can compute that with the FFT. And that would give you n log n compute in the in the sequence length n with an operator that was relatively well optimized for modern hardware.[00:11:28] Dan Fu: So those are really, I'd say, the two key ideas in 2022 that started allowing these breakthroughs to happen in these non transformer architectures. So, these ideas about how to principally model sorry, how to model the recurrent updates of a mo of, of a sequence in a principled way, and also these key ideas in how you can compute it efficiently by turning it into a convolution and then scaling it up with the FFT.[00:11:53] Dan Fu: Along those same lines, so afterwards we started putting out some work on specialized kernels, so just [00:12:00] like we have flash attention for transformers, we also have works like flash fft conf, and if you look at these lines of work oftentimes when, whenever you see a new architecture, you see a new primitive one of the, one of the table stakes now is, do you have an efficient kernel so that you can actually get wall clock speed up?[00:12:14] Idea 3: Selection[00:12:14] Dan Fu: So by 2022, We are starting to have these models that had promising quality primitives, but and, and also promising wall clocks. So you could actually see regimes where they were better than transformers in meaningful ways. That being said, there were, there's still sometimes a quality gap, particularly for language modeling.[00:12:33] Dan Fu: And because languages, It's so core to what we do in sequence modeling these days the, the next, the next key idea that I'm going to talk about is this idea of selection mechanisms. And this is basically an idea of, so you have this recurrent state that you're keeping around that just summarizes everything that, that came before.[00:12:50] Dan Fu: And to get a good sequence model, one of the things that you really need to be able to do is have the model learn what's the best way to pick out pieces from that recurrent [00:13:00] state. So one of the, one of the major ideas here in a line of work called H3, Hungry Hungry Hippos, and also these hyena models were One way you can do this is by just adding some simple element wise gates.[00:13:13] Dan Fu: So versions of these ideas have been around for decades. If you squint at the LSTM paper you, you can probably find, find this gating mechanism. But turns out you can take those old ideas, add them into these new. state space models, and then you can see quality start to pick up. If you've heard of the Mamba model, this also takes the selection to the next level by actually making some changes in that fundamental recurrent state space.[00:13:40] Dan Fu: So, it's not only just this gating that happens around the SSM layer, but also you can actually make The ABCD matrices of your state space model, you can make them data dependent, which will allow you to even better select out different pieces from your hidden state depending on what you're seeing. I'll also point out if you look at the [00:14:00] bottom right of this figure, there's this little triangle with a GPU SRAM, GPU HBM, and this, this is just continuing that trend of when you have a new architecture you, you, you also release it with a kernel to, to, to show that it is hardware efficient, that it, that it can be hardware efficient on modern hardware.[00:14:17] Dan Fu: The, the, one of the next cool things that happened is once we had this understanding of these are the basic pieces, these are the basic principles behind some of the sequence models linear attention actually started to come back. So in earlier this year, there was a model called BASED the, from Simran Arora and, and some other folks, that combined a more principled version of linear attention that basically the, the, the, the two second summary is that it used a Taylor approximation of the softmax attention, combined that with a simple sliding window attention and was starting to able, starting to be able to expand the Pareto frontier of how much data can you recall from your sequence, versus how small is your recurrent state size.[00:14:58] Dan Fu: So those orange dots [00:15:00] are, at the top there, are just showing smaller sequences that can recall more memory.[00:15:07] Just Read Twice[00:15:07] Dan Fu: And the last major idea I think that has been influential in this line of work and is very relatively late breaking just a few months ago, is just the basic idea that when you have these models that are fundamentally more efficient in the sequence length, you maybe don't want to prompt them or use them in exactly the same way.[00:15:26] Dan Fu: So this was a really cool paper called Just Read Twice, also from Simran. That basically said, hey, all these efficient models can process tokens so much more efficiently than transformers that they can sometimes have unfair advantages compared to a simple transformer token. So, or sorry, a simple transformer model.[00:15:44] Dan Fu: So take, for example the standard, the standard use case of you have some long document, you're going to pass it in as input, and then you're going to ask some question about it. One problem you might imagine for a recurrent model where you have a fixed state size is, let's say that [00:16:00] you're. Article is very long, and you're trying to ask about some really niche thing.[00:16:04] Dan Fu: You can imagine it might be hard for the model to know ahead of time what information to put into the hidden state. But these, these, these models are so much more efficient that you can do something really stupid, like, you can just put the document write down the document, write down the question, write down the document again, and then write down the question again, and then this time, the second time that you go over that document, you know exactly what to look for.[00:16:25] Dan Fu: And the cool thing about this is, so this is, And this this results in better quality, especially on these recall intensive tasks. But the other interesting thing is it really takes advantage of the more efficient architectures that, that we're having here. So one of the other, I think, influential ideas in this line of work is if you change the fundamental compute capabilities of your model and the way that it scales, you can actually start to query it at test time differently.[00:16:51] Idea 4: Test Time Compute[00:16:51] Dan Fu: And this actually, of course, goes back to those slides on test time compute. So while everybody's looking at, say, test time compute for big transformer models, [00:17:00] I think potentially a really interesting research question is, how can you take those and how does it change with this new next generation of models?[00:17:09] Dan Fu: So the, I'll just briefly summarize what some of those key ideas were and then talk and then show you briefly kind of what the state of the art is today. So, so the four key ideas are instead of just doing a simple linear attention approximation, instead take ideas that we know from other fields like signal processing, do a more principled approach to your modeling of the sequence.[00:17:32] Idea 2: Hardware & Kernel Support[00:17:32] Dan Fu: Another key idea throughout all these lines of work is you really want. Hardware and kernel support from day one. So, so even if your model is theoretically more efficient if somebody goes and runs it and it's two times slower one of the things that, that we've learned is that if, if you're in that situation, it's, it's just gonna be dead on arrival.[00:17:49] Dan Fu: So you want to be designing your architectures one of the key, key machine learning ideas that has been important for the quality is just making sure that you encode different ways that you can [00:18:00] select from your hidden state and, and really focus on that as a key decider of quality. And finally, I think one of the, the, the emerging new, new things for, for this line of work and something that's quite interesting is, What are the right test time paradigms for these models?[00:18:15] Dan Fu: How do they change relative to relative to what you might do for a standard transformer? I'll briefly end this section. So I've labeled this slide where we are yesterday because Eugene is going to talk about some new models that he released literally this morning. But as of yesterday, some of the really cool results out of the, these efficient alternative models were so AI2 trained this hybrid MOE called Jamba.[00:18:40] Dan Fu: That, that, that seems, that is currently the state of the art for these non transformer architectures. There's this NVIDIA and MIT put out this new diffusion model called SANA recently that one of their key key observations is that you can take a standard diffusion transformer diffusion model, replace the layers with linear [00:19:00] attention, and then that lets you scale to much larger much larger images, much, much Much larger sequences more efficiently.[00:19:07] Dan Fu: And and one thing that I don't think anybody would have called when a few years ago is that one of those gated SSM, gated states based models ended up on the cover of Science because a great group of folks went and trained some DNA models. So that's Michael Polley, Eric Yuen from from Stanford and the Arc Institute.[00:19:26] Dan Fu: So it's, we're really at an exciting time in 2024 where these non transformer, post transformer architectures are showing promise across a wide range. Across a wide range of, of modalities, of applications, and, and of tasks. And with that, I'll pass it on to Eugene, who can tell you a little bit about the latest and greatest with RWKV.[00:19:49] RWKV vs SSMs[00:19:49] Eugene Cheah: So, that's useful? Yeah. You're talking to here. Oh, I'm talking to here. Okay. So, yeah, two streams. Yeah. So, I think one common questions that we tend to get asked, right, is what's the difference between [00:20:00] RWKV and state space? So I think one of the key things to really understand, right the difference between the two groups, right, is that we are actually more like an open source, random internet meets academia kind of situation.[00:20:11] Eugene Cheah: Like, most of us never wrote any paper, but we, we basically look at RNNs and linear intention when intention is all you need came out, and then we decided to like, hey there is a quadratic scaling problem. Why don't we try fixing that instead? So, so, so we end up developing our own branch, but we end up sharing ideas back and forth.[00:20:30] Eugene Cheah: So, and, and we do all this actively in Discord, GitHub, etc. This was so bad for a few years, right, that basically, the average group's H index was so close to zero, right, Illuter. ai actually came in and helped us write our first paper. Great, now our H index is now three, apparently. So, so, so, but, but the thing is, like, a lot of these experiments led to results, and, and, essentially, essentially, we we took the same ideas from linear attention, [00:21:00] and we built on it.[00:21:01] Eugene Cheah: So, to take a step back into, like, how does RWKB handle its own attention mechanic and achieve the same goals of, like, O and compute, respectively, and in focus of our overall goal to make AI accessible to everyone, regardless of language, nation, or compute, that's our goal. We actually train our models primarily on over a hundred languages, which is another topic altogether.[00:21:23] Eugene Cheah: And our goal is to train to even 200 languages to cover all languages in the world. But at the same time, we work on this architecture, To lower the compute cost so that people can run it on Raspberry Pis and on anything. So, how did RWKB break the dependency of LSTM token flow? Because I think to understand architecture, right, it's probably easier to understand it from the RNN lens.[00:21:46] Eugene Cheah: Because that's where we built on. We all, we all state space kind of like try to, try to start anew and took lessons from that and say, So there's a little bit of divergence there. And AKA, this our version of linear attention. So to take step back [00:22:00] all foundation models, be it transformers or non transformers at a very high level, right?[00:22:05] Eugene Cheah: Pumps in the token. I mean, text that things into embeddings and go through a lot of layers. Generate a lot of states where the QKV cache or be iron in states or RW KB states. And outputs and embedding, they are not the same thing. And we just take more layers and more embeddings. And somehow that magically works.[00:22:23] Eugene Cheah: So, if you, if you remember your ancient RNN lessons which we, which we, which we we call best learning these days the general idea is that you have the embedding information flowing all the way up, and when, and you take that information and you flow it back down, and then you process it as part of your LSTM layers.[00:22:41] Eugene Cheah: So, this is how it generally works. Kapati is quoted saying that RNNs are actually unreasonably effective. The problem is this is not scalable. To start doing work on the second token, you need to wait for the first token. And then you need to, and likewise for the third token and fourth token, yada yada.[00:22:55] Eugene Cheah: That is CPU land, not GPU land. So, so, so, you [00:23:00] can have a H100 and you can't even use 1 percent of it. So, so that's kind of why RNNs didn't really take off in the direction that we wanted, like, billions of parameters when it comes to training. So, what did RDAP KV version 0 do? Boom. We just did the dumbest, lamest thing.[00:23:13] Eugene Cheah: Sorry, this is the bottleneck for RNN. We did the dumb thing of removing that line. And it kind of worked. It trained. It sucked, but it kind of worked. Then we were like, hey, then no one cared because the loss was crap, but how do we improve that? And that's essentially where we move forward, because if you see this kind of flow, right, you can actually get your GPU saturated quickly, where it essentially cascades respectively.[00:23:41] Eugene Cheah: So I'm just waiting for this to loop again. So it's like, once you get your first layer, your token to be computed finish. You start to cascade your compute all the way until you are, Hey, I'm using 100 percent of the GPU. So we, we worked on it, and we started going along the principle of that as long as we keep this general architecture [00:24:00] where, where we can cascade and, and be highly efficient with our architecture, nothing is sacred in our architecture.[00:24:06] Eugene Cheah: And we have done some crazy ideas. In fact, you ask us, if you ask me to explain some things in the paper, right, officially in the paper, I'll say we had this idea and we wrote it this way. The reality is someone came with a code, we tested it, it worked, and then we rationalized later. So, so the general[00:24:24] RWKV Arch[00:24:24] Eugene Cheah: The idea behind rwkbr is that we generally have two major blocks that we do.[00:24:30] Eugene Cheah: We call time mix and channel mix. And time mix generally handles handles long term memory states, where essentially, where essentially where we apply the matrix multiplication and Cilu activation functions into processing an input embedding and an output embedding. I'm oversimplifying it because this, This calculation changed every version and we have, like, version 7 right now.[00:24:50] Eugene Cheah: ChannelMix is similar to Base in the sense that it does shorter term attention, where it just looks at the sister token, or the token before it, because [00:25:00] there's a shift in the token shift matrix. I don't really want to go too much into the papers itself, because, like, we do have three papers on this.[00:25:09] Eugene Cheah: Basically, RWKB, RNN for the transformer, ERA, Ego and Pinch, RWKB, Matrix Value State. This is the updated version 5, version 6. And Goldfinch is our, is, is, is, is our hybrid model respectively. We are writing the paper already for V seven and which is, which is for R wk V seven. Called, named Goose, or architectures are named by Bird.[00:25:30] Eugene Cheah: And, I'm going to cover as well, qrwkb, and mama100k, and rwkb, and Where did that lead to? Great! Because we are all GPU poor and to be clear, like, most of this research is done, like, only on a handful H100s, which I had one Google researcher told me that was, like, his experiment budget for a single researcher.[00:25:48] Eugene Cheah: So, our entire organization has less compute than a single researcher in Google. So We, we, one of the things that we explored into was to how do we convert transformer models instead? Because [00:26:00] someone already paid that billion dollars, a million dollars onto training, so why don't we take advantage of those weights?[00:26:05] Eugene Cheah: And, and to, I believe, together AI worked on the lockets for, for the Lambda side of things, and, and we took some ideas from there as well, and we essentially did that for RWKB.[00:26:15] QWRKWv6 launch[00:26:15] Eugene Cheah: And that led to, Q RWKB6, which we just dropped today, a 32 bit instruct preview model, where we took the Quen 32 bit instruct model, freeze the feedforward layer, remove the QKB attention layer, and replace it with RWKB linear layers.[00:26:32] Eugene Cheah: So to be clear, this means we do not have the rwkv channel mix layer, we only have the time mix layer. But but once we do that, we train the rwkv layer. Important is that the feedforward layer needs to be frozen, so the new attention can be learned. And then we unfreeze the feedforward layer, and train all the layers together with a custom learning rate schedule, so that they can learn how to work together.[00:26:54] Eugene Cheah: The end result, surprisingly, And, to be honest, to the frustration of the R. W. [00:27:00] KV MOE team, which ended up releasing the model on the same day, was that, with just a few hours of training on two nodes, we managed to get it to be on par, kind of, with the original QUAN32B model. So, in fact, when the first run, right, that completely confused us, it was like, and I was telling Daniel Goldstein, Smirky, who kind of leads most of our research coordination, When you pitched me this idea, you told me at best you'll get the same level of performance.[00:27:26] Eugene Cheah: You didn't tell me the challenge and score and Winograd score will shoot up. I don't know what's happening there. But it did. MMLU score dropping, that was expected. Because if you think about it, when we were training all the layers, right, we were essentially Like, Frankenstein this thing, and we did brain damage to the feedforward network layer 2 with the new RWKB layers.[00:27:47] Eugene Cheah: But, 76%, hey, somehow it's retained, and we can probably further train this. We didn't even spend more than 3 days training this, so there's a lot more that can be done, hence the preview. This brings up [00:28:00] a big question, because We are already now in the process of converting to 7TB. We are now, this is actually extremely compute efficient to test our attention mechanic.[00:28:10] Eugene Cheah: It's like, it becomes a shortcut. We can, we are already planning to do our version 7 and our hybrid architecture for it. Because we don't need to train from scratch. And we get a really good model out of it. And the other thing that is uncomfortable to say is that because we are doing right now on the 70b is that if this scales correctly to 128k context length, I'm not even talking about a million 128, majority of enterprise workload today is just on 70b at under 32k context length.[00:28:41] Eugene Cheah: That means if this works and the benchmark matches it, It means we can replace the vast majority of current AI workload, unless you want super long context. And then sorry, can someone give us more GPUs? Because we do need the VRAM for super long context, sadly. So yeah, that's what we are working on, and essentially, [00:29:00] we are excited about this to just push it further.[00:29:02] Eugene Cheah: And this conversion process, to be clear, I don't think it's going to be exclusive to RWKB. It probably will work for Mamba as well, I don't see why not. And we will probably see more ideas, or more experiments, or more hybrids, or Yeah, like, one of the weirdest things that I wanted to say outright, and I confirmed this with the Black Mamba team and the Jamba team, which because we did the GoFinch hybrid model, is that none of us understand why a hard hybrid with a state based model to be R.[00:29:28] Eugene Cheah: QA state space and transformer performs better when, than the baseline of both. It's like, it's like when you train one, you expect, and then you replace, you expect the same results. That's our pitch. That's our claim. But somehow when we jam both together, it outperforms both. And that's like one area of emulation that, like, we only have four experiments, plus four teams, that a lot more needs to be done.[00:29:51] Eugene Cheah: But, but these are things that excite me, essentially, because that is what it's potentially we can move ahead for. Which brings us to what comes next.[00:30:00] What's next[00:30:00] [00:30:00][00:30:00] Dan Fu: So, this part is kind of just some, where we'll talk a little bit about stuff that, that we're excited about. Maybe have some wild speculation on, on what, what's, what's coming next.[00:30:12] Dan Fu: And, of course this is also the part that will be more open to questions. So, a couple things that, that I'm excited about is continued hardware model co design for, for these models. So one of the things that we've put out recently is this library called ThunderKittens. It's a CUDA library.[00:30:29] Dan Fu: And one of the things that, that we found frustrating is every time that we built one of these new architectures, and I'm sure you had the exact same experience, we'd have to go and spend two months in CUDA land, like writing these, these new efficient things. And. If we decided to change one thing in PyTorch, like one line of PyTorch code is like a week of CUDA code at least.[00:30:47] Dan Fu: So one of our goals with, with a library like Thunderkitten, so we, we just broke down what are the key principles, what are the key hardware things what are the key, Compute pieces that you get from the hardware. So for example on [00:31:00] H100 everything is really revolves around a warp group matrix multiply operation.[00:31:06] Dan Fu: So you really want your operation to be able to split into relatively small matrix, matrix multiply operations. So like multiplying two 64 by 64 matrices, for example. And so if you know that ahead of time when you're designing your model, that probably gives you you know, some information about how you set the state sizes, how you set the update, how you set the update function.[00:31:27] Dan Fu: So with Thunderkittens we basically built a whole library just around this basic idea that all your basic compute primitives should not be a float, but it should be a matrix, and everything should just be matrix compute. And we've been using that to, to try to both re implement some existing architectures, and also start to design code.[00:31:44] Dan Fu: Some new ones that are really designed with this core with a tensor core primitive in mind. Another thing that that we're, that at least I'm excited about is we, over the last four or five years, we've really been looking at language models as the next thing. But if you've been paying [00:32:00] attention to Twitter there's been a bunch of new next generation models that are coming out.[00:32:04] Dan Fu: So there, there are. So, video generation models that can run real time, that are supported by your mouse and your keyboard, that I'm told if you play with them that, you know, that they only have a few seconds of memory. Can we take that model, can we give it a very long context length so that you could actually maybe generate an entire game state at a time?[00:32:25] Dan Fu: What does that look like for the model? You're certainly not going to do a giant quadratic attention computation to try to run that. Maybe, maybe use some of these new models, or some of these new video generation models that came out. So Sora came out I don't know, two days ago now. But with super long queue times and super long generation times.[00:32:43] Dan Fu: So that's probably a quadratic attention operation at the, at the bottom of it. What if we could remove that and get the same quality, but a lot faster generation time? Or some of the demos that we saw from Paige earlier today. You know, if I have a super long conversation with my [00:33:00] Gemini bot, what if I wanted to remember everything that it's seen in the last week?[00:33:06] Dan Fu: I mean, maybe you don't for personal reasons, but what if I did, you know? What does that mean for the architecture? And I think, you know, that's certainly something I'm pretty excited about. I'm sure you're excited about it too. So, I think we were supposed to have some hot takes, but I honestly don't remember what our hot takes were.[00:33:21] Hot Takes - does anyone really need long context?[00:33:21] Eugene Cheah: Yeah, including the next slide. Hot takes, yes, these are our[00:33:25] Dan Fu: hot takes.[00:33:25] Eugene Cheah: I think the big one on Twitter that we saw, that we shared, was the question is like, is RAG relevant? In the case of, like, the future of, like, state based models?[00:33:38] Dan Fu: Let's see, I haven't played too much with RAG. But when I have. I'll say I found it was a little bit challenging to do research on it because we had this experience over and over again, where you could have any, an embedding model of any quality, so you could have a really, really bad embedding model, or you could have a really, really [00:34:00] good one, By any measure of good.[00:34:03] Dan Fu: And for the final RAG application, it kind of didn't matter. That's what I'll say about RAG while I'm being recorded. I know it doesn't actually answer the question, but[00:34:13] Eugene Cheah: Yeah, so I think a lot of folks are like, extremely excited of the idea of RWKB or State Space potentially having infinite context.[00:34:21] Eugene Cheah: But I think the reality is that when we say infinite context, we just mean a different kind of infinite context, or you, or as it's previously covered, you need to test the model differently. So, think of it more along the lines of the human. Like, I don't remember what I ate for breakfast yesterday.[00:34:37] Eugene Cheah: Yeah, that's the statement that I'll say. And And we humans are not quadratic transformers. If we did, if let's say we increased our brain size for every second we live, we would have exploded by the time we are 5 years old or something like that. And, and I think, I think basically fundamentally for us, right, be it whether we, regardless of whether RWKB, statespace, XLSTM, [00:35:00] etc, our general idea is that instead of that expanding state, that increase in computational cost, what if we have a fixed state size?[00:35:08] Eugene Cheah: And Information theory detects that that fixed state size will have a limit. Just how big of a limit is a question, like, we, like, RWKB is running at 40 megabytes for, for its state. Its future version might run into 400 megabytes. That is like millions of tokens in, if you're talking about mathematically, the maximum possibility.[00:35:29] Eugene Cheah: It's just that I guess we were all more inefficient about it, so maybe we hit 100, 000. And that's kind of like the work we are doing, trying to like push it and maximize it. And that's where the models will start differing, because it will choose to forget things, it will choose to remember things. And that's why I think that there might be some element of right, but it may not be the same right.[00:35:49] Eugene Cheah: It may be the model learn things, and it's like, hmm, I can't remember that, that article. Let me do a database search, to search. Just like us humans, when we can't remember the article in the company. We do a search on Notion. [00:36:00][00:36:00] Dan Fu: I think something that would be really interesting is if you could have facts that are, so right now, the one intuition about language models is that all those parameters are around just to store random facts about the world.[00:36:14] Dan Fu: And this intuition comes from the observation that if you take a really small language model, it can do things like talk to you, or kind of has like the The style of conversation, it can learn that, but where it will usually fall over compared to a much larger one is it'll just be a lot less factual about things that it knows or that it can do.[00:36:32] Dan Fu: But that points to all those weights that we're spending, all that SGD that we're spending to train these models are just being used to store facts. And we have things like databases that are pretty good at storing facts. So I think one thing that would be really interesting is if we could actually have some sort of outside data store that a language model can can look at that that maybe is you know, has has some sort of gradient descent in it, but but would be quite interesting.[00:36:58] Dan Fu: And then maybe you could edit it, delete [00:37:00] facts, you know, change who's president so that it doesn't, it doesn't get lost.[00:37:04] Vibhu: Can we open up Q& A and hot takes for the audience? I have a hot take Q& A. Do these scale? When, when 405B state space model, RAG exists, no one does long context, who's throwing in 2 million token questions, hot takes?[00:37:24] Dan Fu: The, the who's throwing in 2 million token question, I think, is, is a really good question. So I actually, I was going to offer that as a hot take. I mean, my hot take was going to be that long context doesn't matter. I know I just gave a whole talk about it, but you know, what, what's the point of doing research if you can't, you know, play both sides.[00:37:40] Dan Fu: But I think one of the, so I think for both of us, the reason that we first got into this was just from the first principled questions of there's this quadratic thing. Clearly intelligence doesn't need to be quadratic. What is going on? Can we understand it better? You know, since then it's kind of turned into a race, which has [00:38:00] been exciting to watch, like, how much context you can take in.[00:38:03] Dan Fu: But I think it's right. Nobody is actually putting in a two million context prompt into these models. And, and, you know, if they are, maybe we can go, go You know, design a better model to do that particular thing. Yeah, what do you think about that? So you've also been working on this. Do you think long context matters?[00:38:19] Eugene Cheah: So I'm going to burn a bit. How many of you remember the news of Google Gemini supporting 3 million contacts, right? Raise your hand.[00:38:28] Vibhu: Yeah, 2 million.[00:38:29] Eugene Cheah: Oh, it's 2 million.[00:38:31] Eugene Cheah: Yeah, how many of you actually tried that? See?[00:38:34] Vibhu: I use it a lot. You? You work for MindsTV. I use it a lot.[00:38:41] Eugene Cheah: So, for some people that has used, and I think, I think that's the, that's might be, like, this is where my opinion starts to differ, because I think the big labs may have a bigger role in this, because Like, even for RWKB, even when we train non contacts, the reason why I say VRAM is a problem is that because when we did the, we need to backprop [00:39:00] against the states, we actually need to maintain the state in between the tokens by the token length.[00:39:05] Eugene Cheah: So that means we need to actually roll out the whole 1 million contacts if we are actually training 1 million. Which is the same for transformers, actually, but it just means we don't magically reuse the VRAM consumption in the training time space. So that is one of the VRAM bottlenecks, and I'm neither OpenAI nor Google, so donate GPUs if you have too much of them.[00:39:27] Eugene Cheah: But then, putting it back to another paradigm, right, is that I think O1 style reasoning might be actually pushing that direction downwards. In my opinion, this is my partial hot take is that if, let's say you have a super big model, And let's say you have a 70B model that may take double the tokens, but gets the same result.[00:39:51] Eugene Cheah: Strictly speaking, a 70B, and this is even for transformer or non transformer, right? We we'll take less less resources than that 400 B [00:40:00] model, even if it did double the amount thinking. And if that's the case, and we are still all trying to figure this out, maybe the direction for us is really getting the sub 200 B to be as fast as efficient as possible.[00:40:11] Eugene Cheah: We a very efficient architecture that some folks happen to be working on to, to just reason it out over larger and larger context thing.[00:40:20] Question: Yeah. One thing I'm super interested in is. Models that can watch forever? Obviously you cannot train something on infinite context length. How are y'all thinking about that, where you run on a much longer context length than is possible to train on?[00:40:38] Dan Fu: Yeah, it's a, it's a great question. So I think when I think you guys probably had tweets along these lines, too. When we first started doing these things, because these are all recurrent models in theory you could just run it forever. You could just run it forever. And at the very least it won't, it won't like error out on your crash.[00:40:57] Dan Fu: There's another question of whether it can actually [00:41:00] use what it's seen in that infinite context. And I think there, so one place where probably the research and architectures ran faster Then another research is actually the benchmarks for long context. So you turn it on forever. You want to do everything or watch everything.[00:41:16] Dan Fu: What is it that you actually wanted to do? Can we actually build some benchmarks for that? Then measure what's happening. And then ask the question, can the models do it? Is there something else that they need? Yeah, I think that if I were to turn back the clock to 2022, that's probably one of the things I would have done differently, which would have been actually get some long context benchmarks out at the same time as we started pushing context length on all these models.[00:41:41] Eugene Cheah: I will also say the use case. So like, I think we both agree that there's no Infinite memory and the model needs to be able to learn and decide. I think what we have observed for, I think this also fits the state space model, is that one of the key advantages of this alternate attention mechanic that is not based on token position is that the model don't suddenly become crazy when you go past the [00:42:00] 8k training context tank, or a million context tank.[00:42:03] Eugene Cheah: It's actually still stable. It's still able to run, it's still able to rationalize. It just starts forgetting things. But some of these things are still there in latent memory. Some of these things are still somewhat there. That's the whole point of why reading twice works. Things like that. And one of the biggest pushes in this direction is that I think both Statespace and RWKB have Separate papers by other researchers where they use this architecture for time series data.[00:42:26] Eugene Cheah: Weather modeling. So, you are not asking what was the weather five days ago. You're asking what's the weather tomorrow based on the infinite length that we, as long as this Earth and the computer will keep running. So, so, and they found that it is like, better than existing, like, transformer or existing architecture in modeling this weather data.[00:42:47] Eugene Cheah: Control for the param size and stuff. I'm quite sure there are people with larger models. So, so there are things that, that in this case, right, there is future applications if your question is just what's next and not what's 10 years ago.[00:42:59] Dan Fu: Thanks so [00:43:00] much for having us. Get full access to Latent Space at www.latent.space/subscribe
Tired of fumbling for your glasses or wrestling with contacts? This episode is for you! Join Melissa and Selah as they dive into vision correction with Dr. Sheri Rowen, exploring ICL, RLE, and LASIK – the superstars of clear vision. Not sure what those acronyms mean? ICL (Implantable Collamer Lens) works like internal contact lenses (and are even removable!), while RLE (Refractive Lens Exchange) can drastically reduce your need for glasses. And of course, there's the OG, popular LASIK procedure that reshapes your cornea for clear vision. But that's not all we cover! Learn why dry eye often affects contact lens wearers and how to protect your eyes from screen time with blue light glasses and the 20-20-20 rule: every 20 minutes, look 20 feet away and blink, blink, blink! Don't miss this eye-opening episode! Care Experts is a weekly podcast by CareCredit where we sit down with doctors and experts who give information, tips and insight into healthcare treatments and procedures. Check in every Wednesday for new episodes at carecredit.com/careexperts or subscribe on your favorite podcast app. CareCredit is a health, wellness and personal care credit card that has helped millions of people with promotional financing options and is accepted at hundreds of thousands of provider and retail locations nationwide. Learn more at carecredit.com.
The 365 Days of Astronomy, the daily podcast of the International Year of Astronomy 2009
Paul Hill and Dr. Jenifer “Dr. Dust” Millard host. Damien Phillips, John Wildridge and Dustin Ruoff produce. Today we bring you two of the plenary sessions from the British Planetary Science Conference, 2024, hosted by Space Park Leicester and the National Space Centre on June 18-21, 2024. - Dr. Aprajita Verma of the UK ELT Programme. - Dr. Steven G. Banham Research Fellow in planetary surface processes at the ICL. The Space Park newsletter reports: Dr. Jenifer Millard, Managing Editor at Fifth Star Labs, added: “I attended BPSC2024 not as a planetary scientist, but as an astronomer and science communicator, hoping to be inspired and learn beyond my field of expertise. … I'm delighted to say I was not disappointed by the event Space Park Leicester enabled. It was a fantastic few days of learning in a wonderful, encouraging and most importantly safe environment.” The conference was supported by the UK Space Agency, the Science and Technology Facilities Council (STFC), Europlanet Society and the Royal Astronomical Society. A gallery of event images can be found here: https://www.space-park.co.uk/galleries/bpsc2024/ www.awesomeastronomy.com Bio: Awesome Astronomy explores the frontiers of science, space and our evolving understanding of the universe. Join Paul & Jeni for informative and fun astronomy programmes dedicated to space and astronomy news and monthly podcast extras covering hot topics and special interviews in the world of science and astronomy. We've added a new way to donate to 365 Days of Astronomy to support editing, hosting, and production costs. Just visit: https://www.patreon.com/365DaysOfAstronomy and donate as much as you can! Share the podcast with your friends and send the Patreon link to them too! Every bit helps! Thank you! ------------------------------------ Do go visit http://www.redbubble.com/people/CosmoQuestX/shop for cool Astronomy Cast and CosmoQuest t-shirts, coffee mugs and other awesomeness! http://cosmoquest.org/Donate This show is made possible through your donations. Thank you! (Haven't donated? It's not too late! Just click!) ------------------------------------ The 365 Days of Astronomy Podcast is produced by the Planetary Science Institute. http://www.psi.edu Visit us on the web at 365DaysOfAstronomy.org or email us at info@365DaysOfAstronomy.org.