AI in Education Podcast

New Series Alert - all about students In the kickoff episode of Series 12, Dan and Ray set the stage for a deep dive into AI from the student's perspective. Why are students confused about AI? How are they actually using it - and how should they be using it? The hosts explore the idea that AI can act as a tutor, a teacher, or a shortcut (a "cheater") and reflect on how this plays out in real classrooms and learning experiences. They also caught up on plenty of news this week - transdisciplinary learning models, new AI education policies from countries like China and the UAE, and how major tech players like Microsoft and Google are adapting their tools for younger learners. The episode also highlights a new meta-analysis on ChatGPT's effect on student learning. UAE AI Curriculum Changes China AI Curriculum Changes Microsoft's new announcement on Microsoft 365 Copilot for students 13+ The meta analysis paper is The effect of ChatGPT on students' learning performance, learning perception, and higher-order thinking: insights from a meta-analysis Finally, there's two things we ask you, the listener, for in this episode: If you haven't already, pop into your podcast app and give us a rating and review Help shape this season by connecting the podcast with students and researchers who can share insights into real-life student experiences with AI Have feedback or want to get involved? Email us at hosts@aipodcast.education

In this special solo-hosted episode, Ray is joined by Dr. Mike Seymour from the University of Sydney, recorded live at the 2025 AI in Higher Education Symposium. You can find Mike through LinkedIn and the University of Sydney Mike shares captivating insights from his work in digital humans - lifelike AI avatars that can support learning, healthcare, and emotional wellbeing. From using VR to train veterinary students with virtual sheep, to exploring how emotionally intelligent digital tutors can transform how students ask questions, this episode dives deep into the practical, human-centered future of AI. Mike draws on his background in Hollywood visual effects and his current research to make a compelling case: AI isn't a single tool - it's a system, a landscape, a way to augment and extend human capability. The conversation ranges from the ethics of AI in healthcare to using AI for dubbing films, always returning to a central theme: how technology can support, not replace, people. And when you've listened to this podcast, jump across to Mike's two podcasts - the fxpodcast and thevfxshow - which both take you on a journey to Hollywood and visual effects There are so many resources that you can read to dive into this story further: Mike's fxguide25 website Motus Lab - researching AI Digital Humans Mike's portfolio on Vimeo Look at the timestamps on the videos - amazing videos from 5 years ago that we can now do in consumer apps, like this Mike vs Mike Test and the Pinscreen Test video - amazing that it's gone from bleeding edge to available in everyday consumer apps in half a decade! Whether you're an educator, technologist, or just curious about the future, this episode is packed with ideas that will stick with you.  

In this episode of the AI in Education Podcast, Ray and Dan return from a short break with a packed roundup of AI developments across education and beyond. They discuss the online launch of the AEIOU interdisciplinary research hub that Dan attended, explore the promise and pitfalls of prompt engineering—including the idea of the “Uber prompt”—and share first impressions of the OpenAI Academy. Ray unpacks misleading headlines about Bill Gates “replacing teachers” with AI and instead spotlights the real message about AI tutors. They also dive into the 2027 AI forecast report, the emerging impact of the EU AI Act, and Microsoft's latest Work Trend Index, which introduces the idea of "agent bosses" in the AI-driven workplace. And then round off with Ben Williamson's list of AI fails in education and a startling story of an AI radio presenter nobody realised was fake. Here's all the links so you too can fall down the AI news rabbithole

Series 11, Episode 11 Designing the Future: Learning Designers Meet AI with Minh Huynh and Cory Dal Ponte In this episode of the AI in Education Podcast, we bring you two powerful conversations that explore the evolving role of learning designers and their growing impact in the world of AI-enabled education. Together, these two interviews reveal the strategic and practical power of learning design in an AI-driven future. First, we speak with Minh Huynh from The University of Sydney Education Innovation team, who shares her journey from being a student of AI to leading its integration within a large first-year biology course. She offers a compelling look into the behind-the-scenes work of learning designers—building trust with academics, identifying barriers to student learning, and co-creating feedback tools that make a measurable impact. In the second half, we're joined by Cory Dal Ponte from the University of Melbourne. Cory is both a learning designer and a PhD researcher focused on AI literacy. He walks us through some of the GPT-powered tools he's built - from bots that rewrite learning outcomes in Bloom's Taxonomy to AI-driven simulated patients for healthcare education - and unpacks what it really means to be AI literate in education today. His custom GPTs are all available for you to use through ChatGPT Bloomify – Converts unrefined learning goals into Bloom's Taxonomy-aligned outcomes  Sim Patient Builder – Helps create simulated patient cases for healthcare education to use with Sim Patient  UnderstandMe: Supports creating key understandings from topic aims using the Understanding by Design framework.  Corey also mentioned two good resources for thinking about AI competency: UNESCO's AI Competency Framework for Educators Conceptualizing AI literacy: An exploratory review, Ng et al. (2021)  And finally, you can find some other resources from Cory on his linktree

This week, Dan and Ray dive into a whirlwind of AI news shaking up the education world. From $40K private schools with AI tutors to universities reporting chatbot-driven grade boosts, they unpack what's hype and what's happening. Plus, they explore the ethics of AI image generation, energy use in data centers, and whether GPT-4.5 is now officially more human than human. News Alpha School - AI school in Texas News report: https://www.foxnews.com/media/texas-private-schools-use-ai-tutor-rockets-student-test-scores-top-2-country https://alpha.school/ Macquarie University students' exam scores up by nearly 10 per cent thanks to new AI-powered chatbotMicrosoft case study: https://news.microsoft.com/source/asia/2025/03/24/macquarie-university-students-exam-scores-up-by-nearly-10-per-cent-thanks-to-new-ai-powered-chatbot/ Building an AI-Enabled Workforce: Impacts for Finance, Technology and Business Education and Training  https://www.futureskillsorganisation.com.au/building-an-ai-enabled-workforce-impacts-for-finance-technology-and-business-education-and-training The Future of Jobs Report 2025 from World Economic Forum  https://www.weforum.org/publications/the-future-of-jobs-report-2025/digest/ OpenAI Academy https://academy.openai.com  Anthropic launched Claude for Education https://www.anthropic.com/news/introducing-claude-for-education  Open AI image generation announcement https://openai.com/index/introducing-4o-image-generation/    Report: Australia's renewables can power AI and slash energy costs https://www.innovationaus.com/australias-renewables-can-power-ai-and-slash-energy-costs/  UTS Transdisciplinary Innovation course https://www.uts.edu.au/for-students/transdisciplinary-innovation  Research The Cybernetic Teammate: A Field Experiment on Generative AI Reshaping Teamwork and Expertise https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5188231  Large Language Models Pass the Turing Test https://arxiv.org/abs/2503.23674  News report: https://futurism.com/ai-model-turing-test 

Yet again, Dan and Ray are the podcast hosts, but Ray's AI digital twin introduces the episode! This week's guests are: Lee Barrett – Prompt Engineer and AI Advocate at CEnet. Prem Radhakrishnan – AI Technical Manager at CEnet. This episode is a two-level deep dive into the development and deployment of CEchat, an AI-powered chatbot designed to reduce teacher workload and enhance student learning across Catholic schools in Australia. Part 1 of the episode covers the vision, pedagogy, and implementation strategy with both Lee and Prem. Part 2 is a more technical discussion between Dan and Prem, covering codebase customisation, infrastructure, scale, security, and integration. CEchat is an extended school-level implementation of Cogniti, the multi-award-winning open source chatbot from The University of Sydney. We interviewed Danny Liu about the project in this episode: https://aipodcast.education/the-university-of-sydneys-cogniti-ai-bot  They also discussed the Rome Call for AI Ethics, which you'll find here: https://www.romecall.org/  

News Stories Covered in the Episode AI Typing Like a Human? – Graham Clay's LinkedIn post on ChatGPT Operator mimicking human keystrokes https://www.linkedin.com/feed/update/urn:li:activity:7292163775963557888/ The Vatican on AI Ethics – “Antiqua et Nova” report on AI, human intelligence, and ethics in education Sacerdotus: Vatican's New Document on AI: Ethical Guidelines and Human Responsibility Australian Government's AI Study – Treasury report on Microsoft 365 Copilot, estimating it pays for itself if it saves 13 minutes per week Treasury M365 Copilot review estimates 13-minute efficiency gain needed to justify licence cost - Software - iTnews California State University & AI – Providing 500,000 stuents access to ChatGPT Edu https://openai.com/index/openai-and-the-csu-system/ Estonia's AI Strategy – National AI policy giving all students access to AI tutors https://openai.com/index/estonia-schools-and-chatgpt/ Australia's New National AI Centre Director – ex-podcast co-host Lee Hicken appointed to lead the centre. For those keeping count, that's the second of the podcast hosts that's now at NAIC, with current hosts Dan & Ray still waiting for the call

In this episode of AI in Education, Dan and Ray sit down with Leigh Williams, CIO of Brisbane Catholic Education, to dive into one of the most ambitious AI rollouts in Australian schools. With 78,000 students and 13,000 staff, Leigh and her team implemented Microsoft Copilot at scale—reducing teacher workloads by 9+ hours per week and even boosting teacher recruitment. But it's not just about efficiency. Leigh shares how AI is reshaping learning, tackling the digital divide, and even reducing student stress. We also explore the ethics of AI in education, Brisbane Catholic Education's commitment to the Vatican's "Rome Call" for AI ethics, and why gender balance in AI leadership still has a long way to go. We also have a fascinating discussion about other ways that they are using technology to support learning, including FisherOne, their online school. Training resources Leigh talks extensively about the effort they have put into training and support for their teachers and students, and we wanted to share some of the Microsoft resources we know are useful if you're rolling out Copilot to your school: Microsoft Learn: Enhance teaching and learning with Microsoft Copilot Microsoft Adopt: Microsoft 365 Copilot Chat resources for education

Dan and Ray welcome Graham Brown Martin, a seasoned expert in education technology, for a very(!) thought-provoking conversation about navigating education in the rapidly evolving age of artificial intelligence. In this episode: Discover Graham's journey through multiple technological revolutions—from early mainframes and pioneering laser-disc technology to modern-day AI. Hear stories from Graham's past, including his role in bringing together provocative figures like Katherine Birbalsingh and Malcolm McLaren to challenge the status quo in education. Reflect on the historical context of industrial revolutions and their ongoing influence on our current educational systems. Understand why Graham argues that education is still stuck in outdated 19th-century practices and how the pandemic reinforced rather than changed this dynamic. Explore why Graham believes relational skills, creativity, empathy, and human collaboration will define education and employment in the fifth industrial revolution. Graham's call to action? Shifting educational and economic models to prioritise human-centric skills and societal value.   Find out more about Graham on his website: GrahamBrownMartin.com Follow Graham on LinkedIn: https://www.linkedin.com/in/grahambrownmartin/ 

In this episode Dan and Ray sit down with Dr. Nici (Nikki) Sweaney—founder of “AI Her Way,” gender equality advocate, and globally recognized AI consultant. After a fascinating career journey from butterfly ecology to statistics to AI, Nici now helps schools and organizations create ethical, responsible, and effective AI strategies. She shares her insights on responsible AI adoption, gender equity, bias, and how schools can proactively plan for an AI-driven future. Follow Nici on LinkedIn: https://www.linkedin.com/in/dr-nici-sweaney/  Nici's Ai Her Way website  Book in a discovery call with Nici Make an Inquiry about PD for your school: https://www.aiherway.com.au/professional-development  Book Nici as a speaker https://www.aiherway.com.au/speaking-engagements Nici's will be speaking at lots of events in March, if you'd like to hear more, and ask your own questions! March 5 - Australian Retirement Trust live podcast recording, Brisbane March 6 - Canon, online event for IWD March 6 - National Press Club, "Women in Media Canberra Networking Night: Democracy under threat? Unpacking mis/disinformation in Australia" Canberra March 7 - Powerful Steps, IWD Event, 'Empowering Women, Changing Lives', Sydney March 13 - Hoyts, IWD Event, Advancing Women in the AI Era, Sydney March 17 - Women in Data and Digital (Australian Public Service), Online event for IWD March 25 - ARIA's Innovator Conference, Sydney March 27 - Learning Environments Australia Conference, "Architecting Future Learning Environments with AI", Sydney Key Topics & Takeaways Nici's Career Path: Ecology, Academia & AI How studying butterfly behavior and coding in R sparked her interest in data and algorithms. Transition from 17 years in academia to AI consulting, focusing on statistics, data analytics, and ethical tech. The ‘Aha' Moment with ChatGPT Discovering ChatGPT in late 2022 and realizing its massive potential for education—and society at large. Balancing excitement and existential questions (“What is the point of humanity?”) when first encountering generative AI. Bias, Equity & Ethical AI How AI systems inherit the biases found in the internet's data—and why that's problematic for underrepresented groups. Why women's perspectives (and other minority voices) are crucial in AI development and how current data sets often perpetuate stereotypes. Nici's passion for closing the AI gender gap and practical steps schools can take. Building AI Literacy & Culture in Schools The importance of having a written guideline (rather than a static policy) for AI use in schools. How to engage teachers and staff: start with small wins—solving real pain points such as lesson planning or admin tasks. Creating a “community of practice” so that staff share prompts, workflows, and best practices. Parent and Community Involvement Addressing misconceptions and fears by informing families about AI's capabilities, risks, and benefits. Why schools must proactively explain why they're teaching AI skills—and how they're doing so responsibly. Rethinking Assessment & Student Skills Moving beyond “fact recall” to deeper inquiry, collaboration, ethical reflection, and higher-order thinking. Teaching students how AI works (at a conceptual level) so they can use it responsibly and critically. Encouraging leadership traits like empathy, diversity of thought, and clear communication—assets for both human collaboration and AI prompting. Global Perspectives & Data Sovereignty The challenges of relying on global tech giants for AI tools and data security. Understanding AI as a “private commodity,” not a universal public resource—what that means for Australian schools and beyond. Practical Steps for School Leaders Survey staff to find out their AI familiarity, pain points, and training needs. Start with low-hanging fruit: use AI to streamline daily tasks, then build toward larger strategic workflows. Sustain momentum via ongoing PD, regular sharing sessions, and involving all stakeholders, including parents.  

In this episode, Ray and Dan are joined by Danny Bielik, President of the Digital Education Council, to discuss the findings of a global AI faculty survey. With insights from 52 institutions across 28 countries, Danny shares how higher education faculty are adopting AI, the biggest concerns around academic integrity and assessment, and why AI literacy is still a challenge for many. Key topics include:

Book Club Podcast? Before we even got to the News and Research, this week we discussed the AI-related books we're currently reading: Dan's reading: Where Good Ideas Come From, by Steven Johnson (TED Talk) Why Data Science Projects Fail, by Douglas Gray and Evan Shellshear (An interview with Evan) Ray's reading  The Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence, by Kate Crawford (Wikipedia page) News Links Links to the reports and news we discuss in the episode: OpenAI's new Education newsletter https://openaiforeducation.substack.com/ Ethan Mollick's new "AI in Education: Leveraging ChatGPT for Teaching" course on Coursera https://www.coursera.org/learn/wharton-ai-in-education-leveraging-chatgpt-for-teaching World Economic Forum "Future of Jobs report" https://www.weforum.org/publications/the-future-of-jobs-report-2025/infographics-94b6214b36/ Student expelled and deported because they were accused of using ChatGPT by their professor. So they're suing their professor https://www.fox9.com/video/1574324 Digital Education Council Global AI Faculty Survey 2025 https://www.digitaleducationcouncil.com/post/digital-education-council-global-ai-faculty-survey We'll discuss this report with one of the authors in next week's episode UK government policy paper on "Generative artificial intelligence (AI) in education" https://www.gov.uk/government/publications/generative-artificial-intelligence-in-education/generative-artificial-intelligence-ai-in-education Year13 Case Study on AI use https://news.microsoft.com/en-au/2024/12/13/guiding-school-leavers-with-ai-support-year13s-mission-to-democratise-opportunities-for-young-people/ AI Use by industry employees - US, 2024 https://www.nber.org/papers/w32966 In the discussion of energy use by AI, Ray mentioned some stats from this research report: "The Carbon Emissions of Writing and Illustrating Are Lower for AI than for Humans"  https://arxiv.org/ftp/arxiv/papers/2303/2303.06219.pdf Research Papers And finally, links to the research papers we discussed this week ChatGPT and Its Educational Impact: Insights from a Software Development Competition https://arxiv.org/abs/2409.03779  How to Align Large Language Models for Teaching English? Designing and Developing LLM based-Chatbot for Teaching English Conversation in EFL, Findings and Limitations https://arxiv.org/abs/2409.04987  AI Meets the Classroom: When Does ChatGPT Harm Learning? https://arxiv.org/abs/2409.09047  Are Large Language Models Good Essay Graders? https://arxiv.org/abs/2409.13120  An Education Researcher's Guide to ChatGPT https://osf.io/spbz3  A Step Towards Adaptive Online Learning: Exploring the Role of GPT as Virtual Teaching Assistants in Online Education https://osf.io/preprints/edarxiv/rw45b  The AI Assessment Scale (AIAS) in action: A pilot implementation of GenAI-supported assessment https://ajet.org.au/index.php/AJET/article/view/9434     

This week we get to catch up with Katie Ford of Microsoft Australia, who tells us about the projects that have been happening in AI in Education around Australia, and shares some of the lessons learnt from the projects as well as what she is learning through her own research focus. The examples Katie discusses are: Tasmania Department of Education: Collaborated with Microsoft to enhance their data estate and prepare for AI applications aimed at identifying vulnerable children during COVID, helping to reveal overlooked demographics and improve interventions. University of New South Wales (UNSW): Engaged in multiple initiatives including embedding AI intelligence into complex institutional systems and processes, and developing the Academic Success Monitor to predict and intervene early with students disengaging from education. This proactive outreach is personalised and has shown positive impacts on student success rates. South Australia Department of Education: Pioneered the use of generative AI in classrooms, equipping educators with AI tools to enhance teaching and learning, making it one of the first in the world to adopt such technology at this scale. New South Wales Department of Education: Implemented AI thoughtfully to support educators, focusing on significant time savings and improved experiences in the classroom, with a commitment to reducing teacher workloads by five hours weekly. NSWEduChat Brisbane Catholic Education: Conducted a successful pilot with Microsoft Copilot, saving educators an average of 9.3 hours per week, which led to a wider rollout across the board to boost productivity and support staff well-being.  Brisbane Catholic Education to deploy Microsoft 365 Copilot to 12,500 educators and support staff, in largest rollout for K-12 globally - Microsoft Australia News Centre University of Sydney: Developed Cogniti to enable academics to control generative AI usage within their courses, facilitating the creation and monitoring of AI agents to enhance educational delivery and student monitoring. Torrens University: Used Azure OpenAI to overhaul their Learning Management System, addressing user experience feedback, enhancing accessibility, and saving both cost and labour significantly. Of course, we get diverted off course along the way, with a mention of platypus spotting, and Ray's visceral hatred of automated supermarket tills gets ha mention

And we're back! After a relaxing summer holiday Down Under (the school year finishes late December and doesn't restart until after the end of January in Australia) we've made it back to the studio to talk again. In this first episode of the 2025 'AI in Education' podcast, hosts Dan Bowen and Ray Fleming reflect on the major events and developments in AI during 2024. They discuss the importance of continuously addressing the adoption gap, the evolution of AI tools, and the pace of change in AI technology, exemplified by recent announcements like Project Stargate and DeepSeq. The episode transitions to predictions for 2025, where they foresee the year being dominated by the rise of AI agents, increased research on AI's efficacy, and the exploration of AI's role in education. They also emphasised the need for ongoing experiments and adaptability in organisations to keep up with rapid advancements.

We look back on the highlights of 2024, and the mass of stories, challenges and inspirations we had throughout the year. And what a year - AI in education has been moving so fast we even invited two digital AI podcasters to take over half the episode. And, worryingly, they did an amazing job - listen for yourself... We're going to take a break over the Australian school holidays, but then we'll be back with at the end of January 2025. If you miss us, then please go and give us a rating or review in Spotify or Apple Podcasts, and that'll encourage us to return with even more energy for 2025! We mention far too many stories and episodes to list them all, but one thing we mentioned a few times are the top five episodes from 2024, which in chronological order are: Assessment and Swiss Cheese - Phill Dawson - Episode 9 of Series 9 https://aipodcast.education/assessment-and-swiss-cheese-phill-dawson-episode-9-of-series-9 From Burnout to Breakthrough: Amanda Bickerstaff on AI's Role in Education https://aipodcast.education/from-burnout-to-breakthrough-amanda-bickerstaff-on-ais-role-in-education  Jason Lodge - Guiding Through Assessments https://aipodcast.education/jason-lodge-guiding-through-assessments  University of Sydney and the future of assessment https://aipodcast.education/university-of-sydney-and-the-future-of-assessment  Is AI the saviour of teaching? Leanne Cameron's perspective on AI across the teaching profession https://aipodcast.education/leanne-camerons-perspective-on-time-saving-for-the-teaching-professions 

A heap of news stories this week means we didn't cover any research at all! AI isn't a tool, it's an environment by Josh Thorpe https://wonkhe.com/blogs/ai-isnt-a-tool-its-an-environment/  Australian Senate report into Adoption of AI https://www.aph.gov.au/Parliamentary_Business/Committees/Senate/Adopting_Artificial_Intelligence_AI/AdoptingAI/Report  Ethan Mollick's course on Coursera: "AI in Education: Leveraging ChatGPT for Teaching" https://www.coursera.org/learn/wharton-ai-in-education-leveraging-chatgpt-for-teaching  I'll also recommend his book - Co-Intelligence - as a great Christmas gift for yourself or a friend Open AI announced Open AI Pro @ $200/m https://openai.com/index/introducing-chatgpt-pro/  We like Ethan Mollick's example that showed what it could do - solving this problem and creating a working app in 15 minutes - see here: https://bsky.app/profile/emollick.bsky.social/post/3lcldsn2grk2z   Microsoft Copilot with vision for consumers  https://www.microsoft.com/en-us/microsoft-copilot/blog/2024/12/05/copilot-vision-now-in-preview-a-new-way-to-browse Demo example: https://youtu.be/H3-hHiITH_g  Sora released https://openai.com/index/sora-is-here/  ChatGPT's Advanced Voice Mode finally gets visual context on the 6th day of OpenAI https://www.zdnet.com/article/chatgpts-advanced-voice-mode-finally-gets-visual-context-on-the-6th-day-of-openai/  Apple released iOS 18.2 with integrated AI https://www.zdnet.com/article/ios-18-2-rolls-out-to-iphones-try-these-6-new-ai-features-today/  Google Gemini 2.0 with real time speech and vision https://aistudio.google.com/live  We're on Bluesky  https://bsky.app/profile/aiineducation.bsky.social  "The Carbon Emissions of Writing and Illustrating Are Lower for AI than for Humans"  https://arxiv.org/ftp/arxiv/papers/2303/2303.06219.pdf  Microsoft's Zero-Water Solution for Data Centre Cooling https://sustainabilitymag.com/articles/microsoft-unveils-zero-water-cooling-for-ai-data-centres 

This week's episode discussed the new AI toolkit for generative AI strategies from Australia's Higher Education regulator, TEQSA  The full toolkit is available here: https://www.teqsa.gov.au/guides-resources/resources/corporate-publications/gen-ai-strategies-australian-higher-education-emerging-practice  During the episode we referenced some of the podcasts when we'd had the chance to interview some of the people from The University of Sydney who were used as case studies in the toolkit, and here's the link to previous podcast episodes that might be helpful to go back to for more depth: The University of Sydney's Cogniti AI bot https://aipodcast.education/the-university-of-sydneys-cogniti-ai-bot  The University of Sydney's Two Lane approach to assessment https://aipodcast.education/university-of-sydney-and-the-future-of-assessment  We'd also recommend listening to conversations with two leaders on post-AI assessment Jason Lodge at the University of Queensland  https://aipodcast.education/jason-lodge-guiding-through-assessments  Phill Dawson at the CRADLE centre at Deakin University  https://aipodcast.education/website/assessment-and-swiss-cheese-phill-dawson-episode-9-of-series-9 

Everybody or Nobody is using AI - News and ResearchSeries 10, Episode 8 We explore quite a lot of news related to AI in Education that arrived this week, which meant we didn't get to cover nearly as many academic research papers as we'd hoped. Oh well, there's still 4 episodes left this year to catch up

This week's episode is a discussion of the Australian Parliamentary report on AI in Education, "Studdy Buddy or Influencer?". The report highlights both the opportunities and challenges GenAI presents, focusing on student and teacher perspectives, ethical considerations, regulatory approaches, and potential solutions. The report makes many recommendations, with the very first being significant on many levels: "The Committee recommends that the Australian Government: consider making the use of GenAI in education a national priority" Dan and Ray are joined by guest, Miriam Scott, an Education Consultant for Generative AI for the Association of Independent Schools of NSW and also Marketing & Events Coordinator for the Association of Women Educators. Miriam was previously Head of Digital Education at Hillbrook Anglican School, and has produced a number of resources for teachers that she shares on her personal website "Scotty Breaks It Down" An AI starter-kit for anyone looking to integrate generative AI in their school for education An AI professional development toolkit for teachers

Another News & Research episode this week, and lots of interesting links and research discussed. Here's the weblinks for everything! News Deception and Deepfakes - How genAI is Changing Cyber Safety Course: https://spsc.thinkific.com/courses/take/deceptionanddeepfakes/  Leon Furzes online course, where he made a free course about deepfakes hosted by a deepfake, with deepfake content about deepfakes https://leonfurze.teachable.com/p/this-course-is-ai-generated  McKinsey surveyed 1363 working professionals across countries, industries, and demographics about the use of generative AI at their work places.  https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai  The Carbon Emissions of Writing and Illustrating Are Lower for AI than for Humans https://arxiv.org/ftp/arxiv/papers/2303/2303.06219.pdf  Satya Nadella shared 200 examples globally of companies using AI https://blogs.microsoft.com/blog/2024/11/12/how-real-world-businesses-are-transforming-with-ai/  Rose Luckin's Beyond the Hype report  https://www.educateventures.com/beyond-the-hype  Brad Smith shares a Digital Twin of St Peters Basilica in Rome https://youtu.be/5dQI_TXYJbU  Research Spotting Research Fraud - a website that's fascinating https://www.academ-ai.info/  AI or Human? Evaluating Student Feedback Perceptions in Higher Education https://osf.io/preprints/osf/6zm83  Teacher Learning Network Journal - AI in Education special https://tln.org.au/Web/Web/TLN-Journals/TLN%20Journal%20Public.aspx  Adoption and Impact of ChatGPT in Computer Science Education: A Case Study on a Database Administration Course https://arxiv.org/abs/2407.12145  Follow-Up Questions Improve Documents Generated by Large Language Models https://arxiv.org/abs/2407.12017  Educational Personalized Learning Path Planning with Large Language Models https://arxiv.org/abs/2407.11773 

In September, the Toddle team organised "AI for AussieEd", a week-long series of professional development sessions for teachers, which had thousands of attendees for the virtual sessions. This episode "Driving Innovation in Australian Schools" was part of the week, and brings you the experiences of three educators, in conversation with podcast hosts Dan and Ray The guests are: Rachel Saunders, Primary School Learning Leader at Concordia College in Adelaide Ryan Elwell, Director of Digital Pedagogies & Online Safety Education at the ACT Education Directorate Matt Heinrich, Director of Learning Technologies and ICT at St Michaels Grammar School in Melbourne It was a great discussion, and because it was recorded as a live webinar, we had lots of audience questions coming in online, so in the second half of the episode, you're going to hear questions coming in the chat from live listeners.  As usual, hosts Dan and Ray brought along their own contributions to the discussion: Dan came with his deep pedagogical knowledge and insightful education conversation. Ray brought his Buzzword Bingo card

This week's episode has a lot more news than research. But the research that we spend a bit of time on is the insights on how students in Australian universities are using AI. Really good insights for any educator or leader! News AI Detectors Falsely Accuse Students of Cheating—With Big Consequences https://www.bloomberg.com/news/features/2024-10-18/do-ai-detectors-work-students-face-false-cheating-accusations  Empowering Education Leaders Toolkit https://tech.ed.gov/education-leaders-ai-toolkit/  TEQSA Guidance for universities Danny Liu video https://bit.ly/students-ai  Researchers say an AI-powered transcription tool used in hospitals invents things no one ever said https://www.independent.co.uk/news/openai-ap-san-francisco-experts-microsoft-b2635996.html  More than a quarter of new code at Google is generated by AI - The Verge https://www.theverge.com/2024/10/29/24282757/google-new-code-generated-ai-q3-2024  Apple are launching their first devices with Apple Intelligence  https://www.wsj.com/video/series/joanna-stern-personal-technology/full-interview-apples-software-chief-craig-federighi-on-future-of-iphone-ai/756B8727-5FFB-422C-AE63-C4600272BD94?msockid=0a3b30f5f88b6061226e245bf9b96140  Watch out for the Earning reports:  Google just released and Microsoft do this week too.  Always have a listen to these to find out about the momentum in AI.  Alphabet Q3 earnings call: CEO Sundar Pichai's remarks Microsoft Fiscal Year 2025 First Quarter Earnings Conference Call Research A Systematic Mapping Review at the Intersection of Artificial Intelligence and Self-Regulated Learning A call for increased theoretical grounding focus on motivation and diversifying context https://www.researchgate.net/publication/382870027  Students perspectives on AI in higher education Project website: https://aiinhe.org  Survey highlights: https://aiinhe.org/wp-content/uploads/2024/10/aiinhe_surveyinsights.pdf  Guidance for students: https://itali.uq.edu.au/files/31707/how-students-use-ai-guide-students.pdf  Guidance for academics: https://itali.uq.edu.au/files/31702/How-students-talk-about- gen-ai-guide-academics.pdf    

Series 10, Episode 3 This week's episode is an interview with Dr Anna Denejkina, who's an interdisciplinary researcher and Associate Director at The Insight Centre. We discuss her research on youth engagement with generative AI. The conversation explores the multifaceted impact of AI technology in education, addressing benefits such as upskilling and accessibility, as well as concerns related to academic misconduct, job displacement, and misinformation. Key themes include gender disparity in confidence using AI, the importance of critical and empathetic thinking, and the evolving landscape of education assessments. The dialogue also highlights issues of loneliness, anxiety, and the growing equity gap driven by differences in AI adoption across various educational institutions. Anna talks about her previous research on Young People's Perception and Use of Generative AI, which is a collaboration between The Insight Centre and YouthInsight. Here's a good summary article at The Research Society, and the full research here We also mentioned the STEM tracker research, which is published by the Dept of Industry here You can find all of Anna's research publications here

This week we cover a range of AI in Education related news and academic research papers. Here's all the links you need to read more about each of the topics we dicussed: News Australia's Voluntary AI Safety Standard In September the Australian Government published: Voluntary AI Safety Standard (68pg): https://www.industry.gov.au/publications/voluntary-ai-safety-standard Proposals paper for introducing mandatory guardrails for AI in high-risk settings: https://consult.industry.gov.au/ai-mandatory-guardrails Stanford's STORM https://storm.genie.stanford.edu/ Students give English HSC exam an F over use of image with ‘hallmarks' of AI https://www.theguardian.com/australia-news/2024/oct/16/nsw-hsc-english-exams-2024-ai-image-paper-1 Investigation into the use of ChatGPT by a Child Protection worker - Office of the Victorian Information Commissioner https://ovic.vic.gov.au/regulatory-action/investigation-into-the-use-of-chatgpt-by-a-child-protection-worker/   Research Papers To what extent is ChatGPT useful for language teacher lesson plan creation? https://arxiv.org/abs/2407.09974 Have We Reached AGI? Comparing ChatGPT, Claude, and Gemini to Human Literacy and Education Benchmarks https://arxiv.org/abs/2407.09573 The Life Cycle of Large Language Models: A Review of Biases in Education https://arxiv.org/abs/2407.11203 The Future of Learning: Large Language Models through the Lens of Students https://arxiv.org/abs/2407.12723 How to Mitigate the Dependencies of ChatGPT-4o in Engineering Education https://arxiv.org/abs/2407.12693 StuGPTViz: A Visual Analytics Approach to Understand Student-ChatGPT Interactions https://arxiv.org/abs/2407.12423 Apostles, Agnostics and Atheists: Engagement with Generative AI by Australian University Staff https://eprints.qut.edu.au/252079/  

Welcome to the first Episode of Series 10, where we are going to take some time to review some of the fundamental changes we're going to be seeing as AI becomes more pervasive.  In this Episode we're taking a different approach, with Dan and Ray using Google's NotebookLM to create AI-delivered mini-podcasts about each other, which leads to a discussion about the backgrounds of both hosts, and a discussion about how this new AI might be used in education. Obviously, both Dan and Ray conclude that AI won't replace them...yet! For your own experiments, you can find NotebookLM at https://notebooklm.google.com/ The two mini podcasts in this episode were produced by simply feeding NoteBookLM with the hosts LinkedIn profiles (in PDF format - available as a download from any individual's LinkedIn page). We'd love to hear how you're using NotebookLM, and other AI tech, in your work. The easiest way to get hold of us is via our LinkedIn page https://www.linkedin.com/company/ai-in-education-podcast/ And if you're enjoying the podcast, would now be a good time to leave a review in your podcast app - whether you're using Apple Podcasts, Google Podcasts or Spotify, we'd love it if you left a rating and review.

This week we're joined by the brains behind South Australia's EdChat chatbot. It was the first state in Australia to start pilot a custom built generative AI chatbot for their schools, and we spent some time with the team to understand the success story. In the podcast, we heard from Simon Chapman (Director of Digital Architecture and Operations) and Cody Little (AI Technical specialist), both from the Department for Education South Australia Find out more about the South Australia Department AI approach: Artificial intelligence (AI) in schools – information for parents and carers (education.sa.gov.au) and details on their trial - Nation-leading trial in SA schools to focus on the safe use of AI (education.sa.gov.au) Microsoft have written a case study on their News Centre here: Learning in the AI era: How South Australia's Department for Education is empowering students and teachers with AI in the classroom - Microsoft Australia News Centre Video of their amazing work: Department for Education South Australia | Reimagine Education 2024 9 News report : Artificial intelligence set to shake-up South Australian high schools (9news.com.au) AI Safety - AI content safety Towards the end of the episode we also talked about Career chat: SA Career Chat

Unbelievably, it's our 5th Anniversary (AI-nniversary?) and to mark the milestone of an AI podcast that's had more pivots than a robot's legs, and more chat than a chatbot, we've pulled together some of the top episodes from the 108 episodes of the podcast so far, and got the band back together (regretfully, we were unable to persuade Beth Worral, who co-hosted in 2022-2023, to come back for our party podcast - she'd reached escape velocity), so you'll hear Dan, Ray and Lee reminiscing like old men in a shed. Great Guests & Top Episodes Our very first guest - Microsoft's Troy Waller in AI for Accessibility in 2019 Our most listened episode from 2019 and very first external guest - the brilliant Dr David Kellerman in Using AI to personalise learning at UNSW Sydney Our top 2020 episode was A Brief History of AI, which looked backin to the human obsession with creating artificial replicas of themselves. When did it start, who started it, what is the AI winter and how did it accelerate so quickly in the last 10 years. (And even faster in the last 4 years since?) In 2021, another great guest topped our episode charts, with Feel the force: Emerge to the future with Sly Lee as Sly talked about his work around VR and AR and the mergeing of physical and virtual worlds For 2022, it was the Christmas edition that hit the heights, with all four co-hosts - Beth, Lee, Dan & Ray - together for the quizzically named Christmas, Infinite Monkeys and everything By 2023, we were back on solid pedagogy again, with the episode AI - The fuel that drives insight in K12 with Travis Smith (the kind of title a marketing manager would love?) And, although we've not yet reached the end of 2024 and we've got some great episodes ahead, the top episode this far is University of Sydney and the future of assessment with Danny Liu and Adam Bridgman We also had fond memories of: The AI in Popular Culture episode from 2020 Martin O'Sullivan's tales from Turing House School in From AI Detectors to Heartwarming Help: Two Tales of AI in a school Elle Graham (aka Woodes) in Music, Creativity and Minecraft with Woodes Practical lessons from chatbot land with The Search for the Education Holy Grail in NSW, with the stories shared by Dan Hart and Michelle Michael 

News This week's news we rushed through includes "Study Buddy or Influencer?", the Australian Parliamentary Inquiry into the use of Gen AI in the Australia Education System  https://www.aph.gov.au/Parliamentary_Business/Committees/House/Employment_Education_and_Training/AIineducation/Report NSW EduChat has been extended for all teachers in all New South Wales Schools - https://www.innovationaus.com/nsw-teachers-to-get-time-saving-genai-tool/ Learn more about the NSW EduChat chatbot in the first episode of Series 9 Microsoft announced Copilot Wave 2 https://www.microsoft.com/en-us/microsoft-365/blog/2024/09/16/microsoft-365-copilot-wave-2-pages-python-in-excel-and-agents/ OpenAI's new model o1-preview came out - and it's much, much better and logical reasoning and maths Find out what people think by looking at what Ethan Mollick is saying about it (and, as I suggest on the podcast, keenly watch Dan Hart's posts as he's benchmarking it now in the context of EduChat) Google released a podcast-generator as part of NotebookLM, which turns any kind of paper/book etc into a short podcast. To find out what it's like I gave it the top research paper from the podcast last time and you can compare it versus me! There's a quick demo review by Ethan here and you can login and have a play directly here: https://notebooklm.google.com/ (it has two main uses, because on top of this autopodcast, it's original purpose was to allow you give it a pile of documents and it can work with all of them at the same time for q&a, summaries etc)   Research Here's the links to all nine papers we discussed in this week's episode: Generative AI in Real-World Workplaces https://www.microsoft.com/en-us/research/uploads/prodnew/2024/07/Generative-AI-in-Real-World-Workplaces.pdf  Can Large Language Models Make the Grade? https://dl.acm.org/doi/10.1145/3657604.3664693 PlagBench: Exploring the Duality of Large Language Models in Plagiarism Generation and Detection https://arxiv.org/abs/2406.16288  The global landscape of academic guidelines for generative AI and Large Language Models https://arxiv.org/abs/2406.18842  "Is ChatGPT a Better Explainer than My Professor?": Evaluating the Explanation Capabilities of LLMs in Conversation Compared to a Human Baseline  https://arxiv.org/abs/2406.18512 Perceived Impact of Generative AI on Assessments: Comparing Educator and Student Perspectives in Australia, Cyprus, and the United States https://www.sciencedirect.com/science/article/pii/S2666920X24000729 Jill Watson: Scaling and Deploying an AI Conversational Agent in Online Classrooms https://dilab.gatech.edu/publications/jill-watson-scaling-and-deploying-an-ai-conversational-agent-in-online-classrooms/  https://dilab.gatech.edu/test/wp-content/uploads/2024/05/ITS2024_JillWatson_paper.pdf Integrating AI in College Education: Positive yet Mixed Experiences with ChatGPT https://arxiv.org/abs/2407.05810 The AI Companion in Education: Analyzing the Pedagogical Potential of ChatGPT in Computer Science and Engineering https://arxiv.org/abs/2407.05205    

This week's guest is Professor Phillip Dawson, who is Co-Director of the Centre for Research in Assessment and Digital Learning at Deakin University in Australia. In addition to Phill's website, we recommend following Phill on LinkedIn, or Twitter, where shares a lot of his work on the future of assessment, and also his passion project - The Peer Revue - where Phill combines his passion for academic research with his work in Improv Comedy. Every month he hosts a research who talks about their professional research, which is then turned into comedy gold by his improv team at The Improv Conspirancy Theatre (highly recommend keeping an eye out for this if you're in Melbourne) You can find Phill's research papers here on Google Scholar, and his LinkedIn feed has his books and his contributions to other advice and consultations in the education sector Phil mentions a number of researchers and their work in the podcast. Here's the links: James Reason's work on the Swiss Cheese model for failure of complex systems "The contribution of latent human failures to the breakdown of complex systems" You can either read the original research paper or this easier to grasp Wikipedia article "The Swiss Cheese Mode" Kiata Rundle's work on then applying this to academic integrity - you can find all of her papers on Google Scholar Alfie Kohn "Punished by Rewards" - https://www.mv.helsinki.fi/home/hotulain/Punished.pdf Phill mentioned Deci & Ryan's work, so here's a good place to start reading on Self-Determination Theory And here's a starting point if you need it for reading about Vygotsky's Zone of Proximal Development Then Phill mentioned the book Thanks for the Feedback, but Stone & Heen, which is on Amazon here  

Series 9, Episode 9 - Homework and Sex   News How do people actually use ChatGPT? How do people use ChatGPT? We analyzed real AI chatbot conversations - The Washington Post   Make AI tools to reduce teacher workloads, tech companies urged https://www.theguardian.com/education/article/2024/aug/28/make-ai-tools-to-reduce-teacher-workloads-tech-companies-urged     New AI in Teams - and it's all free https://www.linkedin.com/posts/miketholfsen_ai-edtech-microsoftteams-activity-7236817645625335809-08OC https://aka.ms/TeamsEDUAIQuickGuide   Research Papers   Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Course https://arxiv.org/abs/2407.05216   Supporting Self-Reflection at Scale with Large Language Models: Insights from Randomized Field Experiments in Classrooms https://arxiv.org/abs/2406.07571    Evaluating ChatGPT-4 Vision on Brazil's National Undergraduate Computer Science Exam https://arxiv.org/abs/2406.09671    Generative AI Can Harm Learning https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4895486   ChatGPT, Copilot, Gemini, SciSpace and Wolfram versus higher education assessments: an updated multi-institutional study of the academic integrity impacts of Generative Artificial Intelligence (GenAI) on assessment, teaching and learning in engineering https://www.tandfonline.com/doi/epdf/10.1080/22054952.2024.2372154   How critically can an AI think? A framework for evaluating the quality of thinking of generative artificial intelligence https://arxiv.org/abs/2406.14769   Analyzing Large Language Models for Classroom Discussion Assessment https://arxiv.org/abs/2406.08680    Student Perspectives on Using a Large Language Model (LLM) for an Assignment on Professional Ethics https://arxiv.org/abs/2406.11858    ChatGPT as Research Scientist: Probing GPT's Capabilities as a Research Librarian, Research Ethicist, Data Generator and Data Predictor https://arxiv.org/abs/2406.14765    70B-parameter large language models in Japanese medical question-answering https://arxiv.org/abs/2406.14882    I don't trust you (anymore)! -- The effect of students' LLM use on Lecturer-Student-Trust in Higher Education https://arxiv.org/abs/2406.14871    Large Language Models in Student Assessment: Comparing ChatGPT and Human Graders https://arxiv.org/abs/2406.16510 

This week we hear from Professor Rose Luckin, from University College London and Educate Ventures Research  In the podcast, Rose mentioned the 1% project in Finland from 2020 - here's some reporting on it  Through Educate Ventures Research there are a range of AI consultancy and training services for schools, including the AI Readiness Online Course for teachers Rose also has a monthy newsletter "The Skinny on AI for Education" which has an extensive reading list every edition, on a number of AI topics, not just what's happening in education.

News   TEQSA's new paper on Academic Integrity & AI The evolving risk to academic integrity posed by generative artificial intelligence: Options for immediate action https://www.teqsa.gov.au/sites/default/files/2024-08/evolving-risk-to-academic-integrity-posed-by-generative-artificial-intelligence.pdf   State of Generative AI in the Enterprise: An Australian Perspective https://www.deloitte.com/au/en/services/consulting/analysis/state-generative-ai-enterprise.html     Research   A review on the use of large language models as virtual tutors https://arxiv.org/abs/2405.11983   Jill Watson: A Virtual Teaching Assistant powered by ChatGPT https://arxiv.org/abs/2405.11070   An empirical study to understand how students use ChatGPT for writing essays and how it affects their ownership https://arxiv.org/abs/2405.13890   Intelligent Tutor: Leveraging ChatGPT and Microsoft Copilot Studio to Deliver a Generative AI Student Support and Feedback System within Teams https://arxiv.org/abs/2405.13024   Large Language Models as Partners in Student Essay Evaluation https://arxiv.org/abs/2405.18632   Grade Like a Human: Rethinking Automated Assessment with Large Language Models https://arxiv.org/abs/2405.19694    Designing Prompt Analytics Dashboards to Analyze Student-ChatGPT Interactions in EFL Writing https://arxiv.org/abs/2405.19691    Experiences from Integrating Large Language Model Chatbots into the Classroom https://arxiv.org/abs/2406.04817    Delving into ChatGPT usage in academic writing through excess vocabulary https://arxiv.org/abs/2406.07016    Understanding Students' Acceptance of ChatGPT as a Translation Tool: A UTAUT Model Analysis https://arxiv.org/abs/2406.06254 

BONUS EPISODE ! We'd love to meet more of our listeners in person, so here's a list of events over the next few weeks when Dan, Ray, or Dan and Ray are speaking about AI in Education. One of the things that makes the podcast special is the amazing stories we get from our guests, and there's more stories than fit into an episode, and we're always on the lookout for more. So come and say hi at any of these events, and per   haps we can share an untold story, or you can tell us yours! August  19 August - Melbourne - Ray Melbourne EdTech Summit Ray's on the panel discussing "The Transformed Learning Landscape Through AI" at this event for edtech companies and universities 21 August - Sydney - Ray - Free event The Future of Human AI - IATD If you're in Sydney, the Institute of Applied Technology has scheduled the perfect event on Wednesday evening (starting at 6PM). Ray's hosting the free learning session "The Future of Human AI", designed for the thousands of small businesses and employees around Western Sydney who want to make sense of the AI hype and start to understand what everybody else is talking about. If you're a teacher, you'll also walk away with some good ideas of how businesses are using AI to help with your discussion of AI in the classroom   23 August - Sydney - Dan AI in Education Conference | Teaching Tomorrow: Harnessing AI Tools Today Organised by friends of the podcast Matt Esterman and Nick Jackson at WSU's Parramatta campus, it'll be a festival of ideas from a great lineup of teachers. Dan's one of the speakers, and will be wearing his Microsoft badge on the day, talking about all the latest great tech announcements from that world.   September 3 September - Online - Dan - Free event Build a Bot in Copilot Studio Doing his day job, Dan's taking part in this online workshop designed to help Microsoft Copilot users build their own bot. Like Build a Bear workshop, but with less bear and more bot. Open to any Microsoft customers in Australia and New Zealand.   4 September - Christchurch, NZ - Ray NZ Tertiary ICT Conference For New Zealand listeners Ray's heading over the ditch to deliver a keynote called "AI, why?" at the annual conference for digital teams of universities and polytechnics. If you're going to be there, please say Hi!   12-13 September - Adelaide - Ray HE FEST 24 Ray's taking part in the "Marketing, Recruitment, Advancement and AI in Higher Education Conference" in Adelaide. Ray's on a panel discussion "The place of AI in university " with Eddie Major, on applications of AI beyond teaching and learning, and then delivering the closing keynote, grandly titled "The future of HE - The future of higher education in a world where gen AI is ubiquitous"   16-19 September - Online - Dan and Ray - Free event Toddle's AI for AussieEd online event  The toddle team have pulled together 20 speakers from across Australia, who will be talking about assessment, LMSs, chatbots, the AI Framework for schools, leadership and data-driven learning. And tacked on right at the end of the run, at 5:15 on the 19th, we're going to have a crack at a live podcast recording  

In this episode of the AI in Education podcast, hosts Dan and Ray welcome Amanda Bickerstaff, an experienced educator, keynote speaker, researcher, and founder of AI for Education. Amanda shares her journey from traditional teaching to embracing AI during her time in Australia and the US. She explains the transformative potential of generative AI in creating rubrics and personalizing learning while highlighting the current limitations and necessary steps toward adoption. Amanda advocates for building AI literacy, addressing teacher fears and misconceptions, and embracing creativity. The discussion also explores the future of AI in education, particularly in personalised tutoring, and the importance of understanding biases and data privacy. Amanda emphasises meeting educators where they are and the potential of AI in saving time and enhancing teaching practices. Amanda's LinkedIn Profile: Amanda Bickerstaff | LinkedIn AI for Education site: AI for Education AI prompt library: Prompt Library  Webinar archive: AI Webinars for Educators Free resources for teachers: Downloadable Resources 00:00 Guest Introduction: Amanda Bickerstaff 01:17 Amanda's Background and Journey 02:53 The Role of AI in Education 04:56 Challenges and Misconceptions in AI Adoption 06:05 Building AI Literacy and Addressing Fears 12:51 The Future of Personalised Learning 22:13 Exciting Developments and Final Thoughts 30:29 Conclusion and Closing Remarks

Holy smokes, we missed the party that should have been Episode 100! So now we're going to have a belated party episode later. Oh well, this week's episode is not to be stopped, so yet again Dan and Ray discuss the most interesting research on the use of AI in Education from the recent publications. But before that we started with a quick news summary. All the links are here: News California's proposed law against AI replacing human professors https://www.universityworldnews.com/post.php?story=20240702214317879   Animated AI Teaching Assistants Coming to Morehouse https://www.insidehighered.com/news/tech-innovation/artificial-intelligence/2024/07/09/animated-ai-tas-are-coming-morehouse   Khanmigo for all! https://x.com/khanacademy/status/1813665014911316237 Sign up for Khanmigo for Teachers in English: blog.khanacademy.org/khanmigo-world   Open AI https://techcrunch.com/2024/08/07/this-week-in-ai-openais-talent-retention-woes/ Research Papers SUMMATIVE EXAMS WITH THE USE OF CHATGPT: VISION OR REALISTIC ALTERNATIVE TO TRADITIONAL EXAMS? https://library.iated.org/view/BAUME2024SUM Note that this paper is one of the few that I'll flag that's behind a journal paywall. If you don't have access, I'd suggest asking the author, Matthias Baume from TUM, if he's happy to share a copy     The great detectives: humans versus AI detectors in catching large language model-generated medical writing https://edintegrity.biomedcentral.com/articles/10.1007/s40979-024-00155-6 Jae Q. J. Liu, Kelvin T. K. Hui, Fadi Al Zoubi, Zing Z. X. Zhou, Curtis C. H. Yu, Jeremy R. Chang, Arnold Y. L. Wong - The Hong Kong Polytechnic University Dino Samartzis, Rush University Medical Center     Leveraging Large Language Model as Simulated Patients for Clinical Education https://arxiv.org/abs/2404.13066 Yanzeng Li1 , Cheng Zeng2,3 , Jialun Zhong1 , Ruoyu Zhang1 , Minhao Zhang1 , Lei Zou1∗ 1Wangxuan Institute of Computer Technology, Peking University 2School of Computer Science, Wuhan University. 3CureFun Co.     Automated Assessment of Encouragement and Warmth in Classrooms Leveraging Multimodal Emotional Features and ChatGPT https://arxiv.org/abs/2404.15310     "ChatGPT Is Here to Help, Not to Replace Anybody" -- An Evaluation of Students' Opinions On Integrating ChatGPT In CS Courses https://arxiv.org/abs/2404.17443 Bruno Pereira Cipriano and Pedro Alves Lusofona University, COPELABS, Lisbon, Portugal     Math Multiple Choice Question Generation via Human-Large Language Model Collaboration https://arxiv.org/abs/2405.00864 Jaewook Lee, Andrew Lan - University of Massachusetts Amherst Digory Smith, Simon Woodhead -  Eedi     ChatGPT in Data Visualization Education: A Student Perspective https://arxiv.org/abs/2405.00748 Nam Wook Kim, Grace Myers - Boston College; Hyung-Kwon Ko - KAIST; Benjamin Bach - INRIA     A Careful Examination of Large Language Model Performance on Grade School Arithmetic https://arxiv.org/abs/2405.00332     Automated Generation of High-Quality Medical Simulation Scenarios Through Integration of Semi-Structured Data and Large Language Models https://arxiv.org/abs/2404.19713 Scott Sumpter CHSOS, Canadian Surgical Technology and Advanced Robotics, London Health Sciences Centre     Outsmarting Artificial Intelligence in the Classroom—Incorporating Large Language Model-Based Chatbots into Teaching https://publications.aaahq.org/iae/article/doi/10.2308/ISSUES-2023-064/12560 Juliane Wutzler, Worms University of Applied Sciences     University Students' Self-Reported Reliance on ChatGPT for Learning: a Latent Profile Analysis https://www.sciencedirect.com/science/article/pii/S2666920X24000468 Ana Stojanov, Qian Liu , Joyce Hwee Ling Koh - University of Otage  

This episode of the AI in Education podcast features an interview with Anthony England, the Director of Innovative Learning Technologies at Pymble Ladies College in Sydney. Anthony, known for his impressive shirt collection and his kind-hearted approach to education, shares his insights on the challenges and opportunities presented by AI in assessment and personalisation of the learning experience for students. Anthony shares his vision for AI-driven personalised tutors, and how AI can assist in providing contextual and personalised feedback to students. We also cover the role of AI in helping teachers manage their workload and provide timely feedback. When we get onto the community of learning, we hear about Anthony's AI-driven agenda to better connect with parents, and bringing them into the community of learning - they become engaged rather than merely recipients of messages. Anthony talked about some of the events where he's a speaker, and the next ones to look out for him at are: EduTech Expo, in Melbourne on 14th AugustThe Educator to Entrepreneur pipeline: Making your idea a solution The AI in Education Conference, at Western Sydney University on 23rd AugustAI in Education Conference | Teaching Tomorrow: Harnessing AI Tools Today    

In this episode Dan and Ray speak to Michelle Michael and Dan Hart from the New South Wales Department of Education about their world leading trial of AI, called NSWEduChat.    Michelle is the NSW Department of Education Director: Education Support, Rural Initiatives and Gen AI. Her LinkedIn profile is here.   Dan is the Head of AI at the NSW DoE. His LinkedIn profile is here   Some of the resources that the team talked about in the episode are below:   NSWEduChat landing page: NSWEduChat   NSW Department of Education: AI in Education - Artificial intelligence in education (nsw.gov.au)   NSW Department of Education: Guidelines regarding the use of generative AI: Guidelines regarding the use of generative AI (nsw.gov.au)   Safeguard personal information: Manage personal information effectively and de-identify it to protect privacy.   Techniques for de-identification: Use data anonymization and masking to remove or alter personal information.   Verify and edit AI content: Ensure accuracy and suitability of AI-generated content, aligning with ethical principles, teaching standards and quality teaching.   Stay up-to-date with training: Attend training and professional learning on cybersecurity, data breach response, and child protection.   Use effective prompting: Create clear and specific prompts to improve the quality and relevance of AI-generated output.   Future Frontiers - Education for an AI world: e-book: Future Frontiers e-book   NSW DoE Future Frontiers landing page: Education for a Changing World

From AI Detectors to Heartwarming Help: Two Tales of AI in a school Series 8 Episode 11  In this episode of the AI in Education podcast, hosts Ray Fleming and Dan Bowen interview Martin O'Sullivan, a UK headteacher and lifelong friend of Dan. They talk about two contrasting stories from Martin's school—one highlighting the frustration in the application of AI when students were accused of cheating, and the other illustrating the compassionate use of AI to help a student undergoing cancer treatment participate in classes remotely via an AI-enabled robot. The discussion emphasises the complexities and ethical considerations of integrating AI in education.  00:00 Introduction  02:32 Martin's Background and School  03:50 AI in Education: Martin's Journey 05:59 Challenges with AI Detectors 09:23 Emotional Impact on Students 11:45 Reflections on AI in Assessment We discussed two assessment topics that have been in previous episodes: Sydney University's approach to assessment with Lane 1 and Lane 2 assessments - in Series 8 Episode 2 The AI Assessment Scale research - in Series 8 Episode 7 22:34 Heartwarming Story: AI Robot for Student There's more reporting on this story on the BBC website 27:10 Conclusion and Final Thoughts

Another episode rounding up the latest news and research on AI in Education. The links below go straight to all the news stories and research papers discussed this week   NEWS Victorian "Generative Artificial Intelligence Policy" for government schools. https://www2.education.vic.gov.au/pal/generative-artificial-intelligence/policy   Meeting the AI Skills Boom https://techcouncil.com.au/wp-content/uploads/Meeting-the-AI-Skills-Boom-2024.v2.pdf   LAUSD shelves its hyped AI chatbot to help students after collapse of firm that made it https://www.latimes.com/california/story/2024-07-03/lausds-highly-touted-ai-chatbot-to-help-students-fails-to-deliver   A class above: UNSW Sydney uses AI to power personalised paths to student success https://news.microsoft.com/en-au/features/a-class-above-unsw-sydney-uses-ai-to-power-personalised-paths-to-student-success/     Research Detecting ChatGPT-Generated Essays in a Large-Scale Writing Assessment: Is There a Bias Against Non-Native English Speakers? https://www.sciencedirect.com/science/article/abs/pii/S0360131524000848#bib23   GenAI Detection Tools, Adversarial Techniques and Implications for Inclusivity in Higher Education https://arxiv.org/abs/2403.19148   Avoiding embarrassment online: Response to and inferences about chatbots when purchases activate self-presentation concerns https://myscp.onlinelibrary.wiley.com/doi/10.1002/jcpy.1414   Navigating the Ethical Landscape of Multimodal Learning Analytics: A Guiding Framework https://osf.io/preprints/edarxiv/adxuq   How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responses https://arxiv.org/pdf/2405.00970   AI Conversational Agent Design for Supporting Learning and Well-Being of University Students https://osf.io/preprints/edarxiv/w4rtf   The Neglected 15%: Positive Effects of Hybrid Human-AI Tutoring Among Students with Disabilities https://osf.io/preprints/edarxiv/y52ew   The GPT Surprise: Offering Large Language Model Chat in a Massive Coding Class Reduced Engagement but Increased Adopters Exam Performances https://osf.io/preprints/osf/qy8zd   The Future of Feedback: Integrating Peer and Generative AI Reviews to Support Student Work https://osf.io/preprints/edarxiv/x3dct   Is ChatGPT Transforming Academics' Writing Style? https://arxiv.org/abs/2404.08627   Can AI Provide Useful Holistic Essay Scoring? https://osf.io/preprints/osf/7xpre Read the excellent article about this paper in the Heching Report   Best Practices for Using AI When Writing Scientific Manuscripts https://pubs.acs.org/doi/epdf/10.1021/acsnano.3c01544   A real-world test of artificial intelligence infiltration of a university examinations system: A “Turing Test” case study https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0305354

Continuing our Series 8, focused on the topic of assessment, and the impact of AI, roving reporter Ray visits Fitzroy, Victoria, to interview Dan Ingvarson, a notable founder and executive consultant in the field of AI in education, whilst co-host Dan (Welsh Dan?) joins remotely. Dan (Ingvarson) discusses his background and extensive work in AI policy and education technology, touching upon his involvement in various global initiatives including the Edsafe Alliance and Educational Services Australia. The conversation looks into the complexities of modern educational assessment, focusing on how generative AI can transform traditional assessment practices. He highlights the obstacles teachers face with current assessment methods and how AI could help alleviate some of these challenges by offering more personalised and authentic evaluations. The podcast also touches on the potential for AI to support teachers in creating effective rubrics and improving the overall quality of education through better data analytics. Ray and (Welsh) Dan emphasise the importance of evolving curricula to incorporate these advanced AI methodologies while discussing broader implications for student learning and teacher workload.   00:00 Introduction and Welcome 00:47 Meet Dan Ingvarsson: AI Guru 02:26 The Evolution of AI in Education 03:46 Deep Dive into Assessment 06:46 Challenges and Opportunities in AI-Assisted Assessment 19:21 Ensuring Authenticity in Student Work 23:28 Future of AI in Education 31:31 Practical Tips for Teachers 33:47 Conclusion and Final Thoughts

Content warning! This episode talks about an academic research paper titled "ChatGPT is bulls**t", and we've not edited the word out - in fact, we've gone to town with it, talking about the different types of it (in the strictest academic sense). So you may not want to play this in the car on your school run! The news item discussed is: Student crafts elaborate AI scheme to pass university exam, gets arrested https://cybernews.com/news/turkish-student-found-using-ai-arrested/   This week's papers discussed are: Developing evaluative judgement for a time of generative artificial intelligence https://www.tandfonline.com/doi/full/10.1080/02602938.2024.2335321   Prompting Large Language Models for Zero-shot Essay Scoring via Multi-trait Specialization https://arxiv.org/abs/2404.04941   Working Alongside, Not Against, AI Writing Tools in the Composition Classroom: a Dialectical Retrospective https://uen.pressbooks.pub/teachingandgenerativeai/chapter/working-alongside-not-against-ai-writing-tools-in-the-composition-classroom-a-dialectical-retrospective/   GPT versus Resident Physicians — A Benchmark Based on Official Board Scores https://ai.nejm.org/doi/pdf/10.1056/AIdbp2300192   Evaluating General Vision-Language Models for Clinical Medicine https://www.medrxiv.org/content/10.1101/2024.04.12.24305744v1   Re-evaluating GPT-4's bar exam performance https://link.springer.com/article/10.1007/s10506-024-09396-9   Automated Social Science: Language Models as Scientist and Subjects https://arxiv.org/abs/2404.11794   Large language models cannot replace human participants because they cannot portray identity groups https://arxiv.org/abs/2402.01908   The impact of large language models on university students' literacy development https://www.tandfonline.com/doi/epdf/10.1080/07294360.2024.2332259?needAccess=true   Do teachers spot AI? Evaluating the detectability of AI-generated texts among student essays https://www.sciencedirect.com/science/article/pii/S2666920X24000109   Feedback sources in essay writing: peer-generated or AI-generated feedback? https://link.springer.com/article/10.1186/s41239-024-00455-4   ChatGPT is bullshit https://link.springer.com/epdf/10.1007/s10676-024-09775-5?sharing_token=0CIhP_zo5-plierRq8kkDPe4RwlQNchNByi7wbcMAY77xTOWyddkW01qGFs1m5zuuoZGBctVlsJF8SbYqcxWi-XzgEYEPiw7xwWi4bMYXJ_1JARDrER9JGdWZOW-UGSkrk_tXPjPh-XWvFNoiFzNlnDUUUEBAztiX9PtP2p6jfI%3D

Wow, this week we have a bumper episode with more resources than a GPT factory!  Any time we get a guest making their second appearance, and therefore enter our Hall of Fame, then we officially dub them "Friend of the Show". And so this week, we've got Friend of the Show Leon Furze sharing his experiences and expertise.   Here are the links and posts related to our conversation with Leon around assessment.     Leon's blog - for all the updates and posts that he is working on  https://leonfurze.com/blog    Leons's free e-Book on assessment can be found here: https://mailchi.mp/leonfurze/assessment (free ebook on assessment)   Leon Furze Linkedin profile is here if you want to follow his stream of thoughts, and to connect with him: Leon Furze - Furze Smith Consulting | LinkedIn   The Artificial Intelligence Assessment Scale (AIAS) paper we discussed can be found here:  https://open-publishing.org/journals/index.php/jutlp/article/view/810    The online course around practical AI strategies: https://practicalaistrategies.com/p/practical-ai-strategies  And, even better, he's given listeners a discount code that will save you 25% of the cost. Just use the magic word 'AIPODCAST'   The blog post we mentioned a couple of times during the episode: https://leonfurze.com/2024/05/27/dont-use-genai-to-grade-student-work/   Leons new book and course can be also found on his main site here: https://practicalaistrategies.com/

This week we set the episode timer for 15 minutes, and managed to get through just five papers before the buzzer went off! So we have plenty more papers to discuss in future episodes... ENHANCING K-12 STUDENTS' PERFORMANCE IN CHEMISTRY THROUGH CHATGPT-POWERED BLENDED LEARNING IN THE EDUCATION 4.0 ERA https://library.iated.org/view/ORTIZDEZARATE2024ENH   Empowering student self-regulated learning and science education through ChatGPT: A pioneering pilot study https://bera-journals.onlinelibrary.wiley.com/doi/pdfdirect/10.1111/bjet.13454   ChatGPT “contamination”: estimating the prevalence of LLMs in the scholarly literature https://arxiv.org/abs/2403.16887   Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews https://arxiv.org/abs/2403.07183   Large language models are able to downplay their cognitive abilities to fit the persona they simulate https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0298522  

Assessment - Chris Goodall In this episode of the AI Education Podcast, host Dan converses with Chris Goodall, the head of digital education at the Bourne Education Trust in England. They discuss the integration of AI into education, how it can be used to enhance teaching and learning processes, and the impact of personalized AI tools on students and educators. The conversation covers practical applications of AI, the ongoing need for teacher and student adaptation to new technologies, as well as ethical considerations and future possibilities for AI in education. Chris Goodalls Linkedin profile here: Chris Goodall | LinkedIn Practical Advice for embedding IT in school: Embedding AI use in school 

Research Update - 31st May 2024 Honestly folks, we've been trying to keep. We really have. But we have so much great content in the fortnightly (or is it bi-weekly?) interviews, that we've had to bite the bullet and switch to weekly podcasts, so that we can still fit in the Research Updates! Going forwards you'll get a longer interview-style podcast once every two weeks, and a shorter 15-20 minute "Research Update" podcast every two weeks. Filling your Fridays with AI in Education podcast joy! Here's the links to all the research papers discussed this week: Remote Proctoring: Understanding the Debate https://link.springer.com/referenceworkentry/10.1007/978-3-031-54144-5_150#DOI   Large language model-powered chatbots for internationalizing student support in higher education https://arxiv.org/abs/2403.14702   ChatGPT in Veterinary Medicine: A Practical Guidance of Generative Artificial Intelligence in Clinics, Education, and Research https://arxiv.org/abs/2403.14654   Investigation of the effectiveness of applying ChatGPT in Dialogic Teaching Using Electroencephalography https://arxiv.org/abs/2403.16687   An Exploratory Study on Upper-Level Computing Students' Use of Large Language Models as Tools in a Semester-Long Project https://arxiv.org/abs/2403.18679   An MIT Exploration of Generative AI https://mit-genai.pubpub.org/ MIT - Massachusetts Institute of Technology - have just published a series of really interesting papers about the impact of generative AI on  a number of industries, and dive into the implications for society, education, human interaction and other areas. I actually think the whole set are interesting - and they're really easy to get - you can read them on the web, or get a PDF, an ebook, or even an audio book of every one!   We talked about the 3 education ones: When Disruptive Innovations Drive Educational Transformation: Literacy, Pocket Calculator, Google Translate, ChatGPT https://mit-genai.pubpub.org/pub/6chtnd56/release/3?readingCollection=0e231e9c   Generative AI and K-12 Education: An MIT Perspective https://mit-genai.pubpub.org/pub/4k9msp17/release/1?readingCollection=0e231e9c   Generative AI and Creative Learning: Concerns, Opportunities, and Choices https://mit-genai.pubpub.org/pub/gj6eod3e/release/2?readingCollection=0e231e9c  

This week we continue our series on Assessment and AI. Ray talks with Jason Lodge from The University of Queensland, and who must have the longest business card in Australia, as he's Associate Professor of Educational Psychology in School of Education and Deputy Associate Dean in the Faculty of Humanities, Arts and Social Sciences!   The conversation talks about the challenges of assessment, and the options for rethinking assessment - and then we go deeper into Jason's views on the future of learning and assessment.   Jason's a great guest to share his experiences, as during 2023 he was on the TEQSA group of experts that came together to produce a report on assessment for Australian universities, Assessment reform for the age of artificial intelligence https://www.teqsa.gov.au/guides-resources/resources/corporate-publications/assessment-reform-age-artificial-intelligence   Working on policy and guidance in an area where technology is developing so rapidly - and students are racing ahead of institutions, was interesting and Jason talks about the group dynamic. One of the interesting notes he talks about is the mindset: "The mantra we kept returning to is that we weren't trying to develop a map, but a compass. This is the direction we think we might need to head here."

AI and the Future of Assessment: Transforming Educational Practices Episode Overview: In this episode of the AI Education Podcast, hosts Dan and Ray, alongside guests Adam Bridgman and Danny Liu, dive into the evolving landscape of academic assessment in the age of artificial intelligence. Recorded in the University of Sydney's own studios, this discussion explores the significant shifts in assessment strategies and the integration of AI in educational settings. Guest Introductions: Professor Adam Bridgeman: Pro Vice Chancellor Educational Innovation at the University of Sydney - focused on enhancing teaching quality across the university. [University bio] Professor Danny Liu: Professor of Educational Technologies - dedicated to empowering educators to improve their teaching methods through innovative technologies. [University page - LinkedIn page] Key Topics Discussed: The Persistence of Traditional Assessment Models: Despite the push to digital platforms during the COVID-19 pandemic, traditional assessment methods have largely remained unchanged, continuing the practice of replicating physical exam environments online. AI's Role in Rethinking Assessment: The guests discuss how AI challenges the conventional reasons for assessments, advocating for a paradigm shift towards assessments that truly measure student understanding and application of knowledge. Two-Lane Assessment Approach: Adam introduces a dual-lane strategy for assessment: Lane One: Ensures the rigorous verification of student competencies necessary in professional fields. Lane Two: Uses AI to foster skill development in using technology effectively, moving beyond traditional assessment forms to embrace innovative educational practices. Implementation Challenges and Solutions: The transition to new assessment models is recognised as a gradual process, needing careful planning and support for educators in rethinking their assessment strategies. Inclusivity and Access to Technology: Ensuring equitable access to AI tools for all students is highlighted as a critical aspect of the evolving educational landscape, emphasizing the need to support diverse student backgrounds and technological proficiencies. Future Outlook: The discussion concludes with reflections on the potential long-term impacts of AI on educational practices, the necessity of ongoing adaptation by educational institutions, and the importance of preparing students for a future where AI is seamlessly integrated into professional and everyday contexts. Further Reading: We recommend these three articles from the team, that give more detail on the topics discussed Where are we with generative AI as semester 1 starts? What to do about assessments if we can't out-design or out-run AI? Embracing the future of assessment at the University of Sydney

It's time to start a new series, so welcome to Series 8! This episode is the warm up into the series that's going to be focused on Assessment. We'll interview some fascinating people about what's happening in school and university assessment, how we might think differently about assessing students, and what you can be thinking about if you're a teacher. There's no shownotes, links or anything else for your homework for this episode - just listen and enjoy! Dan and Ray

The season-ending episode for Series 7, this is the fifteenth in the series that started on 1st November last year with the "Regeneration: Human Centred Educational AI" episode. And it's an unbelievable 87th episode for the podcast (which started in September 2019). When we come back with Series 8 after a short break for Easter, we're going to take a deeper dive into two specific use cases for AI in Education. The first we'll discuss is Assessment, where there's both a threat and opportunity created by AI. And the second topic is AI Tutors, where there's more of a focus on how we can take advantage of the technology to help improve support for learning for students. This episode looks at one key news announcement - the EU AI Act - and a dozen new research papers on AI in education. News EU AI Act https://www.europarl.europa.eu/news/en/press-room/20240308IPR19015/artificial-intelligence-act-meps-adopt-landmark-law The European Parliament approved the AI Act on 13 March and there's some stuff in here that would make good practice guidance. And if you're developing AI solutions for education, and there's a chance that one of your customers or users might be in the EU, then you're going to need to follow these laws (just like GDPR is an EU law, but effectively applies globally if you're actively offering a service to EU residents). The Act bans some uses of AI that threaten citizen's rights - such as social scoring and biometric identification at mass level (things like untargeted facial scanning of CCTV or internet content, emotion recognition in the workplace or schools, and AI built to manipulate human behaviour) - and for the rest it relies on regulation according to categories.  High Risk AI systems have to be assessed before being deployed and throughout their lifecycle. In the High Risk AI category it includes critical infrastructure (like transport and energy), product safety, law enforcement, justice and democratic processes, employment decision making - and Education. So decision making using AI in education needs to do full risk assessments, maintain usage logs, be transparent and accurate - and ensure human oversight. Examples of decision making that would be covered would be things like exam scoring, student recruitment screening, or behaviour management. General generative AI - like chatgpt or co-pilots - will not be classified as high risk, but they'll still have obligations under the Act to do things like clear labelling for AI generated image, audio and video content ; make sure there's it can't generate illegal content, and also disclose what copyright data was used for training. But, although general AI may not be classified as high risk, if you then use that to build a high risk system - like an automated exam marker for end-of-school exams, then this will be covered under the high risk category. All of this is likely to become law by the middle of the year, and by the end of 2024 prohibited AI systems will be banned - and by mid-2025 the rules will start applying for other AI systems. ResearchAnother huge month. I spent the weekend reviewing a list of 350 new papers published in the first two weeks of March, on Large Language Models, ChatGPT etc, to find the ones that are really interesting for the podcast Adapting Large Language Models for Education: Foundational Capabilities, Potentials, and Challenges arXiv:2401.08664   A Study on Large Language Models' Limitations in Multiple-Choice Question Answering arXiv:2401.07955   Dissecting Bias of ChatGPT in College Major Recommendations arXiv:2401.11699   Evaluating Large Language Models in Analysing Classroom Dialogue arXiv:2402.02380    The Future of AI in Education: 13 Things We Can Do to Minimize the Damage https://osf.io/preprints/edarxiv/372vr   Scaling the Authoring of AutoTutors with Large Language Models https://arxiv.org/abs/2402.09216   Role-Playing Simulation Games using ChatGPT https://arxiv.org/abs/2402.09161   Economic and Financial Learning with Artificial Intelligence: A Mixed-Methods Study on ChatGPT https://arxiv.org/abs/2402.15278   A Study on the Vulnerability of Test Questions against ChatGPT-based Cheating https://arxiv.org/abs/2402.14881   Incorporating Artificial Intelligence Into Athletic Training Education: Developing Case-Based Scenarios Using ChatGPT https://meridian.allenpress.com/atej/article/19/1/42/498456   Incorporating Artificial Intelligence Into Athletic Training Education: Developing Case-Based Scenarios Using ChatGPT https://meridian.allenpress.com/atej/article/19/1/42/498456   RECIPE4U: Student-ChatGPT Interaction Dataset in EFL Writing Education https://arxiv.org/abs/2403.08272   Comparison of the problem-solving performance of ChatGPT-3.5, ChatGPT-4, Bing Chat, and Bard for the Korean emergency medicine board examination question bank https://journals.lww.com/md-journal/fulltext/2024/03010/comparison_of_the_problem_solving_performance_of.48.aspx?context=latestarticles   Comparing the quality of human and ChatGPT feedback of students' writing https://www.sciencedirect.com/science/article/pii/S0959475224000215          

This week we talked with Professor Danny Liu and Dr Joanne Hinitt, of The University of Sydney, about the Cogniti AI service that's been created in the university, and how it's being used to support teaching and learning. Danny is a molecular biologist by training, programmer by night, researcher and academic developer by day, and educator at heart. He works at the confluence of educational technology, student engagement, artificial intelligence, learning analytics, pedagogical research, organisational leadership, and professional development. He is currently a Professor in the Educational Innovation team in the DVC (Education) Portfolio at the University of Sydney. Here's Danny's academic profile. If you want to follow Danny's future work you can find him on LinkedIn and Twitter Joanne is a Lecturer in Occupational Therapy, and her primary area of interest is working with children and their families who experience difficulties participating in occupations related to going to school. She has extensive clinical experience working within occupational therapy settings, providing services for children and their families. Her particular interest is working collaboratively with teachers in the school setting and she completed her PhD in this area. Here's Joanne's academic profile Further reading on the topics discussed in the podcast Cogniti's website is at https://cogniti.ai/ Articles about the topics discussed: How Sydney educators are building ‘AI doubles' of themselves to help their students, Dec 2023 AI as an authentic and engaging teaching tool for occupational therapy students, Oct 2023 Meet ‘Mrs S': a classroom teacher who helps budding occupational therapists hone their skills, Oct 2023 Recorded talks Using Cogniti to design for Diversity, Feb 2023      

It's a News and Research Episode this week    There has been a lot of AI news and AI research that's related to education since our last Rapid Rundown, so we've had to be honest and drop 'rapid' from the title! Despite talking fast, this episode still clocked in just over 40 minutes, and we really can't out what to do - should we talk less, cover less news and research, or just stop worrying about time, and focus instead on making sure we bring you the key things every episode?     News More than half of UK undergraduates say they use AI to help with essays https://www.theguardian.com/technology/2024/feb/01/more-than-half-uk-undergraduates-ai-essays-artificial-intelligence This was from a Higher Education Policy Institute of 1,000 students, where they found 53% are using AI to generate assignment material. 1 in 4 are using things like ChatGPT and Bard to suggest topics 1 in 8 are using it to create content And 1 in 20 admit to copying and pasting unedited AI-generated text straight into their assignments Finance worker pays out $25 million after video call with deepfake ‘chief financial officer' https://www.cnn.com/2024/02/04/asia/deepfake-cfo-scam-hong-kong-intl-hnk/index.html An HK-based employee of a multinational firm wired out $25M after attending a video call where all employees were deepfaked, including the CFO. He first got an email which was suspicious but then was reassured on the video call with his “coworkers.”   NSW Department of Education Launch NSW EduChat https://www.theguardian.com/australia-news/2024/feb/12/the-ai-chat-app-being-trialled-in-nsw-schools-which-makes-students-work-for-the-answers NSW are rolling out a trial to 16 public schools of a chatbot built on Open AI technology, but without giving students and staff unfettered access to ChatGPT. Unlike ChatGPT, the app has been designed to only respond to questions that relate to schooling and education, via content-filtering and topic restriction. It does not reveal full answers or write essays, instead aiming to encourage critical thinking via guided questions that prompt the student to respond – much like a teacher.   The Productivity Commission has thoughts on AI and Education https://www.pc.gov.au/research/completed/making-the-most-of-the-ai-opportunity The PC released a set of research papers about "Making the most of the AI opportunity", looking at Productivity, Regulation and Data Access. They do talk about education in two key ways: "Recent improvements in generative AI are expected to present opportunities for innovation in publicly provided services such as healthcare, education, disability and aged care, which not only account for a significant part of the Australian economy but also traditionally exhibit very low productivity growth" "A challenge for tertiary education institutions will be to keep up to date with technological developments and industry needs. As noted previously by the Commission,  short courses and unaccredited training are often preferred by businesses for developing digital and data skills as they can be more relevant and up to date, as well as more flexible"   Yes, AI-Assisted Inventions can be inventions News from the US, that may set a precedent for the rest of the world. Patents can be granted for AI-assisted inventions - including prompts, as long as there's significant contribution from the human named on the patent https://www.federalregister.gov/public-inspection/2024-02623/guidance-inventorship-guidance-on-ai-assisted-inventions   Not news, but Ray mentioned his Very British Chat bot. Sadly, you need the paid version of ChatGPT to access it as it's one of the public GPTs, but if you have that you'll find it here: Very British Chat   Sora was announced https://www.abc.net.au/news/2024-02-16/ai-video-generator-sora-from-openai-latest-tech-launch/103475830 Although it was the same day that Google announced Gemini 1.5, we led with Sora here - just like the rest of the world's media did!  On the podcast, we didn't do it justice with words, so instead here's four threads on X that are worth your time to readwatch to understand what it can do: Taking a video, and changing the style/environment: https://x.com/minchoi/status/1758831659833602434?s=20 Some phenomenally realistic videos: https://x.com/AngryTomtweets/status/1759171749738840215?s=20 (remember, despite how 'real' these videos appear, none of these places exist outside of the mind of Sora!) Bling Zoo: https://x.com/billpeeb/status/1758223674832728242?s=20 This cooking grandmother does not exist: https://x.com/sama/status/1758219575882301608?s=20 (A little bit like her mixing spoon, that appears to exist only for mixing and then doesn't)   Google's Gemini 1.5 is here…almost https://www.oneusefulthing.org/p/google-gemini-advanced-tasting-notes       Research Papers   Google's Gemini 1.5 can translate languages it doesn't know https://storage.googleapis.com/deepmind-media/gemini/gemini_v1_5_report.pdf Google also published a 58 page report on what their researchers had found with it, and we found the section on translation fascinating. Sidenote: There's an interesting Oxford Academic research project report from last year that was translating cuneiform tablets from Akkadian into English, which didn't use Large Language Models, but set the thinking going on this aspect of using LLMs   Understanding the Role of Large Language Models in Personalizing and Scaffolding Strategies to Combat Academic Procrastination arXiv:2312.13581   Challenges and Opportunities of Moderating Usage of Large Language Models in Education arXiv:2312.14969   ChatEd: A Chatbot Leveraging ChatGPT for an Enhanced Learning Experience in Higher Education arXiv:2401.00052    AI Content Self-Detection for Transformer-based Large Language Models arXiv:2312.17289   Evaluating the Performance of Large Language Models for Spanish Language in Undergraduate Admissions Exams arXiv:2312.16845   Taking the Next Step with Generative Artificial Intelligence: The Transformative Role of Multimodal Large Language Models in Science Education arXiv:2401.00832   Empirical Study of Large Language Models as Automated Essay Scoring Tools in English Composition - Taking TOEFL Independent Writing Task for Example arXiv:2401.03401   Using Large Language Models to Assess Tutors' Performance in Reacting to Students Making Math Errors arXiv:2401.03238   Future-proofing Education: A Prototype for Simulating Oral Examinations Using Large Language Models arXiv:2401.06160   How Teachers Can Use Large Language Models and Bloom's Taxonomy to Create Educational Quizzes arXiv:2401.05914   How does generative artificial intelligence impact student creativity? https://www.sciencedirect.com/science/article/pii/S2713374523000316   Large Language Models As MOOCs Graders arXiv:2402.03776    Can generative AI and ChatGPT outperform humans on cognitive-demanding problem-solving tasks in science? arXiv:2401.15081