Podcasts about interrater

 In this episode of the TTL podcast, the hosts welcome Ed Morgan, founder of Gordian Knot, to discuss enhancing the hiring process for software engineers. Ed highlights the concept of 'sensemaking' and its impact on interview outcomes, stressing the importance of structured versus unstructured interviews. The trio touches on creating effective rubrics, the surprising resistance to change in hiring practices despite evidence, and the role of psychometrics. Listeners will learn practical steps to improve hiring accuracy and discover why structured interviews are statistically superior. Edward Morgan is the founder of Gordian Knot, a consulting firm that helps companies build high performance teams by improving their hiring processes and developing custom technical assessments. Visit www.gordianknot.company to learn more. References: Stubborn Reliance on Intuition and Subjectivity in Employee Selection - https://www.cs.jhu.edu/~misha/DIReadingSeminar/Papers/Highhouse08.pdf Belief in the unstructured interview: The persistence of an illusion - https://www.cambridge.org/core/journals/judgment-and-decision-making/article/belief-in-the-unstructured-interview-the-persistence-of-an-illusion/5BBA77932EF22EBEAA1E8020126A1925 A Meta-Analysis of Interrater and Internal Consistency Reliability of Selection Interviews - https://www.cambridge.org/core/journals/judgment-and-decision-making/article/belief-in-the-unstructured-interview-the-persistence-of-an-illusion/5BBA77932EF22EBEAA1E8020126A1925 Factors affecting employee performance: a systematic literature review - https://www.emerald.com/insight/content/doi/10.1108/JAMR-06-2018-0052/full/html Telling stories to communicate the value of the pre-employment structured job interview - https://www.researchgate.net/publication/335762542_Telling_stories_to_communicate_the_value_of_the_pre-employment_structured_job_interview Myers-Briggs Type Inventory - https://www.themyersbriggs.com/en-US/Products-and-Services/Myers-Briggs DiSC - https://www.discprofile.com/what-is-disc/disc-styles Big 5 - https://en.wikipedia.org/wiki/Big_Five_personality_traits

MedLink Neurology Podcast is delighted to feature selected episodes from BrainWaves, courtesy of James E Siegler MD, its originator and host. BrainWaves is an academic audio podcast whose mission is to educate medical providers through clinical cases and topical reviews in neurology, medicine, and the humanities. Episodes originally aired from 2016 to 2021. Originally released: August 22, 2019 This week on the BrainWaves podcast, finally...a REAL show about BRAINWAVES! Dr. Carolina Maciel of the University of Florida schools Jim Siegler on how to read EEG and interpret abnormal patterns across the ictal-interictal continuum. Produced by James E Siegler and Carolina Maciel. Music courtesy of Chris Zabriskie, Montplaisir, Rafael Archangel, Steve Combs, Unheard Music Concepts, and Siddhartha. Sound effects by Mike Koenig and Daniel Simion. BrainWaves' podcasts and online content are intended for medical education only and should not be used for clinical decision-making. Be sure to follow us on Twitter (now X) @brainwavesaudio for the latest updates to the podcast. REFERENCES Benbadis SR, LaFrance WC Jr, Papandonatos GD, et al. Interrater reliability of EEG-video monitoring. Neurology 2009;73(11):843-6. PMID 19752450Beniczky S, Hirsch LJ, Kaplan PW, et al. Unified EEG terminology and criteria for nonconvulsive status epilepticus. Epilepsia 2013;54 Suppl 6:28-9. PMID 24001066Chong DJ, Hirsch LJ. Which EEG patterns warrant treatment in the critically ill? Reviewing the evidence for treatment of periodic epileptiform discharges and related patterns. J Clin Neurophysiol 2005;22(2):79-91. PMID 15805807Claassen J. How I treat patients with EEG patterns on the ictal-interictal continuum in the neuro ICU. Neurocrit Care 2009;11(3):437-44. PMID 19851892Gaspard N, Hirsch LJ, LaRoche SM, Hahn CD, Westover MB; Critical Care EEG Monitoring Research Consortium. Interrater agreement for Critical Care EEG Terminology. Epilepsia 2014 ;55(9):1366-73. PMID 24888711Gerber PA, Chapman KE, Chung SS, et al. Interobserver agreement in the interpretation of EEG patterns in critically ill adults. J Clin Neurophysiol 2008;25(5):241-9. PMID 18791475Hirsch LJ, LaRoche SM, Gaspard N, et al. American Clinical Neurophysiology Society's Standardized Critical Care EEG Terminology: 2012 version. J Clin Neurophysiol 2013;30(1):1-27. PMID 23377439Newey CR, Sahota P, Hantus S. Electrographic features of lateralized periodic discharges stratify risk in the interictal-ictal continuum. J Clin Neurophysiol 2017;34(4):365-9. PMID 28166083Rubinos C, Reynolds AS, Claassen J. The ictal-interictal continuum: to treat or not to treat (and how)? Neurocrit Care 2018;29(1):3-8. PMID 29139014 We believe that the principles expressed or implied in the podcast remain valid, but certain details may be superseded by evolving knowledge since the episode's original release date.

In this episode, Nathan sits down with Alan Cowen, CEO and Chief Scientist at Hume AI, an emotional intelligence startup working on creating emotionally aware AI. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive MasterClass https://masterclass.com/cognitive get two memberships for the price of 1 Learn from the best to become your best. Learn how to negotiate a raise with Chris Voss or manage your relationships with Esther Perel. Boost your confidence and find practical takeaways you can apply to your life and at work. If you own a business or are a team leader, use MasterClass to empower and create future-ready employees and leaders. Moment of Zen listeners will get two memberships for the price of one at https://masterclass.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL @labenz (Nathan) @AlanCowen (Alan) @eriktorenberg (Erik) @CogRev_Podcast LINKS: Hume: https://hume.ai/ TIMESTAMPS: (00:00) - Episode Preview (00:04:52) - How do you define happiness? How can AI make people happy? (00:08:40) - The striking experience of trying the Hume demo (00:09:16) - Building multimodal models using facial expressions, vocal signals, speech patterns (00:12:27) - How Hume's models have an advantage of LLMs when it comes to interpreting emotions (00:13:23) - Assembling diverse datasets of emotional judgments via surveys (00:15:27) - Sponsors: Shopify (00:22:00) - Across populations, what is common or different in people's judgement of facial expressions (00:26:00) - Interrater reliability for training data (00:30:48) - Sponsors: Omneky (00:33:20) - The unique labelling of “awe” across different cultures (00:36:23) - Customizing models for cultural emotional expression norms (00:41:13) - How they determined the set of emotions recognized by the model (00:42:50) - Schadenfreude as a unique example of semantic space research (00:49:00) - Custom models (00:52:42) - Using Hume in B2B contexts (00:59:49) - The cost comparison of having a human analyze emotions vs AI

Dr Caroline AlexanderCurtin University, Telethon Kids Institute, Perth Children's HospitalPresentation title: Interrater reproducibility of General Movement Assessments and motor optimality scores in large populated based cohort.

In this episode of Faculty Development in 3 Minutes or FD3, Deb Young looks at ways to improve interrater reliability and reimagines the way these rubrics are used.

On Today's FD3 episode, Deb Young talks about why there is poor interrater reliability in assessments of our learners and proposes some new strategies to change this.

Når vi holder fagdagen vår "The Sexy Shoulder" pleier vi å stille deltakerne et spørsmål; "Hvor mange her inne har stått bak en pasient og lurt på, hva i all verden betyr denne testen?". Som regel kommer alle hendene i været, hvilket er beskrivende for den usikkerheten vi alle står i når vi skal tolke funn. For skulderen alene er det beskrevet over 200 kliniske tester for ulike tilstander. Felles for de fleste er at de har høy sensitivitet og lav spesifisitet. Dette vil si, enkelt forklart, at vi kan provosere frem symptomer, men i svært liten grad være sikre på hvilke strukturer symptomene kommer fra. Så hva utgjør da en god klinisk test? Hvilken verdi har den? Trenger vi dem i det hele tatt, eller skal vi bruke tiden vår på noe annet enn omfattende testbatterier?Caneiro, J.P., et al.: It is time to move beyond 'body region silos' to manage musculoskeletal pain: five actions to change clinical practice. Br J Sports Med, 2019.Decary, S., et al.: Diagnostic validity of physical examination tests for common knee disorders: An overview of systematic reviews and meta-analysis. Phys Ther Sport, 2017. 23: p. 143-155.Fu, M.C., et al.: Interrater and intrarater agreements of magnetic resonance imaging findings in the lumbar spine: significant variability across degenerative conditions. Spine J, 2014. 14(10): p. 2442-8.Girish, G., et al.: Ultrasound of the shoulder: asymptomatic findings in men. AJR Am J Roentgenol, 2011. 197(4): p. W713-9.Hegedus, E.J., et al.: Combining orthopedic special tests to improve diagnosis of shoulder pathology. Phys Ther Sport, 2015. 16(2): p. 87-92.Hegedus, E.J., et al.: Physical examination tests of the shoulder: a systematic review with meta-analysis of individual tests. Br J Sports Med, 2008. 42(2): p. 80-92; discussion 92.Hegedus, E.J., et al.: Which physical examination tests provide clinicians with the most value when examining the shoulder? Update of a systematic review with meta-analysis of individual tests. Br J Sports Med, 2012. 46(14): p. 964-78.Hegedus, E.J., et al.: Orthopaedic special tests and diagnostic accuracy studies: house wine served in very cheap containers. British Journal of Sports Medicine, 2017.Herzog, R., et al.: Variability in diagnostic error rates of 10 MRI centers performing lumbar spine MRI examinations on the same patient within a 3-week period. Spine J, 2016.O'Brien, S.J., et al.: The active compression test: a new and effective test for diagnosing labral tears and acromioclavicular joint abnormality. Am J Sports Med, 1998. 26(5): p. 610-3.Reiman, M.P., et al.: Diagnostic accuracy of clinical tests of the hip: a systematic review with meta-analysis. Br J Sports Med, 2013. 47(14): p. 893-902.https://jevnehelse.no/2020/03/05/hva-er-en-god-test/Musikk: Joseph McDade-Mirrors

Interview with Brandon Westover, MD PhD, author of Interrater Reliability of Experts in Identifying Interictal Epileptiform Discharges in Electroencephalograms

Interview with Brandon Westover, MD PhD, author of Interrater Reliability of Experts in Identifying Interictal Epileptiform Discharges in Electroencephalograms

This week on the BrainWaves podcast, finally...a REAL show about BRAINWAVES! Dr. Carolina Maciel, of the University of Florida, schools Jim Siegler on how to read EEG and interpret abnormal patterns across the ictal-interictal continuum. Produced by James E. Siegler and Carolina Maciel. Music courtesy of Chris Zabriskie, Montplaisir, Rafael Archangel, Steve Combs, Unheard Music Concepts, and Siddhartha. Sound effects by Mike Koenig and Daniel Simion. BrainWaves' podcasts and online content are intended for medical education only and should not be used for clinical decision making. Be sure to follow us on Twitter @brainwavesaudio for the latest updates to the podcast. REFERENCES Chong DJ and Hirsch LJ. Which EEG patterns warrant treatment in the critically ill? Reviewing the evidence for treatment of periodic epileptiform discharges and related patterns. Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society. 2005;22:79-91. Benbadis SR, LaFrance WC, Jr., Papandonatos GD, Korabathina K, Lin K, Kraemer HC and Workshop NEST. Interrater reliability of EEG-video monitoring. Neurology. 2009;73:843-6. Hirsch LJ, LaRoche SM, Gaspard N, Gerard E, Svoronos A, Herman ST, Mani R, Arif H, Jette N, Minazad Y, Kerrigan JF, Vespa P, Hantus S, Claassen J, Young GB, So E, Kaplan PW, Nuwer MR, Fountain NB and Drislane FW. American Clinical Neurophysiology Society's Standardized Critical Care EEG Terminology: 2012 version. Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society. 2013;30:1-27. Gaspard N, Hirsch LJ, LaRoche SM, Hahn CD, Westover MB and Critical Care EEGMRC. Interrater agreement for Critical Care EEG Terminology. Epilepsia. 2014;55:1366-73. Newey CR, Sahota P and Hantus S. Electrographic Features of Lateralized Periodic Discharges Stratify Risk in the Interictal-Ictal Continuum. Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society. 2017;34:365-369. Rubinos C, Reynolds AS and Claassen J. The Ictal-Interictal Continuum: To Treat or Not to Treat (and How)? Neurocritical care. 2018;29:3-8. Gerber PA, Chapman KE, Chung SS, Drees C, Maganti RK, Ng YT, Treiman DM, Little AS and Kerrigan JF. Interobserver agreement in the interpretation of EEG patterns in critically ill adults. Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society. 2008;25:241-9. Beniczky S, Hirsch LJ, Kaplan PW, Pressler R, Bauer G, Aurlien H, Brogger JC and Trinka E. Unified EEG terminology and criteria for nonconvulsive status epilepticus. Epilepsia. 2013;54 Suppl 6:28-9. Claassen J. How I treat patients with EEG patterns on the ictal-interictal continuum in the neuro ICU. Neurocritical care. 2009;11:437-44.

Informing the Update to the Physical Therapy Management of Congenital Muscular Torticollis Evidence-Based Clinical Practice Guideline: A Systematic ReviewEmily Heidenreich PT DPT, Doctor of Physical Therapy, Division of Pediatric Rehabilitation  Medicine, Children’s Hospital, Los Angeles & Arkansas Children's, Little Rock:Talks about her study to systematically review the evidence on physical therapy diagnosis, prognosis, and intervention of congenital muscular torticollis to inform the update to the physical therapy management of congenital muscular torticollis evidence-based clinical practice guideline. Interrater and Intrarater Reliability of the Congenital Muscular Torticollis Severity Classification SystemMagdalena M. Oledzka, PT DPT MBA PCS, Director of Pediatric Rehab, Hospital for Special Surgery, New York:Tells the podcast about her data establishing inter- and intra-rater reliability for determining severity grades of the Congenital Muscular Torticollis Severity Classification System Gait analysis parameters and walking activity pre and post operatively in children with cerebral palsy.Chris Church, Program Manager, Gait Analysis Lab., Nemours duPont Hospital for Children, Wilmington DE:Explains what his study found on examining the relationship between the Gait Deviation Index and walking activity preoperatively and postoperatively for children with cerebral palsy. Relationships between gross motor skills and social function in young boys with autism spectrum disorderJamie M. Holloway PT DPT PhD PCS, Assistant Professor, University of South Florida, Tampa, FL:Discusses the purpose of her study to examine the relationship between gross motor skills and social function in young boys with autism spectrum disorder sEMG analysis during landing in children with autism spectrum disorder: A pilot studyMarcelo R. Rosales BS, Graduate student, Biokinesiology Dept, Univ of Southern California:Talks about his findings from a pilot study to explore the timing and duration of muscle activation during a landing task in children with autism spectrum disorder Pain neuroscience education and exercise for neck pain: a focus group study on adolescents' viewsAnabela G. Silva PhD, Assistant Professor, School of Health Sciences and CINTESIS-UA, University of Aveiro, Aveiro, Portugal:Tells the podcast about her findings from an exploration of the views of adolescents with chronic idiopathic neck pain towards an intervention consisting of pain neuroscience education and exercise administered in schools. Use of an In-home Body Weight Support System by a Child with Spina BifidaJames C. Galloway, PT, PhD, FAPTA, Professor in Biomechanicss & Movement Science Program, Dept of Physical Therapy & Pediatric Mobility Lab, University of Delaware, Newark, DE:Discusses data from his examination in a case report of the feasibility of a new open-area body-weight support system to act as both an ‘assistive’ and ‘rehabilitative’ device within the home.

Folkert Kuiken and Ineke Vedder from the University of Amsterdam discuss rater variability in the assessment of speaking and writing in a second language.

Author Kirk Luther discusses his article, The Violent Crime Linkage Analysis System: A Test of Interrater Reliability.

In this episode: Jason presents an article that discusses how  no validated index of clinical supervision exists, despite the fact that educators, learners, and health care decision-makers would all agree that clinical supervision is a critical activity. Length: 15:20 min Authors: Byrne, J.M.; Kashner, M.; Gilman, S.C.; Aron, D.C.; Cannon, G.W.; Chang, B.K.; Godleski, L.; Golden, R.M.; Henley, S.S.; Holland, G.J.; Kaminetzky, C.P.; Keitz, S.A.; Kirsh, S.; Muchmore, E.A.; Wicker, A.B.. Publication details: Measuring the intensity of resident supervision in the department of veterans affairs: the resident supervision index. Academic Medicine. 2010. 85(7): 1171-81. PubMed Link View the abstract here Follow our co-hosts on Twitter! Jason R. Frank: @drjfrank  Jonathan Sherbino: @sherbino  Linda Snell: @LindaSMedEd  Want to learn more about KeyLIME? Click here!

Background: The Structured Inventory for Anorexic and Bulimic Syndromes according to DSM-IV and ICD-10 consists of the Structured Expert Interview for Anorexic and Bulimic Syndromes (SIAB-EX) and the corresponding self report questionnaire (SIAB-S). These instruments assess symptoms of eating disorders and other symptoms often found in eating-disordered individuals (e.g. anxieties, symptoms of OCD, depression, substance abuse and impairment of sexuality and social integration). Thus, parallel forms for self-report and expert rating are available. Separate factor analyses resulted in very similar factor structures for self-report and interview as well as for both time points assessed: current (last 3 months before the interview) and past (time from puberty up to 3 months before the interview). Both assessments can be used for diagnosing eating disorders according to DSM-IV and ICD-10 and a total score can be computed. Method: Test criteria were assessed using a sample of 377 inpatients treated for an eating disorder. For the expert interview, SIAB-EX data were collected in a community sample of 202 young women without eating disorders. Results: Test criteria were satisfying or better. Interrater reliability (kappa) for the expert interview SIAB-EX was 0,81 (current) and 0,85 (past). Sensitivity, specificity, and positive predictive value were very good for the SIAB-EX (ppv = 0.91 lifetime) and the SIAB-S (ppv = 0.98 lifetime). Means for SIAB-EX and SIAB-S for the inpatient sample are reported. For the expert interview SIAB-EX norms for 202 young non-eating disordered women are given. Conclusion: The expert interview SIAB-EX can be seen as a `gold standard' for the assessment of eating disorders. The SIAB-EX is available in German, English, Italian and Spanish.