Podcast appearances and mentions of ray jackendoff

 If you've taken Linguistics 101, you know what language is. It's a system for conveying meaning through speech. We build words out of sounds, and then complex ideas out of those words. Remarkably, the relationship between the sounds and the meanings they convey is purely arbitrary. Human language consists, in other words, of abstract symbols. Now, of course, there are also sign languages, but these operate in the same way, just in a different medium. This, anyway, is the view of language that has dominated and defined linguistics for many decades. But some think it gets some pretty fundamental things pretty wrong. Some think we need a new picture of language altogether.  My guest today is Dr. Neil Cohn. Neil is Associate Professor at the Tilburg Center for Cognition and Communication, in the Netherlands; he is also the director of the Visual Language Lab at Tilburg. For about two decades, Neil has been studying the rich properties of graphic systems—especially comics—and has built an argument that some constitute full-blown languages. His latest book, co-authored with, Joost Schilperoord, is titled A Multimodal Language Faculty. It challenges that longstanding, deeply held view of what language is. Instead, the book argues that the human language capacity combines three different modalities—the vocal modality (as in speech), the bodily modality (as in gesture), and the graphic modality (as in comics and other visual narratives). And each of these modalities is naturally able to support full-blown languages. Here, Neil and I talk about the basic assumptions of modern linguistics and where those assumptions come from. We discuss the idea that there are three expressive modalities that come naturally to humans, with each modality optimized for certain kinds of meaning. We talk about Neil's career, not only as an academic, but as an illustrator. We discuss cross-cultural differences and similarities in comics, and how comics have changed over the last century. And, finally, we consider how Neil's framework challenges current theorizing about the evolution of language. Along the way, Neil and I touch on sign languages and homesign systems, visual style vs visual language, Peircean semiotics, animal tracks, cave art, emoji, upfixes, sand drawing, Manga, the refrain "I can't draw," and the idea that the graphic modality is the only one that's truly unique to our species.  After this episode we'll be taking a bit of a summer break, but we'll be posting some old favorites to tide you over. Alright friends, hope you enjoy this one. On to my conversation with Neil Cohn. Enjoy!   A transcript of this episode will be available soon.   Notes and links 3:30 – An earlier paper by Dr. Cohn on the well-worn refrain “I can't draw.” His more recent Twitter thread covering the topic.  9:00 – An overview of research on homesign systems. For a broader discussion of differences between gesture, homesign systems, and established sign languages, see here.  15:00 – A comic, ‘Chinese Room,' commissioned by the philosopher Dan Dennett and drawn by Dr. Cohn. 19:30 – The webpage of Dr. Cohn's graduate mentor, Ray Jackendoff. 25:00 – A brief overview paper by Dr. Cohn and Dr. Schilperoord on the need to “reimagine language.” 25:30 – The classic book, based on lecture notes, by Ferdinand de Saussure, ‘Course in General Linguistics.'  44:00 – For an overview of “bimodal bilingualism,” see here.  50:00 – A study by Dr. Cohn and colleagues on the processing of emoji substituted for words. 56:00 – A recent study by Dr. Cohn and colleagues on anaphora in visual narratives.  58:30 – For our previous audio essay on animal (and human) tracks, see here.  1:01:30 – For examples of scholarship on non-Western methods of visual storytelling, including Aboriginal Australian sand drawing, see Dr. Cohn's earlier edited volume here. For a deeper dive into sand drawing, see the monograph by Jenny Green here.  1:03:00 – Dr. Cohn also recently published a book on cross-cultural aspects of comics, The Patterns of Comics. The book is the fruit of his lab's TINTIN project.  1:11:00 – For a video of Aboriginal Australian sand drawing, see here. 1:13:00 – See Dr. Cohn's earlier book, Who Understands Comics? 1:15:00 – A study on “upfixes” by Dr. Cohn and a colleague. 1:22:00 – A popular article by Dr. Cohn on the linguistic status of emoji. 1:31:00 – For a deep dive into Peircean semiotics, see here. 1:36:00 – For my own general-audience treatment of “gesture first” theories of language evolution and the “modality transition” problem, see here. 1:37:00 – A paper by Dr. Jackendoff and Eva Wittenberg outlining their “complexity hierarchy.”  ­­­­1:50:00 – For the Getty museum exhibit associated with Dr. Cohn's lecture, see here.   Recommendations The Texture of the Lexicon, by Jenny Audring and Ray Jackendoff Battle in the Mind Fields, by John Goldsmith and Bernard Laks History and Philosophy of the Language Sciences podcast, hosted by James McElvenny   Many Minds is a project of the Diverse Intelligences Summer Institute, which is made possible by a generous grant from the Templeton World Charity Foundation to UCLA. It is hosted and produced by Kensy Cooperrider, with help from Assistant Producer Urte Laukaityte and with creative support from DISI Directors Erica Cartmill and Jacob Foster. Our artwork is by Ben Oldroyd. Our transcripts are created by Sarah Dopierala.  Subscribe to Many Minds on Apple, Stitcher, Spotify, Pocket Casts, Google Play, or wherever you listen to podcasts. You can also now subscribe to the Many Minds newsletter here! We welcome your comments, questions, and suggestions. Feel free to email us at: manymindspodcast@gmail.com.  For updates about the show, visit our website or follow us on Twitter: @ManyMindsPod.

Ray Jackendoff visits Google to discuss "The Peculiar Logic of Value", which centers on how humans conceptualize systems of value.  Jackendoff hypothesizes that value is conceptualized as an abstract property attributed to objects, persons, and actions. There are several distinct types of value - Affective value, or “does it feel good or bad?” Utility, or “is it good for me?”; Prowess, or “is someone good at doing something”; Normative value, or “is it good of someone to do something?”; Personal Normative value, or “is someone a good person?”; and Esteem, or “does someone have a good reputation?”. Each of these kinds of value plays a different role in the ecology of our value systems. Ray Jackendoff is a Professor of Philosophy and the Codirector of the Center for Cognitive Studies at Tufts University. He is the author of many books, including "Foundations of Language”. Originally published in August of 2007. Visit http://youtube.com/TalksAtGoogle/ to watch the video.                                 

Parallel Architecture is a theory of the mental representations involved in the language faculty. These representations are organized in three orthogonal dimensions or levels: phonology, syntax, and semantics, correlated with each other through interface links. Words are encoded in all three levels and serve as part of the interface between sound and meaning. In the representation of an entire sentence, the words are spread out across the combinatoriality of the three levels. An important requirement for a theory of language is that it must offer an account of how we can talk about what we see. It is proposed that conceptual structure in language interfaces with a level of physical space – which in turn interfaces with visual, haptic, and proprioceptive perception, and with the planning of action. Thus, the basic principles of the Parallel Architecture for language can be extended to major aspects of mental function. Series: "CARTA - Center for Academic Research and Training in Anthropogeny" [Humanities] [Science] [Show ID: 38684]

Parallel Architecture is a theory of the mental representations involved in the language faculty. These representations are organized in three orthogonal dimensions or levels: phonology, syntax, and semantics, correlated with each other through interface links. Words are encoded in all three levels and serve as part of the interface between sound and meaning. In the representation of an entire sentence, the words are spread out across the combinatoriality of the three levels. An important requirement for a theory of language is that it must offer an account of how we can talk about what we see. It is proposed that conceptual structure in language interfaces with a level of physical space – which in turn interfaces with visual, haptic, and proprioceptive perception, and with the planning of action. Thus, the basic principles of the Parallel Architecture for language can be extended to major aspects of mental function. Series: "CARTA - Center for Academic Research and Training in Anthropogeny" [Humanities] [Science] [Show ID: 38684]

Parallel Architecture is a theory of the mental representations involved in the language faculty. These representations are organized in three orthogonal dimensions or levels: phonology, syntax, and semantics, correlated with each other through interface links. Words are encoded in all three levels and serve as part of the interface between sound and meaning. In the representation of an entire sentence, the words are spread out across the combinatoriality of the three levels. An important requirement for a theory of language is that it must offer an account of how we can talk about what we see. It is proposed that conceptual structure in language interfaces with a level of physical space – which in turn interfaces with visual, haptic, and proprioceptive perception, and with the planning of action. Thus, the basic principles of the Parallel Architecture for language can be extended to major aspects of mental function. Series: "CARTA - Center for Academic Research and Training in Anthropogeny" [Humanities] [Science] [Show ID: 38684]

Parallel Architecture is a theory of the mental representations involved in the language faculty. These representations are organized in three orthogonal dimensions or levels: phonology, syntax, and semantics, correlated with each other through interface links. Words are encoded in all three levels and serve as part of the interface between sound and meaning. In the representation of an entire sentence, the words are spread out across the combinatoriality of the three levels. An important requirement for a theory of language is that it must offer an account of how we can talk about what we see. It is proposed that conceptual structure in language interfaces with a level of physical space – which in turn interfaces with visual, haptic, and proprioceptive perception, and with the planning of action. Thus, the basic principles of the Parallel Architecture for language can be extended to major aspects of mental function. Series: "CARTA - Center for Academic Research and Training in Anthropogeny" [Humanities] [Science] [Show ID: 38684]

Parallel Architecture is a theory of the mental representations involved in the language faculty. These representations are organized in three orthogonal dimensions or levels: phonology, syntax, and semantics, correlated with each other through interface links. Words are encoded in all three levels and serve as part of the interface between sound and meaning. In the representation of an entire sentence, the words are spread out across the combinatoriality of the three levels. An important requirement for a theory of language is that it must offer an account of how we can talk about what we see. It is proposed that conceptual structure in language interfaces with a level of physical space – which in turn interfaces with visual, haptic, and proprioceptive perception, and with the planning of action. Thus, the basic principles of the Parallel Architecture for language can be extended to major aspects of mental function. Series: "CARTA - Center for Academic Research and Training in Anthropogeny" [Humanities] [Science] [Show ID: 38684]

Parallel Architecture is a theory of the mental representations involved in the language faculty. These representations are organized in three orthogonal dimensions or levels: phonology, syntax, and semantics, correlated with each other through interface links. Words are encoded in all three levels and serve as part of the interface between sound and meaning. In the representation of an entire sentence, the words are spread out across the combinatoriality of the three levels. An important requirement for a theory of language is that it must offer an account of how we can talk about what we see. It is proposed that conceptual structure in language interfaces with a level of physical space – which in turn interfaces with visual, haptic, and proprioceptive perception, and with the planning of action. Thus, the basic principles of the Parallel Architecture for language can be extended to major aspects of mental function. Series: "CARTA - Center for Academic Research and Training in Anthropogeny" [Humanities] [Science] [Show ID: 38684]

Parallel Architecture is a theory of the mental representations involved in the language faculty. These representations are organized in three orthogonal dimensions or levels: phonology, syntax, and semantics, correlated with each other through interface links. Words are encoded in all three levels and serve as part of the interface between sound and meaning. In the representation of an entire sentence, the words are spread out across the combinatoriality of the three levels. An important requirement for a theory of language is that it must offer an account of how we can talk about what we see. It is proposed that conceptual structure in language interfaces with a level of physical space – which in turn interfaces with visual, haptic, and proprioceptive perception, and with the planning of action. Thus, the basic principles of the Parallel Architecture for language can be extended to major aspects of mental function. Series: "CARTA - Center for Academic Research and Training in Anthropogeny" [Humanities] [Science] [Show ID: 38684]

This CARTA symposium addresses the question of how human language came to have the kind of structure it has today, focusing on three sources of evidence. One source, which is discussed in these three talks, concerns what contrasts between new and mature languages reveal about how language evolves. Mark Aronoff (Stony Brook Univ) begins with an examination of the Co-emergence of Meaning and Structure in a New Language, followed by David Perlmutter (UC San Diego) on Combinatoriality within the Word: Sign Language Evidence, and Ray Jackendoff (Tufts Univ) on What Can You Say without Syntax? Series: "CARTA - Center for Academic Research and Training in Anthropogeny" [Humanities] [Science] [Show ID: 29394]

This CARTA symposium addresses the question of how human language came to have the kind of structure it has today, focusing on three sources of evidence. One source, which is discussed in these three talks, concerns what contrasts between new and mature languages reveal about how language evolves. Mark Aronoff (Stony Brook Univ) begins with an examination of the Co-emergence of Meaning and Structure in a New Language, followed by David Perlmutter (UC San Diego) on Combinatoriality within the Word: Sign Language Evidence, and Ray Jackendoff (Tufts Univ) on What Can You Say without Syntax? Series: "CARTA - Center for Academic Research and Training in Anthropogeny" [Humanities] [Science] [Show ID: 29394]

In this talk Ray Jackendoff explores forms of language with very limited organization. Such languages largely lack the familiar manifestations of syntactic structure, but they still manage to map between sound and meaning. Examples include early stages of child language, stages in acquisition of second languages by adults, pidgins, “home sign” (the sign systems invented by deaf children with no sign language input), and “village signs” spoken in isolated communities with hereditary deafness. He suggests that linear grammar is a plausible steppingstone in the evolution of the language faculty – an intermediate stage between primate call systems and modern human language. Series: "CARTA - Center for Academic Research and Training in Anthropogeny" [Humanities] [Science] [Show ID: 29402]

In this talk Ray Jackendoff explores forms of language with very limited organization. Such languages largely lack the familiar manifestations of syntactic structure, but they still manage to map between sound and meaning. Examples include early stages of child language, stages in acquisition of second languages by adults, pidgins, “home sign” (the sign systems invented by deaf children with no sign language input), and “village signs” spoken in isolated communities with hereditary deafness. He suggests that linear grammar is a plausible steppingstone in the evolution of the language faculty – an intermediate stage between primate call systems and modern human language. Series: "CARTA - Center for Academic Research and Training in Anthropogeny" [Humanities] [Science] [Show ID: 29402]

Fred is a New York based composer whose music has been commissioned and performed by major chamber ensembles and orchestras. His seminal book A Generative Theory of Tonal Music, co-authored with linguist Ray Jackendoff, is a founding document for the growing field of the cognitive science of music. He studied at Lawrence University, Princeton, and Tanglewood. He has taught at UC/Berkeley, Harvard, and Michigan, and since 1991 has been Fritz Reiner Professor of Musical Composition at Columbia University, where he directs the composition program. Three of his works composed since 2000 - Time after Time for chamber ensemble, the Third String Quartet, and Arches for cello and chamber orchestra – have been finalists for the Pulitzer Prize in music. You can listen to more of his music at www.fredlerdahl.com.In out conversation we talk about his time studying at Tanglewood and with Milton Babbitt at Princeton, the differences in his approach to composing and music theory, and the changing academic landscape in the field of composition.