When I typically begin a series of blogs to conduct nerdy inquiry into an abstract topic, I don't generally know where I'm going to end up. This series on LLMs was unusual in that in our first post, I outlined pretty much the exact topics I would go on to cover.
Here's where I had spitballed we might go:
The surprisingly inseparable interconnection between form and meaning
Blundering our way to computational precision through human communication; Or, the generative tension between regularity and randomness
The human (and now, machine) capacity for learning and using language may simply be a matter of scale
Is language as separable from thought (and, for that matter, from the world) as Cormac McCarthy said?
Implicit vs. explicit learning of language and literacy
Indeed, we then went on to explore each of these areas, in that order. Cool!
In a previous series, “Innate vs. Developed,” we’ve also challenged the idea that language is entirely hardwired in our brains, highlighting the tension between our more recent linguistic innovations and our more ancient brain structures. Cormac McCarthy, the famed author of some of the most powerful literature ever written, did some fascinating pontificating on this very issue.
In this post, we’ll continue picking away at these tensions, considering implications for AI and LLMs.
“Semantic gradients,” are a tool used by teachers to broaden and deepen students' understanding of related words by plotting them in relation to one another. They often begin with antonyms at each end of the continuum. Here are two basic examples:
Now imagine taking this approach and quantifying the relationships between words by adding numbers to the line graph. Now imagine adding another axis to this graph, so that words are plotted in a three dimensional space in their relationships. Then add another dimension, and another . . . heck, make it tens of thousands more dimensions, relating all the words available in your lexicon across a high dimensional space. . .
. . . and you may begin to envision one of the fundamental powers of Large Language Models (LLMs).
Paper Citation: Philip Capin, Sharon Vaughn, Joseph E. Miller, Jeremy Miciak, Anna-Mari Fall, Greg Roberts, Eunsoo Cho, Amy E. Barth, Paul K. Steinle & Jack M. Fletcher (2023) Investigating the Reading Profiles of Middle School Emergent Bilinguals with Significant Reading Comprehension Difficulties, Scientific Studies of Reading, DOI: 10.1080/10888438.2023.2254871
A few months ago, a study crossed my radar that caused me to stop, print it out, mark it up, and then begin digging into related studies, which is what I do when a study grabs my attention.
Getting into research is akin to getting into Miles Davis—if you like a given song or album, you may start checking out the other musicians he plays with, and they'll lead you into a new and ever expanding fractal universe, because Davis had a knack for collaborating with musicians who were geniuses in their own right. A few examples: John Coltrane, Tony Williams, Keith Jarrett, Herbie Hancock, John McLaughlin, Wayne Shorter, Jack DeJohnette, the list goes on and on.
This has been a great year for education research. I thought it could be fun to review some of what has come across my own limited radar over the course of 2023.
The method I used to create this wrap-up was to go back through my Twitter timeline starting in January, and pull all research related tweets into a doc. I then began sorting those by theme and ended up with several high-level buckets, with further sub-themes within and across those buckets. Note that I didn’t also go through my Mastodon nor Bluesky feeds, as this was time-consuming enough!
The rough big ticket research items I ended up with were:
Multilinguals and multilingualism
Reading
Morphology
The influence of physical or cultural environment
The content of teaching and learning
The precedence of academic skills over soft skills
We know that the explicit teaching of unfamiliar words that students will encounter in written text is important. But what about the language that is used by teachers throughout the school day? What implicit learning opportunities are constrained or afforded through the model of the language that a teacher uses while teaching, and what are the impacts on student learning?
I'm going to try out a new type of post here, in which I'll share one interesting research item I've happened across in greater depth. In the past, I've simply tweeted them out, but then I forget about them. I'm hoping this will be a better way of retaining them in memory and deepening my understanding — and of course, sharing them with you!
Individual differences in L2 listening proficiency revisited: Roles of form, meaning, and use aspects of phonological vocabulary knowledge
Citation: Saito, K., Uchihara, T., Takizawa, K., & Suzukida, Y. (2023). Individual differences in L2 listening proficiency revisited: Roles of form, meaning, and use aspects of phonological vocabulary knowledge. Studies in Second Language Acquisition, 1-27. doi:10.1017/S027226312300044X
This paper explores how various aspects of phonological vocabulary knowledge affect second language (L2) listening proficiency. The study involved 126 Japanese learners of English.
Back in 1978, Bloom & Lahey presented a simple and useful model of language: form, meaning, and use.
There is a fertile topsoil we are born with in our brains, imprinted by the interplay of sights and sounds and movement of those who interact with us. This immersive communicative theater, felt first in the womb, roots itself within the immediacy of each moment, even while gesturing at distant realms yet unknown. Climbing towards this mystery with our tongues and thoughts and technology bends the world toward our needs, and allows us to project our inner selves into the past and future. We ride rivers and build highways across our brains. This is our cultural inheritance, our storied legacy of language and literacy.
Part II: The Shadowed Underbelly of Words
Yet this glorified development harbors dissonance as well, darker truths of the animal and spirit world we project beyond ourselves and thus, distort. As we entangle each other in our webs of words, we may mirror and magnify influences unseen, that inarticulate undertow of us vs. them. When we summon forth our disgust and anger at someone or something else and wrap them into words until our vision becomes blinded, we may become its prisoners, trapped in the enchantment of language itself. As Alicia lived in the interlocution of the pages, the chatter of our minds can lead us unto rifts within. Do animals go mad, other than when rabies infects their brains? Language, in this sense, is viral, amplifying our extremes while shrouding our ensnarement. We can paint a veneer of progress over the denatured scars we leave behind.
We have spent some time picking away at the tension between the generalizations and assumptions made around whether reading and writing development is natural or unnatural.
We continue this exploration, except now we dig into an even more fundamental aspect of human development: language. Language development is a seemingly magical evolutionary development that humans have uniquely adapted—or for which language is uniquely adapted for—to the surviving and thriving of our species.
Are we born with innate capacities for language baked into our brains—a 'universal grammar'? Or do we develop and hone these capacities—albeit, rapidly—through exposure and use? Is it both? If so, how much is innate, and how much is developed? And in what way do these continued advancements of language and literacy across the generations enable our cognitive, cultural, and technological achievements? And in what way might they at the same time magnify the biases and base motivations of those most able to leverage power to manipulate others? In other words, how much does language and literacy bring us into a more generative engagement with ourselves and our world, and how much does it create a distance that may lead to destruction?
Talking is just recording what you're thinking. It's not the thing itself. When I'm talking to you some separate part of my mind is composing what I'm about to say. But it's not yet in the form of words. So what is it in the form of? There's certainly no sense of some homunculus whispering to us the words we're about to say. Aside from raising the spectre of an infinite regress—as in who is whispering to the whisperer—it raises the question of a language of thought. Part of the general puzzle of how we get from the mind to the world. A hundred billion synaptic events clicking away in the dark like blind ladies at their knitting.
–Stella Maris by Cormac McCarthy
OK, so let’s take some stock of where we’ve been thus far in our explorations of the development of language and literacy.
We’ve spent some time poking at the notion of whether learning to read is unnatural or not, and landed on the conviction that terming it unnatural–though useful as a rhetorical device–may be less precise than recognizing that learning to read and write is more formal, abstract, and distal from the immediate context of human interaction – and thus requires more effort, instruction, and practice to master.
We then turned to the development of language and discovered that even here–despite the ubiquity and swiftness with which native languages develop anew in every child across our species–language may not be as innate and inborn as it may appear.
Both language and literacy have bestowed humanity with sacred powers for the transmission and accumulation of cultural knowledge that seems to–as of yet–have no ceiling beyond that of our own destruction. Whether this is natural or innate or not may be beside the point. What does seem to be clear is that we have something inherited within us that is unfurled and reified by the networks that are riven across our brains through storytelling, interactive dialogue, and shared book reading that connects spoken to written language, and further strengthened with the hardwon fluency we manage to achieve on our own across modalities, texts, and languages.
When I typically begin a series of blogs to conduct nerdy inquiry into an abstract topic, I don't generally know where I'm going to end up. This series on LLMs was unusual in that in our first post, I outlined pretty much the exact topics I would go on to cover.
In 
This has been a great year for education research. I thought it could be fun to review some of what has come across my own limited radar over the course of 2023.
