Further Reading: Your Brain on Screens
Essential Reads
"Multimedia Learning" by Richard E. Mayer (2nd edition) The definitive academic text on how people learn from words and pictures. Mayer's "multimedia learning principles" — segmenting, signaling, redundancy, spatial contiguity, temporal contiguity — are the scientific foundation for effective educational video design. Dense but transformative if you make any kind of explainer or educational content.
"Flow: The Psychology of Optimal Experience" by Mihaly Csikszentmihalyi The original and most influential book on flow state. While it focuses on creative work and athletics rather than video consumption specifically, the conditions Csikszentmihalyi identifies (clear goals, immediate feedback, challenge-skill balance) map directly onto designing engaging content. A classic.
"The Shallows: What the Internet Is Doing to Our Brains" by Nicholas Carr A thoughtful counterpoint to the optimistic view of digital media. Carr argues that the internet's emphasis on rapid, multisensory stimulation may be rewiring our brains in ways that reduce capacity for deep, sustained attention. Whether you agree or not, it's essential reading for understanding the debate about screen-based media.
Going Deeper: Research and Academic Sources
Paivio, A. (1971). Imagery and Verbal Processes. The original dual coding theory text. Academic and thorough. If you want to understand the theoretical foundation behind why video works, this is the primary source.
Rizzolatti, G., & Craighero, L. (2004). "The Mirror-Neuron System." Annual Review of Neuroscience, 27, 169-192. A comprehensive review of mirror neuron research by one of the system's discoverers. Covers the evidence, the controversies, and the implications for understanding social cognition. More accessible than the original experimental papers.
Sweller, J. (1988). "Cognitive load during problem solving: Effects on learning." Cognitive Science, 12(2), 257-285. The foundational paper on cognitive load theory. Technical but readable. Essential for anyone who makes educational content and wants to understand why some presentations work and others overwhelm.
Green, M. C., & Brock, T. C. (2000). "The role of transportation in the persuasiveness of public narratives." Journal of Personality and Social Psychology, 79(5), 701-721. The original transportation theory paper. Shows how narrative immersion affects persuasion, emotion, and memory. Directly applicable to story-based content creation.
McGurk, H., & MacDonald, J. (1976). "Hearing lips and seeing voices." Nature, 264, 746-748. The original McGurk effect paper — remarkably short (just a few pages) and accessible. Worth reading to understand the actual experimental setup, which is more nuanced than most popular accounts describe.
For Creators Specifically
"In the Blink of an Eye" by Walter Murch Written by one of cinema's greatest film editors (The Godfather, Apocalypse Now), this short book explores why cuts work in film — why the brain accepts a sudden change in visual perspective as natural rather than jarring. Murch's insights about editing rhythm and the "blink" theory of cuts connect directly to the orienting response and flow state concepts in this chapter.
"Every Frame a Painting" (YouTube channel, now archived) Tony Zhou's video essays on film technique are widely considered the gold standard of educational content about visual storytelling. Watch them not just for the content but as examples of masterful dual coding — Zhou narrates while showing exactly what he's describing, with impeccable timing.
"Understanding Comics" by Scott McCloud A comic book about how comic books work — and, by extension, how visual storytelling works in any medium. McCloud's analysis of how the brain fills in gaps between panels (a process he calls "closure") is directly relevant to understanding how viewers construct meaning from video cuts and transitions.
Videos and Online Resources
Kurzgesagt — In a Nutshell (YouTube) Perhaps the best example of dual coding in educational video. Every word of narration is accompanied by custom animation that illustrates the concept being described. Study their technique — the visual channel and verbal channel are perfectly complementary, never conflicting.
3Blue1Brown (YouTube) Grant Sanderson's math visualization channel demonstrates how complex abstract concepts become intuitive when dual-coded with visual representations. Even if you don't make math content, his approach to visual explanation is universally applicable.
Vox — Borders, Explained series (YouTube) Vox's video journalism combines talking-head segments, archival footage, animated infographics, and environmental shots in a way that maintains flow while managing high cognitive load. A masterclass in the segmenting principle applied to complex topics.