Chapter 9 Further Reading

Dual Coding: Why Words + Visuals Beats Words Alone

Tier 1: Foundational Works (Start Here)

These are the landmark texts that established the research base for this chapter. If you read nothing else, read these.

Paivio, A. (1986). Mental Representations: A Dual Coding Approach. Oxford University Press. The definitive statement of dual coding theory by its creator. Paivio synthesizes decades of experimental research showing that concrete, imageable information is remembered better than abstract information, and that encoding in both verbal and visual formats produces superior memory. The book is technical but accessible to motivated undergraduates. Start with Chapters 1-3 for the core theory, then skip to the experimental evidence chapters that interest you most.

Mayer, R. E. (2009). Multimedia Learning (2nd ed.). Cambridge University Press. Richard Mayer's comprehensive framework for how people learn from words and pictures. This is the essential reference for the multimedia learning principles discussed in Section 9.2 — the multimedia principle, spatial contiguity, temporal contiguity, coherence, and signaling. Each principle is supported by multiple controlled experiments. A must-read for anyone designing learning materials or wanting to understand why some textbooks and presentations work better than others. The third edition (2021) is also excellent and more current.

Mayer, R. E. (2021). Multimedia Learning (3rd ed.). Cambridge University Press. The updated edition incorporates two additional decades of research, including studies on learning from computer-based environments, animations, and virtual reality. Adds new principles (e.g., the embodiment principle, the immersion principle) while strengthening the evidence base for the original principles. If you're choosing between the second and third editions, go with this one.

Clark, J. M., & Paivio, A. (1991). Dual coding theory and education. Educational Psychology Review, 3(3), 149-210. A highly readable review article applying dual coding theory specifically to educational practice. Written by Paivio and his collaborator, this paper bridges the gap between the cognitive theory and the classroom. Particularly useful for teachers and instructional designers. More accessible than the 1986 book and more focused on practical implications.

Tier 2: Key Studies and Reviews (Go Deeper)

These works provide important evidence, extensions, and critical perspectives on dual coding and multimedia learning.

Ainsworth, S. (2006). DeFT: A conceptual framework for considering learning with multiple representations. Learning and Instruction, 16(3), 183-198. Shaaron Ainsworth's framework for understanding when and why multiple representations (including visual representations) support learning. She identifies three functions of multiple representations: complementary (each carries different information), constraining (one helps interpret the other), and constructing (together they create deeper understanding). This framework helps explain when dual coding works and when it doesn't — addressing the redundancy effect and other limitations.

Ainsworth, S. (2014). The multiple representation principle in multimedia learning. In R. E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (2nd ed., pp. 464-486). Cambridge University Press. Ainsworth's updated and more comprehensive treatment of visual representations in learning, specifically within Mayer's multimedia learning framework. Excellent for understanding the nuances: when are multiple representations helpful, and when do they become confusing?

Nesbit, J. C., & Adesope, O. O. (2006). Learning with concept and knowledge maps: A meta-analysis. Review of Educational Research, 76(3), 413-448. The definitive meta-analysis on concept mapping, analyzing decades of research across age groups and subject areas. The finding: concept mapping consistently produces better learning outcomes than traditional activities like reading, attending lectures, and class discussion. The effect is strongest when students create concept maps rather than studying pre-made ones. Essential reading for anyone considering concept mapping as a learning strategy.

Novak, J. D., & Canas, A. J. (2008). The theory underlying concept maps and how to construct and use them. Technical Report IHMC CmapTools 2006-01 Rev 01-2008. Florida Institute for Human and Machine Cognition. A practical guide to concept mapping from Joseph Novak, who developed the technique. Includes clear instructions for constructing concept maps, examples across disciplines, and theoretical justification rooted in Ausubel's meaningful learning theory. Available free online — an excellent starting point for learning to concept map.

Mueller, P. A., & Oppenheimer, D. M. (2014). The pen is mightier than the keyboard: Advantages of longhand over laptop note-taking. Psychological Science, 25(6), 1159-1168. The influential study showing that students who took notes by hand outperformed laptop note-takers on conceptual questions, despite capturing fewer words. The proposed mechanism — that handwriting's slower speed forces generative processing and selectivity — connects directly to sketch-noting, which pushes this advantage even further by adding visual encoding.

Paivio, A. (1969). Mental imagery in associative learning and memory. Psychological Review, 76(3), 241-263. Paivio's early experimental work demonstrating the concreteness effect — that concrete, imageable words are remembered approximately twice as well as abstract words. This paper laid the groundwork for the full dual coding theory published later. A classic in cognitive psychology.

Tier 3: Practical Guides (Apply It)

These resources help you actually implement dual coding techniques in your studying.

Rohde, M. (2013). The Sketchnote Handbook: The Illustrated Guide to Visual Note Taking. Peachpit Press. The most accessible and popular guide to sketch-noting. Mike Rohde coined the term "sketchnotes" and this book provides a step-by-step introduction to the visual vocabulary, layout techniques, and mindset needed for visual note-taking. Full of examples and practice exercises. If the idea of sketch-noting appeals to you but you don't know where to start, this is your book.

Rohde, M. (2014). The Sketchnote Workbook: Advanced Techniques for Taking Visual Notes You Can Use Anywhere. Peachpit Press. The follow-up to the Handbook, with more advanced techniques, additional examples across different contexts (meetings, travel, personal reflection), and guided practice exercises. Read the Handbook first.

Caviglioli, O. (2019). Dual Coding with Teachers. John Catt Educational. A brilliant book that translates dual coding theory into practical classroom application. Written for teachers but equally useful for students and self-directed learners. Oliver Caviglioli shows how to create effective visuals for a wide range of concepts and subjects. The illustrations in the book are themselves masterful examples of dual coding — it practices what it preaches.

Brown, P. C., Roediger, H. L., & McDaniel, M. A. (2014). Make It Stick: The Science of Successful Learning. Harvard University Press. While not specifically about dual coding, this trade book includes dual coding among its recommended strategies and contextualizes it alongside retrieval practice, spacing, and interleaving. Chapter 7 is particularly relevant. An excellent companion to this textbook.

Weinstein, Y., Sumeracki, M., & Caviglioli, O. (2019). Understanding How We Learn: A Visual Guide. Routledge. A uniquely dual-coded book about learning science — the entire book uses visual representations to explain cognitive psychology concepts. A beautiful example of dual coding applied to the science of dual coding. Short, accessible, and highly recommended as a reference companion to this course.

Tier 4: Advanced and Specialized (For the Deeply Curious)

Sadoski, M., & Paivio, A. (2001). Imagery and Text: A Dual Coding Theory of Reading and Writing. Routledge. An application of dual coding theory specifically to literacy — reading and writing. Explores how mental imagery during reading enhances comprehension and memory, and how writers use concrete, imageable language to communicate more effectively. Relevant to Chapter 19 (Reading to Learn) and useful for anyone interested in the intersection of visual cognition and language arts.

Schnotz, W., & Bannert, M. (2003). Construction and interference in learning from multiple representations. Learning and Instruction, 13(2), 141-156. A more critical perspective on when multiple representations help and when they hurt. Schnotz and Bannert demonstrate that under certain conditions, adding visualizations can actually impair learning — particularly when learners construct incorrect mental models from misleading visuals. A useful counterpoint to the sometimes overly enthusiastic dual coding advocacy.

Mayer, R. E. (Ed.). (2014). The Cambridge Handbook of Multimedia Learning (2nd ed.). Cambridge University Press. The comprehensive academic reference on multimedia learning. Contains 35 chapters by leading researchers covering every aspect of learning from words and pictures: cognitive theory, individual differences, assessment, technology, and specific application domains. This is the definitive academic resource — graduate-level, thorough, and authoritative.

Baddeley, A. D. (2000). The episodic buffer: A new component of working memory? Trends in Cognitive Sciences, 4(11), 417-423. Baddeley's update to his working memory model, adding the episodic buffer as a component that integrates information from the phonological loop, visuospatial sketchpad, and long-term memory. Relevant to understanding how the two working memory channels combine during dual coding. Assumes familiarity with the original Baddeley and Hitch (1974) model.

Online Resources

The Learning Scientists (www.learningscientists.org) A website run by cognitive psychologists Yana Weinstein and Megan Sumeracki dedicated to translating learning science into practice. Their page on dual coding includes free downloadable materials, blog posts, and examples. An excellent starting point for practical application.

Sketchnote Army (sketchnotearmy.com) A community and resource hub for sketch-noting. Includes galleries of sketchnotes across domains, interviews with practitioners, and tips for beginners. Useful for inspiration and for seeing the range of what sketch-noting can look like.

Concept Mapping Software: CmapTools (cmap.ihmc.us) Free software for creating digital concept maps, developed at the Florida Institute for Human and Machine Cognition. Allows you to create, share, and annotate concept maps digitally. Note: the research suggests that hand-drawn concept maps may produce deeper processing than digital ones, because the physical act of drawing adds an additional encoding channel. But digital tools are useful for revision, sharing, and complex maps.

Reading Strategy Suggestion

Don't try to read all of these. Instead:

1. If you want the theory: Start with Clark & Paivio (1991) — it's the most readable overview of dual coding theory for non-specialists.

2. If you want the evidence: Read Nesbit & Adesope (2006) on concept mapping and Mueller & Oppenheimer (2014) on handwriting vs. typing. These are the strongest empirical papers on the practical techniques.

3. If you want to practice: Get Rohde's Sketchnote Handbook or Caviglioli's Dual Coding with Teachers. Both are visual, practical, and immediately useful.

4. If you want the full picture: Read Mayer's Multimedia Learning (2021). It's the comprehensive treatment and will serve you well for Chapters 19 and 20 as well.

These readings extend Chapter 9 and connect to Chapters 2, 5, 7, 8, 12, 19, and 20.