Mixed-Initiative Dialogue Systems, Perception, Visualization, Simulation and Imagination

Publications pertinent to descriptive rhetoric, writing and screenplay writing include: Rhetorical Status of the Descriptive by Philippe Hamon and Patricia Baudoin, Ekphrasis and Representation by James A. W. Heffernan, Picture Theory: Essays on Verbal and Visual Representation by William J. T. Mitchell, Pictures into Words: Theoretical and Descriptive Approaches to Ekphrasis edited by Valerie Robillard and Els Jongeneel, Writing for Art: The Aesthetics of Ekphrasis by Stephen Cheeke, Descriptive Imagery by Michael Riffaterre, From Image Sequences towards Conceptual Descriptions by Hans-Hellmut Nagel, Natural Language Description of Time-varying Scenes by Bernd Neumann, Time in Language, Situation Models, and Mental Simulations by Rolf A. Zwaan, Pictorial Models and Narrative Ekphrasis by Tamar Yacobi, Action, Action Description, and Narrative by Teun A. van Dijk, Description and Event in Narrative by Peter Klaus, Description, Narrative and Representation by Ruth Ronen, Description, Narrative, and Explanation: Text-type Categories and the Cognitive Foundations of Discourse Competence by David Herman, The Poetics of Ekphrasis by John Hollander, Toward a Poetics of “Descriptized” Narration by Harold F. Mosher, Towards a Typology, Poetics and History of Description in Fiction by Ansgar Nünning, Painting, Poetry, Parallelism: Ekphrasis, Stylistics and Cognitive Poetics by Peter Verdonk, Cognitive Poetics and Imagery by Line Brandt and Per Aage Brandt, The Visuospatial Dimension of Writing by Thierry Olive and Jean-Michel Passerault, Verbal, Visual, and Spatial Working Memory in Written Language Production by Ronald T. Kellogg, Thierry Olive and Annie Piolat, Verbal, Visual, and Spatial Working Memory Demands During Text Composition by Thierry Olive, Ronald T. Kellogg and Annie Piolat, The Role of Visuospatial Sketchpad in the Written Production of Descriptive and Argumentative Texts by Jean-Michel Passerault and Jérôme Dinet, The Contribution of Different Components of Working Memory to Knowledge Transformation During Writing by David Galbraith, Sheila Ford, Gillian Walker and Jessica Ford, The Represented World: Toward a Phenomenological Theory of Description in the Novel by Alexander Gelley, Narrative Ways of Worldmaking by David Herman, The Making of Fictional Worlds: Processes, Features, and Functions by Vera Nünning, The Creation and Comprehension of Fictional Worlds by Deena S. Weisberg and Development of Beliefs About Storybook Reality by Jacqueline D. Woolley and Victoria Cox.

Publications pertinent to descriptive rhetoric and reading include: Language and Perception by George A. Miller and Philip N. Johnson-Laird, The Relationship of Language to the Formation of Concepts by Eric H. Lenneberg, Language and Simulation in Conceptual Processing by Lawrence W. Barsalou, Ava Santos, W. Kyle Simmons and Christine D. Wilson, Mental Simulation in Literal and Figurative Language Understanding by Benjamin Bergen, Imagination and Simulation in Audience Responses to Fiction by Alvin I. Goldman, Reading Imaginatively: The Imagination in Cognitive Science and Cognitive Literary Studies by Emily T. Troscianko, Fidelity Without Mimesis: Mental Imagery from Visual Description by Anežka Kuzmičová, From Text to Images through Meanings by Jayakumar S. Kandhasamy and Ming Xie, Spatial and Linguistic Aspects of Visual Imagery in Sentence Comprehension by Benjamin K. Bergen, Shane Lindsay, Teenie Matlock and Srini Narayanan, Spatial Language, Visual Attention, and Perceptual Simulation by Kenny R. Coventry, Dermot Lynott, Angelo Cangelosi, Lynn Monrouxe, Dan Joyce and Daniel C. Richardson, A Theory of Vague Adjectives Grounded in Relevant Observables by Brandon Bennett, Language and Event Perception: Steps toward a Synthesis by Robert R. Verbrugge, Understanding Scene Descriptions as Event Simulations by David L. Waltz, “Situated Events” in Fictional Worlds: The Reader’s Role in Context Construction by Catherine Emmott, Simulation and Knowledge of Action edited by Jérôme Dokic and Joëlle Proust, Perception, Action, and Word Meanings in the Human Brain: The Case from Action Verbs by Marina Bedny and Alfonso Caramazza, Spatial Representations Activated During Real-time Comprehension of Verbs by Daniel C. Richardson, Michael J. Spivey, Lawrence W. Barsalou and Ken McRae, Reading Stories Activates Neural Representations of Visual and Motor Experiences by Nicole K. Speer, Jeremy R. Reynolds, Khena M. Swallow and Jeffrey M. Zacks, Mental Imagery in the Experience of Literary Narrative: Views from Embodied Cognition by Anežka Kuzmičová, Interpreting Words, Interpreting Worlds by John Gibson, Seeing What They Read and Hearing What They Say: Readers’ Representation of the Story Characters’ World by Celia M. Klin and April M. Drumm, The Immersed Experiencer: Toward an Embodied Theory of Language Comprehension by Rolf A. Zwaan, The Experiential View of Language Comprehension by Barbara Kaup, Rolf A. Zwaan and Jana Lüdtke, Embodied Experience and Linguistic Meaning by Raymond W. Gibbs Jr., Differential Roles for Visuospatial and Verbal Working Memory in Situation Model Construction by Naomi P. Friedman and Akira Miyake, Situation Models: The Mental Leap into Imagined Worlds by Rolf A. Zwaan, Perceptual Components of Situation Models by Rebecca Fincher-Kiefer and Embodied Cognition, Perceptual Symbols, and Situation Models by Rolf A. Zwaan.

Publications pertinent to perception include: The Senses Considered as Perceptual Systems by James J. Gibson, Perceptions of Perceptual Symbols by Lawrence W. Barsalou, Perceptual Organization Influences Visual Working Memory by Geoffrey F. Woodman, Shaun P. Vecera and Steven J. Luck, Perceptual Processing Affects Conceptual Processing by Saskia van Dantzig, Diane Pecher, René Zeelenberg and Lawrence W. Barsalou, The Emergence of Semantic Meaning in the Ventral Temporal Pathway by Thomas A. Carlson, Ryan A. Simmons, Nikolaus Kriegeskorte and L. Robert Slevc, Integrating Episodic and Semantic Information in Memory for Natural Scenes by Pernille Hemmer and Mark Steyvers, Toward a Cognitive Semantics by Leonard Talmy, Episodic and Semantic Memory by Endel Tulving, Grounded Semantic Composition for Visual Scenes by Peter Gorniak and Deb K. Roy, Visual Event Perception by Gunnar Johansson, Grounding Conceptual Knowledge in Modality-specific Systems by Lawrence W. Barsalou, W. Kyle Simmons, Aron K. Barbey and Christine D. Wilson, Coming of Age: A Review of Embodiment and the Neuroscience of Semantics by Lotte Meteyard, Sara R. Cuadrado, Bahador Bahrami and Gabriella Vigliocco, A Continuous Semantic Space Describes the Representation of Thousands of Object and Action Categories across the Human Brain by Alexander G. Huth, Shinji Nishimoto, An T. Vu and Jack L. Gallant, Event Structure in Perception and Conception by Jeffrey M. Zacks and Barbara Tversky, Attention, Perception and Memory: An Integrated Introduction by Elizabeth A. Styles, Memory for Elements of a Complex Scene: Binding and the Influence of Attention by Stephanie L. Martin, Attention during Natural Vision Warps Semantic Representation across the Human Brain by Tolga Çukur, Shinji Nishimoto, Alexander G. Huth and Jack L. Gallant, Interactions between Attention and Working Memory by Edward Awh, Edward K. Vogel and Sei-Hwan Oh, Contextual Cueing of Visual Attention by Marvin M. Chun, Visual Objects in Context by Moshe Bar, Contextual Priming for Object Detection by Antonio Torralba, Imagery, Context Availability, Contextual Constraint, and Abstractness by Katja Wiemer-Hastings, Jan Krug and Xu Xu, The Role of Context in Object Recognition by Aude Oliva and Antonio Torralba, Context, Attention and Depth of Processing during Interpretation by Anthony J. Sanford, Selective Attention to the Parts of an Object by Shaun P. Vecera, Marlene Behrmann and John McGoldrick, Exploration of Complex Visual Feature Spaces for Object Perception by Daniel D. Leeds, John A. Pyles and Michael J. Tarr, The Development of Features in Object Concepts by Philippe G. Schyns, Robert L. Goldstone and Jean-Pierre Thibaut, Storage of Features, Conjunctions, and Objects in Visual Working Memory by Steven J. Luck, Geoffrey F. Woodman and Edward K. Vogel, Property Generation Reflects Word Association and Situated Simulation by Ava Santos, Sergio E. Chaigneau, W. Kyle Simmons and Lawrence W. Barsalou, Perceptual Simulation in Conceptual Combination: Evidence from Property Generation by Ling-ling Wu and Lawrence W. Barsalou, Perceptual Simulation in Property Verification by Karen O. Solomon and Lawrence W. Barsalou, Verifying Different-modality Properties for Concepts Produces Switching Costs by Diane Pecher, René Zeelenberg and Lawrence W. Barsalou, Automatic Activation of Episodic Information in a Semantic Memory Task by Gail McKoon and Roger Ratcliff, Perceptual Knowledge Retrieval Activates Sensory Brain Regions by Robert F. Goldberg, Charles A. Perfetti and Walter Schneider, Imagery and Mental Processes by Allan Paivio, Dynamics of Brain Processing During Mental Imagery by Livia Tomova, Using Imagination to Understand the Neural Basis of Episodic Memory by Demis Hassabis, Dharshan Kumaran and Eleanor A. Maguire and The Role of Imagination in Perception by Michael Pendlebury.

Publications pertinent to semiotics and imagination include: Semiosis, Cognition, Interpretation by Jerzy Pelc, Semiosis as a Multimodal Process by Ferdinando Arzarello, Speaking of Art as Embodied Imagination: A Multisensory Approach to Understanding Aesthetic Experience by Annamma Joy and John F. Sherry Jr., On Minds and Symbols: The Relevance of Cognitive Science for Semiotics by Thomas C. Daddesio, Perception, Interpretation, and the Signs of Art by Robert E. Innis, Phenomenology and Art by José Ortega y Gasset, The Phenomenology of Aesthetic Experience by Mikel Dufrenne, Art and Imagination by Margaret MacDonald, Sensory Fluidity: Dialogues of Imagination in Art by Kathleen Coessens and Imagination, Philosophy, and the Arts edited by Matthew Kieran and Dominic Lopes.

Publications pertinent to the cognitive science of imagination include: Imagination as Simulation: Aesthetics Meets Cognitive Science by Gregory Currie, Handbook of Imagination and Mental Simulation by William M. P. Klein, Julie A. Suhr and Keith D. Markman, Simulation Theory and Mental Concepts by Alvin I. Goldman, Situated Simulation in the Human Conceptual System by Lawrence W. Barsalou, Imagining: A Phenomenological Study by Edward S. Casey, Cognitive Control and Episodic Memory by Anthony D. Wagner and Voluntary and Automatic Attentional Control of Visual Working Memory by Brandon K. Schmidt, Edward K. Vogel, Geoffrey F. Woodman and Steven J. Luck.

Publications pertinent to imagination and epistemology include: Imagination and Epistemology by Jonathan Ichikawa, When an Image Turns Into Knowledge: The Role of Visualization in Thought Experimentation by Miriam Reiner and John Gilbert, Interrogation of a Dynamic Visualization During Learning by Richard K. Lowe, The Philosophy and Epistemology of Simulation: A Review by Till Grüne-Yanoff and Paul Weirich, Epistemological Perspectives on Simulation by Ulrich Frank and Klaus G. Troitzsch, How Can Computer Simulations Produce New Knowledge? by Claus Beisbart, The Role of Semantics in Games and Simulations by Tim Tutenel, Rafael Bidarra, Ruben M. Smelik and Klaas Jan de Kraker, Using Semantics to Improve the Design of Game Worlds by Tim Tutenel, Ruben Michaël Smelik, Rafael Bidarra and Klaas Jan de Kraker, The Increasing Role of Semantics in Object Modeling by Willem F. Bronsvoort, Rafael Bidarra, Hilderick A. van der Meiden and Tim Tutenel, A Method for Specifying Semantics of Large Sets of 3D Models by Xin Zhang, Tim Tutenel, Rong Mo, Rafael Bidarra and Willem F. Bronsvoort and Overview: Semantic Management of 3D Objects by Claudia Ciorascu, Christophe Künzi and Kilian Stoffel.

Publications pertinent to cognitive pragmatics and imagination include: Mental Simulation in Language Comprehension and Social Cognition by Rolf A. Zwaan, Visual and Cognitive Viewpoint in an Interactional Task by Shweta Narayan, Cooperative Meaning Construction in an Interactional Task by Zachary Weinberg, Shweta Narayan and Rafael Núñez, Discourse Models as Interfaces between Language and the Spatial World by Simon C. Garrod and Anthony J. Sanford, Coupling Perception and Simulation: Steps Towards Conversational Robotics by Kai-yuh Hsiao, Nikolaos Mavridis and Deb K. Roy, Mental Imagery for a Conversational Robot by Deb K. Roy, Kai-Yuh Hsiao and Nikolaos Mavridis, Computational Models for Integrating Linguistic and Visual Information: A Survey by Rohini K. Srihari and Towards Robot Imagination through Object Feature Inference by Juan G. Victores, Santiago Morante, Alberto Jardón and Carlos Balaguer.

Publications pertinent to scientific visualization and multimedia instructional design include: A Multi-level Typology of Abstract Visualization Tasks by Matthew Brehmer and Tamara Munzner, Visual Explanations: Images and Quantities, Evidence and Narrative by Edward R. Tufte and E. Weise Moeller, The Role of Narrative in Multimedia Learning by Myrna E. Diamond, What Storytelling Can Do for Information Visualization by Nahum Gershon and Ward Page, Verbal Frames and Ekphrastic Figuration by Tamar Yacobi, Visualization Rhetoric: Framing Effects in Narrative Visualization by Jessica Hullman and Nicholas Diakopoulos, Narrative Visualization: Telling Stories with Data by Edward Segel and Jeffrey Heer, Narrative Visualization: Sharing Insights into Complex Data by Graham Dove and Sara Jones, A Deeper Understanding of Sequence in Narrative Visualization by Jessica Hullman, Steven Drucker, Nathalie Henry Riche, Bongshin Lee, Danyel Fisher and Eytan Adar, Space, Time and Visual Analytics by Gennady Andrienko, Natalia Andrienko, Urska Demsar, Doris Dransch, Jason Dykes, Sara Irina Fabrikant, Mikael Jern, Menno-Jan Kraak, Heidrun Schumann and Christian Tominski, Verbalization of 3D Scenes based on Natural Language Generation Techniques by Vassilios Golfinopoulos, Dimitrios Makris, Georgios Bardis, Georgios Miaoulis and Dimitri Plemenos, Incremental Natural Language Description of Dynamic Imagery by Gerd Herzog, Chen-Ko Sung, Elisabeth André, Wilfried Enkelmann, Hans-Hellmut Nagel, Thomas Rist, Wolfgang Wahlster and Georg Zimmermann, Generating Coordinated Natural Language and 3D Animations for Complex Spatial Explanations by Stuart Towns and Charles B. Callaway and James C. Lester and Visual Semantic Approach for Virtual Scene Generation by Xin Zeng.

Publications pertinent to story visualization include: The Development of a Language Interface for 3D Scene Generation by Xin Zeng and Man Ling Tan, Toward Text-to-picture Synthesis by Andrew B. Goldberg, Jake Rosin, Xiaojin Zhu and Charles R. Dyer, An Ontology-based Approach to Text-to-picture Synthesis Systems by Dmitry Ustalov and Aleksander Kudryavtsev, Reconstructing Spatial Image from Natural Language Texts by Atsushi Yamada, Tadashi Yamamoto, Hisashi Ikeda, Toyoaki Nishida and Shuji Doshita, A Visually Grounded Natural Language Interface for Reference to Spatial Scenes by Peter Gorniak and Deb K. Roy, Extraction of Visual Material and Spatial Information from Text Description for Scene Visualization by Xin Zeng, Man Ling Tan, and W. Jing Chen, From Text Descriptions to Interactive 3D Scene Reconstruction by Man Ling Tan and Xin Zeng, A New Framework for Automatic 3D Scene Construction from Text Description by Jiajie Lu, Canlin Li, Chao Yin and Lizhuang Ma, Real-time Automatic 3D Scene Generation from Natural Language Voice and Text Descriptions by Lee M. Seversky and Lijun Yin, Visual Translator: Linking Perceptions and Natural Language Descriptions by Gerd Herzog and Peter Wazinski, Learning Visually Grounded Words and Syntax for a Scene Description Task by Deb K. Roy, Perceptually Grounded Word Meaning Acquisition: A Computational Model by Claudius Gläser and Frank Joublin, A Computational Model of Embodied Language Learning by Chen Yu and Dana H. Ballard, Towards Situated Speech Understanding: Visual Context Priming of Language Models by Deb K. Roy and Niloy Mukherjee, 3D Visualization of Simple Natural Language Statement Using Semantic Description by Rabiah A. Kadir, Abdul R. M. Hashim, Rahmita Wirza and Aida Mustapha, Understanding Scenes by Vassilios S. Golfinopoulos, Multiple Scene Understanding for Declarative Scene Modelling by Vassilios S. Golfinopoulos, Georgios Bardis, Dimitrios Makris, Georgios Miaoulis and Dimitri Plemenos, Depicting Dynamics Using Principles of Visual Art and Narrations by Marc Nienhaus and Jurgen Dollner, 3D Scene Creation Using Story-based Descriptions by Xin Zeng, Qasim H. Mehdi and Norman E. Gough, A Review of Scene Visualization Based on Language Descriptions by Xin Zeng and Man Ling Tan, Shape of the Story: Story Visualization Techniques by Xin Zeng, Qasim H. Mehdi, Norman E. Gough, Virtual Human Animation in Natural Language Visualisation by Minhua Ma and Paul McKevitt and Theatrical Text to 3D Virtual Scenography by Rabiafaranjato Velonoromanalintantely, Tahiry Andriamarozakaina, Cédric Sanza, Véronique Gaildrat, Monique Martinez-Thomas and Pouget Matthieu.

Publications pertinent to computer-aided design, creativity and group creativity include: Towards a Natural Language Interface for CAD by Tariq Samad and Stephen W. Director, The Language of Design by Andy Dong, Aspects of Language Use in Design Conversation by Friedrich Glock, Analysing Conversation: Studying Design as Social Action by Ben Matthews and Trine Heinemann, Exploring the Relationship between Lexical Behavior and Concept Formation in Design Conversations by Andy Dong, Kevin Davies and David McInnes, Using Language as Related Stimuli for Concept Generation by Ivey Chiu and L. H. Shu, Concept Formation as Knowledge Accumulation: A Computational Linguistics Study by Andy Dong, A Comparative Analysis of Multimodal Communication during Design Sketching in Co-located and Distributed Environments by Ozgur Eris, Nikolas Martelaro and Petra Badke-Schaub, Interaction, External Representation and Sense Making by David Kirsh, A Framework for the Study of External Representations in Collaborative Design Settings by Erica de Vries and Cédric Masclet, Sketching and the Psychology of Design by Rudolf Arnheim, Drawing as a Means to Design Reasoning by Ellen Yi-Luen Do and Mark D. Gross, Sketches from a Design Process: Creative Cognition Inferred from Intermediate Products by Saskia Jaarsveld and Cees Leeuwen, Representing Design Intents for Design Thinking Process Modelling by Jihong Liu and Zhaoyang Sun, Shared Design Thinking Process Model for Supporting Collaborative Design by Junpeng Du, Shikai Jing and Jihong Liu, The Role of Mental Models in Collaborative Sketching by Wei Xiang, Lingyun Sun, Shi Chen, Zhiyuan Yang and Zheng Liu, Shared Understanding as a Condition for Team Design by Rianne C. Valkenburg, Team Mental Models in Design by Petra Badke-Schaub, Kristina Lauche, and André Neumann, Investigating Design Cognition in the Construction and Enactment of Team Mental Models by Andy Dong, Maaike S. Kleinsmann and Fleur Deken, Cognitive, Collaborative, Conceptual and Creative — Four Characteristics of the Next Generation of Knowledge-based CAD Systems: A Study in Biologically Inspired Design by Ashok K. Goel, Swaroop Vattam, Bryan Wiltgen and Michael Helms, Creativity, Cooperation and Interactive Design by Susanne Bødker, Christina Nielsen and Marianne Graves Petersen, Research on Computer-aided Creative Design Platform based on Creativity Model by Xiaoying Liu, Yan Li, Peiyuan Pan and Wenqiang Li, Structuring Information for Design Problem Solving by Erica de Vries, The Role of Imagination in Creativity by Dustin Stokes, Explorations of Creative Visual Synthesis in Mental Imagery by Ronald A. Finke and Karen Slayton, Creative Imagery: Discoveries and Inventions in Visualization by Ronald A. Finke, Creativity in Design: Analyzing and Modeling the Creative Leap by Nigel Cross, Creativity, Emergence and Evolution in Design by John S. Gero, Computational Models of Innovative and Creative Design Processes by John S. Gero, A Computational View of Design Creativity by William J. Mitchell, Creativity and Design as Exploration by Brian Logan and Tim Smithers, Towards a Model of Exploration in Computer-aided Design by John S. Gero, A Model of Co-evolutionary Design by Mary Lou Maher, Co-evolution as a Computational and Cognitive Model of Design by Mary Lou Maher and Hsien-Hui Tang, Creativity: Understanding Innovation in Problem Solving, Science, Invention, and the Arts by Robert W. Weisberg, Creative Cognition as a Window on Creativity by Thomas B. Ward, Metacognition in Creativity by Bonnie B. Armbruster, Concept Generation Support by Conceptual Blending: Multi-area Inspiration Search by Do Thanh Mai, Perspectives on Concept Generation and Design Creativity by Toshiharu Taura and Yukari Nagai and A Systematized Theory of Creative Concept Generation in Design: First-order and High-order Concept Generation by Toshiharu Taura and Yukari Nagai.


Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s