Eye tracking in multimodal comprehension of graphs

2012-07-31
Eye tracking methodology has been a major empirical research approach for the study of online comprehension processes in reading and scene viewing. The use of eye tracking methodology for the study of diagrammatic representations, however, has been relatively limited so far. The investigation of specific types of diagrammatic representations, such as statistical graphs is even scarce. In this study, we propose eye tracking as an empirical research approach for a systematic analysis of multimodal comprehension of line graphs. Based on a framework of multimodal comprehension of graphs and texts, which focuses on the role of spatial concepts, we present an experimental investigation of linguistic guidance and eye movement control in comprehension of time-domain line graphs with a particular focus on the analysis of gaze patterns in graph inspections.

Suggestions

Investigation of haptic line graph comprehension through co production of gesture and language
Deniz, Ozan; Mehmetcan, Fal; Acartürk, Cengiz (null; 2013-06-30)
In communication settings, statistical graphs accompany language by providing visual access to various aspects of domain entities, such as conveying information about trends. A similar and comparable means for providing perceptual access is to provide haptic graphs for blind people. In this study, we present the results of an experimental study that aimed to investigate visual line graphs and haptic line graphs in time domain by means of gesture production as an indicator of event conceptualization. The par...
Towards a systematic understanding of graphical cues in communication through statistical graphs
Acartürk, Cengiz (2014-04-01)
Statistical graphs in particular, line graphs and bar graphs are efficient means of communication in a wide range of non-expert settings. In communication settings, statistical graphs do not only serve as visualizations of individual data points but also provide visual access to various aspects of the information contained in data. Moreover, specific types of graphs are better means for providing visual access to certain aspects of data. For instance, trend information is visually conveyed through line grap...
Verbally assisted haptic graph comprehension The role of taking initiative in a joint activity
Deniz, Ozan; Mehmetcan, Fal; Acartürk, Cengiz (2014-08-31)
Statistical graphs are tools for multimodal communication in daily life settings. For visually impaired people, haptic interfaces provide perceptual access to the information provided by the graph. Haptic comprehension is facilitated by audio and verbal assistance. We investigate the circumstances under which verbal assistance facilitates haptic comprehension of graphs. For this, we focus on cases where unaided haptic graph comprehension has limitations, such as when describing a global (rather than a local...
Micro analysis of referring expressions in a dual eye tracking paradigm Two case studies on voice and chat mediated interaction
Çakır, Murat Perit; Acartürk, Cengiz (null; 2013-07-31)
Performance evaluation of saliency map methods on remotely sensed RGB images
Sönmez, Selen; Halıcı, Uğur; Department of Geodetic and Geographical Information Technologies (2016)
Predictive applications of human eye visualization so called saliency map computational models become more attractive in image processing studies. Saliency map highlights regions that are distinctive from their surrounding in the images in interest. In this study, various computational models for salient region detection are investigated on remotely sensed images. The computational methods considered are Itti-Koch, Graph-Based Visual Saliency, Saliency Detection by Combining Simple Priors, Frequency-tuned S...
Citation Formats
C. Acartürk, “Eye tracking in multimodal comprehension of graphs,” 2012, vol. 887, Accessed: 00, 2021. [Online]. Available: http://ceur-ws.org/Vol-887/.