New Publication: More of what? Dissociating effects of conceptual and numeric mappings on interpreting colormap data visualizations

Our paper, “More of what? Dissociating effects of conceptual and numeric mappings on interpreting colormap data visualizations,” was published in Cognitive Research: Principles and Implications.

AUthors: LEXI SOTO,  MELISSA A. SCHOENLEIN, and Karen B. Schloss

In visual communication, people glean insights about patterns of data by observing visual representations of datasets. Colormap data visualizations (“colormaps”) show patterns in datasets by mapping variations in color to variations in magnitude. When people interpret colormaps, they have expectations about how colors map to magnitude, and they are better at interpreting visualizations that align with those expectations. For example, they infer that darker colors map to larger quantities (dark-is-more bias) and colors that are higher on vertically oriented legends map to larger quantities (high-is-more bias). In previous studies, the notion of quantity was straightforward because more of the concept represented (conceptual magnitude) corresponded to larger numeric values (numeric magnitude). However, conceptual and numeric magnitude can conflict, such as using rank order to quantify health—smaller numbers correspond to greater health. Under conflicts, are inferred mappings formed based on the numeric level, the conceptual level, or a combination of both? We addressed this question across five experiments, spanning data domains: alien animals, antibiotic discovery, and public health. Across experiments, the high-is-more bias operated at the conceptual level: colormaps were easier to interpret when larger conceptual magnitude was represented higher on the legend, regardless of numeric magnitude. The dark-is-more bias tended to operate at the conceptual level, but numeric magnitude could interfere, or even dominate, if conceptual magnitude was less salient. These results elucidate factors influencing meanings inferred from visual features and emphasize the need to consider data meaning, not just numbers, when designing visualizations aimed to facilitate visual communication.

Reference: Soto, L., Schoenlein, M. A., & Schloss, K. B. (2023). More of what? Dissociating effects of conceptual and numeric mappings on interpreting colormap data visualizations. Cognitive Research: Principles and Implications, 8, 38, 1-17. PDF

 

New Publication: Red and blue states: dichotomized maps mislead and reduce perceived voting influence

Our paper, “Red and blue states: dichotomized maps mislead and reduce perceived voting influence,” was published in Cognitive Research: Principles and Implications.

AUthors: Rémy A. Furrur,  Karen B. Schloss, Gary Lupyan, Paula M. Neidenthal, and Adrienne Wood

 

In the United States the color red has come to represent the Republican party, and blue the Democratic party, in maps of voting patterns. Here we test the hypothesis that voting maps dichotomized into red and blue states leads people to overestimate political polarization compared to maps in which states are represented with continuous gradations of color. We also tested whether any polarizing effect is due to partisan semantic associations with red and blue, or if alternative hues produce similar efects. In Study 1, participants estimated the hypothetical voting patterns of eight swing states on maps with dichotomous or continuous red/blue or orange/green color schemes. A continuous gradient mitigated the polarizing efects of red/blue maps on voting predictions. We also found that a novel hue pair, green/orange, decreased perceived polarization. Whether this efect was due to the novelty of the hues or the fact that the hues were not explicitly labeled “Democrat” and “Republican” was unclear. In Study 2, we explicitly assigned green/orange hues to the two parties. Participants viewed electoral maps depicting results from the 2020 presidential election and estimated the voting margins for a subset of states. We replicated the finding that continuous red/blue gradient reduced perceived polarization, but the novel hues did not reduce perceived polarization. Participants also expected their hypothetical vote to matter more when viewing maps with continuous color gradations. We conclude that the dichotomization of electoral maps (not the particular hues) increases perceived voting polarization and reduces a voter’s expected influence on election outcomes.

New Publication: Unifying Effects of Direct and Relational Associations for Visual Communication

Our paper, “Unifying Effects of Direct and Relational Associations for Visual Communication,” was published in IEEE Transactions on Visualization and Computer Graphics.

AUthors: Melissa A. Schoenlein, Jonny Campos, Kevin J. Lande, Laurent Lessard, and Karen B. Schloss

 

People have expectations about how colors map to concepts in visualizations, and they are better at interpreting visualizations that match their expectations. Traditionally, studies on these expectations (inferred mappings) distinguished distinct factors relevant for visualizations of categorical vs. continuous information. Studies on categorical information focused on direct associations (e.g., mangos are associated with yellows) whereas studies on continuous information focused on relational associations (e.g., darker colors map to larger quantities; dark-is-more bias). We unite these two areas within a single framework of assignment inference. Assignment inference is the process by which people infer mappings between perceptual features and concepts represented in encoding systems. Observers infer globally optimal assignments by maximizing the “merit,” or “goodness,” of each possible assignment. Previous work on assignment inference focused on visualizations of categorical information. We extend this approach to visualizations of continuous data by (a) broadening the notion of merit to include relational associations and (b) developing a method for combining multiple (sometimes conflicting) sources of merit to predict people’s inferred mappings. We developed and tested our model on data from experiments in which participants interpreted colormap data visualizations, representing fictitious data about environmental concepts (sunshine, shade, wild fire, ocean water, glacial ice). We found both direct and relational associations contribute independently to inferred mappings. These results can be used to optimize visualization design to facilitate visual communication

Reference: Schoenlein, M. A., Campos, J., Lande, K. J., Lessard, L., & Schloss, K. B. (2023). Unifying Effects of Direct and Relational Associations for Visual Communication. IEEE Transactions on Visualization and Computer Graphics, 29, 1, 385-395.  PDF

New Publication: A holey perspective on Venn diagrams

Our new paper, “A holey perspective on Venn diagrams,” was published in Cognitive Science.

Authors: Anna N. Bartel, Kevin J. Lande,  Joris Roos, and Karen B. Schloss

When interpreting the meanings of visual features in information visualizations, observers have expectations about how visual features map onto concepts (“inferred mappings”). In this study we examined whether aspects of inferred mappings, previously identified for other types of visualizations (e.g., colormap data visualizations), generalize to a different type of visualization, Venn diagrams. Venn diagrams offer an interesting test case because empirical evidence about the nature of inferred mappings for colormaps suggests that established conventions for Venn diagrams are counterintuitive. Venn diagrams represent classes using overlapping circles and express logical relationships between those classes by shading out regions to encode the concept of non-existence, or none. We propose that people do not simply expect shading to signify non-existence, but rather they expect regions that appear as holes to signify non-existence (the “hole hypothesis”). The appearance of a hole depends on perceptual properties in the diagram in relation to its background. Across three experiments, results supported the hole hypothesis, underscoring the importance of configural processing for interpreting the meanings of visual features in information visualizations.

Reference: Bartel, A. N., Lande, K. J., Roos, J., & Schloss, K. B. (2021). A holey perspective on Venn diagrams. Cognitive Science, 46, 1, e13073. PDF

 

 

IEEE VIS 2021 Honorable Mention for Best Paper

Our paper “Context matters: A theory of semantic discriminability for perceptual encoding systems” received Honorable Mention for best paper at IEEE VIS 20211!

This paper presents semantic discriminability theory, a new theory on constraints for generating semantically discriminable perceptual features for encoding systems that map perceptual features to concepts. We provided evidence supporting two hypotheses that arise from the theory. First, the capacity to create semantically discriminable color palettes for a set of concepts depends on the difference in color-concept association distributions between those concepts, independent of properties of the concepts alone. Second, people can accurately interpret mappings between colors and concepts for concepts previously considered “non-colorable,” to the extent that the colors are semantically discriminable. Although we focused on color in this study,  the theory has potential to extend to other types of visual features (e.g., shape, orientation, visual texture) and features in other  perceptual modalities (e.g., sound, odor, touch).

Reference: Mukherjee, K., Yin, B., Sherman, B. E., Lessard, L. & Schloss, K. B. Context matters: A theory of semantic discriminability for perceptual encoding systems. IEEE Transactions on Visualization and Computer Graphics.  PDF

Estimating color-concept associations from image statistics

Our paper on how estimating color-concept associations from images will be published in IEEE Transactions on Visualization and Computer Graphics (TVCG) and presented at InfoVis 2019. This study assessed different methods for estimating color-concept associations from image statistics.  The most effective model used features that were relevant to human perception and cognition—features aligned with perceptual dimensions of color space and a feature that extrapolated to all colors within a color category.

Rathore, R., Leggon, Z., Lessard, L., Schloss, K. B. (in press). Estimating color-concept associations from image statistics. IEEE Transactions on Visualization and Computer Graphics

New Publication: Color, Music, and Emotion: Bach to the Blues

 

Our new article on color-music associations for a wide variety of genres was recently published in i-Perception. 

Color-music associations can be predicted from lower-level perceptual dimensions and higher-level emotional dimensions, but evidence indicates that the lower-level correspondences are mediated by shared emotional content between the colors and the music.

 

Whiteford, K. L., Schloss, K. B., Helwig, N. E., & Palmer, S. E. (2018). Color, Music, and Emotion: Bach to the Blues. i-Perception9(6), 1-27. 

New Publication: Color inference in visual communication: the meaning of colors in recycling

Our new article on how people interpret messages in color-coding systems was published in Cognitive Research: Principles and Implications (CRPI).

REFERENCE: Schloss, K. B., Lessard, L., Walmsley, C. S., & Foley, K. (2018). Color inference in visual communication: The meaning of colors in recycling. Cognitive Research: Principles and Implications, 3, 5.

New Publication: Seasonal Changes in Color Preferences Are Linked to Variations in Environmental Colors: A Longitudinal Study of Fall

Our new article on how and why color preferences change of the course of Fall was published in the i-Perception Special Issue: Seeing Colors.

REFERENCE: Schloss, K. B., & Heck, I. A. (2017). Seasonal changes in color preferences are linked to variations in environmental colors: A longitudinal study of fall, i-Perception, 8, 6, 1-19.