Virtual Brain Demos Coming Soon!

VSS 2022 demo night lessons, including the Desktop versions and the touch system, are coming soon! Stay tuned!

Kushin Mukherjee awarded Kenzi Valentyn Vision Research Grant

Kushin Mukherjee was awarded a Kushin Mukherjee awarded Kenzi Valentyn Vision Research Grant from the McPherson Eye Research Institute at the University of Wisconsin-Madison.

His project is on understanding how visual communication shapes the structure of visual concept representations. Congrats Kushin!

New publications

We are excited to announce two new papers! Mukherjee et al. presents a new theory of semantic discriminability for visual communication,  and Schloss et al., is our first paper on the UW Virtual Brain Project!

Mukherjee, K., Yin, B., Sherman, B. E., Lessard, L. & Schloss, K. B. Context matters: A theory of semantic discriminability for perceptual encoding systems. IEEE Transactions on Visualization and Computer Graphics.  PDF

 

Schloss, K. B., Schoenlein, M. A., Tredinnick, R., Smith, S. Miller, N. Racey, C. Castro, C. Rokers, B. (2021-online). The UW Virtual Brain Project: An immersive approach to teaching functional neuroanatomy. Translational Issues in Psychological Science. PDF

 

PI Karen Schloss received the 2020 Steve Yantis Early Career Award

The Psychonomic Society awarded PI Karen Schloss with the 2020 Steve Yantis Early Career award. As stated on their site:

The Psychonomic Society confers scientific awards each year upon young scientists who have made excellent scientific contributions to the field of cognitive psychology early in their careers. The purpose of the Early Career Award (ECA) is to raise the visibility of our science by recognizing excellent young scientists within the field.

https://www.psychonomic.org/page/early_career_award

 

Color-concept associations

Associations between visual features and concepts are at the core of visual reasoning. Evidence suggests that color-concept associations are the basis on which people (1) evaluate preferences for colors, (2) evaluate preferences for entities, and (3) interpret meanings of colors in information visualizations. The link between color-concept associations and these three seemingly different types of judgements can be understood within the Color Inference Framework (Schloss, 2018). The framework posits that people continually form and update their associations between colors and concepts through color-related experiences in the world. These associations can be represented in a network that stores associations between all possible colors and concepts. Different kinds of inference operations are computed on the color-concept association network to produce different kinds of judgments: pooling produces preferences for colors, transmitting influences preferences for entities, and assigning determines interpretations of the meanings of colors in visual encoding systems. 

In this line of research we have two key objectives. First, we aim to understand how people form color-concept associations through their experiences in the world. Second, we aim to develop efficient ways of quantifying color-concept associations by leveraging image databases and computational modeling. With good estimates of color-concept associations, we will be able to produce more comprehensive predictions about how these associations contribute to visual reasoning.

Automatically estimating color-concept associations

Quantifying color-concept associations is a central part of our research, but obtaining those judgments from human participants is costly in time and effort. Building on prior work using large-scale databases, we are working on new ways to automatically estimate color-concept associations. So far, we have developed a hybrid approach using image statistics and human judgments. We trained and tested models using human ratings on a specific set of colors, and once the models were trained, they could be used to estimate color-concept associations for new concepts and new colors without humans in the loop. The most effective model used features that were relevant to human perception and cognition, aligning with perceptual dimensions of color space and extrapolating within color categories (Rathore, Leggon, Lessard, & Schloss, 2020). 

 

These methods will advance the field’s understanding of visual reasoning for visual communication in a few ways. First, they will help make visual reasoning research more efficient by circumventing the need to collect human ratings each time we to quantify color-concept associations to use for experiment designs on interpreting information visualizations. Second, these models provide insights into how humans form color-concept associations. Third, they will help achieve a long-term goal of automatically producing optimal color palettes for semantically interpretable visualizations.

Understanding how color-concept associations map onto dimensions in color space

Both in the scientific literature and in popular culture, it is common to find claims like color x means y (e.g., red means anger). However, color-concept associations are not so discreet or unitary. Color-concept associations are graded and continuous across color space, not all-or-none. Researchers can quantify the associations between a given concept and all possible colors, and represent them in what we call a “color-concept association space”. We contend that every concept has a color-concept association space, which means every color is associated with every concept to some degree, even if that degree is near zero. 

From this perspective, we can approach characterizing color-concept associations by quantifying how they map onto dimensions within color space (e.g., lightness, chroma, redness vs. greenness, and yellowness vs. blueness). This approach has been shown to dispel commonly held notions about color-concept associations. In particular, it is commonly held that yellow hues are associated with happiness whereas blues hues are associated with sadness. We found that happiness/sadness of colors was dominated by lightness and chroma. When lightness and chroma were controlled statistically or colorimetrically, yellow hues were no happier than blue hues and in some cases blue hues were happier (Schloss, Witzel, & Lai, 2020). Although the origin of these color-emotion associations is still unclear, having a more accurate description of the phenomena will help constrain possible accounts of where color-emotion associations come from and why they exist.

Christopher Thorstenson to RIT

CChristopher Thorstensonhristopher Thorstenson has been appointed to a tenure-track position in Color Science at Rochester Institute of Technology. He will start in Fall 2021, so excitedly, we get to keep him for another year! Congratulations Chris!

NSF CAREER award

PI Karen Schloss received an NSF CAREER award to advance the understanding of visual reasoning for visual communication. This research can be translated to producing online tools for designing visualizations, which will improve STEM education and increase public literacy and engagement with science and technology. Our education plan will use visual communication to make science more accessible and engaging through virtual reality (VR) and accompanying hands-on experiences with color and visualization.  Click here for more details.

Congrats to Autumn Wickman!

Autumn Wickman

Autumn Wickman received an Outstanding Undergraduate Research Scholar Award from the UW-Madison Department of Psychology. Congratulations Autumn!

Estimating color-concept associations from image statistics

Our paper on how estimating color-concept associations from images will be published in IEEE Transactions on Visualization and Computer Graphics (TVCG) and presented at InfoVis 2019. This study assessed different methods for estimating color-concept associations from image statistics.  The most effective model used features that were relevant to human perception and cognition—features aligned with perceptual dimensions of color space and a feature that extrapolated to all colors within a color category.

Rathore, R., Leggon, Z., Lessard, L., Schloss, K. B. (in press). Estimating color-concept associations from image statistics. IEEE Transactions on Visualization and Computer Graphics