Category: Announcement

New Publication: Unifying Effects of Direct and Relational Associations for Visual Communication

Our paper, “Unifying Effects of Direct and Relational Associations for Visual Communication,” was published in IEEE Transactions on Visualization and Computer Graphics.

AUthors: Melissa A. Schoenlein, Jonny Campos, Kevin J. Lande, Laurent Lessard, and Karen B. Schloss

 

People have expectations about how colors map to concepts in visualizations, and they are better at interpreting visualizations that match their expectations. Traditionally, studies on these expectations (inferred mappings) distinguished distinct factors relevant for visualizations of categorical vs. continuous information. Studies on categorical information focused on direct associations (e.g., mangos are associated with yellows) whereas studies on continuous information focused on relational associations (e.g., darker colors map to larger quantities; dark-is-more bias). We unite these two areas within a single framework of assignment inference. Assignment inference is the process by which people infer mappings between perceptual features and concepts represented in encoding systems. Observers infer globally optimal assignments by maximizing the “merit,” or “goodness,” of each possible assignment. Previous work on assignment inference focused on visualizations of categorical information. We extend this approach to visualizations of continuous data by (a) broadening the notion of merit to include relational associations and (b) developing a method for combining multiple (sometimes conflicting) sources of merit to predict people’s inferred mappings. We developed and tested our model on data from experiments in which participants interpreted colormap data visualizations, representing fictitious data about environmental concepts (sunshine, shade, wild fire, ocean water, glacial ice). We found both direct and relational associations contribute independently to inferred mappings. These results can be used to optimize visualization design to facilitate visual communication

Reference: Schoenlein, M. A., Campos, J., Lande, K. J., Lessard, L., & Schloss, K. B. (2023). Unifying Effects of Direct and Relational Associations for Visual Communication. IEEE Transactions on Visualization and Computer Graphics, 29, 1, 385-395.  PDF

Welcome to the Schloss Visual Reasoning Lab! We are part of the Department of Psychology and Wisconsin Institute for Discovery, Virtual Environments Group at the University of Wisconsin–Madison.  Our lab aims to understand how people use visual reasoning for visual communication.  We study how people form associations between visual features (e.g., color, shape) and concepts, and how they use those associations to interpret meanings of visual features in information visualizations (e.g., graphs, maps, diagrams, signs). Our lab also investigates how to increase engagement in science through immersive experiences in scientific visualizations using virtual reality. Our work can be translated to making visual communication more effective and efficient.

Recruiting graduate students for Fall 2023

The Schloss Visual Reasoning Lab is recruiting qualified graduate students to start in Fall 2023 in the Department of Psychology and Wisconsin Institute for Discovery at the University of Wisconsin-Madison!

If you are interested in joining the lab as a PhD student, please send Karen Schloss an introductory email that outlines your research interests and explains why our lab would be a good place to pursue those interests. Please also include your current academic CV in your email.

Before reaching out to us, please familiarize yourself with the lab’s current research. We suggest reading the following two papers, which will give you a sense of the ongoing work in the lab and the kind of research you may do if you join our group: 

(1) Unifying effects of direct and relational associations for visual communication

(2) Context matters: A theory of semantic discriminability for perceptual encoding systems

We look forward to hearing from you!

PI Karen Schloss was promoted to Associate Professor with tenure

PI Karen Schloss has been promoted to Associate professor with tenure!

She is extremely grateful to her students, collaborators, mentors, colleagues, friends, family, and the staff in Psychology and WID for their support in the process.

Go Badgers!

 

New Publication: Color-concept association formation for novel concepts

Our new paper, “Color-concept association formation for novel concepts,” was published in Visual Cognition.

AUthors: Melissa A. Schoenlein and Karen B. Schloss

 

Color-concept associations influence fundamental processes in cognition and perception, including object recognition, color perception, and visual reasoning. To fully understand these effects, it is necessary to understand how color-concept associations are formed. It is assumed that color-concept associations are learned through experiences in the world, but questions remain concerning how association formation is influenced by properties of the input and cognitive factors during input. We addressed these questions by first exposing participants to color-concept co-occurrences for novel concepts (“Filk” and “Slub” alien species) using a category learning task. We then assessed color-concept associations using an association rating task. During alien species category learning, color was a noisy cue and shape was 100% diagnostic of species category membership, so participants could have ignored color to complete the task. Nonetheless, participants learned systematic color-concept associations for “seen” colors during alien category learning and generalized to “unseen” colors as a function of color distance from the seen colors (Experiment 1). Association formation not only depended on color-alien co-occurrences during the alien category learning task, but also depended on cognitive structure of color categories (e.g., degree to which an observed red color is typical of the color category “red”) (Experiment 2). Thus, environmental and cognitive factors combine to influence color-concept associations formed from experiences in the world.

Reference: Schoenlein, M. A. & Schloss, K. B. (2022). Color-concept association formation for novel concepts. Visual Cognition. PDF

Dr. Anna Bartel graduated with her PhD in Psychology

Dr. Anna Bartel graduated with her PhD from the UW-Madison Department of Psychology!

We were honored to have Anna as a member of the lab, and we wish her all the best in her next steps as an Efficacy and Impact Researcher on the Learning and Technology team at WestEd!

Congratulations Anna!

Kelsey Campbell awarded Outstanding Undergraduate Research Scholar Award

Kelsey Campbell was awarded the Outstanding Undergraduate Research Scholar Award from the Department of Psychology at the University of Wisconsin-Madison.

This award recognizes outstanding undergraduate Psychology majors for their contribution to research in our department. We thank Kelsey for her outstanding work in our lab!

Congratulations Kelsey, and best of luck with your graduate studies!

Melissa Schoenlein awarded 2022 Elsevier/Vision Research Travel Award

Melissa SchoenleinMelissa Schoenlein received a 2022 Elsevier/Vision Research Travel Award to present her work at the Annual Meeting of the Vision Sciences Society.

Talk title: “Color category boundaries predict generalization of color-concept associations”

Congratulations Melissa!

Clementine Zimnicki awarded Kenzi Valentyn Vision Research Grant

Clementine Zimnicki was awarded a Kenzi Valentyn Vision Research Grant from the McPherson Eye Research Institute at the University of Wisconsin-Madison.

Her project is on understanding factors that influence people’s interpretations of colormap data visualizations. Congrats Clementine!

IEEE VIS 2021 Honorable Mention for Best Paper

Our paper “Context matters: A theory of semantic discriminability for perceptual encoding systems” received Honorable Mention for best paper at IEEE VIS 20211!

This paper presents semantic discriminability theory, a new theory on constraints for generating semantically discriminable perceptual features for encoding systems that map perceptual features to concepts. We provided evidence supporting two hypotheses that arise from the theory. First, the capacity to create semantically discriminable color palettes for a set of concepts depends on the difference in color-concept association distributions between those concepts, independent of properties of the concepts alone. Second, people can accurately interpret mappings between colors and concepts for concepts previously considered “non-colorable,” to the extent that the colors are semantically discriminable. Although we focused on color in this study,  the theory has potential to extend to other types of visual features (e.g., shape, orientation, visual texture) and features in other  perceptual modalities (e.g., sound, odor, touch).

Reference: Mukherjee, K., Yin, B., Sherman, B. E., Lessard, L. & Schloss, K. B. Context matters: A theory of semantic discriminability for perceptual encoding systems. IEEE Transactions on Visualization and Computer Graphics.  PDF