UW Graphics Group
= Menu


This page contains information associated with our publication for InfoVis 2013, Perception of Average Value in Multiclass Scatterplots.

For the paper itself, click here.

For the talk slides, click here.

For information about the experimental stimuli and design (along with sample experiments), click here.

For data tables and other resources, click here.

Other questions and requests can be directed to the paper authors.

Experiments

We conducted a series of experiments for this paper. This website provides details about these experiments not included in the paper for reasons of space or relevancy, as well as information for reproducibility.

A sample version of the experiment run in this paper (with slightly fewer stimuli for the purpose of convenience) is kept running here.

Simplified versions of the experiments (without consent forms, training, and with participant feedback) will be available here, as well as the associated stimuli for the experiment sets.

Experiment Set One

The following is the stimuli set we used in our first round of experiments, in which encoding type was a between-subjects factor. The "short name" is used to refer to a particular encoding level both here and in the data tables.

Each file contains .png images with the following format:
(R,P,T,F)+/-(00-40)-(00-02)
The image kind (Regular, Practice, Tutorial, or Flipped regular).The difference between the first class and the second, in units of 4 pixelsThe image index

Short NameStimuliDescription
ColorColor.zip (624 kB)Orange vs. purple circles
ColorConfusiColorConfusi.zip (748 kB)Orange vs. purple, randomly triangles or circles
ColorRedundaColorRedunda.zip (1.1 MB)Orange circles vs. purple trianges
ColorTrianglColorTriangl.zip (1.2 MB)Orange triangles vs. purple triangles
GreenDistracGreenDistrac.zip (595 kB)Orange circles vs. purple circles, green distractor circles
GreenShapeGreenShape.zip (876 kB)Orange vs. purple with green distractors, randomly triangles or circles
LuminanceLuminance.zip (861 kB)Dark gray circles vs. light gray circles
ShapeShape.zip (1.0 MB)Purple circles vs. purple triangles
ShapeConfusiShapeConfusi.zip (961 kB)Circles vs. triangles, randomly orange or purple
TriConfusingTriConfusing.zip (767 kB)Orange triangles vs. purple triangles, randomly rightside-up or upside-down

Experiment Set Two

The following is the stimuli set we used in our second round of experiments, in which encoding type was a two-level within-subjects factor. The "short name" is used to refer to a particular encoding level both here and in the data tables. Block 1 represents a "baseline" condition.

Each file contains two folders, Block 1 and Block 2, each of which contain .png images with the following format:
(R,P,T,F)+/-(00-40)-(00-02)
The image kind (Regular, Practice, Tutorial, or Flipped regular).The difference between the first class and the second, in units of 4 pixelsThe image index

Short NameStimuliBlock 1 DescriptionBlock 2 Description
Color75Color75.zip (1.7 MB)Orange vs. purple circles, 50 points per classOrange vs. purple circles, 75 points per class
ColorConflictColorConflict.zip (2.0 MB)Orange vs. purple circlesOrange vs. purple, randomly circles or traingles.
ColorDistractorColorDistractor.zip (2.0 MB)Orange vs. purple circlesOrange vs. purple circles, additional (extraneous) class of green circles
ColorDistvsColorShDiColorDistvsColorShDi.zip (3.3 MB)Orange circles vs. purple circles, additional (extraneous) class of green circlesOrange vs purple, additional green class, randomly circles or triangles
ColorGreenDistrColorGreenDistr.zip (3.0 MB)Orange vs. purple circlesOrange vs. purple, additional green class, randomly circles or triangles
ColorRedundantColorRedundant.zip (2.0 MB)Orange vs. purple with green distractors, randomly triangles or circlesOrange circles vs. purple circles
PlusSquare-ColorConfPlusSquare-ColorConf.zip (936 kB)Purple pluses vs. purple squaresPluses vs. squares, randomly purple or orange
PlusSquare-ColorReduPlusSquare-ColorRedu.zip (883 kB)Purple pluses vs. purple squaresPurple pluses vs. orange squares
ShapeColorDistrShapeColorDistr.zip (2.2 MB)Purple circles vs. purple trianglesCircles vs. triangles, randomly purple or orange

Data

The raw data tables for our experiment sets are stored as two .csv files. For reasons of privacy, information which could be use to identify participants has been removed. Certain participants did not meet the quality standards required for inclusion in our analysis. These participants have been excised from the data tables.

Each csv contains a number of columns. Not every column is in every table. This table explains those headings:

idA pseudo-random anonymous participant idenitifier.
indexThe question number of this particular trial for the participant.
imgWhat specific image did the participant see in this trial?
flippedWas a point from the first group always the highest absolute point (0), or a point from the second group (1).
encodingWhat encoding was being tested in this experiment? (See above for list of encoding abbreviations)
blockOrderWhich block did this participant see first.
blockWhich block was the participant on when they answered the question.
deltaDifference between the first group and the second, in units of 4 pixels.
absDeltaAbsolute value of delta.
signIs the sign of delta positive (1) or negative (0).
ansWhich group did the participant guess? (1=the first group or 0= the second group).
isRightDid the participant guess correctly (1=yes or 0=no).

Data for experiment set one (between-subjects test of encoding): between.csv (236 kB)

Data for experiment set two (within-subjects test of encoding): within.csv (1.5 MB)