Authors: Salman Mahmood, Klaus Mueller
Abstract: Elo is a popular rating scheme in chess and online games. We propose a modified version of the Elo rating system to compare visualization designs in an efficient and asynchronous manner. Our method allows researchers to evolve the design of a visualization layout and monitor its performance. We study our method for testing small multiple designs. Small multiples is a very popular technique to reduce clutter in visualizations. However, they can be difficult to interpret for people who are not entirely familiar with them. We designed various exploded view methods to make small multiples comprehensible and then compared them using our adaptation of the Elo rating system.