Design Challenge 2 Draft Feedback

by Mike Gleicher on November 22, 2017

I wanted to get some feedback to people quickly – so the individual feedback isn’t as extensive as I may have hoped. So instead, I am giving the feedback collectively. Each draft should get a comment in the handin – at least with a link to this posting.

Note: the 4/4 means you turned something in. It’s check/no check grading for the drafts.

Overall, I am very impressed by the quick scan that I did – there is a great diversity of assignments, and people are succeeding in many different ways. There are lots of different designs, and considerations of different tasks. Many assignments show some really good, deep thinking.

While going through assignments, I made a list of comments I would make. Some of these may apply to you. Even if I specified one or more, the others may be relevant as well. Or maybe you can see some of the problems that you don’t have.

Each is written about one design – it could be one of your designs have this problem, or that many do.

Or, it could be that your work doesn’t actually have this problem, I just thought it did at a quick glance.

(some critiques may be about the set of designs)

  1. Your design is quite specific to a particular data set or use case. For example, there are map designs (which make some assumptions about what the lines are) – where each line is a map.It’s OK to make highly specialized designs. Just document it. Be clear what are the requirements for when your design is applicable. Describe how your design might generalize.
  2. Your design/scenario isn’t one that obviously fits the assignment. The assignment is about line chart data (with many lines). It’s not clear how the data you’re describing and/or the design you’re giving fits. You should better explain how your design fits the model, and compare your designs to the standard designs (since the standard designs are a good fit for the data type – they just may not be effective for some tasks).
  3. Your design you provide is really similar to the standard designs. It’s not clear what the pros/cons are relative to the corresponding standard design. You should make that comparison more explicit.
  4. Your design doesn’t appear scale well in one of the axes. Try to explain why you think the design scales (or doesn’t, as the case may be).
  5. Having an experiment design is great – but you may want to add detail. What kind of data might you use for the examples? What kinds of things might you measure? How will you define tasks with measureable correctness?
  6. I can’t quite figure out what is going on in your design. Usually, this is a sign that the design is interesting (it’s non-standard enough that it isn’t obvious) – but it needs to be described better.
  7. Be sure to describe the designs in a clear way – and have it be easy to find the descriptions.
  8. Be careful about using adjacent area encodings for things that are not part/whole relationships.
  9. Consider spacing for the lasagna plots or some other method to make the rows more distinct.
  10. Using eye tracking for evaluation can be tricky.
  11. Make clear what you have implemented, and what is a mockup.
  12. Be sure to document how to run things and what tools/libraries were used.
  13. Your design is really simple, a very minor tweak on the standard. This is OK, if it has some other good feature to go along with it.
  14. Your discussion seems to focus on a single, small example. At least discuss how your designs scale, and why this single small example isn’t well served by the traditional designs.
  15. Your designs seem very similar. You may want to contrast them, and explain why you need multiple designs.
  16. I’m not sure I quite understand the task you describe, please elaborate/clarify.
  17. Comparison in a stacked chart can be hard since there is no common baseline.
  18. Designs that show one time at a time serve very limited tasks – be sure to consider what they can and cannot do.
  19. Try to back up assertions. Saying something is good requires some explanation.
  20. Discuss tasks as part of critique/comparison.
  21. It’s not clear how the design connects to the task
  22. If you’re focused on a single task, be sure to compare/contrast your designs.
  23. Descriptions and critique are terse.
  24. Describes cons (as well as pros) for designs.
  25. Give rationale for designs.
  26. Give comparisons with baseline designs.
Print Friendly, PDF & Email

Previous post:

Next post: