ShiViz — Supporting materials for TSE journal submission
Paper title: Visualizing distributed system executions
User studies (Section 6)
We ran several user studies to evaluate ShiViz. These studies are described in the paper. We make available the questionnaires and anonymized results here.
Understanding distributed systems (Section 6.1)
- Slides for in-class ShiViz tutorial
- Questionnaire
- Reliable broadcast log (sort processes in ascending order by appearance in log)
- Log parsing regular expression: \[\w+\] \[(?([^ ]+ [^ ]+))\] [^ ]+ \[akka://Broadcast/user/(?\w+)\] (?.*\}) (?.*)
- Facebook data-center log (sort processes in descending order by # of events)
- Log parsing regular expression: (?(\d{1,3}\.){3}\d{1,3}) (?(\d{1,2}/){2}\d{4} (\d{2}:){2}\d{2} (AM|PM)) (?(INFO|GET|POST)) (?.*)\n(?\w*) (?.*)
- Voldemort log (sort processes in descending order by # of events)
- Log parsing regular expression: \[(?\d{4}-\d{2}-\d{2} (\d{2}:){2}\d{2},\d{3}) (?\S*)\] (?(INFO|WARN)) (?.*)\n(?\S*) (?{.*})
- Facebook log with multiple executions (sort processes in descending order by # of events)
- Log parsing regular expression: (?(\d{1,3}\.){3}\d{1,3}) (?(\d{1,2}/){2}\d{4} (\d{2}:){2}\d{2} (AM|PM)) (?(INFO|GET|POST)) (?.*)\n(?\w*) (?.*)
- Multiple executions regular expression delimiter: ^=== (?.*) ===$
- Treatment group
- Control group
- The control group relied on the raw logs to answer the questions.
- We followed the same protocol with the control group
participants, except these participants were not given
access to ShiViz.
- Results and analysis
Developing distributed systems (Section 6.2)
- Distributed systems course study