tree-testing-forum.md 4.89 KB
Newer Older
Nah's avatar
Nah committed
1
2
## Background

Nah's avatar
Nah committed
3
The purpose of this study is to test the flow and information structure of our discourse forum. If users are not able to find what they are looking for in the proposed structure it can result in frustration for them, causing a bad experience. We will be using the **Tree Testing** [methodology](https://www.nngroup.com/articles/tree-testing/) to understand the user experience with the flow, and generating a quantitative analysis report.
Nah's avatar
Nah committed
4
5
6

## Objectives

Nah's avatar
Nah committed
7
Evaluate the current structure for the discourse forum, our user flow, and any immediate pain point users may face when trying to find a topic or post a new entry in the forum.
Nah's avatar
Nah committed
8
9
10
11
12

## Participants

For this study, we will recruit participants who are already part of the Tor Community or some communication channel, such as mailing lists, that indicates their familiarity with collaborating or testing Tor products.

Nah's avatar
Nah committed
13
We expect between 15-50 participants for this study.
Nah's avatar
Nah committed
14
15
16
17
18
19
20

### Recruitment Strategy

We will send a Call For Participation (CFP) to: global-south, tor-qa, tor-project, community mailing lists.

## Methodology

Nah's avatar
Nah committed
21
In this Research Plan we will be using **Tree Testing** Methodology to ask research participants to complete findability tasks by using an information structure presented to them. This method will enable us to understand our users flow, ensuring we are using the right (or not) structure for the forum.
Nah's avatar
Nah committed
22

Nah's avatar
Nah committed
23
We will use a self-hosted LimeSurvey to create the activity for this study. This activity shouldn't last more than 10-15 minutes.
Nah's avatar
Nah committed
24
25
26
27
28
29
30

### We will need:
1. Instructions
2. Questions
3. Tasks

#### Instructions: 
Nah's avatar
Nah committed
31
32
33
34
- You will be asked to find a certain category on a list that resonate to your need;
- Click through the list until you get to the one that you think helps you complete the task;
- If you don't find the category you're looking for, you can let us know in a follow-up question.

Nah's avatar
Nah committed
35
36
37
38
39
40
41
42
43
44
45

Warning: Please don’t use the back button on your browser. This is not a test of your ability, there are no right or wrong answers.

#### Questions

Do users can successfully post a new topic using our discourse structure?
Do people feel more confident giving us feedback through discourse?
How many people successfully report a problem and search for at least one update of our product using discourse?

#### Tasks

Nah's avatar
Nah committed
46
47
Our research participants are familiar with one or more Tor products, and are potential participants for the forum. We will give them hypothetical 'scenarios' based on their uses of Tor products. We should use different language than the labels in the forum structure, and we only need one or two sentences for the tasks. We aim to provide 8 tasks in total.

Nah's avatar
Nah committed
48
49
1. Imagine you were navigating through Tor Browser Android and it crashed after trying to load your e-mail page. Use the tree below to indicate where you can share this problem.
2. A recent Tor Browser update has changed the way an existing feature works, and you don't like it. Where would you voice your opinion about the change?
Nah's avatar
Nah committed
50

Nah's avatar
Nah committed
51
3. An onion site you're trying to visit is not loading. Where would you look for help?
Nah's avatar
Nah committed
52

Nah's avatar
Nah committed
53
4. When navigating on The Tor Project website, you found a translation mistake and you want to report it. Where you go to do it?
Nah's avatar
Nah committed
54

Nah's avatar
Nah committed
55
5. A website you're usually to visit is not working. Where would you go to ask for help?
Nah's avatar
Nah committed
56

Nah's avatar
Nah committed
57
6. You're running a relay, but your relay is very slow. Where would you look for help?
Nah's avatar
Nah committed
58

Nah's avatar
Nah committed
59
7. You live in a country that is censoring Tor Network and you need to setup a bridge. The bridges provided are not working, where you go to ask for help?
Nah's avatar
Nah committed
60
61
62

##### Follow-up question for each task

Nah's avatar
Nah committed
63
Let's use two Likert Scale questions to measure participants perception about our tasks and structure. 
Nah's avatar
Nah committed
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90

1. Overall, how confident are you that you've completed the previous task successfully?

2. Overall, how difficult or easy was the task to complete?

#### Tree

|  |  |  |  |
| ------ | ------ | ------ | ------ |
| Forum Rules and Guidelines |  |  |  |
| Announcements |  |  |  |
| Feedback |  |  |  |
| Feedback | Tor Browser Alpha |  |  |
| Feedback | UI/UX |  |  |
| Feedback | Localization |  |  |
| Feedback | Websites |  |  |
| Feedback | Feature request |  |  |
| Support |  |  |  |
| Support | Tor Browser for Android |  |  |
| Support | Tor Browser Desktop |  |  |
| Support | Censorship Circumvention |  |  |
| Support | Onion Services |  |  |
| Support | Relay Operator |  |  |
| Support | Core Tor |  |  |
| In your language |  |  |  |
| In your language | Spanish |  |  |
| In your language | Portuguese |  |  |
Nah's avatar
Nah committed
91
92
| Mailing List|  |  |  |
| General Discussion|  |  |  |
Nah's avatar
Nah committed
93

Nah's avatar
Nah committed
94
95

#### Results
Nah's avatar
Nah committed
96
We will measure the **Sucess Rate**: the percentage of participants completing the task correctly, and determine if the proposed structure works. We can't measure Speed or Directness rate using LimeSurvey.
Nah's avatar
Nah committed
97
98
99
100

### Timeline
We will run this study for one-week, in August 2021.

Nah's avatar
Nah committed
101
102
103
104
105
### Issues
- https://gitlab.torproject.org/tpo/community/support/-/issues/40026
- https://gitlab.torproject.org/tpo/community/support/-/issues/40027