|
|
[[PageOutline]]
|
|
|
|
|
|
= Introduction =
|
|
|
# Introduction
|
|
|
|
|
|
The Tor Browser Bundle [https://blog.torproject.org/blog/volunteer-qa-price-freedom-eternal-vigilance Volunteer QA] process is managed by Runa A. Sandvik.
|
|
|
The Tor Browser Bundle [Volunteer QA](https://blog.torproject.org/blog/volunteer-qa-price-freedom-eternal-vigilance) process is managed by Runa A. Sandvik.
|
|
|
|
|
|
To participate in the process, subscribe to the [https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-qa tor-qa mailinglist]. Subscription is moderated, and you'll have to provide your platform information (or at least commit to collecting or writing tests) to Runa to participate, and discussion is restricted to commenting on specific releases and test suite development.
|
|
|
To participate in the process, subscribe to the [tor-qa mailinglist](https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-qa). Subscription is moderated, and you'll have to provide your platform information (or at least commit to collecting or writing tests) to Runa to participate, and discussion is restricted to commenting on specific releases and test suite development.
|
|
|
|
|
|
Do not mix test suite development discussion in release test result threads. We want to keep the release threads clean to easily check for regressions from release to release. Replying to test results to mention test page issues, known bugs, or to announce the filing of new bugs are perhaps the lone exceptions here.
|
|
|
|
|
|
If you want to simply view the action, the [http://lists.torproject.org/pipermail/tor-qa/ mailing list archives] are public.
|
|
|
If you want to simply view the action, the [mailing list archives](http://lists.torproject.org/pipermail/tor-qa/) are public.
|
|
|
|
|
|
= The Process =
|
|
|
# The Process
|
|
|
|
|
|
The process itself works as follows: Runa will send out a mail with a url to a set of builds with a time limit for feedback using the Functionality Checklist below. The length of the time limit will depend upon the release branch and the reasons for the release. If serious issues specific to that release are found, the build may be rejected. In all other cases, the build will be published upon expiry of the time limit, regardless of who actually tests it or replies.
|
|
|
|
... | ... | @@ -18,17 +18,17 @@ We want both positive and negative feedback in the release thread, as well as sp |
|
|
|
|
|
However, remember we want to keep the build test result threads focused on results, and not discussion.
|
|
|
|
|
|
= Documentation Checklist =
|
|
|
# Documentation Checklist
|
|
|
1. Check that the version number on the top line of the changelog file matches the version number in the filename (to prevent things #6084).
|
|
|
|
|
|
= Functionality Checklist =
|
|
|
# Functionality Checklist
|
|
|
1. TBB Launches successfully
|
|
|
1. Connects to the Tor network
|
|
|
1. Browser toolbars and menus work. Tab dragging works.
|
|
|
1. All extensions are present and functional
|
|
|
1. Web browsing works as expected. See Test Pages.
|
|
|
|
|
|
== Test Pages to Use ==
|
|
|
## Test Pages to Use
|
|
|
|
|
|
FIXME: At some point we should differentiate this into a "short list" for security and/or minor releases, and the "Full List" for the alpha releases.
|
|
|
|
... | ... | @@ -50,11 +50,14 @@ FIXME: At some point we should differentiate this into a "short list" for securi |
|
|
1. http://www.ip-check.info
|
|
|
* See "Expected issues with popular test pages"
|
|
|
|
|
|
Proposed by adrelanos: [[BR]]
|
|
|
https://www.browserleaks.com/ [[BR]]
|
|
|
http://www.stayinvisible.com/ [[BR]]
|
|
|
Proposed by adrelanos:
|
|
|
|
|
|
== Expected issues with popular test pages ==
|
|
|
https://www.browserleaks.com/
|
|
|
|
|
|
http://www.stayinvisible.com/
|
|
|
|
|
|
|
|
|
## Expected issues with popular test pages
|
|
|
1. Panopticlick will report a higher entropy than you might expect.
|
|
|
* See #6119 and https://lists.torproject.org/pipermail/tor-qa/2012-June/000015.html
|
|
|
1. We handle "Cache cookies" differently than some popular test pages expect
|
... | ... | @@ -67,7 +70,7 @@ http://www.stayinvisible.com/ [[BR]] |
|
|
* http://browserspy.dk/plugs.php reports a Java plug for all releases, even if Java is absent from the system
|
|
|
* http://browserspy.dk/plugins.php is a better plugin test page.
|
|
|
|
|
|
= Extra Bonus Stuff To Do If You're Feeling Awesome =
|
|
|
# Extra Bonus Stuff To Do If You're Feeling Awesome
|
|
|
1. Jail TBB using iptables rules that log proxy bypass. Watch your logs.
|
|
|
* https://trac.torproject.org/projects/tor/ticket/5741#comment:22
|
|
|
1. Use AppArmor or other sandbox that logs issues. Watch your logs.
|
... | ... | |