tor-browser-bundle-testsuite issueshttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues2023-12-08T09:26:09Zhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40079Clean mullvadbrowser builds using browser-all-desktop instead of browser-all ...2023-12-08T09:26:09ZboklmClean mullvadbrowser builds using browser-all-desktop instead of browser-all targetIn #40076 we updated
`rbm-config/tb-build-06.torproject.org.rbm.local.conf` to clean
mullvadbrowser builds, however we used the `browser-all` target, which
doesn't work since mullvadbrowser is not currently built for android.
So we shoul...In #40076 we updated
`rbm-config/tb-build-06.torproject.org.rbm.local.conf` to clean
mullvadbrowser builds, however we used the `browser-all` target, which
doesn't work since mullvadbrowser is not currently built for android.
So we should use the `browser-all-desktop` target instead.boklmboklmhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40075Move nightly builds to tb-build-062023-08-22T17:06:37ZboklmMove nightly builds to tb-build-06With tpo/tpa/team#40984 we have a new machine for nightly build.
While moving nightly builds there, we should configure the build to use
`/tmp` during the build.
List of tasks:
- [x] Update references to `tb-build-01` on wiki page: htt...With tpo/tpa/team#40984 we have a new machine for nightly build.
While moving nightly builds there, we should configure the build to use
`/tmp` during the build.
List of tasks:
- [x] Update references to `tb-build-01` on wiki page: https://gitlab.torproject.org/tpo/applications/tor-browser/-/wikis/Nightly_Builds_Setup
- [x] Update references to `tb-build-01` in tor-browser-bundle-testsuite.git: !33
- [ ] Use `/tmp` in `rbm.local.conf`: !34
- [x] Generate two new ssh key on `tb-build-06` for user `tb-builder`, and add them to `tbb-nightlies-master` (with `command` option, following https://gitlab.torproject.org/tpo/applications/tor-browser/-/wikis/Nightly_Builds_Setup#rsync-between-tb-build-06-and-tbb-nightlies-master)
- [x] Remove old ssh keys from `/etc/ssh/userkeys/tbb-nightlies` on `tbb-nightlies-master`
- [x] Copy gpg key (CB91EDC56B9E276D7144ABD567509BB73B8DE954) from `tb-build-01` to `tb-build-06`
- [x] Copy `/home/tb-builder/nightly-builds` from `tb-build-01` to `tb-build-06`
- [x] Copy `/home/tb-builder/tor-browser-builds-archive` from `tb-build-01` to `tb-build-06`
- [x] Clone `/home/tb-builder/tor-browser-bundle-testsuite` on `tb-build-06`
- [x] Disable cron job on `tb-build-01`
- [x] Add cron job on `tb-build-06`boklmboklmhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40074Add Nightly builds of the openssl project for linux-arm2023-06-28T18:45:50ZboklmAdd Nightly builds of the openssl project for linux-arm/cc @JeremyRand/cc @JeremyRandboklmboklmhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40073Create incrementals for base-browser nightly builds2023-03-20T15:31:28ZboklmCreate incrementals for base-browser nightly buildsboklmboklmhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40072Fix torbrowser-incrementals-nightly-*2023-02-08T10:30:32ZboklmFix torbrowser-incrementals-nightly-*Building incrementals for Tor Browser during nightly builds currently fails with:
```
make: *** No rule to make target 'incrementals-nightly'. Stop.
```
We need to update the makefile target we use after tor-browser-build#40742.Building incrementals for Tor Browser during nightly builds currently fails with:
```
make: *** No rule to make target 'incrementals-nightly'. Stop.
```
We need to update the makefile target we use after tor-browser-build#40742.boklmboklmhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40071Update tor-browser-build.git URL2023-01-13T14:38:54ZboklmUpdate tor-browser-build.git URLSince tor-browser-build.git is no longer updated on git.tpo, we should fetch it from gitlab.Since tor-browser-build.git is no longer updated on git.tpo, we should fetch it from gitlab.boklmboklmhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40068Fix cleaning of old nightly builds2022-11-10T10:13:30ZboklmFix cleaning of old nightly buildsIn `rbm-config/tb-build-01.torproject.org.rbm.local.conf` we still have:
```
clean:
HEAD:
- project: release
target:
- nightly
- torbrowser-all
```
However the targets changed with tor-browser-bui...In `rbm-config/tb-build-01.torproject.org.rbm.local.conf` we still have:
```
clean:
HEAD:
- project: release
target:
- nightly
- torbrowser-all
```
However the targets changed with tor-browser-build#40501. We should also add the base-browser builds there.boklmboklmhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40067Add @dan, @henry, @ma1 to nightly build emails2022-11-10T10:13:30ZboklmAdd @dan, @henry, @ma1 to nightly build emailsWe should make @dan, @henry, @ma1 receive the emails about nightly build results.We should make @dan, @henry, @ma1 receive the emails about nightly build results.boklmboklmhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40065Update tools/tb-build-01-start-nightly-build for multi-locale and base-browse...2022-11-10T10:13:30ZboklmUpdate tools/tb-build-01-start-nightly-build for multi-locale and base-browser buildsWith tor-browser#17400, multi-locale bundles are enabled. We should update `Archive today's build` in `tools/tb-build-01-start-nightly-build` to archive the `ALL` (multi-locale) bundles.With tor-browser#17400, multi-locale bundles are enabled. We should update `Archive today's build` in `tools/tb-build-01-start-nightly-build` to archive the `ALL` (multi-locale) bundles.Sponsor 131 - Phase 3 - Major ESR 102 Migrationboklmboklmhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40063Remove aguestuser from nightly build emails2022-08-24T13:11:29ZboklmRemove aguestuser from nightly build emails@aguestuser asked me to stop receiving nightly build emails (since not working on Tor Browser anymore).@aguestuser asked me to stop receiving nightly build emails (since not working on Tor Browser anymore).boklmboklmhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40062Build nightly builds from tor-browser-build.git main branch2022-09-01T10:38:27ZboklmBuild nightly builds from tor-browser-build.git main branchIn `TBBTestSuite/TestSuite/TorBrowserBuild.pm` we currently checkout the `master` branch of `tor-browser-build.git`. We should switch to the `main` branch.In `TBBTestSuite/TestSuite/TorBrowserBuild.pm` we currently checkout the `master` branch of `tor-browser-build.git`. We should switch to the `main` branch.boklmboklmhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40061Update tor-browser-build targets after tor-browser-build#405012022-07-16T06:45:37ZboklmUpdate tor-browser-build targets after tor-browser-build#40501In tor-browser-build#40501 we change the name of the rbm targets used for building Tor Browser. We should also change them in `TBBTestSuite/TestSuite/TorBrowserBuild.pm`.In tor-browser-build#40501 we change the name of the rbm targets used for building Tor Browser. We should also change them in `TBBTestSuite/TestSuite/TorBrowserBuild.pm`.boklmboklmhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40046Build infrastructure updates to build nightly base-browser2022-10-25T10:18:19ZrichardBuild infrastructure updates to build nightly base-browserWhatever infrastructure work that needs to happen to build nightly 'base-browser' packagesWhatever infrastructure work that needs to happen to build nightly 'base-browser' packagesSponsor 131 - Phase 1 - MVP Base Browserboklmboklmhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40045Nightly build artifacts are missing (at least since 12/18/2021)2022-04-26T19:45:46ZGeorg KoppenNightly build artifacts are missing (at least since 12/18/2021)Our wiki points to https://nightlies.tbb.torproject.org/nightly-builds/tor-browser-builds/ for nightly builds to download. But that location is empty right now. I *think* that's at least so since 12/18/2021 as I remember I wanted to look...Our wiki points to https://nightlies.tbb.torproject.org/nightly-builds/tor-browser-builds/ for nightly builds to download. But that location is empty right now. I *think* that's at least so since 12/18/2021 as I remember I wanted to look at the new Android artifacts and found those (and all the other bundles) missing.boklmboklmhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40041Add @richard @pierov @aguestuser to nightly build emails2022-04-08T11:14:30ZboklmAdd @richard @pierov @aguestuser to nightly build emailsAdd @richard @pierov @aguestuser to nightly build emails.Add @richard @pierov @aguestuser to nightly build emails.boklmboklmhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40039Do not send nightly test and build mails to gk2022-03-21T14:17:33ZGeorg KoppenDo not send nightly test and build mails to gkI *think* I am getting mails about (nightly) test runs and builds due to my email address hard-coded in this repo. Thus, let's remove those parts to stop those mails.I *think* I am getting mails about (nightly) test runs and builds due to my email address hard-coded in this repo. Thus, let's remove those parts to stop those mails.Georg KoppenGeorg Koppenhttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40036Move here tests from tor-browser#126202022-04-07T09:15:21ZPier Angelo VendrameMove here tests from tor-browser#12620tor-browser#12620 includes 3 tests on preferences/permissions.
We may think to move them here (as briefly discussed on tor-browser!242).tor-browser#12620 includes 3 tests on preferences/permissions.
We may think to move them here (as briefly discussed on tor-browser!242).Pier Angelo VendramePier Angelo Vendramehttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40027Fix onion_security_expectations test2021-08-18T17:06:00ZMatthew FinkelFix onion_security_expectations test```
Using workspace for temporary data: "/home/sysrqb/tor-browser-bundle-testsuite/reports/r/tbb.nightly.2021.08.10/results-tor-browser-linux64-tbb-nightly.2021.08.10_en-US.tar.xz/onion_security_expectations
_ws" ...```
Using workspace for temporary data: "/home/sysrqb/tor-browser-bundle-testsuite/reports/r/tbb.nightly.2021.08.10/results-tor-browser-linux64-tbb-nightly.2021.08.10_en-US.tar.xz/onion_security_expectations
_ws"
mozversion application_buildid: 20210810010101
mozversion application_display_name: Tor Browser
mozversion application_id: {ec8030f7-c20a-464f-9b0e-13a3a9e97384}
mozversion application_name: Firefox
mozversion application_remotingname: firefox
mozversion application_vendor: Mozilla
mozversion application_version: 78.12.0
mozversion platform_buildid: 20210810010101
mozversion platform_version: 78.12.0
Application command: /home/sysrqb/tor-browser-bundle-testsuite/tmp/tqma2o0O7h/tor-browser_en-US/Browser/ff_wrapper -no-remote -marionette -profile /home/sysrqb/tor-browser-bundle-testsuite/reports/r/tbb$
nightly.2021.08.10/results-tor-browser-linux64-tbb-nightly.2021.08.10_en-US.tar.xz/onion_security_expectations_ws/tmpysD6mq.profile.default
Profile path is /home/sysrqb/tor-browser-bundle-testsuite/reports/r/tbb.nightly.2021.08.10/results-tor-browser-linux64-tbb-nightly.2021.08.10_en-US.tar.xz/onion_security_expectations_ws/tmpysD6mq.profil$
.default
Starting fixture servers
Fixture server listening on http://127.0.0.1:45029/
Fixture server listening on https://127.0.0.1:37017/
e10s is enabled
mozversion application_buildid: 20210810010101
mozversion application_display_name: Tor Browser
mozversion application_id: {ec8030f7-c20a-464f-9b0e-13a3a9e97384}
mozversion application_name: Firefox
mozversion application_remotingname: firefox
mozversion application_vendor: Mozilla
mozversion application_version: 78.12.0
mozversion platform_buildid: 20210810010101
mozversion platform_version: 78.12.0
SUITE-START | Running 1 tests
TEST-START | ../../../../marionette/tor_browser_tests/test_onion_security_expectations.py Test.test_onion_security_expectations
TEST-UNEXPECTED-ERROR | ../../../../marionette/tor_browser_tests/test_onion_security_expectations.py Test.test_onion_security_expectations | UnknownException: [Exception... "The load caused an error pag$
to be displayed." nsresult: "0x804b004d (NS_ERROR_LOAD_SHOWED_ERRORPAGE)" location: "JS frame :: chrome://marionette/content/listener.js :: get/< :: line 1147" data: no]
stacktrace:
get/<@chrome://marionette/content/listener.js:1147:9
navigate/<@chrome://marionette/content/listener.js:446:13
navigate@chrome://marionette/content/listener.js:447:7
get@chrome://marionette/content/listener.js:1145:18
Traceback (most recent call last):
File "/home/sysrqb/tor-browser-bundle-testsuite/virtualenv-marionette-5.0.0/local/lib/python2.7/site-packages/marionette_harness-5.0.0-py2.7.egg/marionette_harness/marionette_test/testcases.py", line $
59, in run
testMethod()
File "/home/sysrqb/tor-browser-bundle-testsuite/marionette/tor_browser_tests/test_onion_security_expectations.py", line 121, in test_onion_security_expectations
m.navigate('https://3g2upl4pq6kufc4m.onion/')
File "/home/sysrqb/tor-browser-bundle-testsuite/virtualenv-marionette-5.0.0/local/lib/python2.7/site-packages/marionette_driver-3.0.0-py2.7.egg/marionette_driver/marionette.py", line 1467, in navigate
{"url": url})
File "/home/sysrqb/tor-browser-bundle-testsuite/virtualenv-marionette-5.0.0/local/lib/python2.7/site-packages/marionette_driver-3.0.0-py2.7.egg/marionette_driver/decorators.py", line 26, in _
return func(*args, **kwargs)
File "/home/sysrqb/tor-browser-bundle-testsuite/virtualenv-marionette-5.0.0/local/lib/python2.7/site-packages/marionette_driver-3.0.0-py2.7.egg/marionette_driver/marionette.py", line 598, in _send_mess
age
self._handle_error(err)
File "/home/sysrqb/tor-browser-bundle-testsuite/virtualenv-marionette-5.0.0/local/lib/python2.7/site-packages/marionette_driver-3.0.0-py2.7.egg/marionette_driver/marionette.py", line 618, in _handle_er
ror
raise errors.lookup(error)(message, stacktrace=stacktrace)
TEST-INFO took 41991ms
```Tor Browser: 11.0 Issues with previous releasehttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40026Fix onion_location test (expect v3 address)2021-08-18T17:06:00ZMatthew FinkelFix onion_location test (expect v3 address)```
FAILED TESTS
-------
test_onion_location.py test_onion_location.Test.test_onion_location
SUITE-END | took 30s
Using workspace for temporary data: "/home/sysrqb/tor-browser-bundle-testsuite/reports/r/tbb.nightly.2021.0...```
FAILED TESTS
-------
test_onion_location.py test_onion_location.Test.test_onion_location
SUITE-END | took 30s
Using workspace for temporary data: "/home/sysrqb/tor-browser-bundle-testsuite/reports/r/tbb.nightly.2021.08.10/results-tor-browser-linux64-tbb-nightly.2021.08.10_en-US.tar.xz/onion_location_ws"
mozversion application_buildid: 20210810010101
mozversion application_display_name: Tor Browser
mozversion application_id: {ec8030f7-c20a-464f-9b0e-13a3a9e97384}
mozversion application_name: Firefox
mozversion application_remotingname: firefox
mozversion application_vendor: Mozilla
mozversion application_version: 78.12.0
mozversion platform_buildid: 20210810010101
mozversion platform_version: 78.12.0
Application command: /home/sysrqb/tor-browser-bundle-testsuite/tmp/tqma2o0O7h/tor-browser_en-US/Browser/ff_wrapper -no-remote -marionette -profile /home/sysrqb/tor-browser-bundle-testsuite/reports/r/tbb.
nightly.2021.08.10/results-tor-browser-linux64-tbb-nightly.2021.08.10_en-US.tar.xz/onion_location_ws/tmpSbiB2k.profile.default
Profile path is /home/sysrqb/tor-browser-bundle-testsuite/reports/r/tbb.nightly.2021.08.10/results-tor-browser-linux64-tbb-nightly.2021.08.10_en-US.tar.xz/onion_location_ws/tmpSbiB2k.profile.default
Starting fixture servers
Fixture server listening on http://127.0.0.1:43955/
Fixture server listening on https://127.0.0.1:46883/
e10s is enabled
mozversion application_buildid: 20210810010101
mozversion application_display_name: Tor Browser
mozversion application_id: {ec8030f7-c20a-464f-9b0e-13a3a9e97384}
mozversion application_name: Firefox
mozversion application_remotingname: firefox
mozversion application_vendor: Mozilla
mozversion application_version: 78.12.0
mozversion platform_buildid: 20210810010101
mozversion platform_version: 78.12.0
SUITE-START | Running 1 tests
TEST-START | ../../../../marionette/tor_browser_tests/test_onion_location.py Test.test_onion_location
TEST-UNEXPECTED-FAIL | ../../../../marionette/tor_browser_tests/test_onion_location.py Test.test_onion_location | AssertionError: u'http://2gzyxa5ihm7nsggfxnu52rck2vv4rvmdlkiu3zzui5du4xyclen53wid.onion/i
ndex.html' != 'http://expyuzz4wqqyqhjn.onion/index.html'
Traceback (most recent call last):
File "/home/sysrqb/tor-browser-bundle-testsuite/virtualenv-marionette-5.0.0/local/lib/python2.7/site-packages/marionette_harness-5.0.0-py2.7.egg/marionette_harness/marionette_test/testcases.py", line 1
59, in run
testMethod()
File "/home/sysrqb/tor-browser-bundle-testsuite/marionette/tor_browser_tests/test_onion_location.py", line 94, in test_onion_location
self.get_url(), 'http://expyuzz4wqqyqhjn.onion/index.html')
TEST-INFO took 31816ms
```Tor Browser: 11.0 Issues with previous releasehttps://gitlab.torproject.org/tpo/applications/tor-browser-bundle-testsuite/-/issues/40021Archive old nightly builds on tb-build-012021-05-17T20:00:55ZboklmArchive old nightly builds on tb-build-01We currently have 398G of free disk space available on `tb-build-01`. I think we can keep a few old builds there to have them available if we need to bisect some issue. Keeping only the en-US bundles will also allow us to keep more diffe...We currently have 398G of free disk space available on `tb-build-01`. I think we can keep a few old builds there to have them available if we need to bisect some issue. Keeping only the en-US bundles will also allow us to keep more different builds.boklmboklm