**//Note: most of this page about the old Tor Browser build system based on Gitian, which is no longer used in current releases. For up to date information, see the [wiki:TorBrowser/Hacking/ Tor Browser Hacking page].//**
**//Note: most of this page about the old Tor Browser build system based on Gitian, which is no longer used in current releases. For up to date information, see the [Tor Browser Hacking page](./TorBrowser/Hacking/).//**
= Building the Tor Browser Bundle (TBB) Using the Gitian Build System =
# Building the Tor Browser Bundle (TBB) Using the Gitian Build System
This page gives guidance to novice developers building TBB for the first time and serves as reference to experienced developers when troubleshooting.
This page gives guidance to novice developers building TBB for the first time and serves as reference to experienced developers when troubleshooting.
=== How to Use This Wiki ===
### How to Use This Wiki
Use the ''search on page'' for text relating to a problem at hand or the more general ''search'' function of the top level wiki system (and hope for redirection to a solution.)
Use the _search on page_ for text relating to a problem at hand or the more general _search_ function of the top level wiki system (and hope for redirection to a solution.)
Beware that reading this collection of problems like a book may cause nausea.
Beware that reading this collection of problems like a book may cause nausea.
= Starting With the Correct Source Revisions =
# Starting With the Correct Source Revisions
Once the gitian build system is bootstrapped according to [wiki:TorBrowser/Hacking/ the hacking document], a number of revisions and branches can be used to build TBB. A typical workflow consists of:
Once the gitian build system is bootstrapped according to [the hacking document](./TorBrowser/Hacking/), a number of revisions and branches can be used to build TBB. A typical workflow consists of:
Please note that the ''match-*'' Makefile targets will produce correct results only if the revision built matches that of the ''versions-*'' file at hand. Also beware of troubles originating from the [#TargetsforSpecialProductClasses wrong choice of branch/tag or make(1) target.]
Please note that the _match-*_ Makefile targets will produce correct results only if the revision built matches that of the _versions-*_ file at hand. Also beware of troubles originating from the [#TargetsforSpecialProductClasses wrong choice of branch/tag or make(1) target.]
=== Individual Revisions Fetched ===
### Individual Revisions Fetched
Incidentally, several bundled subprojects are fetched to populate the `tor-browser-bundle/../gitian-builder/inputs` directory. To inspect what gitian is downloading and building try:
Incidentally, several bundled subprojects are fetched to populate the `tor-browser-bundle/../gitian-builder/inputs` directory. To inspect what gitian is downloading and building try:
{{{
```
tor-browser-bundle$ cd ../gitian-builder/inputs/tor-browser
tor-browser-bundle$ cd ../gitian-builder/inputs/tor-browser
gitian-builder/inputs/tor-browser$ git branch
gitian-builder/inputs/tor-browser$ git branch
* (detached from tor-browser-31.4.0esr-4.5-1-build1)
* (detached from tor-browser-31.4.0esr-4.5-1-build1)
gitian-builder/inputs/tor-browser$ cd -
gitian-builder/inputs/tor-browser$ cd -
tor-browser-bundle$
tor-browser-bundle$
}}}
```
= How to Avoid Destruction of Successfully Built Components =
# How to Avoid Destruction of Successfully Built Components
In short: Run `make build`, not `make`, when you want to restart a partial build. `make` destroys all partial build products and starts the build from scratch.
In short: Run `make build`, not `make`, when you want to restart a partial build. `make` destroys all partial build products and starts the build from scratch.
gitian/Makefile is simple; take a look at it to see what commands it runs.
gitian/Makefile is simple; take a look at it to see what commands it runs.
{{{
```
tor-browser-bundle/gitian$ make
tor-browser-bundle/gitian$ make
# ...implicitly destroys all built components
# ...implicitly destroys all built components
tor-browser-bundle/gitian$ make build
tor-browser-bundle/gitian$ make build
# ...will preserve all previously built components
# ...will preserve all previously built components
tor-browser-bundle/gitian$ ./mkbundle-linux.sh
tor-browser-bundle/gitian$ ./mkbundle-linux.sh
# ...executed manually for even finer grained control
# ...executed manually for even finer grained control
}}}
```
= Targets for Special Product Classes =
# Targets for Special Product Classes
For expediency, build engineers take liberties to make assumptions and update (or fail to update) certain YAML, version, and other build system logic according to product class. For example, alpha builds do not require a updated version file to succeed (as opposed to release builds.) The Makefile targets '''alpha''', '''prep-alpha''', and '''build-alpha''' tolerate such a version discrepancy. For example:
For expediency, build engineers take liberties to make assumptions and update (or fail to update) certain YAML, version, and other build system logic according to product class. For example, alpha builds do not require a updated version file to succeed (as opposed to release builds.) The Makefile targets **alpha**, **prep-alpha**, and **build-alpha** tolerate such a version discrepancy. For example:
The '''nightly''' targets are useful for building the tip of selected projects for quality assurance. Inspect the repository in question and choose the tag describing a changeset to test. Adapt the revision entry in `tor-browser-bundle/gitian/versions.nightly` correspondingly and build:
The **nightly** targets are useful for building the tip of selected projects for quality assurance. Inspect the repository in question and choose the tag describing a changeset to test. Adapt the revision entry in `tor-browser-bundle/gitian/versions.nightly` correspondingly and build:
`tor-browser-bundle/gitian$ make nightly`
`tor-browser-bundle/gitian$ make nightly`
= Examination of Gitian Build Segments =
# Examination of Gitian Build Segments
While building, the gitian build sequence produces output of which the following is most important:
While building, the gitian build sequence produces output of which the following is most important:
`****** Starting Tor Component of Linux Bundle (1/4 for Linux) ******`[[BR]]
`****** Starting Tor Component of Linux Bundle (1/4 for Linux) ******`
`****** Starting TorBrowser Component of Linux Bundle (2/4 for Linux) ******`[[BR]]
`****** Starting Pluggable Transports Component of Linux Bundle (3/4 for Linux) ******`[[BR]]
`****** Starting TorBrowser Component of Linux Bundle (2/4 for Linux) ******`
`****** Starting Bundling+Localization of Linux Bundle (4/4 for Linux) ******`[[BR]]
`****** Linux Bundle complete ******`[[BR]]
`****** Starting Pluggable Transports Component of Linux Bundle (3/4 for Linux) ******`
`****** Starting Tor Component of Windows Bundle (1/4 for Windows) ******`[[BR]]
`****** Starting Bundling+Localization of Linux Bundle (4/4 for Linux) ******`
`****** Starting Torbrowser Component of Windows Bundle (2/4 for Windows) ******`[[BR]]
`****** Starting Pluggable Transports Component of Windows Bundle (3/4 for Windows) ******`[[BR]]
`****** Linux Bundle complete ******`
`****** Starting Bundling+Localization of Windows Bundle (4/4 for Windows) ******`[[BR]]
`****** Windows Bundle complete ******`[[BR]]
`****** Starting Tor Component of Windows Bundle (1/4 for Windows) ******`
`****** Starting Tor Component of Mac Bundle (1/4 for Mac******`[[BR]]
`****** Starting Torbrowser Component of Mac Bundle (2/4 for Mac) ******`[[BR]]
`****** Starting Torbrowser Component of Windows Bundle (2/4 for Windows) ******`
`****** Starting Pluggable Transports Component of Mac Bundle (3/4 for Mac) ******`[[BR]]
`****** Starting Bundling+Localization of Mac Bundle (4/4 for Mac) ******`[[BR]]
`****** Starting Pluggable Transports Component of Windows Bundle (3/4 for Windows) ******`
`****** Starting Bundling+Localization of Windows Bundle (4/4 for Windows) ******`
`****** Windows Bundle complete ******`
`****** Starting Tor Component of Mac Bundle (1/4 for Mac******`
`****** Starting Torbrowser Component of Mac Bundle (2/4 for Mac) ******`
`****** Starting Pluggable Transports Component of Mac Bundle (3/4 for Mac) ******`
`****** Starting Bundling+Localization of Mac Bundle (4/4 for Mac) ******`
`****** Mac Bundle complete ******`
`****** Mac Bundle complete ******`
These lines correspond to the build stages of the respective Linux, Windows, and Mac bundles.
These lines correspond to the build stages of the respective Linux, Windows, and Mac bundles.
== Knowing When the Build Succeeded ==
## Knowing When the Build Succeeded
The TBB build succeeds just after the Mac bundle completes. Therefore, to confirm success look for:
The TBB build succeeds just after the Mac bundle completes. Therefore, to confirm success look for:
...
@@ -117,7 +131,7 @@ The TBB build succeeds just after the Mac bundle completes. Therefore, to confir
...
@@ -117,7 +131,7 @@ The TBB build succeeds just after the Mac bundle completes. Therefore, to confir
...in the final lines of build output. Additionally, a number of bundles are found in the gitian/<version> subdirectory.
...in the final lines of build output. Additionally, a number of bundles are found in the gitian/<version> subdirectory.
Once a TBB build succeeds, make(1) match returns text indicating if the bundles match the hashes of valid (from independent deterministic built) bundles.
Once a TBB build succeeds, make(1) match returns text indicating if the bundles match the hashes of valid (from independent deterministic built) bundles.
== Build Times ==
## Build Times
The duration of TBB builds varies according to hardware type and availability of resources like memory and swap. For guidance in VM guest creation and corresponding requirements please review [the VM guest setup document.](./TorBrowser/VMSetup/)
^1^ Bare metal host **(BM)** using KVM or virtual machine guest **(VM)** using LXC
^2^ OS preconfigured package selections (often desktop or server)
^3^ Total processing units (processors, cores, hyperthreads?)
The duration of TBB builds varies according to hardware type and availability of resources like memory and swap. For guidance in VM guest creation and corresponding requirements please review [wiki:TorBrowser/VMSetup/ the VM guest setup document.]
^4^ Processor clock rate and performance influencing factors
^1^ Bare metal host '''(BM)''' using KVM or virtual machine guest '''(VM)''' using LXC[[br]]
^2^ OS preconfigured package selections (often desktop or server)[[br]]
^3^ Total processing units (processors, cores, hyperthreads?)[[br]]
^4^ Processor clock rate and performance influencing factors[[br]]
'''(!)''' The canonical indicator (what we're interested to measure)[[br]]
= Gitian Build Tips =
# Gitian Build Tips
Useful log files are produced (and then deleted as each stage succeeds) and are extremely helpful in debugging build problems. Consider opening a new window and following log output as gitian produces it:
Useful log files are produced (and then deleted as each stage succeeds) and are extremely helpful in debugging build problems. Consider opening a new window and following log output as gitian produces it:
{{{
```
$ tail -F gitian-builder/var/install.log
$ tail -F gitian-builder/var/install.log
$ tail -F gitian-builder/var/build.log
$ tail -F gitian-builder/var/build.log
}}}
```
Or even better, install multitail(1) and monitor each of the two main logs from start to finish:
Or even better, install multitail(1) and monitor each of the two main logs from start to finish:
Don't be fooled by storage measurements of completed builds. Such late stage analysis doesn't reflect temporary build content stored during the build (which is quite a bit more than the resulting bundles.)
Don't be fooled by storage measurements of completed builds. Such late stage analysis doesn't reflect temporary build content stored during the build (which is quite a bit more than the resulting bundles.)
{{{
```
$ df -h
$ df -h
Filesystem Size Used Avail Use% Mounted on
Filesystem Size Used Avail Use% Mounted on
/dev/sda1 34G 20G 14G 58% /
/dev/sda1 34G 20G 14G 58% /
$ du -hs gitian-builder tor-browser-bundle
$ du -hs gitian-builder tor-browser-bundle
16G gitian-builder
16G gitian-builder
1,9G tor-browser-bundle
1,9G tor-browser-bundle
}}}
```
= Troubleshooting Build Failures =
# Troubleshooting Build Failures
The gitian build sequence is complex and uses tools not particularly designed to work together. Thus, the nature of gitian building is fragile and new TBB builds typically break at some point.
The gitian build sequence is complex and uses tools not particularly designed to work together. Thus, the nature of gitian building is fragile and new TBB builds typically break at some point.
== RAM Exhaustion ==
## RAM Exhaustion
Rather than 'You ran out of memory', error messages indicating RAM exhaustion typically look like this:
Rather than 'You ran out of memory', error messages indicating RAM exhaustion typically look like this:
...
@@ -190,24 +210,24 @@ This is quite common when shaving the bits off minimum RAM requirements and giti
...
@@ -190,24 +210,24 @@ This is quite common when shaving the bits off minimum RAM requirements and giti
Obviously to solve the problem of RAM exhaustion, more memory is needed. This is trivial if building on a memory reduced VM, but if not there's still the chance of increasing swap and hoping for the best.
Obviously to solve the problem of RAM exhaustion, more memory is needed. This is trivial if building on a memory reduced VM, but if not there's still the chance of increasing swap and hoping for the best.
== Gitian failures with LXC on Ubuntu 14.04 ==
## Gitian failures with LXC on Ubuntu 14.04
If one sees Gitian failures like
If one sees Gitian failures like
{{{
```
bash: cannot set terminal process group (-1): Inappropriate ioctl for device
bash: cannot set terminal process group (-1): Inappropriate ioctl for device
bash: no job control in this shell
bash: no job control in this shell
}}}
```
then this is a sign that new containers need to get created. Related to that `lxc-execute` is required for building Tor Browser using LXC since 14.04. This is off by default (to support older Ubuntu versions) but can be activated by setting the proper environment variable before starting the build:
then this is a sign that new containers need to get created. Related to that `lxc-execute` is required for building Tor Browser using LXC since 14.04. This is off by default (to support older Ubuntu versions) but can be activated by setting the proper environment variable before starting the build:
`export LXC_EXECUTE=lxc-execute`
`export LXC_EXECUTE=lxc-execute`
#15947 has further details for interested parties.
#15947 has further details for interested parties.
== Apt-cacher-ng(1) Strangulation ==
## Apt-cacher-ng(1) Strangulation
The version of apt-cacher-ng(1) distributed in Ubuntu 12.04.4 enjoys strangulating guest (KVM or LXC) gitian instances. When the window where gitian/make(1) was issued returns:
The version of apt-cacher-ng(1) distributed in Ubuntu 12.04.4 enjoys strangulating guest (KVM or LXC) gitian instances. When the window where gitian/make(1) was issued returns:
{{{
```
Updating apt-get repository (log in var/install.log)
Updating apt-get repository (log in var/install.log)
Installing additional packages (log in var/install.log)
Installing additional packages (log in var/install.log)
./bin/gbuild:21:in `system!': failed to run on-target -u root -e DEBIAN_FRONTEND=noninteractive apt-get --no-install-recommends -y install git-core unzip zip swig m4 python-setuptools python-dev faketime libtool > var/install.log 2>&1 (RuntimeError)
./bin/gbuild:21:in `system!': failed to run on-target -u root -e DEBIAN_FRONTEND=noninteractive apt-get --no-install-recommends -y install git-core unzip zip swig m4 python-setuptools python-dev faketime libtool > var/install.log 2>&1 (RuntimeError)
...
@@ -219,7 +239,7 @@ Installing additional packages (log in var/install.log)
...
@@ -219,7 +239,7 @@ Installing additional packages (log in var/install.log)
from ./bin/gbuild:217
from ./bin/gbuild:217
make: *** [build] Fehler 1
make: *** [build] Fehler 1
Command exited with non-zero status 2
Command exited with non-zero status 2
}}}
```
...or when the the gitian-builder/var/install.log indicates a call to apt-get(1) that returns:
...or when the the gitian-builder/var/install.log indicates a call to apt-get(1) that returns:
...
@@ -227,7 +247,7 @@ Command exited with non-zero status 2
...
@@ -227,7 +247,7 @@ Command exited with non-zero status 2
...or when encountering hash sum mismatches when fetching and comparing input checksums:
...or when encountering hash sum mismatches when fetching and comparing input checksums:
{{{
```
Fetched 18 MB in 1min (300 kB/s)
Fetched 18 MB in 1min (300 kB/s)
, stderr: bzip2: (stdin) is not a bzip2 file.
, stderr: bzip2: (stdin) is not a bzip2 file.
W: Failed to fetch gzip:/var/lib/apt/lists/partial/127.0.0.1:3142_archive.ubuntu.com_ubuntu_dists_precise_universe_binary-amd64_Packages Hash Sum mismatch
W: Failed to fetch gzip:/var/lib/apt/lists/partial/127.0.0.1:3142_archive.ubuntu.com_ubuntu_dists_precise_universe_binary-amd64_Packages Hash Sum mismatch
...
@@ -236,43 +256,43 @@ E: Some index files failed to download. They have been ignored, or old ones used
...
@@ -236,43 +256,43 @@ E: Some index files failed to download. They have been ignored, or old ones used
qemu-img: target-precise-amd64.qcow2: Could not open 'base-precise-amd64.qcow2': Could not open 'base-precise-amd64.qcow2': No such file or directory: No such file or directory
qemu-img: target-precise-amd64.qcow2: Could not open 'base-precise-amd64.qcow2': Could not open 'base-precise-amd64.qcow2': No such file or directory: No such file or directory
amd64 precise VM creation failed
amd64 precise VM creation failed
}}}
```
...or similar, then it's time to kill and restart the apt-cacher-ng(1) process in the controlling (outer) gitian host. That means, log into the machine where gitian/make(1) build was executed and:
...or similar, then it's time to kill and restart the apt-cacher-ng(1) process in the controlling (outer) gitian host. That means, log into the machine where gitian/make(1) build was executed and:
A alternative solution involves installing a newer (or older?) version of the [https://packages.ubuntu.com/search?suite=all&searchon=names&keywords=apt-cacher-ng apt-cacher-ng package]. You'll likely need to download and install the (dependency) [https://packages.ubuntu.com/search?suite=all&searchon=names&keywords=init-system-helpers init-system-helpers package] as well.
A alternative solution involves installing a newer (or older?) version of the [apt-cacher-ng package](https://packages.ubuntu.com/search?suite=all&searchon=names&keywords=apt-cacher-ng). You'll likely need to download and install the (dependency) [init-system-helpers package](https://packages.ubuntu.com/search?suite=all&searchon=names&keywords=init-system-helpers) as well.
Another solution involves removing resudual cache cruft:
Another solution involves removing resudual cache cruft:
A yet third option is to edit gitian-builder/bin/make-base-vm and remove 127.0.0.1 from the MIRROR_HOST, directly fetching packages every time. (Obviously this may use more bandwidth/be slower.)
A yet third option is to edit gitian-builder/bin/make-base-vm and remove 127.0.0.1 from the MIRROR_HOST, directly fetching packages every time. (Obviously this may use more bandwidth/be slower.)
== Flawed Software Hangs ==
## Flawed Software Hangs
Building TBB on some (newer) systems like Ubuntu 14.04 (LTS) AMD64 Desktop employs components affected with networking problems leading to unexpected disconnections and indirectly causing hangs in the build process (actually it's the 'prep' stage.) This is indicated by the top(1) command listing the component in question at the top of the list consuming 100% CPU cycles. For example, this can happen when downloading dependencies with svn(1) in conjunction with torsocks(1). To solve this particular problem repeat the build sequence using the svn(1) command without torsocks(1), the component actually at fault:
Building TBB on some (newer) systems like Ubuntu 14.04 (LTS) AMD64 Desktop employs components affected with networking problems leading to unexpected disconnections and indirectly causing hangs in the build process (actually it's the 'prep' stage.) This is indicated by the top(1) command listing the component in question at the top of the list consuming 100% CPU cycles. For example, this can happen when downloading dependencies with svn(1) in conjunction with torsocks(1). To solve this particular problem repeat the build sequence using the svn(1) command without torsocks(1), the component actually at fault:
{{{
```
tor-browser-bundle/gitian$ make prep TORSOCKS=
tor-browser-bundle/gitian$ make prep TORSOCKS=
}}}
```
== Assembly Errors in Mismatched Architecture Code or 'failed to run on-target setarch'==
== Assembly Errors in Mismatched Architecture Code or 'failed to run on-target setarch'==
A general problem that can manifest in a few ways:
A general problem that can manifest in a few ways:
{{{
```
x86cpuid.s Err: invalid instruction suffix for `push'
x86cpuid.s Err: invalid instruction suffix for `push'
}}}
```
{{{
```
Preparing build environment
Preparing build environment
setarch: x86_64: Unrecognized architecture
setarch: x86_64: Unrecognized architecture
./bin/gbuild:21:in `system!': failed to run on-target setarch x86_64 bash < target-bin/init-build.sh (RuntimeError)
./bin/gbuild:21:in `system!': failed to run on-target setarch x86_64 bash < target-bin/init-build.sh (RuntimeError)
In these situations, it meant that kvm was running for the wrong architecture. It happens when the VM for gitian-utils amd64 (or i386) didn't shut down properly, and the build for gitian-tor 386 (or amd64) started up using the running VM for the wrong architecture. To fix it, kill the kvm process (in difference circumstances, running 'poweroff' inside the VM works, other times the kill must be from outside), and start another "make build". If the problem is indeed that the wrong VM is running, then installing gcc-multilib may not be the right thing to do. But if you want to attempt it...
In these situations, it meant that kvm was running for the wrong architecture. It happens when the VM for gitian-utils amd64 (or i386) didn't shut down properly, and the build for gitian-tor 386 (or amd64) started up using the running VM for the wrong architecture. To fix it, kill the kvm process (in difference circumstances, running 'poweroff' inside the VM works, other times the kill must be from outside), and start another "make build". If the problem is indeed that the wrong VM is running, then installing gcc-multilib may not be the right thing to do. But if you want to attempt it...
Assembly errors have been observed with output in gitian-builder/var/build.log resembling:
Assembly errors have been observed with output in gitian-builder/var/build.log resembling:
{{{
```
x86cpuid.s Err: invalid instruction suffix for `push'
x86cpuid.s Err: invalid instruction suffix for `push'
x86cpuid.s Err: invalid instruction suffix for `pop'
x86cpuid.s Err: invalid instruction suffix for `pop'
[...]
[...]
}}}
```
While this specific example refers to OpenSSL, it's a typical side effect of compiling IA32 assembly code on AMD64 platforms lacking certain assembler components, probably available in gcc-multilib or similar (in the build guest not the host!)
While this specific example refers to OpenSSL, it's a typical side effect of compiling IA32 assembly code on AMD64 platforms lacking certain assembler components, probably available in gcc-multilib or similar (in the build guest not the host!)
To investigate and work around this problem, start building as usual:
To investigate and work around this problem, start building as usual:
{{{
```
tor-browser-bundle/gitian$ make build
tor-browser-bundle/gitian$ make build
}}}
```
...but once 'Building tor-linux for lucid i386' appears, run:
...but once 'Building tor-linux for lucid i386' appears, run:
{{{
```
tor-browser-bundle/gitian$ cd ../../gitian-builder
tor-browser-bundle/gitian$ cd ../../gitian-builder
gitian-builder$ libexec/on-target -u root
gitian-builder$ libexec/on-target -u root
root@ubuntu~# apt-get install gcc-multilib
root@ubuntu~# apt-get install gcc-multilib
root@ubuntu~# cd /home/ubuntu/build/openssl-1.0.1g
root@ubuntu~# cd /home/ubuntu/build/openssl-1.0.1g
}}}
```
''By the way, installing gcc-multilib (or possibly libc6-dev-i386) is a workaround in consideration in a partly related bug report #12391 about mingw-w64 components.''
_By the way, installing gcc-multilib (or possibly libc6-dev-i386) is a workaround in consideration in a partly related bug report #12391 about mingw-w64 components._
== Package Management Failures ==
## Package Management Failures
The apt-get(1) package manager is used in the prep stages to create virtual machines or linux containers. A variety of errors can cause gitian-builder to fail.
The apt-get(1) package manager is used in the prep stages to create virtual machines or linux containers. A variety of errors can cause gitian-builder to fail.
{{{
```
WARNING: The following packages cannot be authenticated!
WARNING: The following packages cannot be authenticated!
E: There are problems and -y was used without --force-yes
E: There are problems and -y was used without --force-yes
}}}
```
In most cases the seemingly random failure is neither deterministic nor indicative of any real problem. Restart the build and cross fingers, toes, or press the thumbs:
In most cases the seemingly random failure is neither deterministic nor indicative of any real problem. Restart the build and cross fingers, toes, or press the thumbs:
{{{
```
tor-browser-bundle/gitian$ make prep(|-alpha|-beta|-nightly)
tor-browser-bundle/gitian$ make prep(|-alpha|-beta|-nightly)
tor-browser-bundle/gitian$ make build(|-alpha|-beta|-nightly)
tor-browser-bundle/gitian$ make build(|-alpha|-beta|-nightly)
}}}
```
== Random Build Failures ==
## Random Build Failures
There are times during the gitian build sequence when it simply hangs or stops for reasons that seem random. Rest assured that 'Ctrl-C' and 'make build' are often the best course of action, and that repeating this results in incremental build success.
There are times during the gitian build sequence when it simply hangs or stops for reasons that seem random. Rest assured that 'Ctrl-C' and 'make build' are often the best course of action, and that repeating this results in incremental build success.
If you feel your build problems are overly chaotic please contact your representative in congress or speak with a psychic counsellor. Otherwise, the friendly folks hanging out in the #tor-dev chat room (on irc.oftc.org) are ready to help answer build questions. Don't forget to [https://cypherpunks:writecode@trac.torproject.org/projects/tor/login/ update this document] when solutions are found!
If you feel your build problems are overly chaotic please contact your representative in congress or speak with a psychic counsellor. Otherwise, the friendly folks hanging out in the #tor-dev chat room (on irc.oftc.org) are ready to help answer build questions. Don't forget to [update this document](https://cypherpunks:writecode@trac.torproject.org/projects/tor/login/) when solutions are found!
= Other Related Resources =
# Other Related Resources
Other documents that aide in further understanding of using gitian-build for Tor software include:
Other documents that aide in further understanding of using gitian-build for Tor software include:
* [wiki:TorBrowser/Hacking/ So, You Want to Hack on Tor Browser!]
*[So, You Want to Hack on Tor Browser!](./TorBrowser/Hacking/)
* [https://blog.torproject.org/category/tags/deterministic-builds/ Mike Perry's Tor blog post that started it all]
*[Mike Perry's Tor blog post that started it all](https://blog.torproject.org/category/tags/deterministic-builds/)
* [https://media.ccc.de/browse/congress/2014/31c3_-_6240_-_en_-_saal_g_-_201412271400_-_reproducible_builds_-_mike_perry_-_seth_schoen_-_hans_steiner.html Mike Perry and Seth Schoen at CCC 31c3]
*[Mike Perry and Seth Schoen at CCC 31c3](https://media.ccc.de/browse/congress/2014/31c3_-_6240_-_en_-_saal_g_-_201412271400_-_reproducible_builds_-_mike_perry_-_seth_schoen_-_hans_steiner.html)
* [ticket:14278 Tor Trac 'Gitian documentation lint magnet' ticket]
* [ticket:14278 Tor Trac 'Gitian documentation lint magnet' ticket]
=== Upstream Gitian Documentation ===
### Upstream Gitian Documentation
Additional help can be obtained by appeals to #bitcoin-dev (irc.freenode.net) or a number of online resources:
Additional help can be obtained by appeals to #bitcoin-dev (irc.freenode.net) or a number of online resources:
[https://github.com/bitcoin/bitcoin/blob/master/doc/gitian-building.md Bitcoin's Gitian Building document]
[Bitcoin's Gitian Building document](https://github.com/bitcoin/bitcoin/blob/master/doc/gitian-building.md)
