In order to build a working toolchain, the following source packages are needed
In order to build a working toolchain, the following source packages are needed
from Apple: cctools, dyld, and ld64.
from Apple: cctools, dyld, and ld64.
@ -29,16 +27,19 @@ originally done in toolchain4.
To complicate things further, all builds must target an Apple SDK. These SDKs
To complicate things further, all builds must target an Apple SDK. These SDKs
are free to download, but not redistributable.
are free to download, but not redistributable.
To obtain it, register for a developer account, then download the Xcode 6.1.1 dmg:
To obtain it, register for a developer account, then download the [Xcode 7.3.1 dmg](https://developer.apple.com/devcenter/download.action?path=/Developer_Tools/Xcode_7.3.1/Xcode_7.3.1.dmg).
Unfortunately, the usual linux tools (7zip, hpmount, loopback mount) are incapable of opening this file.
Unfortunately, the usual linux tools (7zip, hpmount, loopback mount) are incapable of opening this file.
To create a tarball suitable for Gitian input, mount the dmg in OS X, then create it with:
To create a tarball suitable for Gitian input, mount the dmg in OS X, then create it with:
$ tar -C /Volumes/Xcode/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/ -czf MacOSX10.9.sdk.tar.gz MacOSX10.9.sdk
```
$ tar -C /Volumes/Xcode/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/ -czf MacOSX10.11.sdk.tar.gz MacOSX10.11.sdk
```
The Gitian descriptors build 2 sets of files: Linux tools, then Apple binaries
The Gitian descriptors build 2 sets of files: Linux tools, then Apple binaries
which are created using these tools. The build process has been designed to
which are created using these tools. The build process has been designed to
@ -48,15 +49,14 @@ fully deterministic and may be freely redistributed.
genisoimage is used to create the initial DMG. It is not deterministic as-is,
genisoimage is used to create the initial DMG. It is not deterministic as-is,
so it has been patched. A system genisoimage will work fine, but it will not
so it has been patched. A system genisoimage will work fine, but it will not
be deterministic because the file-order will change between invocations.
be deterministic because the file-order will change between invocations.
The patch can be seen here:
The patch can be seen here: [theuni/osx-cross-depends](https://raw.githubusercontent.com/theuni/osx-cross-depends/master/patches/cdrtools/genisoimage.diff).
No effort was made to fix this cleanly, so it likely leaks memory badly. But
No effort was made to fix this cleanly, so it likely leaks memory badly. But
it's only used for a single invocation, so that's no real concern.
it's only used for a single invocation, so that's no real concern.
genisoimage cannot compress DMGs, so afterwards, the 'dmg' tool from the
genisoimage cannot compress DMGs, so afterwards, the 'dmg' tool from the
libdmg-hfsplus project is used to compress it. There are several bugs in this
libdmg-hfsplus project is used to compress it. There are several bugs in this
tool and its maintainer has seemingly abandoned the project. It has been forked
tool and its maintainer has seemingly abandoned the project. It has been forked
and is available (with fixes) here: https://github.com/theuni/libdmg-hfsplus .
and is available (with fixes) here: [theuni/libdmg-hfsplus](https://github.com/theuni/libdmg-hfsplus).
The 'dmg' tool has the ability to create DMGs from scratch as well, but this
The 'dmg' tool has the ability to create DMGs from scratch as well, but this
functionality is broken. Only the compression feature is currently used.
functionality is broken. Only the compression feature is currently used.
@ -77,6 +77,6 @@ build process to remain somewhat deterministic. Here's how it works:
that have been previously (deterministically) built in order to create a
that have been previously (deterministically) built in order to create a
final dmg.
final dmg.
- The Apple keyholder uses this unsigned app to create a detached signature,
- The Apple keyholder uses this unsigned app to create a detached signature,
using the script that is also included there.
using the script that is also included there. Detached signatures are available from this [repository](https://github.com/bitcoin-core/bitcoin-detached-sigs).
- Builders feed the unsigned app + detached signature back into Gitian. It
- Builders feed the unsigned app + detached signature back into Gitian. It
uses the pre-built tools to recombine the pieces into a deterministic dmg.
uses the pre-built tools to recombine the pieces into a deterministic dmg.
* Update translations (ping wumpus on IRC) see [translation_process.md](https://github.com/bitcoin/bitcoin/blob/master/doc/translation_process.md#syncing-with-transifex)
* Update translations (ping wumpus on IRC) see [translation_process.md](https://github.com/bitcoin/bitcoin/blob/master/doc/translation_process.md#synchronising-translations).
Before every minor and major release:
Before every minor and major release:
@ -13,7 +13,7 @@ Before every minor and major release:
Before every major release:
Before every major release:
* Update hardcoded [seeds](/contrib/seeds/README.md), see [this pull request](https://github.com/bitcoin/bitcoin/pull/7415) for an example.
* Update hardcoded [seeds](/contrib/seeds/README.md), see [this pull request](https://github.com/bitcoin/bitcoin/pull/7415) for an example.
### First time / New builders
### First time / New builders
@ -75,7 +75,7 @@ Ensure your gitian.sigs are up-to-date if you wish to gverify your builds agains
git pull
git pull
popd
popd
Ensure gitian-builder is up-to-date to take advantage of new caching features (`e9741525c` or later is recommended).
Ensure gitian-builder is up-to-date:
pushd ./gitian-builder
pushd ./gitian-builder
git pull
git pull
@ -89,13 +89,7 @@ Ensure gitian-builder is up-to-date to take advantage of new caching features (`
Wladimir J. van der Laan
9 years ago