builder: release-mozilla-release-firefox-macosx64_partner_repacks slave: bld-lion-r5-003 starttime: 1501805418.13 results: exception (4) revision: 9e30e915f1325f041d01c722bd640300f32dc9c3 ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2017-08-03 17:10:18.125749) ========= master: http://buildbot-master86.bb.releng.scl3.mozilla.com:8001/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2017-08-03 17:10:18.126419) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2017-08-03 17:10:18.126728) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2017-08-03 17:10:18.709478) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2017-08-03 17:10:18.710108) ========= bash -c 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py' in dir /builds/slave/rel-m-rel-fx-m64_pner_rpks-000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py'] environment: Apple_PubSub_Socket_Render=/tmp/launch-ht7g7j/Render DISPLAY=/tmp/launch-DTDxEH/org.x:0 GIT_SHARE_BASE_DIR=/builds/git-shared HG_SHARE_BASE_DIR=/builds/hg-shared HOME=/Users/cltbld IDLEIZER_DISABLE_SHUTDOWN=true LOGNAME=cltbld PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin/X11 PWD=/builds/slave/rel-m-rel-fx-m64_pner_rpks-000 RUNNER_CONFIG_CMD=/opt/runner/bin/python2.7 /opt/runner/bin/runner -c /opt/runner/runner.cfg SHELL=/bin/bash SSH_AUTH_SOCK=/tmp/launch-TPBAyV/Listeners TMPDIR=/var/folders/c6/2425x2g163z6n4ys_rgwhc1h00000w/T/ TWISTD_LOG_PATH=/builds/slave/twistd.log USER=cltbld VERSIONER_PYTHON_PREFER_32_BIT=no VERSIONER_PYTHON_VERSION=2.7 __CF_USER_TEXT_ENCODING=0x1C:0:0 using PTY: False --2017-08-03 17:10:18-- https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py Resolving hg.mozilla.org... 63.245.215.25, 63.245.215.102 Connecting to hg.mozilla.org|63.245.215.25|:443... connected. HTTP request sent, awaiting response... 200 Script output follows Length: 12179 (12K) [text/x-python] Saving to: 'archiver_client.py' 0K .......... . 100% 6.80M=0.002s 2017-08-03 17:10:19 (6.80 MB/s) - 'archiver_client.py' saved [12179/12179] program finished with exit code 0 elapsedTime=0.307330 ========= master_lag: 0.05 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2017-08-03 17:10:19.067151) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2017-08-03 17:10:19.067487) ========= rm -rf scripts properties in dir /builds/slave/rel-m-rel-fx-m64_pner_rpks-000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts', 'properties'] environment: Apple_PubSub_Socket_Render=/tmp/launch-ht7g7j/Render DISPLAY=/tmp/launch-DTDxEH/org.x:0 GIT_SHARE_BASE_DIR=/builds/git-shared HG_SHARE_BASE_DIR=/builds/hg-shared HOME=/Users/cltbld IDLEIZER_DISABLE_SHUTDOWN=true LOGNAME=cltbld PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin/X11 PWD=/builds/slave/rel-m-rel-fx-m64_pner_rpks-000 RUNNER_CONFIG_CMD=/opt/runner/bin/python2.7 /opt/runner/bin/runner -c /opt/runner/runner.cfg SHELL=/bin/bash SSH_AUTH_SOCK=/tmp/launch-TPBAyV/Listeners TMPDIR=/var/folders/c6/2425x2g163z6n4ys_rgwhc1h00000w/T/ TWISTD_LOG_PATH=/builds/slave/twistd.log USER=cltbld VERSIONER_PYTHON_PREFER_32_BIT=no VERSIONER_PYTHON_VERSION=2.7 __CF_USER_TEXT_ENCODING=0x1C:0:0 using PTY: False program finished with exit code 0 elapsedTime=0.006264 ========= master_lag: 0.05 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2017-08-03 17:10:19.119700) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 1 secs) (at 2017-08-03 17:10:19.120070) ========= bash -c 'python archiver_client.py mozharness --repo releases/mozilla-release --rev 9e30e915f1325f041d01c722bd640300f32dc9c3 --destination scripts --debug' in dir /builds/slave/rel-m-rel-fx-m64_pner_rpks-000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', u'python archiver_client.py mozharness --repo releases/mozilla-release --rev 9e30e915f1325f041d01c722bd640300f32dc9c3 --destination scripts --debug'] environment: Apple_PubSub_Socket_Render=/tmp/launch-ht7g7j/Render DISPLAY=/tmp/launch-DTDxEH/org.x:0 GIT_SHARE_BASE_DIR=/builds/git-shared HG_SHARE_BASE_DIR=/builds/hg-shared HOME=/Users/cltbld IDLEIZER_DISABLE_SHUTDOWN=true LOGNAME=cltbld PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin/X11 PWD=/builds/slave/rel-m-rel-fx-m64_pner_rpks-000 RUNNER_CONFIG_CMD=/opt/runner/bin/python2.7 /opt/runner/bin/runner -c /opt/runner/runner.cfg SHELL=/bin/bash SSH_AUTH_SOCK=/tmp/launch-TPBAyV/Listeners TMPDIR=/var/folders/c6/2425x2g163z6n4ys_rgwhc1h00000w/T/ TWISTD_LOG_PATH=/builds/slave/twistd.log USER=cltbld VERSIONER_PYTHON_PREFER_32_BIT=no VERSIONER_PYTHON_VERSION=2.7 __CF_USER_TEXT_ENCODING=0x1C:0:0 using PTY: False 2017-08-03 17:10:19,714 truncating revision to first 12 chars 2017-08-03 17:10:19,714 Setting DEBUG logging. 2017-08-03 17:10:19,714 attempt 1/10 2017-08-03 17:10:19,714 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/releases/mozilla-release/9e30e915f132?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2017-08-03 17:10:20,731 unpacking tar archive at: mozilla-release-9e30e915f132/testing/mozharness/ program finished with exit code 0 elapsedTime=1.815470 ========= master_lag: 0.01 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 1 secs) (at 2017-08-03 17:10:20.948844) ========= ========= Started set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2017-08-03 17:10:20.949200) ========= script_repo_revision: 9e30e915f1325f041d01c722bd640300f32dc9c3 ========= Finished set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2017-08-03 17:10:20.949674) ========= ========= Started remove old nonce (results: 0, elapsed: 0 secs) (at 2017-08-03 17:10:20.950015) ========= rm -f nonce in dir /builds/slave/rel-m-rel-fx-m64_pner_rpks-000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-f', 'nonce'] environment: Apple_PubSub_Socket_Render=/tmp/launch-ht7g7j/Render DISPLAY=/tmp/launch-DTDxEH/org.x:0 GIT_SHARE_BASE_DIR=/builds/git-shared HG_SHARE_BASE_DIR=/builds/hg-shared HOME=/Users/cltbld IDLEIZER_DISABLE_SHUTDOWN=true LOGNAME=cltbld PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin/X11 PWD=/builds/slave/rel-m-rel-fx-m64_pner_rpks-000 RUNNER_CONFIG_CMD=/opt/runner/bin/python2.7 /opt/runner/bin/runner -c /opt/runner/runner.cfg SHELL=/bin/bash SSH_AUTH_SOCK=/tmp/launch-TPBAyV/Listeners TMPDIR=/var/folders/c6/2425x2g163z6n4ys_rgwhc1h00000w/T/ TWISTD_LOG_PATH=/builds/slave/twistd.log USER=cltbld VERSIONER_PYTHON_PREFER_32_BIT=no VERSIONER_PYTHON_VERSION=2.7 __CF_USER_TEXT_ENCODING=0x1C:0:0 using PTY: False program finished with exit code 0 elapsedTime=0.006317 ========= master_lag: 0.05 ========= ========= Finished remove old nonce (results: 0, elapsed: 0 secs) (at 2017-08-03 17:10:21.002771) ========= ========= Started download_token exception (results: 4, elapsed: 45 mins, 0 secs) (at 2017-08-03 17:10:21.003120) ========= Slave: bld-lion-r5-003 IP: 10.26.52.23 Duration: 25200 URI: https://mac-v2-signing2.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing2.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing2.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing2.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing2.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing5.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing5.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing5.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing5.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing5.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing3.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing3.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing3.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing3.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing3.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing7.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing7.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing7.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing7.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing7.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing1.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing1.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing1.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing1.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing1.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')]

<type 'exceptions.Exception'>: No more signing servers to try.

<type 'exceptions.Exception'>: No more signing servers to try.

Traceback (most recent call last): Failure: exceptions.Exception: No more signing servers to try. ========= Finished download_token exception (results: 4, elapsed: 45 mins, 0 secs) (at 2017-08-03 17:55:21.387692) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Started no change (results: 0, elapsed: 0 secs) (at 2017-08-03 17:55:21.388954) ========= bash -c 'for file in `ls -1`; do cat $file; done' in dir /builds/slave/rel-m-rel-fx-m64_pner_rpks-000/properties (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'for file in `ls -1`; do cat $file; done'] environment: Apple_PubSub_Socket_Render=/tmp/launch-ht7g7j/Render DISPLAY=/tmp/launch-DTDxEH/org.x:0 GIT_SHARE_BASE_DIR=/builds/git-shared HG_SHARE_BASE_DIR=/builds/hg-shared HOME=/Users/cltbld IDLEIZER_DISABLE_SHUTDOWN=true LOGNAME=cltbld PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin/X11 PWD=/builds/slave/rel-m-rel-fx-m64_pner_rpks-000/properties RUNNER_CONFIG_CMD=/opt/runner/bin/python2.7 /opt/runner/bin/runner -c /opt/runner/runner.cfg SHELL=/bin/bash SSH_AUTH_SOCK=/tmp/launch-TPBAyV/Listeners TMPDIR=/var/folders/c6/2425x2g163z6n4ys_rgwhc1h00000w/T/ TWISTD_LOG_PATH=/builds/slave/twistd.log USER=cltbld VERSIONER_PYTHON_PREFER_32_BIT=no VERSIONER_PYTHON_VERSION=2.7 __CF_USER_TEXT_ENCODING=0x1C:0:0 using PTY: False program finished with exit code 0 elapsedTime=0.575861 ========= master_lag: 0.04 ========= ========= Finished no change (results: 0, elapsed: 0 secs) (at 2017-08-03 17:55:22.004491) ========= ========= Started reboot skipped (results: 3, elapsed: 0 secs) (at 2017-08-03 17:55:22.004837) ========= ========= Finished reboot skipped (results: 3, elapsed: 0 secs) (at 2017-08-03 17:55:22.005104) ========= ========= Total master_lag: 0.20 =========