builder: release-jamun-firefox_schedule_publishing_in_balrog slave: bld-linux64-spot-034 starttime: 1509478160.9 results: failure (2) revision: a3a6860becd3c9ce755f22a168b2afbab2b7d3d0 ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:20.898743) ========= master: http://buildbot-master71.bb.releng.use1.mozilla.com:8001/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:20.899179) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:20.899478) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:21.050981) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:21.051326) ========= bash -c 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py' in dir /builds/slave/rel-jamun-fx_sc_p_in_balrog-00/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-034.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-jamun-fx_sc_p_in_balrog-00 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False --2017-10-31 12:29:21-- https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py Resolving hg.mozilla.org... 63.245.215.25, 63.245.215.102 Connecting to hg.mozilla.org|63.245.215.25|:443... connected. HTTP request sent, awaiting response... 200 Script output follows Length: 12179 (12K) [text/x-python] Saving to: ‘archiver_client.py’ 0K .......... . 100% 55.3M=0s 2017-10-31 12:29:21 (55.3 MB/s) - ‘archiver_client.py’ saved [12179/12179] program finished with exit code 0 elapsedTime=0.605101 ========= master_lag: 0.04 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:21.695078) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:21.695463) ========= rm -rf scripts properties in dir /builds/slave/rel-jamun-fx_sc_p_in_balrog-00/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts', 'properties'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-034.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-jamun-fx_sc_p_in_balrog-00 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002730 ========= master_lag: 0.04 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:21.743071) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 2 secs) (at 2017-10-31 12:29:21.743439) ========= bash -c 'python archiver_client.py mozharness --repo projects/jamun --rev a3a6860becd3c9ce755f22a168b2afbab2b7d3d0 --destination scripts --debug' in dir /builds/slave/rel-jamun-fx_sc_p_in_balrog-00/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', u'python archiver_client.py mozharness --repo projects/jamun --rev a3a6860becd3c9ce755f22a168b2afbab2b7d3d0 --destination scripts --debug'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-034.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-jamun-fx_sc_p_in_balrog-00 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 2017-10-31 12:29:21,784 truncating revision to first 12 chars 2017-10-31 12:29:21,784 Setting DEBUG logging. 2017-10-31 12:29:21,784 attempt 1/10 2017-10-31 12:29:21,784 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/projects/jamun/a3a6860becd3?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2017-10-31 12:29:23,662 unpacking tar archive at: jamun-a3a6860becd3/testing/mozharness/ program finished with exit code 0 elapsedTime=2.956886 ========= master_lag: 0.01 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 2 secs) (at 2017-10-31 12:29:24.709434) ========= ========= Started set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:24.709762) ========= script_repo_revision: a3a6860becd3c9ce755f22a168b2afbab2b7d3d0 ========= Finished set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:24.710134) ========= ========= Started downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:24.710429) ========= ========= Finished downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:24.717984) ========= ========= Started '/tools/buildbot/bin/python scripts/scripts/release/publish_balrog.py ...' failed (results: 2, elapsed: 22 secs) (at 2017-10-31 12:29:24.718287) ========= /tools/buildbot/bin/python scripts/scripts/release/publish_balrog.py -c releases/dev_updates_firefox_beta.py in dir /builds/slave/rel-jamun-fx_sc_p_in_balrog-00/. (timeout 3600 secs) (maxTime 14400 secs) watching logfiles {} argv: ['/tools/buildbot/bin/python', 'scripts/scripts/release/publish_balrog.py', '-c', 'releases/dev_updates_firefox_beta.py'] environment: CCACHE_COMPRESS=1 CCACHE_DIR=/builds/ccache CCACHE_HASHDIR= CCACHE_UMASK=002 DISPLAY=:2 G_BROKEN_FILENAMES=1 HG_SHARE_BASE_DIR=/builds/hg-shared HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-034.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LC_ALL=C LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld MOZ_AUTOMATION=1 MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_OBJDIR=obj-firefox PATH=/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin PROPERTIES_FILE=/builds/slave/rel-jamun-fx_sc_p_in_balrog-00/buildprops.json PWD=/builds/slave/rel-jamun-fx_sc_p_in_balrog-00 SHELL=/bin/bash SHLVL=1 TERM=linux TINDERBOX_OUTPUT=1 TMOUT=86400 TOOLTOOL_CACHE=/builds/tooltool_cache TOOLTOOL_HOME=/builds USER=cltbld _=/tools/buildbot/bin/python using PTY: False 12:29:24 INFO - MultiFileLogger online at 20171031 12:29:24 in /builds/slave/rel-jamun-fx_sc_p_in_balrog-00 12:29:24 INFO - Using buildbot properties: 12:29:24 INFO - { 12:29:24 INFO - "channels": "beta", 12:29:24 INFO - "product": "firefox", 12:29:24 INFO - "build_number": 27, 12:29:24 INFO - "taskId": "CjXaPXJETUe13J2Oe_HUBQ", 12:29:24 INFO - "repository": "", 12:29:24 INFO - "buildername": "release-jamun-firefox_schedule_publishing_in_balrog", 12:29:24 INFO - "buildnumber": 1, 12:29:24 INFO - "balrog_api_root": "https://balrog-admin.stage.mozaws.net/api", 12:29:24 INFO - "basedir": "/builds/slave/rel-jamun-fx_sc_p_in_balrog-00", 12:29:24 INFO - "project": "", 12:29:24 INFO - "platform": null, 12:29:24 INFO - "version": "58.0b1", 12:29:24 INFO - "release_promotion": true, 12:29:24 INFO - "script_repo_revision": "a3a6860becd3c9ce755f22a168b2afbab2b7d3d0", 12:29:24 INFO - "branch": "jamun", 12:29:24 INFO - "master": "http://buildbot-master71.bb.releng.use1.mozilla.com:8001/", 12:29:24 INFO - "schedule_at": "2017-10-31T00:45:00+00:00", 12:29:24 INFO - "revision": "a3a6860becd3c9ce755f22a168b2afbab2b7d3d0", 12:29:24 INFO - "slavename": "bld-linux64-spot-034", 12:29:24 INFO - "repo_path": "projects/jamun" 12:29:24 INFO - } 12:29:24 INFO - Overriding product with firefox 12:29:24 INFO - Overriding version with 58.0b1 12:29:24 INFO - Overriding build_number with 27 12:29:24 INFO - Overriding channels with beta 12:29:24 INFO - Overriding balrog_api_root with https://balrog-admin.stage.mozaws.net/api 12:29:24 INFO - Overriding schedule_at with 2017-10-31T00:45:00+00:00 12:29:24 INFO - Run as scripts/scripts/release/publish_balrog.py -c releases/dev_updates_firefox_beta.py 12:29:24 INFO - Dumping config to /builds/slave/rel-jamun-fx_sc_p_in_balrog-00/logs/localconfig.json. 12:29:24 INFO - {'append_to_log': False, 12:29:24 INFO - 'archive_domain': 'ftp.stage.mozaws.net', 12:29:24 INFO - 'archive_prefix': 'https://ftp.stage.mozaws.net/pub', 12:29:24 INFO - 'balrog_api_root': u'https://balrog-admin.stage.mozaws.net/api', 12:29:24 INFO - 'balrog_url': 'https://aus4.stage.mozaws.net', 12:29:24 INFO - 'balrog_use_dummy_suffix': False, 12:29:24 INFO - 'balrog_username': 'balrog-stage-ffxbld', 12:29:24 INFO - 'base_work_dir': '/builds/slave/rel-jamun-fx_sc_p_in_balrog-00', 12:29:24 INFO - 'build_number': 27, 12:29:24 INFO - 'buildbot_json_path': 'buildprops.json', 12:29:24 INFO - 'channels': u'beta', 12:29:24 INFO - 'config_files': ('releases/dev_updates_firefox_beta.py',), 12:29:24 INFO - 'credentials_file': 'oauth.txt', 12:29:24 INFO - 'download_domain': 'download.mozilla.org', 12:29:24 INFO - 'ignore_no_changes': True, 12:29:24 INFO - 'log_level': 'info', 12:29:24 INFO - 'log_name': 'bump_beta_dev', 12:29:24 INFO - 'log_to_console': True, 12:29:24 INFO - 'opt_config_files': (), 12:29:24 INFO - 'previous_archive_prefix': 'https://archive.mozilla.org/pub', 12:29:24 INFO - 'product': u'firefox', 12:29:24 INFO - 'push_dest': 'ssh://hg.mozilla.org/users/stage-ffxbld/tools', 12:29:24 INFO - 'repo': {'branch': 'default', 12:29:24 INFO - 'dest': 'tools', 12:29:24 INFO - 'repo': 'https://hg.mozilla.org/users/stage-ffxbld/tools', 12:29:24 INFO - 'vcs': 'hg'}, 12:29:24 INFO - 'schedule_at': u'2017-10-31T00:45:00+00:00', 12:29:24 INFO - 'shipped-locales-url': 'https://hg.mozilla.org/projects/jamun/raw-file/{revision}/browser/locales/shipped-locales', 12:29:24 INFO - 'ssh_key': '~/.ssh/ffxbld_rsa', 12:29:24 INFO - 'ssh_user': 'ffxbld', 12:29:24 INFO - 'update_channels': {'beta': {'channel_names': ('beta', 12:29:24 INFO - 'beta-localtest', 12:29:24 INFO - 'beta-cdntest'), 12:29:24 INFO - 'mar_channel_ids': (), 12:29:24 INFO - 'patcher_config': 'mozBeta-branch-patcher2.cfg', 12:29:24 INFO - 'publish_rules': (32,), 12:29:24 INFO - 'requires_mirrors': True, 12:29:24 INFO - 'rules_to_update': ('firefox-beta-cdntest', 12:29:24 INFO - 'firefox-beta-localtest'), 12:29:24 INFO - 'update_verify_channel': 'beta-localtest', 12:29:24 INFO - 'version_regex': '^(\\d+\\.\\d+(b\\d+)?)$'}}, 12:29:24 INFO - 'vcs_share_base': '/builds/hg-shared', 12:29:24 INFO - 'version': u'58.0b1', 12:29:24 INFO - 'volatile_config': {'actions': None, 'add_actions': None, 'no_actions': None}, 12:29:24 INFO - 'work_dir': 'build'} 12:29:24 INFO - [mozharness: 2017-10-31 19:29:24.857905Z] Running clobber step. 12:29:24 INFO - Running main action method: clobber 12:29:24 INFO - rmtree: /builds/slave/rel-jamun-fx_sc_p_in_balrog-00/build 12:29:24 INFO - [mozharness: 2017-10-31 19:29:24.860765Z] Finished clobber step (success) 12:29:24 INFO - [mozharness: 2017-10-31 19:29:24.861004Z] Running pull step. 12:29:24 INFO - Running main action method: pull 12:29:24 INFO - mkdir: /builds/slave/rel-jamun-fx_sc_p_in_balrog-00/build 12:29:24 INFO - Changing directory to /builds/slave/rel-jamun-fx_sc_p_in_balrog-00/build. 12:29:24 INFO - retry: Calling _get_revision with args: (, 'tools'), kwargs: {}, attempt #1 12:29:24 INFO - Running command: ['hg', '--config', 'ui.merge=internal:merge', '--version'] 12:29:24 INFO - Copy/paste: hg --config ui.merge=internal:merge --version 12:29:25 INFO - Mercurial Distributed SCM (version 3.9.1) 12:29:25 INFO - (see https://mercurial-scm.org for more information) 12:29:25 INFO - Copyright (C) 2005-2016 Matt Mackall and others 12:29:25 INFO - This is free software; see the source for copying conditions. There is NO 12:29:25 INFO - warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. 12:29:25 INFO - Return code: 0 12:29:25 INFO - Running command: ['hg', '--config', 'ui.merge=internal:merge', 'debuginstall', '--config=ui.username=worker'] 12:29:25 INFO - Copy/paste: hg --config ui.merge=internal:merge debuginstall --config=ui.username=worker 12:29:25 INFO - checking encoding (ascii)... 12:29:25 INFO - checking Python executable (/tools/python27/bin/python2.7) 12:29:25 INFO - checking Python version (2.7.3) 12:29:25 INFO - checking Python lib (/tools/python27/lib/python2.7)... 12:29:25 INFO - checking Mercurial version (3.9.1) 12:29:25 INFO - checking Mercurial custom build () 12:29:25 INFO - checking module policy (c) 12:29:25 INFO - checking installed modules (/tools/python27-mercurial/lib/python2.7/site-packages/mercurial)... 12:29:25 INFO - checking templates (/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/templates)... 12:29:25 INFO - checking default template (/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/templates/map-cmdline.default) 12:29:25 INFO - checking commit editor... (vi) 12:29:25 INFO - checking username (worker) 12:29:25 INFO - no problems detected 12:29:25 INFO - Return code: 0 12:29:25 INFO - Running command: ['hg', '--config', 'ui.merge=internal:merge', '--config', 'extensions.robustcheckout=/builds/slave/rel-jamun-fx_sc_p_in_balrog-00/scripts/external_tools/robustcheckout.py', 'robustcheckout', 'https://hg.mozilla.org/users/stage-ffxbld/tools', 'tools', '--sharebase', '/builds/hg-shared', '--branch', 'default'] 12:29:25 INFO - Copy/paste: hg --config ui.merge=internal:merge --config extensions.robustcheckout=/builds/slave/rel-jamun-fx_sc_p_in_balrog-00/scripts/external_tools/robustcheckout.py robustcheckout https://hg.mozilla.org/users/stage-ffxbld/tools tools --sharebase /builds/hg-shared --branch default 12:29:25 INFO - (using Mercurial 3.9.1) 12:29:26 INFO - ensuring https://hg.mozilla.org/users/stage-ffxbld/tools@default is available at tools 12:29:26 INFO - warning: connecting to hg.mozilla.org using legacy security technology (TLS 1.0); see https://mercurial-scm.org/wiki/SecureConnections for more info 12:29:28 INFO - (sharing from new pooled repository 7ae7fb134bf7aec6ec96a062ff47a69053dd2973) 12:29:28 INFO - warning: connecting to hg.mozilla.org using legacy security technology (TLS 1.0); see https://mercurial-scm.org/wiki/SecureConnections for more info 12:29:42 INFO - 12:29:42 INFO - manifests [=================================> ] 4883/7989 12:29:42 INFO - 12:29:42 INFO - 12:29:42 INFO - files [ ] 11/2169 8m05s 12:29:42 INFO - files [ ] 16/2169 8m28s 12:29:42 INFO - files [ ] 17/2169 12m00s 12:29:42 INFO - files [========================> ] 958/2169 09s 12:29:42 INFO - files [==============================================> ] 1826/2169 02s 12:29:42 INFO - files [==================================================> ] 1973/2169 01s 12:29:42 INFO - 12:29:42 INFO - requesting all changes 12:29:42 INFO - adding changesets 12:29:42 INFO - adding manifests 12:29:42 INFO - adding file changes 12:29:42 INFO - added 7989 changesets with 17824 changes to 2169 files (+2 heads) 12:29:43 INFO - warning: connecting to hg.mozilla.org using legacy security technology (TLS 1.0); see https://mercurial-scm.org/wiki/SecureConnections for more info 12:29:43 INFO - searching for changes 12:29:43 INFO - no changes found 12:29:43 INFO - (pulling to obtain default) 12:29:43 INFO - warning: connecting to hg.mozilla.org using legacy security technology (TLS 1.0); see https://mercurial-scm.org/wiki/SecureConnections for more info 12:29:44 INFO - (remote resolved default to 4f34d38cd4abb5648c68f569e14764bd9e12fe1d; result is not deterministic) 12:29:44 INFO - (revision already present locally; not pulling) 12:29:44 INFO - 12:29:44 INFO - updating [====> ] 100/1058 12:29:44 INFO - 12:29:44 INFO - 1058 files updated, 0 files merged, 0 files removed, 0 files unresolved 12:29:44 INFO - updated to 4f34d38cd4abb5648c68f569e14764bd9e12fe1d 12:29:44 INFO - Return code: 0 12:29:44 INFO - Changing directory to /builds/slave/rel-jamun-fx_sc_p_in_balrog-00. 12:29:44 INFO - [mozharness: 2017-10-31 19:29:44.815139Z] Finished pull step (success) 12:29:44 INFO - [mozharness: 2017-10-31 19:29:44.815336Z] Running submit-to-balrog step. 12:29:44 INFO - Running main action method: submit_to_balrog 12:29:44 INFO - retry: Calling with args: (), kwargs: {}, attempt #1 12:29:44 INFO - Running command: ['/tools/buildbot/bin/python', '/builds/slave/rel-jamun-fx_sc_p_in_balrog-00/build/tools/scripts/build-promotion/balrog-release-shipper.py', '--api-root', u'https://balrog-admin.stage.mozaws.net/api', '--credentials-file', '/builds/slave/rel-jamun-fx_sc_p_in_balrog-00/oauth.txt', '--username', 'balrog-stage-ffxbld', '--version', u'58.0b1', '--product', u'firefox', '--build-number', '27', '--verbose', '--rules', '32', '--schedule-at', u'2017-10-31T00:45:00+00:00'] 12:29:44 INFO - Copy/paste: /tools/buildbot/bin/python /builds/slave/rel-jamun-fx_sc_p_in_balrog-00/build/tools/scripts/build-promotion/balrog-release-shipper.py --api-root https://balrog-admin.stage.mozaws.net/api --credentials-file /builds/slave/rel-jamun-fx_sc_p_in_balrog-00/oauth.txt --username balrog-stage-ffxbld --version 58.0b1 --product firefox --build-number 27 --verbose --rules 32 --schedule-at 2017-10-31T00:45:00+00:00 12:29:45 INFO - Balrog request to https://balrog-admin.stage.mozaws.net/api/rules/32 12:29:45 INFO - Data sent: None 12:29:45 INFO - Starting new HTTPS connection (1): balrog-admin.stage.mozaws.net 12:29:45 INFO - /builds/slave/rel-jamun-fx_sc_p_in_balrog-00/build/tools/scripts/build-promotion/../../lib/python/vendor/requests-2.7.0/requests/packages/urllib3/util/ssl_.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning. 12:29:45 INFO - InsecurePlatformWarning 12:29:46 INFO - "GET /api/rules/32 HTTP/1.1" 200 493 12:29:46 INFO - REQUEST STATS: {"url": "https://balrog-admin.stage.mozaws.net/api/rules/32", "timestamp": 1509478186.181528, "method": "GET", "elapsed_secs": 1.064089059829712, "status_code": 200} 12:29:46 INFO - Balrog request to https://balrog-admin.stage.mozaws.net/api/rules/32 12:29:46 INFO - Data sent: None 12:29:46 INFO - Starting new HTTPS connection (1): balrog-admin.stage.mozaws.net 12:29:46 INFO - /builds/slave/rel-jamun-fx_sc_p_in_balrog-00/build/tools/scripts/build-promotion/../../lib/python/vendor/requests-2.7.0/requests/packages/urllib3/util/ssl_.py:90: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning. 12:29:46 INFO - InsecurePlatformWarning 12:29:46 INFO - "HEAD /api/rules/32 HTTP/1.1" 200 0 12:29:46 INFO - REQUEST STATS: {"url": "https://balrog-admin.stage.mozaws.net/api/rules/32", "timestamp": 1509478186.856195, "method": "HEAD", "elapsed_secs": 0.6682078838348389, "status_code": 200} 12:29:46 INFO - Balrog request to https://balrog-admin.stage.mozaws.net/api/scheduled_changes/rules 12:29:46 INFO - Data sent: {u'comment': None, 'change_type': 'update', u'fallbackMapping': u'Firefox-57.0b10-build1', u'buildID': None, u'jaws': None, u'product': u'Firefox', u'instructionSet': None, u'mapping': 'Firefox-58.0b1-build27', u'alias': u'firefox-beta', u'headerArchitecture': None, u'buildTarget': None, 'data_verison': 354, u'osVersion': None, u'distVersion': None, u'mig64': None, u'data_version': 354, 'when': 1509410700000, u'backgroundRate': 100, u'priority': 90, u'locale': None, u'version': None, u'update_type': u'minor', u'memory': None, u'distribution': None, u'rule_id': '32', u'channel': u'beta'} 12:29:47 INFO - "POST /api/scheduled_changes/rules HTTP/1.1" 400 116 12:29:47 INFO - Caught HTTPError: {"status": 400, "type": "about:blank", "detail": "Changes may not be scheduled in the past", "title": "Bad Request"} 12:29:47 INFO - REQUEST STATS: {"url": "https://balrog-admin.stage.mozaws.net/api/scheduled_changes/rules", "timestamp": 1509478187.015032, "method": "POST", "elapsed_secs": 0.15850400924682617, "status_code": 400} 12:29:47 INFO - Traceback (most recent call last): 12:29:47 INFO - File "/builds/slave/rel-jamun-fx_sc_p_in_balrog-00/build/tools/scripts/build-promotion/balrog-release-shipper.py", line 55, in 12:29:47 INFO - args.build_number, args.rule_ids, args.schedule_at) 12:29:47 INFO - File "/builds/slave/rel-jamun-fx_sc_p_in_balrog-00/build/tools/scripts/build-promotion/../../lib/python/balrog/submitter/cli.py", line 546, in run 12:29:47 INFO - ).add_scheduled_rule_change(**data) 12:29:47 INFO - File "/builds/slave/rel-jamun-fx_sc_p_in_balrog-00/build/tools/lib/python/vendor/balrogclient-0.0.4/balrogclient/api.py", line 254, in add_scheduled_rule_change 12:29:47 INFO - return self.request(method='POST', data=rule_data) 12:29:47 INFO - File "/builds/slave/rel-jamun-fx_sc_p_in_balrog-00/build/tools/lib/python/vendor/balrogclient-0.0.4/balrogclient/api.py", line 111, in request 12:29:47 INFO - return self.do_request(url, data, method) 12:29:47 INFO - File "/builds/slave/rel-jamun-fx_sc_p_in_balrog-00/build/tools/lib/python/vendor/balrogclient-0.0.4/balrogclient/api.py", line 130, in do_request 12:29:47 INFO - req.raise_for_status() 12:29:47 INFO - File "/builds/slave/rel-jamun-fx_sc_p_in_balrog-00/build/tools/scripts/build-promotion/../../lib/python/vendor/requests-2.7.0/requests/models.py", line 851, in raise_for_status 12:29:47 INFO - raise HTTPError(http_error_msg, response=self) 12:29:47 INFO - requests.exceptions.HTTPError: 400 Client Error: BAD REQUEST 12:29:47 ERROR - Return code: 1 12:29:47 ERROR - 1 not in success codes: [0] 12:29:47 WARNING - setting return code to 2 12:29:47 FATAL - Halting on failure while running ['/tools/buildbot/bin/python', '/builds/slave/rel-jamun-fx_sc_p_in_balrog-00/build/tools/scripts/build-promotion/balrog-release-shipper.py', '--api-root', u'https://balrog-admin.stage.mozaws.net/api', '--credentials-file', '/builds/slave/rel-jamun-fx_sc_p_in_balrog-00/oauth.txt', '--username', 'balrog-stage-ffxbld', '--version', u'58.0b1', '--product', u'firefox', '--build-number', '27', '--verbose', '--rules', '32', '--schedule-at', u'2017-10-31T00:45:00+00:00'] 12:29:47 FATAL - Running post_fatal callback... 12:29:47 FATAL - Exiting 2 12:29:47 INFO - [mozharness: 2017-10-31 19:29:47.030226Z] Finished submit-to-balrog step (failed) 12:29:47 INFO - Running post-run listener: copy_logs_to_upload_dir 12:29:47 INFO - Copying logs to upload dir... 12:29:47 INFO - mkdir: /builds/slave/rel-jamun-fx_sc_p_in_balrog-00/build/upload/logs program finished with exit code 2 elapsedTime=22.322924 ========= master_lag: 0.01 ========= ========= Finished '/tools/buildbot/bin/python scripts/scripts/release/publish_balrog.py ...' failed (results: 2, elapsed: 22 secs) (at 2017-10-31 12:29:47.054316) ========= ========= Started no change (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:47.055783) ========= bash -c 'for file in `ls -1`; do cat $file; done' in dir /builds/slave/rel-jamun-fx_sc_p_in_balrog-00/properties (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'for file in `ls -1`; do cat $file; done'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-034.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-jamun-fx_sc_p_in_balrog-00/properties SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.004917 ========= master_lag: 0.04 ========= ========= Finished no change (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:47.103533) ========= ========= Started 'rm -f ...' (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:47.103872) ========= rm -f oauth.txt in dir /builds/slave/rel-jamun-fx_sc_p_in_balrog-00/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-f', 'oauth.txt'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-034.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-jamun-fx_sc_p_in_balrog-00 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002423 ========= master_lag: 0.05 ========= ========= Finished 'rm -f ...' (results: 0, elapsed: 0 secs) (at 2017-10-31 12:29:47.151337) ========= ========= Started reboot skipped (results: 3, elapsed: 0 secs) (at 2017-10-31 12:29:47.151663) ========= ========= Finished reboot skipped (results: 3, elapsed: 0 secs) (at 2017-10-31 12:29:47.151979) ========= ========= Total master_lag: 0.19 =========