builder: release-mozilla-beta-firefox_updates slave: bld-linux64-spot-372 starttime: 1470187540.27 results: failure (2) revision: f21e48559ecda2e225953d4dffef3127cd903ba7 ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2016-08-02 18:25:40.265399) ========= master: http://buildbot-master72.bb.releng.usw2.mozilla.com:8001/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2016-08-02 18:25:40.265848) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-08-02 18:25:40.266127) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-08-02 18:25:40.334932) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-08-02 18:25:40.335195) ========= rm -rf scripts properties in dir /builds/slave/rel-m-beta-fx_upds-00000000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts', 'properties'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-372.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fx_upds-00000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.010722 ========= master_lag: 0.04 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-08-02 18:25:40.382960) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2016-08-02 18:25:40.383285) ========= bash -c 'python /tools/checkouts/build-tools/buildfarm/utils/archiver_client.py mozharness --repo releases/mozilla-beta --rev f21e48559ecda2e225953d4dffef3127cd903ba7 --destination scripts --debug' in dir /builds/slave/rel-m-beta-fx_upds-00000000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', u'python /tools/checkouts/build-tools/buildfarm/utils/archiver_client.py mozharness --repo releases/mozilla-beta --rev f21e48559ecda2e225953d4dffef3127cd903ba7 --destination scripts --debug'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-372.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fx_upds-00000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 2016-08-02 18:25:40,427 truncating revision to first 12 chars 2016-08-02 18:25:40,427 Setting DEBUG logging. 2016-08-02 18:25:40,427 attempt 1/10 2016-08-02 18:25:40,427 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/releases/mozilla-beta/f21e48559ecd?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2016-08-02 18:25:41,034 unpacking tar archive at: mozilla-beta-f21e48559ecd/testing/mozharness/ program finished with exit code 0 elapsedTime=0.757646 ========= master_lag: 0.01 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2016-08-02 18:25:41.150163) ========= ========= Started set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-08-02 18:25:41.150472) ========= script_repo_revision: f21e48559ecda2e225953d4dffef3127cd903ba7 ========= Finished set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-08-02 18:25:41.150862) ========= ========= Started downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2016-08-02 18:25:41.151134) ========= ========= Finished downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2016-08-02 18:25:41.157734) ========= ========= Started '/tools/buildbot/bin/python scripts/scripts/release/updates.py ...' failed (results: 2, elapsed: 12 mins, 0 secs) (at 2016-08-02 18:25:41.158026) ========= /tools/buildbot/bin/python scripts/scripts/release/updates.py -c releases/updates_firefox_beta.py in dir /builds/slave/rel-m-beta-fx_upds-00000000000/. (timeout 3600 secs) (maxTime 14400 secs) watching logfiles {} argv: ['/tools/buildbot/bin/python', 'scripts/scripts/release/updates.py', '-c', 'releases/updates_firefox_beta.py'] environment: CCACHE_COMPRESS=1 CCACHE_DIR=/builds/ccache CCACHE_HASHDIR= CCACHE_UMASK=002 DISPLAY=:2 G_BROKEN_FILENAMES=1 HG_SHARE_BASE_DIR=/builds/hg-shared HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-372.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LC_ALL=C LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld MOZ_AUTOMATION=1 MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_OBJDIR=obj-firefox PATH=/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin PROPERTIES_FILE=/builds/slave/rel-m-beta-fx_upds-00000000000/buildprops.json PWD=/builds/slave/rel-m-beta-fx_upds-00000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TINDERBOX_OUTPUT=1 TMOUT=86400 TOOLTOOL_CACHE=/builds/tooltool_cache TOOLTOOL_HOME=/builds USER=cltbld _=/tools/buildbot/bin/python using PTY: False 18:25:41 INFO - MultiFileLogger online at 20160802 18:25:41 in /builds/slave/rel-m-beta-fx_upds-00000000000 18:25:41 INFO - Using buildbot properties: 18:25:41 INFO - { 18:25:41 INFO - "channels": "beta", 18:25:41 INFO - "platforms": "linux, linux64, macosx64, win32, win64", 18:25:41 INFO - "partial_versions": "48.0build2, 48.0b10build1, 48.0b9build1", 18:25:41 INFO - "buildnumber": 18, 18:25:41 INFO - "build_number": 1, 18:25:41 INFO - "platform": null, 18:25:41 INFO - "balrog_api_root": "https://aus4-admin.mozilla.org/api", 18:25:41 INFO - "basedir": "/builds/slave/rel-m-beta-fx_upds-00000000000", 18:25:41 INFO - "appVersion": "49.0", 18:25:41 INFO - "slavename": "bld-linux64-spot-372", 18:25:41 INFO - "version": "49.0b1", 18:25:41 INFO - "master": "http://buildbot-master72.bb.releng.usw2.mozilla.com:8001/", 18:25:41 INFO - "branch": "mozilla-beta", 18:25:41 INFO - "revision": "f21e48559ecda2e225953d4dffef3127cd903ba7", 18:25:41 INFO - "product": "firefox", 18:25:41 INFO - "repository": "", 18:25:41 INFO - "buildername": "release-mozilla-beta-firefox_updates", 18:25:41 INFO - "taskId": "b4I5MSPwRyCrDmKTlLvikA", 18:25:41 INFO - "script_repo_revision": "f21e48559ecda2e225953d4dffef3127cd903ba7", 18:25:41 INFO - "project": "", 18:25:41 INFO - "release_promotion": true, 18:25:41 INFO - "repo_path": "releases/mozilla-beta" 18:25:41 INFO - } 18:25:41 INFO - Overriding product with firefox 18:25:41 INFO - Overriding version with 49.0b1 18:25:41 INFO - Overriding build_number with 1 18:25:41 INFO - Overriding revision with f21e48559ecda2e225953d4dffef3127cd903ba7 18:25:41 INFO - Overriding appVersion with 49.0 18:25:41 INFO - Overriding balrog_api_root with https://aus4-admin.mozilla.org/api 18:25:41 INFO - Overriding channels with beta 18:25:41 INFO - Run as scripts/scripts/release/updates.py -c releases/updates_firefox_beta.py 18:25:41 INFO - Dumping config to /builds/slave/rel-m-beta-fx_upds-00000000000/logs/localconfig.json. 18:25:41 INFO - {'appVersion': u'49.0', 18:25:41 INFO - 'append_to_log': False, 18:25:41 INFO - 'archive_domain': 'archive.mozilla.org', 18:25:41 INFO - 'archive_prefix': 'https://archive.mozilla.org/pub', 18:25:41 INFO - 'balrog_api_root': u'https://aus4-admin.mozilla.org/api', 18:25:41 INFO - 'balrog_url': 'https://aus5.mozilla.org', 18:25:41 INFO - 'balrog_use_dummy_suffix': False, 18:25:41 INFO - 'balrog_username': 'ffxbld', 18:25:41 INFO - 'base_work_dir': '/builds/slave/rel-m-beta-fx_upds-00000000000', 18:25:41 INFO - 'build_number': 1, 18:25:41 INFO - 'buildbot_json_path': 'buildprops.json', 18:25:41 INFO - 'channels': (u'beta',), 18:25:41 INFO - 'config_files': ('releases/updates_firefox_beta.py',), 18:25:41 INFO - 'credentials_file': 'oauth.txt', 18:25:41 INFO - 'download_domain': 'download.mozilla.org', 18:25:41 INFO - 'hg_user': 'ffxbld ', 18:25:41 INFO - 'ignore_no_changes': True, 18:25:41 INFO - 'log_level': 'info', 18:25:41 INFO - 'log_name': 'updates_beta', 18:25:41 INFO - 'log_to_console': True, 18:25:41 INFO - 'opt_config_files': (), 18:25:41 INFO - 'partial_versions': ((u'48.0', u'2'), (u'48.0b10', u'1'), (u'48.0b9', u'1')), 18:25:41 INFO - 'platforms': (u'linux', u'linux64', u'macosx64', u'win32', u'win64'), 18:25:41 INFO - 'previous_archive_prefix': 'https://archive.mozilla.org/pub', 18:25:41 INFO - 'product': u'firefox', 18:25:41 INFO - 'push_dest': 'ssh://hg.mozilla.org/build/tools', 18:25:41 INFO - 'repo': {'branch': 'default', 18:25:41 INFO - 'dest': 'tools', 18:25:41 INFO - 'repo': 'https://hg.mozilla.org/build/tools', 18:25:41 INFO - 'vcs': 'hg'}, 18:25:41 INFO - 'revision': u'f21e48559ecda2e225953d4dffef3127cd903ba7', 18:25:41 INFO - 'shipped-locales-url': 'https://hg.mozilla.org/releases/mozilla-beta/raw-file/{revision}/browser/locales/shipped-locales', 18:25:41 INFO - 'ssh_key': '~/.ssh/ffxbld_rsa', 18:25:41 INFO - 'ssh_user': 'ffxbld', 18:25:41 INFO - 'update_channels': {'beta': {'channel_names': ('beta', 18:25:41 INFO - 'beta-localtest', 18:25:41 INFO - 'beta-cdntest'), 18:25:41 INFO - 'mar_channel_ids': (), 18:25:41 INFO - 'patcher_config': 'mozBeta-branch-patcher2.cfg', 18:25:41 INFO - 'publish_rules': ('firefox-beta',), 18:25:41 INFO - 'requires_mirrors': True, 18:25:41 INFO - 'rules_to_update': ('firefox-beta-cdntest', 18:25:41 INFO - 'firefox-beta-localtest'), 18:25:41 INFO - 'update_verify_channel': 'beta-localtest', 18:25:41 INFO - 'version_regex': '^(\\d+\\.\\d+(b\\d+)?)$'}}, 18:25:41 INFO - 'version': u'49.0b1', 18:25:41 INFO - 'volatile_config': {'actions': None, 'add_actions': None, 'no_actions': None}, 18:25:41 INFO - 'work_dir': 'build'} 18:25:41 INFO - ##### 18:25:41 INFO - ##### Running clobber step. 18:25:41 INFO - ##### 18:25:41 INFO - Running main action method: clobber 18:25:41 INFO - rmtree: /builds/slave/rel-m-beta-fx_upds-00000000000/build 18:25:41 INFO - retry: Calling rmtree with args: ('/builds/slave/rel-m-beta-fx_upds-00000000000/build',), kwargs: {}, attempt #1 18:25:41 INFO - ##### 18:25:41 INFO - ##### Finished clobber step (success) 18:25:41 INFO - ##### 18:25:41 INFO - ##### 18:25:41 INFO - ##### Running pull step. 18:25:41 INFO - ##### 18:25:41 INFO - Running main action method: pull 18:25:41 INFO - mkdir: /builds/slave/rel-m-beta-fx_upds-00000000000/build 18:25:41 INFO - Changing directory to /builds/slave/rel-m-beta-fx_upds-00000000000/build. 18:25:41 INFO - retry: Calling _get_revision with args: (, 'tools'), kwargs: {}, attempt #1 18:25:41 INFO - rmtree: tools 18:25:41 INFO - retry: attempt #1 caught exception: vcs share base not defined; refusing to operate sub-optimally 18:25:41 INFO - retry: Failed, sleeping 60 seconds before retrying 18:26:41 INFO - retry: Calling _get_revision with args: (, 'tools'), kwargs: {}, attempt #2 18:26:41 INFO - rmtree: tools 18:26:41 INFO - retry: attempt #2 caught exception: vcs share base not defined; refusing to operate sub-optimally 18:26:41 INFO - retry: Failed, sleeping 120 seconds before retrying 18:28:41 INFO - retry: Calling _get_revision with args: (, 'tools'), kwargs: {}, attempt #3 18:28:41 INFO - rmtree: tools 18:28:41 INFO - retry: attempt #3 caught exception: vcs share base not defined; refusing to operate sub-optimally 18:28:41 INFO - retry: Failed, sleeping 240 seconds before retrying 18:32:41 INFO - retry: Calling _get_revision with args: (, 'tools'), kwargs: {}, attempt #4 18:32:41 INFO - rmtree: tools 18:32:41 INFO - retry: attempt #4 caught exception: vcs share base not defined; refusing to operate sub-optimally 18:32:41 INFO - retry: Failed, sleeping 300 seconds before retrying 18:37:41 INFO - retry: Calling _get_revision with args: (, 'tools'), kwargs: {}, attempt #5 18:37:41 INFO - rmtree: tools 18:37:41 INFO - retry: attempt #5 caught exception: vcs share base not defined; refusing to operate sub-optimally 18:37:41 FATAL - Automation Error: Can't checkout https://hg.mozilla.org/build/tools! 18:37:41 FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally 18:37:41 FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally 18:37:41 FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally 18:37:41 FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally 18:37:41 FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally 18:37:41 FATAL - Running post_fatal callback... 18:37:41 FATAL - Exiting -1 18:37:41 INFO - ##### 18:37:41 INFO - ##### Finished pull step (failed) 18:37:41 INFO - ##### 18:37:41 INFO - Running post-run listener: copy_logs_to_upload_dir 18:37:41 INFO - Copying logs to upload dir... 18:37:41 INFO - mkdir: /builds/slave/rel-m-beta-fx_upds-00000000000/build/upload/logs program finished with exit code 255 elapsedTime=720.501699 ========= master_lag: 0.01 ========= ========= Finished '/tools/buildbot/bin/python scripts/scripts/release/updates.py ...' failed (results: 2, elapsed: 12 mins, 0 secs) (at 2016-08-02 18:37:41.668668) ========= ========= Started no change (results: 0, elapsed: 0 secs) (at 2016-08-02 18:37:41.669664) ========= bash -c 'for file in `ls -1`; do cat $file; done' in dir /builds/slave/rel-m-beta-fx_upds-00000000000/properties (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'for file in `ls -1`; do cat $file; done'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-372.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fx_upds-00000000000/properties SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.004459 ========= master_lag: 0.05 ========= ========= Finished no change (results: 0, elapsed: 0 secs) (at 2016-08-02 18:37:41.722259) ========= ========= Started 'rm -f ...' (results: 0, elapsed: 0 secs) (at 2016-08-02 18:37:41.722542) ========= rm -f oauth.txt in dir /builds/slave/rel-m-beta-fx_upds-00000000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-f', 'oauth.txt'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-372.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fx_upds-00000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002373 ========= master_lag: 0.04 ========= ========= Finished 'rm -f ...' (results: 0, elapsed: 0 secs) (at 2016-08-02 18:37:41.768935) ========= ========= Started reboot skipped (results: 3, elapsed: 0 secs) (at 2016-08-02 18:37:41.769216) ========= ========= Finished reboot skipped (results: 3, elapsed: 0 secs) (at 2016-08-02 18:37:41.769468) ========= ========= Total master_lag: 0.15 =========