builder: mozilla-inbound-linux-pgo slave: bld-linux64-spot-302 starttime: 1479598240.63 results: exception (4) buildid: 20161119153001 builduid: 51637e55e5f14ea3a18c602964000188 revision: 9f8700acec463beb0f1d37bcd3946a69a152f7a3 ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2016-11-19 15:30:40.631201) ========= master: http://buildbot-master74.bb.releng.usw2.mozilla.com:8001/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2016-11-19 15:30:40.631655) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-11-19 15:30:40.631940) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-11-19 15:30:40.725024) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-11-19 15:30:40.725343) ========= rm -rf scripts properties in dir /builds/slave/m-in-lx-pgo-000000000000000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts', 'properties'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-302.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-in-lx-pgo-000000000000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.003111 ========= master_lag: 0.06 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-11-19 15:30:40.785233) ========= ========= Started 'bash -c ...' exception (results: 4, elapsed: 8 mins, 57 secs) (at 2016-11-19 15:30:40.800315) ========= bash -c 'python /tools/checkouts/build-tools/buildfarm/utils/archiver_client.py mozharness --repo integration/mozilla-inbound --rev 9f8700acec463beb0f1d37bcd3946a69a152f7a3 --destination scripts --debug' in dir /builds/slave/m-in-lx-pgo-000000000000000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'python /tools/checkouts/build-tools/buildfarm/utils/archiver_client.py mozharness --repo integration/mozilla-inbound --rev 9f8700acec463beb0f1d37bcd3946a69a152f7a3 --destination scripts --debug'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-302.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-in-lx-pgo-000000000000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 2016-11-19 15:30:40,841 truncating revision to first 12 chars 2016-11-19 15:30:40,841 Setting DEBUG logging. 2016-11-19 15:30:40,841 attempt 1/10 2016-11-19 15:30:40,841 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/integration/mozilla-inbound/9f8700acec46?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2016-11-19 15:30:41,221 attempt 1/10 2016-11-19 15:30:41,582 current task status: no status available at this point. state: PENDING 2016-11-19 15:30:41,582 sleeping for 11.00s (attempt 1/10) 2016-11-19 15:30:52,593 attempt 2/10 2016-11-19 15:30:52,997 current task status: no status available at this point. state: PENDING 2016-11-19 15:30:52,997 sleeping for 16.50s (attempt 2/10) 2016-11-19 15:31:09,514 attempt 3/10 2016-11-19 15:31:09,897 current task status: no status available at this point. state: PENDING 2016-11-19 15:31:09,897 sleeping for 24.75s (attempt 3/10) 2016-11-19 15:31:34,672 attempt 4/10 2016-11-19 15:31:35,019 current task status: Task has expired from pending for too long. Re-creating task. state: RETRY 2016-11-19 15:31:35,019 sleeping for 38.12s (attempt 4/10) 2016-11-19 15:32:13,182 attempt 5/10 2016-11-19 15:32:13,519 current task status: no status available at this point. state: PENDING 2016-11-19 15:32:13,520 sleeping for 56.19s (attempt 5/10) 2016-11-19 15:33:09,764 attempt 6/10 2016-11-19 15:33:10,113 current task status: no status available at this point. state: PENDING 2016-11-19 15:33:10,113 sleeping for 85.28s (attempt 6/10) 2016-11-19 15:34:35,480 attempt 7/10 2016-11-19 15:34:35,837 current task status: no status available at this point. state: PENDING 2016-11-19 15:34:35,837 sleeping for 101.00s (attempt 7/10) 2016-11-19 15:36:16,938 attempt 8/10 2016-11-19 15:36:17,284 current task status: no status available at this point. state: PENDING 2016-11-19 15:36:17,285 sleeping for 101.00s (attempt 8/10) 2016-11-19 15:37:58,385 attempt 9/10 2016-11-19 15:37:58,718 current task status: no status available at this point. state: PENDING 2016-11-19 15:37:58,718 sleeping for 99.00s (attempt 9/10) 2016-11-19 15:39:37,818 attempt 10/10 2016-11-19 15:39:38,143 current task status: no status available at this point. state: PENDING 2016-11-19 15:39:38,143 Automation Error: task state did not equal SUCCESS 2016-11-19 15:39:38,144 Check archiver logs for errors. Task status: no status available at this point. Task state: PENDING program finished with exit code 3 elapsedTime=537.352277 ========= master_lag: 0.01 ========= ========= Finished 'bash -c ...' exception (results: 4, elapsed: 8 mins, 57 secs) (at 2016-11-19 15:39:38.162043) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Started no change (results: 0, elapsed: 0 secs) (at 2016-11-19 15:39:38.162397) ========= bash -c 'for file in `ls -1`; do cat $file; done' in dir /builds/slave/m-in-lx-pgo-000000000000000000/properties (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'for file in `ls -1`; do cat $file; done'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-302.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-in-lx-pgo-000000000000000000/properties SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.004456 ========= master_lag: 0.04 ========= ========= Finished no change (results: 0, elapsed: 0 secs) (at 2016-11-19 15:39:38.209287) ========= ========= Started 'rm -f ...' (results: 0, elapsed: 0 secs) (at 2016-11-19 15:39:38.209600) ========= rm -f oauth.txt in dir /builds/slave/m-in-lx-pgo-000000000000000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-f', 'oauth.txt'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-302.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-in-lx-pgo-000000000000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002651 ========= master_lag: 0.04 ========= ========= Finished 'rm -f ...' (results: 0, elapsed: 0 secs) (at 2016-11-19 15:39:38.255806) ========= ========= Started reboot skipped (results: 3, elapsed: 0 secs) (at 2016-11-19 15:39:38.256083) ========= ========= Finished reboot skipped (results: 3, elapsed: 0 secs) (at 2016-11-19 15:39:38.256310) ========= ========= Total master_lag: 0.15 =========