Page 1 of 1
Projects: 94xx - WORK_QUIT (404)
Posted: Sat Jan 23, 2016 11:16 am
by ^w^ing
Code: Select all
*********************** Log Started 2016-01-23T01:10:58Z ***********************
01:10:58:************************* Folding@home Client *************************
01:10:58: Website: http://folding.stanford.edu/
01:10:58: Copyright: (c) 2009-2014 Stanford University
01:10:58: Author: Joseph Coffland <[email protected]>
01:10:58: Args:
01:10:58: Config: D:/$TEMP$/fah/config.xml
01:10:58:******************************** Build ********************************
01:10:58: Version: 7.4.4
01:10:58: Date: Mar 4 2014
01:10:58: Time: 20:26:54
01:10:58: SVN Rev: 4130
01:10:58: Branch: fah/trunk/client
01:10:58: Compiler: Intel(R) C++ MSVC 1500 mode 1200
01:10:58: Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
01:10:58: /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
01:10:58: Platform: win32 XP
01:10:58: Bits: 32
01:10:58: Mode: Release
01:10:58:******************************* System ********************************
01:10:58: CPU: Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz
01:10:58: CPU ID: GenuineIntel Family 6 Model 26 Stepping 5
01:10:58: CPUs: 8
01:10:58: Memory: 17.99GiB
01:10:58: Free Memory: 16.08GiB
01:10:58: Threads: WINDOWS_THREADS
01:10:58: OS Version: 6.1
01:10:58: Has Battery: false
01:10:58: On Battery: false
01:10:58: UTC Offset: 1
01:10:58: PID: 4716
01:10:58: CWD: D:/$TEMP$/fah
01:10:58: OS: Windows 7 Ultimate
01:10:58: OS Arch: AMD64
01:10:58: GPUs: 1
01:10:58: GPU 0: NVIDIA:3 GK110 [GeForce GTX 780 Ti]
01:10:58: CUDA: 3.5
01:10:58: CUDA Driver: 8000
01:10:58:Win32 Service: false
01:10:58:***********************************************************************
01:10:59:<config>
01:10:59: <!-- Folding Slot Configuration -->
01:10:59: <extra-core-args v='-forceasm -verbose'/>
01:10:59: <max-packet-size v='big'/>
01:10:59:
01:10:59: <!-- HTTP Server -->
01:10:59: <allow v='127.0.0.1 192.168.20.0/24'/>
01:10:59:
01:10:59: <!-- Network -->
01:10:59: <proxy v=':8080'/>
01:10:59:
01:10:59: <!-- Remote Command Server -->
01:10:59: <password v='*****'/>
01:10:59:
01:10:59: <!-- Slot Control -->
01:10:59: <power v='full'/>
01:10:59:
01:10:59: <!-- User Information -->
01:10:59: <passkey v='********************************'/>
01:10:59: <team v='229610'/>
01:10:59: <user v='^w^ing'/>
01:10:59:
01:10:59: <!-- Work Unit Control -->
01:10:59: <next-unit-percentage v='100'/>
01:10:59:
01:10:59: <!-- Folding Slots -->
01:10:59: <slot id='0' type='GPU'>
01:10:59: <core-priority v='low'/>
01:10:59: </slot>
01:10:59:</config>
01:10:59:Trying to access database...
01:10:59:Successfully acquired database lock
01:10:59:Enabled folding slot 00: READY gpu:0:GK110 [GeForce GTX 780 Ti]
01:10:59:WU00:FS00:Connecting to 171.67.108.45:80
01:11:00:WARNING:WU00:FS00:Failed to get assignment from '171.67.108.45:80': Failed to connect to 171.67.108.45:80: Došlo k pokusu o přístup k soketu způsobem zakázaným jeho přístupovými oprávněními.
01:11:00:WU00:FS00:Connecting to 171.67.108.204:80
01:11:01:WU00:FS00:Assigned to work server 140.163.4.235
01:11:01:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GK110 [GeForce GTX 780 Ti] from 140.163.4.235
01:11:01:WU00:FS00:Connecting to 140.163.4.235:8080
01:11:01:WARNING:WU00:FS00:WorkServer connection failed on port 8080 trying 80
01:11:01:WU00:FS00:Connecting to 140.163.4.235:80
01:11:02:ERROR:WU00:FS00:Exception: Failed to connect to 140.163.4.235:80: Došlo k pokusu o přístup k soketu způsobem zakázaným jeho přístupovými oprávněními.
01:11:02:WU00:FS00:Connecting to 171.67.108.45:80
01:11:03:WARNING:WU00:FS00:Failed to get assignment from '171.67.108.45:80': Failed to connect to 171.67.108.45:80: Došlo k pokusu o přístup k soketu způsobem zakázaným jeho přístupovými oprávněními.
01:11:03:WU00:FS00:Connecting to 171.67.108.204:80
01:11:03:WU00:FS00:Assigned to work server 171.64.65.56
01:11:03:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GK110 [GeForce GTX 780 Ti] from 171.64.65.56
01:11:03:WU00:FS00:Connecting to 171.64.65.56:8080
01:11:04:WU00:FS00:Downloading 1.50MiB
01:11:07:WU00:FS00:Download complete
01:11:07:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9430 run:5 clone:1 gen:230 core:0x18 unit:0x00000107ab40413855474b77950be90e
01:11:07:WU00:FS00:Starting
01:11:07:WU00:FS00:Running FahCore: C:\FoldingAtHome\FAHClient/FAHCoreWrapper.exe D:/$TEMP$/fah/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_18.fah/FahCore_18.exe -dir 00 -suffix 01 -version 704 -lifeline 4716 -checkpoint 15 -gpu 0 -gpu-vendor nvidia -forceasm -verbose
01:11:07:WU00:FS00:Started FahCore on PID 6696
01:11:08:WU00:FS00:Core PID:2212
01:11:08:WU00:FS00:FahCore 0x18 started
01:11:09:WU00:FS00:0x18:*********************** Log Started 2016-01-23T01:11:08Z ***********************
01:11:09:WU00:FS00:0x18:Project: 9430 (Run 5, Clone 1, Gen 230)
01:11:09:WU00:FS00:0x18:Unit: 0x00000107ab40413855474b77950be90e
01:11:09:WU00:FS00:0x18:CPU: 0x00000000000000000000000000000000
01:11:09:WU00:FS00:0x18:Machine: 0
01:11:09:WU00:FS00:0x18:Reading tar file state.xml
01:11:09:WU00:FS00:0x18:Reading tar file system.xml
01:11:09:WU00:FS00:0x18:Reading tar file integrator.xml
01:11:09:WU00:FS00:0x18:Reading tar file core.xml
01:11:09:WU00:FS00:0x18:Digital signatures verified
01:11:09:WU00:FS00:0x18:Folding@home GPU core18
01:11:09:WU00:FS00:0x18:Version 0.0.4
01:11:22:WU00:FS00:0x18:Completed 0 out of 16000000 steps (0%)
01:11:22:WU00:FS00:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:17:14:WU00:FS00:0x18:Completed 160000 out of 16000000 steps (1%)
01:23:02:WU00:FS00:0x18:Completed 320000 out of 16000000 steps (2%)
01:28:50:WU00:FS00:0x18:Completed 480000 out of 16000000 steps (3%)
01:34:37:WU00:FS00:0x18:Completed 640000 out of 16000000 steps (4%)
01:40:26:WU00:FS00:0x18:Completed 800000 out of 16000000 steps (5%)
01:46:19:WU00:FS00:0x18:Completed 960000 out of 16000000 steps (6%)
01:52:07:WU00:FS00:0x18:Completed 1120000 out of 16000000 steps (7%)
01:57:56:WU00:FS00:0x18:Completed 1280000 out of 16000000 steps (8%)
02:03:44:WU00:FS00:0x18:Completed 1440000 out of 16000000 steps (9%)
02:09:32:WU00:FS00:0x18:Completed 1600000 out of 16000000 steps (10%)
02:15:26:WU00:FS00:0x18:Completed 1760000 out of 16000000 steps (11%)
02:21:15:WU00:FS00:0x18:Completed 1920000 out of 16000000 steps (12%)
02:27:03:WU00:FS00:0x18:Completed 2080000 out of 16000000 steps (13%)
02:32:52:WU00:FS00:0x18:Completed 2240000 out of 16000000 steps (14%)
02:38:40:WU00:FS00:0x18:Completed 2400000 out of 16000000 steps (15%)
02:44:34:WU00:FS00:0x18:Completed 2560000 out of 16000000 steps (16%)
02:50:22:WU00:FS00:0x18:Completed 2720000 out of 16000000 steps (17%)
02:56:11:WU00:FS00:0x18:Completed 2880000 out of 16000000 steps (18%)
03:01:59:WU00:FS00:0x18:Completed 3040000 out of 16000000 steps (19%)
03:07:47:WU00:FS00:0x18:Completed 3200000 out of 16000000 steps (20%)
03:13:41:WU00:FS00:0x18:Completed 3360000 out of 16000000 steps (21%)
03:19:29:WU00:FS00:0x18:Completed 3520000 out of 16000000 steps (22%)
03:25:17:WU00:FS00:0x18:Completed 3680000 out of 16000000 steps (23%)
03:31:06:WU00:FS00:0x18:Completed 3840000 out of 16000000 steps (24%)
03:36:54:WU00:FS00:0x18:Completed 4000000 out of 16000000 steps (25%)
03:42:48:WU00:FS00:0x18:Completed 4160000 out of 16000000 steps (26%)
03:48:37:WU00:FS00:0x18:Completed 4320000 out of 16000000 steps (27%)
03:54:25:WU00:FS00:0x18:Completed 4480000 out of 16000000 steps (28%)
04:00:14:WU00:FS00:0x18:Completed 4640000 out of 16000000 steps (29%)
04:06:02:WU00:FS00:0x18:Completed 4800000 out of 16000000 steps (30%)
04:11:56:WU00:FS00:0x18:Completed 4960000 out of 16000000 steps (31%)
04:17:44:WU00:FS00:0x18:Completed 5120000 out of 16000000 steps (32%)
04:23:33:WU00:FS00:0x18:Completed 5280000 out of 16000000 steps (33%)
04:29:21:WU00:FS00:0x18:Completed 5440000 out of 16000000 steps (34%)
04:35:10:WU00:FS00:0x18:Completed 5600000 out of 16000000 steps (35%)
04:41:04:WU00:FS00:0x18:Completed 5760000 out of 16000000 steps (36%)
04:46:52:WU00:FS00:0x18:Completed 5920000 out of 16000000 steps (37%)
04:52:41:WU00:FS00:0x18:Completed 6080000 out of 16000000 steps (38%)
04:58:29:WU00:FS00:0x18:Completed 6240000 out of 16000000 steps (39%)
05:04:18:WU00:FS00:0x18:Completed 6400000 out of 16000000 steps (40%)
05:10:12:WU00:FS00:0x18:Completed 6560000 out of 16000000 steps (41%)
05:16:00:WU00:FS00:0x18:Completed 6720000 out of 16000000 steps (42%)
05:21:49:WU00:FS00:0x18:Completed 6880000 out of 16000000 steps (43%)
05:27:37:WU00:FS00:0x18:Completed 7040000 out of 16000000 steps (44%)
05:33:26:WU00:FS00:0x18:Completed 7200000 out of 16000000 steps (45%)
05:39:20:WU00:FS00:0x18:Completed 7360000 out of 16000000 steps (46%)
05:45:08:WU00:FS00:0x18:Completed 7520000 out of 16000000 steps (47%)
05:50:57:WU00:FS00:0x18:Completed 7680000 out of 16000000 steps (48%)
05:56:46:WU00:FS00:0x18:Completed 7840000 out of 16000000 steps (49%)
06:02:34:WU00:FS00:0x18:Completed 8000000 out of 16000000 steps (50%)
06:08:28:WU00:FS00:0x18:Completed 8160000 out of 16000000 steps (51%)
06:14:17:WU00:FS00:0x18:Completed 8320000 out of 16000000 steps (52%)
06:20:05:WU00:FS00:0x18:Completed 8480000 out of 16000000 steps (53%)
06:25:56:WU00:FS00:0x18:Completed 8640000 out of 16000000 steps (54%)
06:31:44:WU00:FS00:0x18:Completed 8800000 out of 16000000 steps (55%)
06:37:38:WU00:FS00:0x18:Completed 8960000 out of 16000000 steps (56%)
06:43:27:WU00:FS00:0x18:Completed 9120000 out of 16000000 steps (57%)
06:49:15:WU00:FS00:0x18:Completed 9280000 out of 16000000 steps (58%)
06:55:04:WU00:FS00:0x18:Completed 9440000 out of 16000000 steps (59%)
07:00:52:WU00:FS00:0x18:Completed 9600000 out of 16000000 steps (60%)
07:06:47:WU00:FS00:0x18:Completed 9760000 out of 16000000 steps (61%)
******************************* Date: 2016-01-23 *******************************
07:12:35:WU00:FS00:0x18:Completed 9920000 out of 16000000 steps (62%)
07:18:24:WU00:FS00:0x18:Completed 10080000 out of 16000000 steps (63%)
07:24:13:WU00:FS00:0x18:Completed 10240000 out of 16000000 steps (64%)
07:30:02:WU00:FS00:0x18:Completed 10400000 out of 16000000 steps (65%)
07:35:57:WU00:FS00:0x18:Completed 10560000 out of 16000000 steps (66%)
07:41:46:WU00:FS00:0x18:Completed 10720000 out of 16000000 steps (67%)
07:47:35:WU00:FS00:0x18:Completed 10880000 out of 16000000 steps (68%)
07:53:24:WU00:FS00:0x18:Completed 11040000 out of 16000000 steps (69%)
07:59:12:WU00:FS00:0x18:Completed 11200000 out of 16000000 steps (70%)
08:05:07:WU00:FS00:0x18:Completed 11360000 out of 16000000 steps (71%)
08:10:56:WU00:FS00:0x18:Completed 11520000 out of 16000000 steps (72%)
08:16:46:WU00:FS00:0x18:Completed 11680000 out of 16000000 steps (73%)
08:22:34:WU00:FS00:0x18:Completed 11840000 out of 16000000 steps (74%)
08:28:23:WU00:FS00:0x18:Completed 12000000 out of 16000000 steps (75%)
08:34:17:WU00:FS00:0x18:Completed 12160000 out of 16000000 steps (76%)
08:40:06:WU00:FS00:0x18:Completed 12320000 out of 16000000 steps (77%)
08:45:55:WU00:FS00:0x18:Completed 12480000 out of 16000000 steps (78%)
08:51:44:WU00:FS00:0x18:Completed 12640000 out of 16000000 steps (79%)
08:57:33:WU00:FS00:0x18:Completed 12800000 out of 16000000 steps (80%)
09:03:27:WU00:FS00:0x18:Completed 12960000 out of 16000000 steps (81%)
09:09:15:WU00:FS00:0x18:Completed 13120000 out of 16000000 steps (82%)
09:15:18:WU00:FS00:0x18:Completed 13280000 out of 16000000 steps (83%)
09:21:36:WU00:FS00:0x18:Completed 13440000 out of 16000000 steps (84%)
09:27:51:WU00:FS00:0x18:Completed 13600000 out of 16000000 steps (85%)
09:34:15:WU00:FS00:0x18:Completed 13760000 out of 16000000 steps (86%)
09:40:37:WU00:FS00:0x18:Completed 13920000 out of 16000000 steps (87%)
09:47:05:WU00:FS00:0x18:Completed 14080000 out of 16000000 steps (88%)
09:53:19:WU00:FS00:0x18:Completed 14240000 out of 16000000 steps (89%)
09:59:32:WU00:FS00:0x18:Completed 14400000 out of 16000000 steps (90%)
10:06:00:WU00:FS00:0x18:Completed 14560000 out of 16000000 steps (91%)
10:12:16:WU00:FS00:0x18:Completed 14720000 out of 16000000 steps (92%)
10:18:27:WU00:FS00:0x18:Completed 14880000 out of 16000000 steps (93%)
10:24:41:WU00:FS00:0x18:Completed 15040000 out of 16000000 steps (94%)
10:30:42:WU00:FS00:0x18:Completed 15200000 out of 16000000 steps (95%)
10:36:51:WU00:FS00:0x18:Completed 15360000 out of 16000000 steps (96%)
10:43:19:WU00:FS00:0x18:Completed 15520000 out of 16000000 steps (97%)
10:43:38:FS00:Finishing
10:49:38:WU00:FS00:0x18:Completed 15680000 out of 16000000 steps (98%)
10:55:54:WU00:FS00:0x18:Completed 15840000 out of 16000000 steps (99%)
11:02:22:WU00:FS00:0x18:Completed 16000000 out of 16000000 steps (100%)
11:02:28:WU00:FS00:0x18:Saving result file logfile_01.txt
11:02:28:WU00:FS00:0x18:Saving result file checkpointState.xml
11:02:28:WU00:FS00:0x18:Saving result file checkpt.crc
11:02:28:WU00:FS00:0x18:Saving result file log.txt
11:02:28:WU00:FS00:0x18:Saving result file positions.xtc
11:02:33:WU00:FS00:0x18:Folding@home Core Shutdown: FINISHED_UNIT
11:02:33:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
11:02:33:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:9430 run:5 clone:1 gen:230 core:0x18 unit:0x00000107ab40413855474b77950be90e
11:02:34:WU00:FS00:Uploading 24.01MiB to 171.64.65.56
11:02:34:WU00:FS00:Connecting to 171.64.65.56:8080
11:02:40:WU00:FS00:Upload 1.82%
11:02:46:WU00:FS00:Upload 3.38%
11:02:52:WU00:FS00:Upload 4.94%
11:02:58:WU00:FS00:Upload 6.77%
11:03:04:WU00:FS00:Upload 8.33%
11:03:10:WU00:FS00:Upload 9.89%
11:03:16:WU00:FS00:Upload 11.71%
11:03:22:WU00:FS00:Upload 13.27%
11:03:28:WU00:FS00:Upload 14.83%
11:03:34:WU00:FS00:Upload 16.40%
11:03:40:WU00:FS00:Upload 18.22%
11:03:46:WU00:FS00:Upload 19.78%
11:03:52:WU00:FS00:Upload 21.34%
11:03:58:WU00:FS00:Upload 22.90%
11:04:04:WU00:FS00:Upload 24.72%
11:04:10:WU00:FS00:Upload 26.29%
11:04:16:WU00:FS00:Upload 27.85%
11:04:22:WU00:FS00:Upload 29.41%
11:04:28:WU00:FS00:Upload 31.23%
11:04:34:WU00:FS00:Upload 32.79%
11:04:40:WU00:FS00:Upload 34.35%
11:04:46:WU00:FS00:Upload 36.18%
11:04:52:WU00:FS00:Upload 37.74%
11:04:58:WU00:FS00:Upload 39.30%
11:05:04:WU00:FS00:Upload 41.12%
11:05:10:WU00:FS00:Upload 42.68%
11:05:16:WU00:FS00:Upload 44.24%
11:05:22:WU00:FS00:Upload 46.07%
11:05:28:WU00:FS00:Upload 47.63%
11:05:34:WU00:FS00:Upload 49.19%
11:05:40:WU00:FS00:Upload 51.01%
11:05:46:WU00:FS00:Upload 52.57%
11:05:52:WU00:FS00:Upload 54.13%
11:05:58:WU00:FS00:Upload 55.95%
11:06:04:WU00:FS00:Upload 57.52%
11:06:10:WU00:FS00:Upload 59.08%
11:06:16:WU00:FS00:Upload 60.64%
11:06:22:WU00:FS00:Upload 62.46%
11:06:28:WU00:FS00:Upload 64.02%
11:06:34:WU00:FS00:Upload 65.58%
11:06:40:WU00:FS00:Upload 67.41%
11:06:46:WU00:FS00:Upload 68.97%
11:06:52:WU00:FS00:Upload 70.53%
11:06:58:WU00:FS00:Upload 72.35%
11:07:04:WU00:FS00:Upload 73.91%
11:07:10:WU00:FS00:Upload 75.47%
11:07:16:WU00:FS00:Upload 77.04%
11:07:22:WU00:FS00:Upload 78.86%
11:07:28:WU00:FS00:Upload 80.42%
11:07:34:WU00:FS00:Upload 81.98%
11:07:40:WU00:FS00:Upload 83.54%
11:07:46:WU00:FS00:Upload 85.10%
11:07:52:WU00:FS00:Upload 86.66%
11:07:58:WU00:FS00:Upload 88.49%
11:08:04:WU00:FS00:Upload 90.05%
11:08:10:WU00:FS00:Upload 91.61%
11:08:16:WU00:FS00:Upload 92.91%
11:08:22:WU00:FS00:Upload 94.47%
11:08:28:WU00:FS00:Upload 96.29%
11:08:34:WU00:FS00:Upload 97.86%
11:08:40:WU00:FS00:Upload 99.42%
11:08:42:WU00:FS00:Upload complete
11:08:42:WU00:FS00:Server responded WORK_QUIT (404)
11:08:42:WARNING:WU00:FS00:Server did not like results, dumping
11:08:43:WU00:FS00:Cleaning up
what does that even mean? It took 12 hours to complete, cost me a measurable amount in electricity and these things are happening more and more often now.
Re: Project: 9430 (Run 5, Clone 1, Gen 230) - WORK_QUIT (404
Posted: Sat Jan 23, 2016 1:42 pm
by Joe_H
It usually means the WS detected that the WU was corrupted in some way when it received the upload. Is your GPU overclocked or running at a particularly high temperature?
Other than that, this WS has had some problems similar to this in the past. It is possible that it is mistakenly discarding a WU return as bad. But yours is the first report so far, so can't tell if the problem is at the WS or with your system and its connection for upload.
Re: Project: 9430 (Run 5, Clone 1, Gen 230) - WORK_QUIT (404
Posted: Sun Jan 24, 2016 3:17 am
by cinetrope
I just had the same thing happen to me WU P9430 R16 C6 G173
No bad state errors detected during processing.
Re: Project: 9430 (Run 5, Clone 1, Gen 230) - WORK_QUIT (404
Posted: Sun Jan 24, 2016 3:53 am
by cinetrope
Code: Select all
17:36:11:WU00:FS01:0x18:*********************** Log Started 2016-01-23T17:36:10Z ***********************
17:36:11:WU00:FS01:0x18:Project: 9430 (Run 16, Clone 6, Gen 173)
17:36:11:WU00:FS01:0x18:Unit: 0x000000dcab40413855474bb0c3a8d196
17:36:11:WU00:FS01:0x18:CPU: 0x00000000000000000000000000000000
17:36:11:WU00:FS01:0x18:Machine: 1
17:36:11:WU00:FS01:0x18:Reading tar file state.xml
17:36:11:WU00:FS01:0x18:Reading tar file system.xml
17:36:11:WU00:FS01:0x18:Reading tar file integrator.xml
17:36:11:WU00:FS01:0x18:Reading tar file core.xml
17:36:11:WU00:FS01:0x18:Digital signatures verified
17:36:11:WU00:FS01:0x18:Folding@home GPU core18
17:36:11:WU00:FS01:0x18:Version 0.0.4
17:36:16:WU02:FS01:Upload 5.01%
17:36:19:WU00:FS01:0x18:Completed 0 out of 16000000 steps (0%)
17:36:19:WU00:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
17:36:22:WU02:FS01:Upload 10.86%
17:36:28:WU02:FS01:Upload 16.29%
17:36:34:WU02:FS01:Upload 22.13%
17:36:40:WU02:FS01:Upload 27.56%
17:36:46:WU02:FS01:Upload 32.99%
17:36:52:WU02:FS01:Upload 38.42%
17:36:58:WU02:FS01:Upload 44.26%
17:37:04:WU02:FS01:Upload 49.27%
17:37:10:WU02:FS01:Upload 54.70%
17:37:16:WU02:FS01:Upload 60.13%
17:37:22:WU02:FS01:Upload 65.56%
17:37:28:WU02:FS01:Upload 70.99%
17:37:34:WU02:FS01:Upload 76.42%
17:37:40:WU02:FS01:Upload 81.43%
17:37:46:WU02:FS01:Upload 86.86%
17:37:52:WU02:FS01:Upload 91.87%
17:37:58:WU02:FS01:Upload 97.71%
17:38:32:WU02:FS01:Upload complete
17:38:32:WU02:FS01:Server responded WORK_ACK (400)
17:38:32:WU02:FS01:Final credit estimate, 44827.00 points
17:38:32:WU02:FS01:Cleaning up
17:41:31:WU00:FS01:0x18:Completed 160000 out of 16000000 steps (1%)
17:46:39:WU00:FS01:0x18:Completed 320000 out of 16000000 steps (2%)
17:51:48:WU00:FS01:0x18:Completed 480000 out of 16000000 steps (3%)
17:56:56:WU00:FS01:0x18:Completed 640000 out of 16000000 steps (4%)
18:02:05:WU00:FS01:0x18:Completed 800000 out of 16000000 steps (5%)
18:07:17:WU00:FS01:0x18:Completed 960000 out of 16000000 steps (6%)
18:12:25:WU00:FS01:0x18:Completed 1120000 out of 16000000 steps (7%)
18:17:34:WU00:FS01:0x18:Completed 1280000 out of 16000000 steps (8%)
18:22:42:WU00:FS01:0x18:Completed 1440000 out of 16000000 steps (9%)
18:27:51:WU00:FS01:0x18:Completed 1600000 out of 16000000 steps (10%)
18:33:03:WU00:FS01:0x18:Completed 1760000 out of 16000000 steps (11%)
18:38:11:WU00:FS01:0x18:Completed 1920000 out of 16000000 steps (12%)
18:43:20:WU00:FS01:0x18:Completed 2080000 out of 16000000 steps (13%)
18:48:28:WU00:FS01:0x18:Completed 2240000 out of 16000000 steps (14%)
18:53:37:WU00:FS01:0x18:Completed 2400000 out of 16000000 steps (15%)
18:58:49:WU00:FS01:0x18:Completed 2560000 out of 16000000 steps (16%)
19:03:58:WU00:FS01:0x18:Completed 2720000 out of 16000000 steps (17%)
19:09:07:WU00:FS01:0x18:Completed 2880000 out of 16000000 steps (18%)
19:14:16:WU00:FS01:0x18:Completed 3040000 out of 16000000 steps (19%)
19:19:25:WU00:FS01:0x18:Completed 3200000 out of 16000000 steps (20%)
19:24:37:WU00:FS01:0x18:Completed 3360000 out of 16000000 steps (21%)
19:29:46:WU00:FS01:0x18:Completed 3520000 out of 16000000 steps (22%)
19:34:55:WU00:FS01:0x18:Completed 3680000 out of 16000000 steps (23%)
19:40:04:WU00:FS01:0x18:Completed 3840000 out of 16000000 steps (24%)
19:45:13:WU00:FS01:0x18:Completed 4000000 out of 16000000 steps (25%)
19:50:25:WU00:FS01:0x18:Completed 4160000 out of 16000000 steps (26%)
19:55:34:WU00:FS01:0x18:Completed 4320000 out of 16000000 steps (27%)
20:00:43:WU00:FS01:0x18:Completed 4480000 out of 16000000 steps (28%)
20:05:52:WU00:FS01:0x18:Completed 4640000 out of 16000000 steps (29%)
20:11:01:WU00:FS01:0x18:Completed 4800000 out of 16000000 steps (30%)
20:16:14:WU00:FS01:0x18:Completed 4960000 out of 16000000 steps (31%)
20:21:23:WU00:FS01:0x18:Completed 5120000 out of 16000000 steps (32%)
20:26:31:WU00:FS01:0x18:Completed 5280000 out of 16000000 steps (33%)
20:31:41:WU00:FS01:0x18:Completed 5440000 out of 16000000 steps (34%)
20:36:50:WU00:FS01:0x18:Completed 5600000 out of 16000000 steps (35%)
20:42:02:WU00:FS01:0x18:Completed 5760000 out of 16000000 steps (36%)
******************************* Date: 2016-01-23 *******************************
20:47:11:WU00:FS01:0x18:Completed 5920000 out of 16000000 steps (37%)
20:52:20:WU00:FS01:0x18:Completed 6080000 out of 16000000 steps (38%)
20:57:29:WU00:FS01:0x18:Completed 6240000 out of 16000000 steps (39%)
21:02:37:WU00:FS01:0x18:Completed 6400000 out of 16000000 steps (40%)
21:07:50:WU00:FS01:0x18:Completed 6560000 out of 16000000 steps (41%)
21:12:59:WU00:FS01:0x18:Completed 6720000 out of 16000000 steps (42%)
21:18:09:WU00:FS01:0x18:Completed 6880000 out of 16000000 steps (43%)
21:23:18:WU00:FS01:0x18:Completed 7040000 out of 16000000 steps (44%)
21:28:27:WU00:FS01:0x18:Completed 7200000 out of 16000000 steps (45%)
21:33:40:WU00:FS01:0x18:Completed 7360000 out of 16000000 steps (46%)
21:38:50:WU00:FS01:0x18:Completed 7520000 out of 16000000 steps (47%)
21:44:01:WU00:FS01:0x18:Completed 7680000 out of 16000000 steps (48%)
21:49:11:WU00:FS01:0x18:Completed 7840000 out of 16000000 steps (49%)
21:54:22:WU00:FS01:0x18:Completed 8000000 out of 16000000 steps (50%)
21:59:37:WU00:FS01:0x18:Completed 8160000 out of 16000000 steps (51%)
22:04:49:WU00:FS01:0x18:Completed 8320000 out of 16000000 steps (52%)
22:10:01:WU00:FS01:0x18:Completed 8480000 out of 16000000 steps (53%)
22:15:12:WU00:FS01:0x18:Completed 8640000 out of 16000000 steps (54%)
22:20:24:WU00:FS01:0x18:Completed 8800000 out of 16000000 steps (55%)
22:25:39:WU00:FS01:0x18:Completed 8960000 out of 16000000 steps (56%)
22:30:50:WU00:FS01:0x18:Completed 9120000 out of 16000000 steps (57%)
22:36:01:WU00:FS01:0x18:Completed 9280000 out of 16000000 steps (58%)
22:41:13:WU00:FS01:0x18:Completed 9440000 out of 16000000 steps (59%)
22:46:24:WU00:FS01:0x18:Completed 9600000 out of 16000000 steps (60%)
22:51:38:WU00:FS01:0x18:Completed 9760000 out of 16000000 steps (61%)
22:56:49:WU00:FS01:0x18:Completed 9920000 out of 16000000 steps (62%)
23:02:00:WU00:FS01:0x18:Completed 10080000 out of 16000000 steps (63%)
23:07:12:WU00:FS01:0x18:Completed 10240000 out of 16000000 steps (64%)
23:12:23:WU00:FS01:0x18:Completed 10400000 out of 16000000 steps (65%)
23:17:37:WU00:FS01:0x18:Completed 10560000 out of 16000000 steps (66%)
23:22:49:WU00:FS01:0x18:Completed 10720000 out of 16000000 steps (67%)
23:28:00:WU00:FS01:0x18:Completed 10880000 out of 16000000 steps (68%)
23:33:12:WU00:FS01:0x18:Completed 11040000 out of 16000000 steps (69%)
23:38:23:WU00:FS01:0x18:Completed 11200000 out of 16000000 steps (70%)
23:43:38:WU00:FS01:0x18:Completed 11360000 out of 16000000 steps (71%)
23:48:49:WU00:FS01:0x18:Completed 11520000 out of 16000000 steps (72%)
23:54:00:WU00:FS01:0x18:Completed 11680000 out of 16000000 steps (73%)
23:59:12:WU00:FS01:0x18:Completed 11840000 out of 16000000 steps (74%)
00:04:23:WU00:FS01:0x18:Completed 12000000 out of 16000000 steps (75%)
00:09:38:WU00:FS01:0x18:Completed 12160000 out of 16000000 steps (76%)
00:14:49:WU00:FS01:0x18:Completed 12320000 out of 16000000 steps (77%)
00:20:01:WU00:FS01:0x18:Completed 12480000 out of 16000000 steps (78%)
00:25:12:WU00:FS01:0x18:Completed 12640000 out of 16000000 steps (79%)
00:30:24:WU00:FS01:0x18:Completed 12800000 out of 16000000 steps (80%)
00:35:39:WU00:FS01:0x18:Completed 12960000 out of 16000000 steps (81%)
00:40:50:WU00:FS01:0x18:Completed 13120000 out of 16000000 steps (82%)
00:46:02:WU00:FS01:0x18:Completed 13280000 out of 16000000 steps (83%)
00:51:13:WU00:FS01:0x18:Completed 13440000 out of 16000000 steps (84%)
00:56:24:WU00:FS01:0x18:Completed 13600000 out of 16000000 steps (85%)
01:01:39:WU00:FS01:0x18:Completed 13760000 out of 16000000 steps (86%)
01:06:50:WU00:FS01:0x18:Completed 13920000 out of 16000000 steps (87%)
01:12:01:WU00:FS01:0x18:Completed 14080000 out of 16000000 steps (88%)
01:17:12:WU00:FS01:0x18:Completed 14240000 out of 16000000 steps (89%)
01:22:24:WU00:FS01:0x18:Completed 14400000 out of 16000000 steps (90%)
01:27:38:WU00:FS01:0x18:Completed 14560000 out of 16000000 steps (91%)
01:32:50:WU00:FS01:0x18:Completed 14720000 out of 16000000 steps (92%)
01:38:01:WU00:FS01:0x18:Completed 14880000 out of 16000000 steps (93%)
01:43:13:WU00:FS01:0x18:Completed 15040000 out of 16000000 steps (94%)
01:48:24:WU00:FS01:0x18:Completed 15200000 out of 16000000 steps (95%)
01:53:39:WU00:FS01:0x18:Completed 15360000 out of 16000000 steps (96%)
01:58:51:WU00:FS01:0x18:Completed 15520000 out of 16000000 steps (97%)
02:04:02:WU00:FS01:0x18:Completed 15680000 out of 16000000 steps (98%)
02:09:14:WU00:FS01:0x18:Completed 15840000 out of 16000000 steps (99%)
02:14:26:WU00:FS01:0x18:Completed 16000000 out of 16000000 steps (100%)
02:14:26:WU01:FS01:Connecting to 171.67.108.45:80
02:14:27:WU01:FS01:Assigned to work server 171.67.108.53
02:14:27:WU01:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GM204 [GeForce GTX 970] from 171.67.108.53
02:14:27:WU01:FS01:Connecting to 171.67.108.53:8080
02:14:27:WU01:FS01:Downloading 1.36MiB
02:14:29:WU00:FS01:0x18:Saving result file logfile_01.txt
02:14:29:WU00:FS01:0x18:Saving result file checkpointState.xml
02:14:30:WU00:FS01:0x18:Saving result file checkpt.crc
02:14:30:WU00:FS01:0x18:Saving result file log.txt
02:14:30:WU00:FS01:0x18:Saving result file positions.xtc
02:14:33:WU01:FS01:Download 46.00%
02:14:33:WU00:FS01:0x18:Folding@home Core Shutdown: FINISHED_UNIT
02:14:34:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
02:14:34:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:9430 run:16 clone:6 gen:173 core:0x18 unit:0x000000dcab40413855474bb0c3a8d196
02:14:34:WU00:FS01:Uploading 24.01MiB to 171.64.65.56
02:14:34:WU00:FS01:Connecting to 171.64.65.56:8080
02:14:39:WU01:FS01:Download 64.40%
02:14:40:WU00:FS01:Upload 2.08%
02:14:44:WU01:FS01:Download complete
02:14:44:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9201 run:117 clone:4 gen:0 core:0x17 unit:0x000000076652edc5566bb3b2104ffa0f
02:14:44:WU01:FS01:Starting
02:14:44:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/cinetrope/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 3764 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
02:14:44:WU01:FS01:Started FahCore on PID 152
02:14:44:WU01:FS01:Core PID:160
02:14:44:WU01:FS01:FahCore 0x17 started
02:14:45:WU01:FS01:0x17:*********************** Log Started 2016-01-24T02:14:44Z ***********************
02:14:45:WU01:FS01:0x17:Project: 9201 (Run 117, Clone 4, Gen 0)
02:14:45:WU01:FS01:0x17:Unit: 0x000000076652edc5566bb3b2104ffa0f
02:14:45:WU01:FS01:0x17:CPU: 0x00000000000000000000000000000000
02:14:45:WU01:FS01:0x17:Machine: 1
02:14:45:WU01:FS01:0x17:Reading tar file system.xml
02:14:45:WU01:FS01:0x17:Reading tar file integrator.xml
02:14:45:WU01:FS01:0x17:Reading tar file state.xml
02:14:45:WU01:FS01:0x17:Reading tar file core.xml
02:14:45:WU01:FS01:0x17:Digital signatures verified
02:14:45:WU01:FS01:0x17:Folding@home GPU core17
02:14:45:WU01:FS01:0x17:Version 0.0.52
02:14:46:WU00:FS01:Upload 3.91%
02:14:52:WU00:FS01:Upload 6.25%
02:14:59:WU00:FS01:Upload 8.07%
02:14:59:WU01:FS01:0x17:Completed 0 out of 5000000 steps (0%)
02:14:59:WU01:FS01:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
02:15:05:WU00:FS01:Upload 9.63%
02:15:12:WU00:FS01:Upload 11.46%
02:15:18:WU00:FS01:Upload 13.28%
02:15:24:WU00:FS01:Upload 15.10%
02:15:30:WU00:FS01:Upload 16.92%
02:15:36:WU00:FS01:Upload 18.75%
02:15:42:WU00:FS01:Upload 20.57%
02:15:48:WU00:FS01:Upload 22.39%
02:15:54:WU00:FS01:Upload 24.47%
02:16:00:WU00:FS01:Upload 26.30%
02:16:06:WU00:FS01:Upload 28.38%
02:16:12:WU00:FS01:Upload 30.46%
02:16:18:WU00:FS01:Upload 32.54%
02:16:24:WU00:FS01:Upload 34.37%
02:16:30:WU00:FS01:Upload 35.93%
02:16:36:WU00:FS01:Upload 37.23%
02:16:42:WU01:FS01:0x17:Completed 50000 out of 5000000 steps (1%)
02:16:42:WU00:FS01:Upload 39.31%
02:16:48:WU00:FS01:Upload 41.40%
02:16:54:WU00:FS01:Upload 43.48%
02:17:00:WU00:FS01:Upload 45.82%
02:17:06:WU00:FS01:Upload 47.91%
02:17:12:WU00:FS01:Upload 49.47%
02:17:18:WU00:FS01:Upload 51.29%
02:17:24:WU00:FS01:Upload 53.11%
02:17:30:WU00:FS01:Upload 54.41%
02:17:36:WU00:FS01:Upload 56.24%
02:17:42:WU00:FS01:Upload 57.80%
02:17:48:WU00:FS01:Upload 59.36%
02:17:54:WU00:FS01:Upload 61.18%
02:18:00:WU00:FS01:Upload 62.75%
02:18:06:WU00:FS01:Upload 64.31%
02:18:12:WU00:FS01:Upload 65.87%
02:18:18:WU00:FS01:Upload 67.43%
02:18:24:WU00:FS01:Upload 68.73%
02:18:25:WU01:FS01:0x17:Completed 100000 out of 5000000 steps (2%)
02:18:30:WU00:FS01:Upload 70.04%
02:18:36:WU00:FS01:Upload 71.60%
02:18:42:WU00:FS01:Upload 73.16%
02:18:48:WU00:FS01:Upload 74.46%
02:18:54:WU00:FS01:Upload 75.76%
02:19:00:WU00:FS01:Upload 77.07%
02:19:06:WU00:FS01:Upload 78.63%
02:19:12:WU00:FS01:Upload 80.19%
02:19:18:WU00:FS01:Upload 81.75%
02:19:24:WU00:FS01:Upload 83.31%
02:19:30:WU00:FS01:Upload 84.88%
02:19:36:WU00:FS01:Upload 86.44%
02:19:42:WU00:FS01:Upload 88.00%
02:19:49:WU00:FS01:Upload 89.82%
02:19:55:WU00:FS01:Upload 91.38%
02:20:01:WU00:FS01:Upload 92.69%
02:20:07:WU00:FS01:Upload 94.51%
02:20:08:WU01:FS01:0x17:Completed 150000 out of 5000000 steps (3%)
02:20:13:WU00:FS01:Upload 96.07%
02:20:19:WU00:FS01:Upload 97.89%
02:20:25:WU00:FS01:Upload 99.98%
02:20:26:WU00:FS01:Upload complete
02:20:26:WU00:FS01:Server responded WORK_QUIT (404)
02:20:26:WARNING:WU00:FS01:Server did not like results, dumping
02:20:26:WU00:FS01:Cleaning up
Sorry for the 241 post, I was away from the affected computer and unable to include a log entry with the mobile device used to make the initial post.
Re: Project: 9430 (Run 5, Clone 1, Gen 230) - WORK_QUIT (404
Posted: Sun Jan 24, 2016 2:57 pm
by HayesK
Also had a 9430 dumped, linux client, gtx970, driver 346.96,
project:9430 run:11 clone:5 gen:169.
Code: Select all
*********************** Log Started 2016-01-19T03:28:02Z ***********************
03:28:02:************************* Folding@home Client *************************
03:28:02: Website: http://folding.stanford.edu/
03:28:02: Copyright: (c) 2009-2014 Stanford University
03:28:02: Author: Joseph Coffland <[email protected]>
03:28:02: Args: --child --lifeline 1105 /etc/fahclient/config.xml --run-as
03:28:02: fahclient --pid-file=/var/run/fahclient.pid --daemon
03:28:02: Config: /etc/fahclient/config.xml
03:28:02:******************************** Build ********************************
03:28:02: Version: 7.4.4
03:28:02: Date: Mar 4 2014
03:28:02: Time: 12:02:38
03:28:02: SVN Rev: 4130
03:28:02: Branch: fah/trunk/client
03:28:02: Compiler: GNU 4.4.7
03:28:02: Options: -std=gnu++98 -O3 -funroll-loops -mfpmath=sse -ffast-math
03:28:02: -fno-unsafe-math-optimizations -msse2
03:28:02: Platform: linux2 3.2.0-1-amd64
03:28:02: Bits: 64
03:28:02: Mode: Release
03:28:02:******************************* System ********************************
03:28:02: CPU: Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz
03:28:02: CPU ID: GenuineIntel Family 6 Model 42 Stepping 7
03:28:02: CPUs: 8
03:28:02: Memory: 7.77GiB
03:28:02:Free Memory: 7.31GiB
03:28:02: Threads: POSIX_THREADS
03:28:02: OS Version: 3.13
03:28:02:Has Battery: false
03:28:02: On Battery: false
03:28:02: UTC Offset: -6
03:28:02: PID: 1107
03:28:02: CWD: /var/lib/fahclient
03:28:02: OS: Linux 3.13.0-68-generic x86_64
03:28:02: OS Arch: AMD64
03:28:02: GPUs: 2
03:28:02: GPU 0: NVIDIA:5 GM204 [GeForce GTX 970]
03:28:02: GPU 1: NVIDIA:5 GM204 [GeForce GTX 970]
03:28:02: CUDA: 5.2
03:28:02:CUDA Driver: 7000
03:28:02:***********************************************************************
04:52:45:WU02:FS01:Connecting to 171.67.108.45:80
\x1b[93m04:52:45:WARNING:WU02:FS01:Failed to get assignment from '171.67.108.45:80': 10001: Server responded: HTTP_INTERNAL_SERVER_ERROR\x1b[0m
04:52:45:WU02:FS01:Connecting to 171.67.108.204:80
04:52:46:WU02:FS01:Assigned to work server 171.64.65.56
04:52:46:WU02:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GM204 [GeForce GTX 970] from 171.64.65.56
04:52:46:WU02:FS01:Connecting to 171.64.65.56:8080
04:52:46:WU01:FS01:0x21:Saving result file logfile_01.txt
04:52:46:WU01:FS01:0x21:Saving result file checkpointState.xml
04:52:46:WU02:FS01:Downloading 1.50MiB
04:52:47:WU02:FS01:Download complete
04:52:47:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9430 run:11 clone:5 gen:169 core:0x18 unit:0x000000d4ab40413855474b8ff0609072
04:52:48:WU01:FS01:0x21:Saving result file checkpt.crc
04:52:48:WU01:FS01:0x21:Saving result file log.txt
04:52:48:WU01:FS01:0x21:Saving result file positions.xtc
04:52:50:WU01:FS01:0x21:Folding@home Core Shutdown: FINISHED_UNIT
04:52:50:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
04:52:50:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:11402 run:4 clone:10 gen:31 core:0x21 unit:0x000000278ca304f255ed4e6ee5453ac6
04:52:50:WU01:FS01:Uploading 10.81MiB to 140.163.4.242
04:52:50:WU01:FS01:Connecting to 140.163.4.242:8080
04:52:50:WU02:FS01:Starting
04:52:50:WU02:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/NVIDIA/Fermi/beta/Core_18.fah/FahCore_18 -dir 02 -suffix 01 -version 704 -lifeline 1107 -checkpoint 15 -gpu 0 -gpu-vendor nvidia -gpu-vendor=nvidia -noclean
04:52:50:WU02:FS01:Started FahCore on PID 20277
04:52:50:WU02:FS01:Core PID:20281
04:52:50:WU02:FS01:FahCore 0x18 started
04:52:51:WU02:FS01:0x18:*********************** Log Started 2016-01-23T04:52:50Z ***********************
04:52:51:WU02:FS01:0x18:Project: 9430 (Run 11, Clone 5, Gen 169)
04:52:51:WU02:FS01:0x18:Unit: 0x000000d4ab40413855474b8ff0609072
04:52:51:WU02:FS01:0x18:CPU: 0x00000000000000000000000000000000
04:52:51:WU02:FS01:0x18:Machine: 1
04:52:51:WU02:FS01:0x18:Reading tar file state.xml
04:52:51:WU02:FS01:0x18:Reading tar file system.xml
04:52:51:WU02:FS01:0x18:Reading tar file integrator.xml
04:52:51:WU02:FS01:0x18:Reading tar file core.xml
04:52:51:WU02:FS01:0x18:Digital signatures verified
04:52:51:WU02:FS01:0x18:Folding@home GPU core18
04:52:51:WU02:FS01:0x18:Version 0.0.4
04:52:56:WU01:FS01:Upload 71.13%
04:52:56:WU02:FS01:0x18:Completed 0 out of 16000000 steps (0%)
04:52:56:WU02:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
04:53:04:WU01:FS01:Upload complete
04:53:05:WU01:FS01:Server responded WORK_ACK (400)
04:53:05:WU01:FS01:Final credit estimate, 84620.00 points
04:53:05:WU01:FS01:Cleaning up
04:53:55:WU00:FS02:0x21:Completed 3250000 out of 5000000 steps (65%)
04:58:19:WU02:FS01:0x18:Completed 160000 out of 16000000 steps (1%)
04:58:27:WU00:FS02:0x21:Completed 3300000 out of 5000000 steps (66%)
05:02:55:WU00:FS02:0x21:Completed 3350000 out of 5000000 steps (67%)
05:03:38:WU02:FS01:0x18:Completed 320000 out of 16000000 steps (2%)
05:07:25:WU00:FS02:0x21:Completed 3400000 out of 5000000 steps (68%)
05:08:54:WU02:FS01:0x18:Completed 480000 out of 16000000 steps (3%)
05:11:52:WU00:FS02:0x21:Completed 3450000 out of 5000000 steps (69%)
05:14:11:WU02:FS01:0x18:Completed 640000 out of 16000000 steps (4%)
05:16:20:WU00:FS02:0x21:Completed 3500000 out of 5000000 steps (70%)
05:19:27:WU02:FS01:0x18:Completed 800000 out of 16000000 steps (5%)
05:20:49:WU00:FS02:0x21:Completed 3550000 out of 5000000 steps (71%)
05:24:46:WU02:FS01:0x18:Completed 960000 out of 16000000 steps (6%)
05:25:17:WU00:FS02:0x21:Completed 3600000 out of 5000000 steps (72%)
05:29:48:WU00:FS02:0x21:Completed 3650000 out of 5000000 steps (73%)
05:30:05:WU02:FS01:0x18:Completed 1120000 out of 16000000 steps (7%)
05:34:17:WU00:FS02:0x21:Completed 3700000 out of 5000000 steps (74%)
05:35:26:WU02:FS01:0x18:Completed 1280000 out of 16000000 steps (8%)
05:38:46:WU00:FS02:0x21:Completed 3750000 out of 5000000 steps (75%)
05:40:45:WU02:FS01:0x18:Completed 1440000 out of 16000000 steps (9%)
05:43:15:WU00:FS02:0x21:Completed 3800000 out of 5000000 steps (76%)
05:46:01:WU02:FS01:0x18:Completed 1600000 out of 16000000 steps (10%)
05:47:43:WU00:FS02:0x21:Completed 3850000 out of 5000000 steps (77%)
05:51:20:WU02:FS01:0x18:Completed 1760000 out of 16000000 steps (11%)
05:52:12:WU00:FS02:0x21:Completed 3900000 out of 5000000 steps (78%)
05:56:36:WU02:FS01:0x18:Completed 1920000 out of 16000000 steps (12%)
05:56:39:WU00:FS02:0x21:Completed 3950000 out of 5000000 steps (79%)
06:01:07:WU00:FS02:0x21:Completed 4000000 out of 5000000 steps (80%)
06:01:53:WU02:FS01:0x18:Completed 2080000 out of 16000000 steps (13%)
06:05:36:WU00:FS02:0x21:Completed 4050000 out of 5000000 steps (81%)
06:07:09:WU02:FS01:0x18:Completed 2240000 out of 16000000 steps (14%)
06:10:04:WU00:FS02:0x21:Completed 4100000 out of 5000000 steps (82%)
06:12:26:WU02:FS01:0x18:Completed 2400000 out of 16000000 steps (15%)
06:14:33:WU00:FS02:0x21:Completed 4150000 out of 5000000 steps (83%)
06:17:44:WU02:FS01:0x18:Completed 2560000 out of 16000000 steps (16%)
06:19:01:WU00:FS02:0x21:Completed 4200000 out of 5000000 steps (84%)
06:23:01:WU02:FS01:0x18:Completed 2720000 out of 16000000 steps (17%)
06:23:29:WU00:FS02:0x21:Completed 4250000 out of 5000000 steps (85%)
06:27:58:WU00:FS02:0x21:Completed 4300000 out of 5000000 steps (86%)
06:28:17:WU02:FS01:0x18:Completed 2880000 out of 16000000 steps (18%)
06:32:26:WU00:FS02:0x21:Completed 4350000 out of 5000000 steps (87%)
06:33:34:WU02:FS01:0x18:Completed 3040000 out of 16000000 steps (19%)
06:36:55:WU00:FS02:0x21:Completed 4400000 out of 5000000 steps (88%)
06:38:51:WU02:FS01:0x18:Completed 3200000 out of 16000000 steps (20%)
06:41:23:WU00:FS02:0x21:Completed 4450000 out of 5000000 steps (89%)
06:44:09:WU02:FS01:0x18:Completed 3360000 out of 16000000 steps (21%)
06:45:50:WU00:FS02:0x21:Completed 4500000 out of 5000000 steps (90%)
06:49:26:WU02:FS01:0x18:Completed 3520000 out of 16000000 steps (22%)
06:50:20:WU00:FS02:0x21:Completed 4550000 out of 5000000 steps (91%)
06:54:42:WU02:FS01:0x18:Completed 3680000 out of 16000000 steps (23%)
06:54:48:WU00:FS02:0x21:Completed 4600000 out of 5000000 steps (92%)
06:59:17:WU00:FS02:0x21:Completed 4650000 out of 5000000 steps (93%)
06:59:59:WU02:FS01:0x18:Completed 3840000 out of 16000000 steps (24%)
07:03:45:WU00:FS02:0x21:Completed 4700000 out of 5000000 steps (94%)
07:05:16:WU02:FS01:0x18:Completed 4000000 out of 16000000 steps (25%)
07:08:13:WU00:FS02:0x21:Completed 4750000 out of 5000000 steps (95%)
07:10:34:WU02:FS01:0x18:Completed 4160000 out of 16000000 steps (26%)
07:12:42:WU00:FS02:0x21:Completed 4800000 out of 5000000 steps (96%)
07:15:51:WU02:FS01:0x18:Completed 4320000 out of 16000000 steps (27%)
07:17:10:WU00:FS02:0x21:Completed 4850000 out of 5000000 steps (97%)
07:21:09:WU02:FS01:0x18:Completed 4480000 out of 16000000 steps (28%)
07:21:41:WU00:FS02:0x21:Completed 4900000 out of 5000000 steps (98%)
07:26:10:WU00:FS02:0x21:Completed 4950000 out of 5000000 steps (99%)
07:26:29:WU02:FS01:0x18:Completed 4640000 out of 16000000 steps (29%)
07:30:39:WU00:FS02:0x21:Completed 5000000 out of 5000000 steps (100%)
07:30:40:WU01:FS02:Connecting to 171.67.108.45:80
07:30:40:WU01:FS02:Assigned to work server 140.163.4.242
07:30:40:WU01:FS02:Requesting new work unit for slot 02: RUNNING gpu:1:GM204 [GeForce GTX 970] from 140.163.4.242
07:30:40:WU01:FS02:Connecting to 140.163.4.242:8080
07:30:41:WU01:FS02:Downloading 3.44MiB
07:30:42:WU00:FS02:0x21:Saving result file logfile_01.txt
07:30:42:WU00:FS02:0x21:Saving result file checkpointState.xml
07:30:42:WU01:FS02:Download complete
07:30:42:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:11400 run:8 clone:6 gen:48 core:0x21 unit:0x0000003e8ca304f255de8e15808bd521
07:30:44:WU00:FS02:0x21:Saving result file checkpt.crc
07:30:44:WU00:FS02:0x21:Saving result file log.txt
07:30:44:WU00:FS02:0x21:Saving result file positions.xtc
07:30:46:WU00:FS02:0x21:Folding@home Core Shutdown: FINISHED_UNIT
07:30:46:WU00:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
07:30:46:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:11406 run:5 clone:14 gen:5 core:0x21 unit:0x000000088ca304f25686b1e16979440f
07:30:46:WU00:FS02:Uploading 14.11MiB to 140.163.4.242
07:30:46:WU00:FS02:Connecting to 140.163.4.242:8080
07:30:46:WU01:FS02:Starting
07:30:46:WU01:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21 -dir 01 -suffix 01 -version 704 -lifeline 1107 -checkpoint 15 -gpu 1 -gpu-vendor nvidia -gpu-vendor=nvidia -noclean
07:30:46:WU01:FS02:Started FahCore on PID 20735
07:30:46:WU01:FS02:Core PID:20739
07:30:46:WU01:FS02:FahCore 0x21 started
07:30:47:WU01:FS02:0x21:*********************** Log Started 2016-01-23T07:30:46Z ***********************
07:30:47:WU01:FS02:0x21:Project: 11400 (Run 8, Clone 6, Gen 48)
07:30:47:WU01:FS02:0x21:Unit: 0x0000003e8ca304f255de8e15808bd521
07:30:47:WU01:FS02:0x21:CPU: 0x00000000000000000000000000000000
07:30:47:WU01:FS02:0x21:Machine: 2
07:30:47:WU01:FS02:0x21:Reading tar file core.xml
07:30:47:WU01:FS02:0x21:Reading tar file system.xml
07:30:47:WU01:FS02:0x21:Reading tar file integrator.xml
07:30:47:WU01:FS02:0x21:Reading tar file state.xml
07:30:47:WU01:FS02:0x21:Digital signatures verified
07:30:47:WU01:FS02:0x21:Folding@home GPU Core21 Folding@home Core
07:30:47:WU01:FS02:0x21:Version 0.0.17
07:30:51:WU01:FS02:0x21:Completed 0 out of 5000000 steps (0%)
07:30:51:WU01:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
07:30:52:WU00:FS02:Upload 51.84%
07:31:04:WU00:FS02:Upload complete
07:31:04:WU00:FS02:Server responded WORK_ACK (400)
07:31:04:WU00:FS02:Final credit estimate, 112119.00 points
07:31:05:WU00:FS02:Cleaning up
07:31:50:WU02:FS01:0x18:Completed 4800000 out of 16000000 steps (30%)
07:33:50:WU01:FS02:0x21:Completed 50000 out of 5000000 steps (1%)
07:36:48:WU01:FS02:0x21:Completed 100000 out of 5000000 steps (2%)
07:37:10:WU02:FS01:0x18:Completed 4960000 out of 16000000 steps (31%)
07:39:48:WU01:FS02:0x21:Completed 150000 out of 5000000 steps (3%)
07:42:27:WU02:FS01:0x18:Completed 5120000 out of 16000000 steps (32%)
07:42:47:WU01:FS02:0x21:Completed 200000 out of 5000000 steps (4%)
07:45:45:WU01:FS02:0x21:Completed 250000 out of 5000000 steps (5%)
07:47:45:WU02:FS01:0x18:Completed 5280000 out of 16000000 steps (33%)
07:48:46:WU01:FS02:0x21:Completed 300000 out of 5000000 steps (6%)
07:51:46:WU01:FS02:0x21:Completed 350000 out of 5000000 steps (7%)
07:53:06:WU02:FS01:0x18:Completed 5440000 out of 16000000 steps (34%)
07:54:46:WU01:FS02:0x21:Completed 400000 out of 5000000 steps (8%)
07:57:44:WU01:FS02:0x21:Completed 450000 out of 5000000 steps (9%)
07:58:22:WU02:FS01:0x18:Completed 5600000 out of 16000000 steps (35%)
08:00:43:WU01:FS02:0x21:Completed 500000 out of 5000000 steps (10%)
08:03:41:WU02:FS01:0x18:Completed 5760000 out of 16000000 steps (36%)
08:03:42:WU01:FS02:0x21:Completed 550000 out of 5000000 steps (11%)
08:06:41:WU01:FS02:0x21:Completed 600000 out of 5000000 steps (12%)
08:08:58:WU02:FS01:0x18:Completed 5920000 out of 16000000 steps (37%)
08:09:40:WU01:FS02:0x21:Completed 650000 out of 5000000 steps (13%)
08:12:39:WU01:FS02:0x21:Completed 700000 out of 5000000 steps (14%)
08:14:14:WU02:FS01:0x18:Completed 6080000 out of 16000000 steps (38%)
08:15:37:WU01:FS02:0x21:Completed 750000 out of 5000000 steps (15%)
08:18:37:WU01:FS02:0x21:Completed 800000 out of 5000000 steps (16%)
08:19:31:WU02:FS01:0x18:Completed 6240000 out of 16000000 steps (39%)
08:21:35:WU01:FS02:0x21:Completed 850000 out of 5000000 steps (17%)
08:24:35:WU01:FS02:0x21:Completed 900000 out of 5000000 steps (18%)
08:24:48:WU02:FS01:0x18:Completed 6400000 out of 16000000 steps (40%)
08:27:34:WU01:FS02:0x21:Completed 950000 out of 5000000 steps (19%)
08:30:06:WU02:FS01:0x18:Completed 6560000 out of 16000000 steps (41%)
08:30:32:WU01:FS02:0x21:Completed 1000000 out of 5000000 steps (20%)
08:33:32:WU01:FS02:0x21:Completed 1050000 out of 5000000 steps (21%)
08:35:23:WU02:FS01:0x18:Completed 6720000 out of 16000000 steps (42%)
08:36:30:WU01:FS02:0x21:Completed 1100000 out of 5000000 steps (22%)
08:39:31:WU01:FS02:0x21:Completed 1150000 out of 5000000 steps (23%)
08:40:42:WU02:FS01:0x18:Completed 6880000 out of 16000000 steps (43%)
08:42:30:WU01:FS02:0x21:Completed 1200000 out of 5000000 steps (24%)
08:45:30:WU01:FS02:0x21:Completed 1250000 out of 5000000 steps (25%)
08:46:03:WU02:FS01:0x18:Completed 7040000 out of 16000000 steps (44%)
08:48:31:WU01:FS02:0x21:Completed 1300000 out of 5000000 steps (26%)
08:51:24:WU02:FS01:0x18:Completed 7200000 out of 16000000 steps (45%)
08:51:30:WU01:FS02:0x21:Completed 1350000 out of 5000000 steps (27%)
08:54:30:WU01:FS02:0x21:Completed 1400000 out of 5000000 steps (28%)
08:56:43:WU02:FS01:0x18:Completed 7360000 out of 16000000 steps (46%)
08:57:29:WU01:FS02:0x21:Completed 1450000 out of 5000000 steps (29%)
09:00:28:WU01:FS02:0x21:Completed 1500000 out of 5000000 steps (30%)
09:02:00:WU02:FS01:0x18:Completed 7520000 out of 16000000 steps (47%)
09:03:27:WU01:FS02:0x21:Completed 1550000 out of 5000000 steps (31%)
09:06:26:WU01:FS02:0x21:Completed 1600000 out of 5000000 steps (32%)
09:07:17:WU02:FS01:0x18:Completed 7680000 out of 16000000 steps (48%)
09:09:25:WU01:FS02:0x21:Completed 1650000 out of 5000000 steps (33%)
09:12:24:WU01:FS02:0x21:Completed 1700000 out of 5000000 steps (34%)
09:12:33:WU02:FS01:0x18:Completed 7840000 out of 16000000 steps (49%)
09:15:23:WU01:FS02:0x21:Completed 1750000 out of 5000000 steps (35%)
09:17:52:WU02:FS01:0x18:Completed 8000000 out of 16000000 steps (50%)
09:18:24:WU01:FS02:0x21:Completed 1800000 out of 5000000 steps (36%)
09:21:22:WU01:FS02:0x21:Completed 1850000 out of 5000000 steps (37%)
09:23:11:WU02:FS01:0x18:Completed 8160000 out of 16000000 steps (51%)
09:24:22:WU01:FS02:0x21:Completed 1900000 out of 5000000 steps (38%)
09:27:20:WU01:FS02:0x21:Completed 1950000 out of 5000000 steps (39%)
09:28:28:WU02:FS01:0x18:Completed 8320000 out of 16000000 steps (52%)
09:30:19:WU01:FS02:0x21:Completed 2000000 out of 5000000 steps (40%)
09:33:20:WU01:FS02:0x21:Completed 2050000 out of 5000000 steps (41%)
09:33:47:WU02:FS01:0x18:Completed 8480000 out of 16000000 steps (53%)
09:36:20:WU01:FS02:0x21:Completed 2100000 out of 5000000 steps (42%)
09:39:08:WU02:FS01:0x18:Completed 8640000 out of 16000000 steps (54%)
09:39:20:WU01:FS02:0x21:Completed 2150000 out of 5000000 steps (43%)
09:42:18:WU01:FS02:0x21:Completed 2200000 out of 5000000 steps (44%)
09:44:24:WU02:FS01:0x18:Completed 8800000 out of 16000000 steps (55%)
09:45:17:WU01:FS02:0x21:Completed 2250000 out of 5000000 steps (45%)
******************************* Date: 2016-01-23 *******************************
09:48:17:WU01:FS02:0x21:Completed 2300000 out of 5000000 steps (46%)
09:49:43:WU02:FS01:0x18:Completed 8960000 out of 16000000 steps (56%)
09:51:15:WU01:FS02:0x21:Completed 2350000 out of 5000000 steps (47%)
09:54:15:WU01:FS02:0x21:Completed 2400000 out of 5000000 steps (48%)
09:55:00:WU02:FS01:0x18:Completed 9120000 out of 16000000 steps (57%)
09:57:13:WU01:FS02:0x21:Completed 2450000 out of 5000000 steps (49%)
10:00:12:WU01:FS02:0x21:Completed 2500000 out of 5000000 steps (50%)
10:00:16:WU02:FS01:0x18:Completed 9280000 out of 16000000 steps (58%)
10:03:11:WU01:FS02:0x21:Completed 2550000 out of 5000000 steps (51%)
10:05:33:WU02:FS01:0x18:Completed 9440000 out of 16000000 steps (59%)
10:06:10:WU01:FS02:0x21:Completed 2600000 out of 5000000 steps (52%)
10:09:09:WU01:FS02:0x21:Completed 2650000 out of 5000000 steps (53%)
10:10:50:WU02:FS01:0x18:Completed 9600000 out of 16000000 steps (60%)
10:12:08:WU01:FS02:0x21:Completed 2700000 out of 5000000 steps (54%)
10:15:06:WU01:FS02:0x21:Completed 2750000 out of 5000000 steps (55%)
10:16:09:WU02:FS01:0x18:Completed 9760000 out of 16000000 steps (61%)
10:18:07:WU01:FS02:0x21:Completed 2800000 out of 5000000 steps (56%)
10:21:06:WU01:FS02:0x21:Completed 2850000 out of 5000000 steps (57%)
10:21:30:WU02:FS01:0x18:Completed 9920000 out of 16000000 steps (62%)
10:24:07:WU01:FS02:0x21:Completed 2900000 out of 5000000 steps (58%)
10:26:48:WU02:FS01:0x18:Completed 10080000 out of 16000000 steps (63%)
10:27:05:WU01:FS02:0x21:Completed 2950000 out of 5000000 steps (59%)
10:30:03:WU01:FS02:0x21:Completed 3000000 out of 5000000 steps (60%)
10:32:05:WU02:FS01:0x18:Completed 10240000 out of 16000000 steps (64%)
10:33:03:WU01:FS02:0x21:Completed 3050000 out of 5000000 steps (61%)
10:36:01:WU01:FS02:0x21:Completed 3100000 out of 5000000 steps (62%)
10:37:21:WU02:FS01:0x18:Completed 10400000 out of 16000000 steps (65%)
10:39:01:WU01:FS02:0x21:Completed 3150000 out of 5000000 steps (63%)
10:41:59:WU01:FS02:0x21:Completed 3200000 out of 5000000 steps (64%)
10:42:40:WU02:FS01:0x18:Completed 10560000 out of 16000000 steps (66%)
10:44:58:WU01:FS02:0x21:Completed 3250000 out of 5000000 steps (65%)
10:47:56:WU02:FS01:0x18:Completed 10720000 out of 16000000 steps (67%)
10:47:58:WU01:FS02:0x21:Completed 3300000 out of 5000000 steps (66%)
10:50:56:WU01:FS02:0x21:Completed 3350000 out of 5000000 steps (67%)
10:53:13:WU02:FS01:0x18:Completed 10880000 out of 16000000 steps (68%)
10:53:55:WU01:FS02:0x21:Completed 3400000 out of 5000000 steps (68%)
10:56:54:WU01:FS02:0x21:Completed 3450000 out of 5000000 steps (69%)
10:58:29:WU02:FS01:0x18:Completed 11040000 out of 16000000 steps (69%)
10:59:52:WU01:FS02:0x21:Completed 3500000 out of 5000000 steps (70%)
11:02:52:WU01:FS02:0x21:Completed 3550000 out of 5000000 steps (71%)
11:03:46:WU02:FS01:0x18:Completed 11200000 out of 16000000 steps (70%)
11:05:50:WU01:FS02:0x21:Completed 3600000 out of 5000000 steps (72%)
11:08:50:WU01:FS02:0x21:Completed 3650000 out of 5000000 steps (73%)
11:09:05:WU02:FS01:0x18:Completed 11360000 out of 16000000 steps (71%)
11:11:48:WU01:FS02:0x21:Completed 3700000 out of 5000000 steps (74%)
11:14:21:WU02:FS01:0x18:Completed 11520000 out of 16000000 steps (72%)
11:14:47:WU01:FS02:0x21:Completed 3750000 out of 5000000 steps (75%)
11:17:47:WU01:FS02:0x21:Completed 3800000 out of 5000000 steps (76%)
11:19:38:WU02:FS01:0x18:Completed 11680000 out of 16000000 steps (73%)
11:20:45:WU01:FS02:0x21:Completed 3850000 out of 5000000 steps (77%)
11:23:46:WU01:FS02:0x21:Completed 3900000 out of 5000000 steps (78%)
11:24:56:WU02:FS01:0x18:Completed 11840000 out of 16000000 steps (74%)
11:26:45:WU01:FS02:0x21:Completed 3950000 out of 5000000 steps (79%)
11:29:44:WU01:FS02:0x21:Completed 4000000 out of 5000000 steps (80%)
11:30:17:WU02:FS01:0x18:Completed 12000000 out of 16000000 steps (75%)
11:32:44:WU01:FS02:0x21:Completed 4050000 out of 5000000 steps (81%)
11:35:35:WU02:FS01:0x18:Completed 12160000 out of 16000000 steps (76%)
11:35:42:WU01:FS02:0x21:Completed 4100000 out of 5000000 steps (82%)
11:38:42:WU01:FS02:0x21:Completed 4150000 out of 5000000 steps (83%)
11:40:52:WU02:FS01:0x18:Completed 12320000 out of 16000000 steps (77%)
11:41:40:WU01:FS02:0x21:Completed 4200000 out of 5000000 steps (84%)
11:44:39:WU01:FS02:0x21:Completed 4250000 out of 5000000 steps (85%)
11:46:08:WU02:FS01:0x18:Completed 12480000 out of 16000000 steps (78%)
11:47:38:WU01:FS02:0x21:Completed 4300000 out of 5000000 steps (86%)
11:50:37:WU01:FS02:0x21:Completed 4350000 out of 5000000 steps (87%)
11:51:25:WU02:FS01:0x18:Completed 12640000 out of 16000000 steps (79%)
11:53:36:WU01:FS02:0x21:Completed 4400000 out of 5000000 steps (88%)
11:56:35:WU01:FS02:0x21:Completed 4450000 out of 5000000 steps (89%)
11:56:42:WU02:FS01:0x18:Completed 12800000 out of 16000000 steps (80%)
11:59:33:WU01:FS02:0x21:Completed 4500000 out of 5000000 steps (90%)
12:02:01:WU02:FS01:0x18:Completed 12960000 out of 16000000 steps (81%)
12:02:32:WU01:FS02:0x21:Completed 4550000 out of 5000000 steps (91%)
12:05:31:WU01:FS02:0x21:Completed 4600000 out of 5000000 steps (92%)
12:07:17:WU02:FS01:0x18:Completed 13120000 out of 16000000 steps (82%)
12:08:30:WU01:FS02:0x21:Completed 4650000 out of 5000000 steps (93%)
12:11:29:WU01:FS02:0x21:Completed 4700000 out of 5000000 steps (94%)
12:12:34:WU02:FS01:0x18:Completed 13280000 out of 16000000 steps (83%)
12:14:27:WU01:FS02:0x21:Completed 4750000 out of 5000000 steps (95%)
12:17:28:WU01:FS02:0x21:Completed 4800000 out of 5000000 steps (96%)
12:17:53:WU02:FS01:0x18:Completed 13440000 out of 16000000 steps (84%)
12:20:27:WU01:FS02:0x21:Completed 4850000 out of 5000000 steps (97%)
12:23:13:WU02:FS01:0x18:Completed 13600000 out of 16000000 steps (85%)
12:23:27:WU01:FS02:0x21:Completed 4900000 out of 5000000 steps (98%)
12:26:26:WU01:FS02:0x21:Completed 4950000 out of 5000000 steps (99%)
12:28:32:WU02:FS01:0x18:Completed 13760000 out of 16000000 steps (86%)
12:29:24:WU01:FS02:0x21:Completed 5000000 out of 5000000 steps (100%)
12:29:24:WU00:FS02:Connecting to 171.67.108.45:80
12:29:25:WU00:FS02:Assigned to work server 140.163.4.243
12:29:25:WU00:FS02:Requesting new work unit for slot 02: RUNNING gpu:1:GM204 [GeForce GTX 970] from 140.163.4.243
12:29:25:WU00:FS02:Connecting to 140.163.4.243:8080
12:29:25:WU00:FS02:Downloading 3.98MiB
12:29:25:WU01:FS02:0x21:Saving result file logfile_01.txt
12:29:25:WU01:FS02:0x21:Saving result file checkpointState.xml
12:29:26:WU00:FS02:Download complete
12:29:26:WU00:FS02:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:11704 run:0 clone:23 gen:29 core:0x21 unit:0x000000208ca304f3568834043c46e722
12:29:27:WU01:FS02:0x21:Saving result file checkpt.crc
12:29:27:WU01:FS02:0x21:Saving result file log.txt
12:29:27:WU01:FS02:0x21:Saving result file positions.xtc
12:29:28:WU01:FS02:0x21:Folding@home Core Shutdown: FINISHED_UNIT
12:29:28:WU01:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
12:29:28:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:11400 run:8 clone:6 gen:48 core:0x21 unit:0x0000003e8ca304f255de8e15808bd521
12:29:29:WU01:FS02:Uploading 8.96MiB to 140.163.4.242
12:29:29:WU01:FS02:Connecting to 140.163.4.242:8080
12:29:29:WU00:FS02:Starting
12:29:29:WU00:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21 -dir 00 -suffix 01 -version 704 -lifeline 1107 -checkpoint 15 -gpu 1 -gpu-vendor nvidia -gpu-vendor=nvidia -noclean
12:29:29:WU00:FS02:Started FahCore on PID 21589
12:29:29:WU00:FS02:Core PID:21593
12:29:29:WU00:FS02:FahCore 0x21 started
12:29:29:WU00:FS02:0x21:*********************** Log Started 2016-01-23T12:29:29Z ***********************
12:29:29:WU00:FS02:0x21:Project: 11704 (Run 0, Clone 23, Gen 29)
12:29:29:WU00:FS02:0x21:Unit: 0x000000208ca304f3568834043c46e722
12:29:29:WU00:FS02:0x21:CPU: 0x00000000000000000000000000000000
12:29:29:WU00:FS02:0x21:Machine: 2
12:29:29:WU00:FS02:0x21:Reading tar file core.xml
12:29:29:WU00:FS02:0x21:Reading tar file system.xml
12:29:29:WU00:FS02:0x21:Reading tar file integrator.xml
12:29:29:WU00:FS02:0x21:Reading tar file state.xml
12:29:30:WU00:FS02:0x21:Digital signatures verified
12:29:30:WU00:FS02:0x21:Folding@home GPU Core21 Folding@home Core
12:29:30:WU00:FS02:0x21:Version 0.0.17
12:29:34:WU00:FS02:0x21:Completed 0 out of 5000000 steps (0%)
12:29:34:WU00:FS02:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
12:29:35:WU01:FS02:Upload 96.98%
12:29:40:WU01:FS02:Upload complete
12:29:40:WU01:FS02:Server responded WORK_ACK (400)
12:29:40:WU01:FS02:Final credit estimate, 69537.00 points
12:29:40:WU01:FS02:Cleaning up
12:33:21:WU00:FS02:0x21:Completed 50000 out of 5000000 steps (1%)
12:33:52:WU02:FS01:0x18:Completed 13920000 out of 16000000 steps (87%)
12:37:09:WU00:FS02:0x21:Completed 100000 out of 5000000 steps (2%)
12:39:13:WU02:FS01:0x18:Completed 14080000 out of 16000000 steps (88%)
12:40:56:WU00:FS02:0x21:Completed 150000 out of 5000000 steps (3%)
12:44:34:WU02:FS01:0x18:Completed 14240000 out of 16000000 steps (89%)
12:44:44:WU00:FS02:0x21:Completed 200000 out of 5000000 steps (4%)
12:48:31:WU00:FS02:0x21:Completed 250000 out of 5000000 steps (5%)
12:49:55:WU02:FS01:0x18:Completed 14400000 out of 16000000 steps (90%)
12:52:19:WU00:FS02:0x21:Completed 300000 out of 5000000 steps (6%)
12:55:13:WU02:FS01:0x18:Completed 14560000 out of 16000000 steps (91%)
12:56:05:WU00:FS02:0x21:Completed 350000 out of 5000000 steps (7%)
12:59:51:WU00:FS02:0x21:Completed 400000 out of 5000000 steps (8%)
13:00:30:WU02:FS01:0x18:Completed 14720000 out of 16000000 steps (92%)
13:03:38:WU00:FS02:0x21:Completed 450000 out of 5000000 steps (9%)
13:05:47:WU02:FS01:0x18:Completed 14880000 out of 16000000 steps (93%)
13:07:24:WU00:FS02:0x21:Completed 500000 out of 5000000 steps (10%)
13:11:06:WU02:FS01:0x18:Completed 15040000 out of 16000000 steps (94%)
13:11:13:WU00:FS02:0x21:Completed 550000 out of 5000000 steps (11%)
13:15:00:WU00:FS02:0x21:Completed 600000 out of 5000000 steps (12%)
13:16:27:WU02:FS01:0x18:Completed 15200000 out of 16000000 steps (95%)
13:18:48:WU00:FS02:0x21:Completed 650000 out of 5000000 steps (13%)
13:21:50:WU02:FS01:0x18:Completed 15360000 out of 16000000 steps (96%)
13:22:35:WU00:FS02:0x21:Completed 700000 out of 5000000 steps (14%)
13:26:23:WU00:FS02:0x21:Completed 750000 out of 5000000 steps (15%)
13:27:11:WU02:FS01:0x18:Completed 15520000 out of 16000000 steps (97%)
13:30:12:WU00:FS02:0x21:Completed 800000 out of 5000000 steps (16%)
13:32:32:WU02:FS01:0x18:Completed 15680000 out of 16000000 steps (98%)
13:33:59:WU00:FS02:0x21:Completed 850000 out of 5000000 steps (17%)
13:37:46:WU00:FS02:0x21:Completed 900000 out of 5000000 steps (18%)
13:37:52:WU02:FS01:0x18:Completed 15840000 out of 16000000 steps (99%)
13:41:33:WU00:FS02:0x21:Completed 950000 out of 5000000 steps (19%)
13:43:12:WU02:FS01:0x18:Completed 16000000 out of 16000000 steps (100%)
13:43:12:WU01:FS01:Connecting to 171.67.108.45:80
13:43:12:WU01:FS01:Assigned to work server 140.163.4.244
13:43:12:WU01:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GM204 [GeForce GTX 970] from 140.163.4.244
13:43:12:WU01:FS01:Connecting to 140.163.4.244:8080
13:43:13:WU01:FS01:Downloading 2.54MiB
13:43:14:WU01:FS01:Download complete
13:43:14:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:10490 run:267 clone:0 gen:104 core:0x18 unit:0x000000768ca304f45537e9067eb3d877
13:43:14:WU02:FS01:0x18:Saving result file logfile_01.txt
13:43:14:WU02:FS01:0x18:Saving result file checkpointState.xml
13:43:14:WU02:FS01:0x18:Saving result file checkpt.crc
13:43:14:WU02:FS01:0x18:Saving result file log.txt
13:43:14:WU02:FS01:0x18:Saving result file positions.xtc
13:43:18:WU02:FS01:0x18:Folding@home Core Shutdown: FINISHED_UNIT
13:43:18:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
13:43:18:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:9430 run:11 clone:5 gen:169 core:0x18 unit:0x000000d4ab40413855474b8ff0609072
13:43:18:WU02:FS01:Uploading 24.13MiB to 171.64.65.56
13:43:18:WU02:FS01:Connecting to 171.64.65.56:8080
13:43:18:WU01:FS01:Starting
13:43:18:WU01:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/web.stanford.edu/~pande/Linux/AMD64/NVIDIA/Fermi/beta/Core_18.fah/FahCore_18 -dir 01 -suffix 01 -version 704 -lifeline 1107 -checkpoint 15 -gpu 0 -gpu-vendor nvidia -gpu-vendor=nvidia -noclean
13:43:18:WU01:FS01:Started FahCore on PID 22036
13:43:18:WU01:FS01:Core PID:22040
13:43:18:WU01:FS01:FahCore 0x18 started
13:43:19:WU01:FS01:0x18:*********************** Log Started 2016-01-23T13:43:18Z ***********************
13:43:19:WU01:FS01:0x18:Project: 10490 (Run 267, Clone 0, Gen 104)
13:43:19:WU01:FS01:0x18:Unit: 0x000000768ca304f45537e9067eb3d877
13:43:19:WU01:FS01:0x18:CPU: 0x00000000000000000000000000000000
13:43:19:WU01:FS01:0x18:Machine: 1
13:43:19:WU01:FS01:0x18:Reading tar file core.xml
13:43:19:WU01:FS01:0x18:Reading tar file system.xml
13:43:19:WU01:FS01:0x18:Reading tar file integrator.xml
13:43:19:WU01:FS01:0x18:Reading tar file state.xml
13:43:19:WU01:FS01:0x18:Digital signatures verified
13:43:19:WU01:FS01:0x18:Folding@home GPU core18
13:43:19:WU01:FS01:0x18:Version 0.0.4
13:43:24:WU02:FS01:Upload 33.93%
13:43:26:WU01:FS01:0x18:Completed 0 out of 5000000 steps (0%)
13:43:26:WU01:FS01:0x18:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
13:43:30:WU02:FS01:Upload 69.41%
13:43:35:WU02:FS01:Upload complete
13:43:35:WU02:FS01:Server responded WORK_QUIT (404)
\x1b[93m13:43:35:WARNING:WU02:FS01:Server did not like results, dumping\x1b[0m
13:43:36:WU02:FS01:Cleaning up
Re: New Core18 Project: 9430
Posted: Sun Jan 24, 2016 10:07 pm
by Ricky
project:9430 run:6 clone:8 gen:178 dumped. There is another recent thread of 9430 dumping work units, could the collection server be full?
Code: Select all
16:21:47:WU01:FS01:0x18:Completed 16000000 out of 16000000 steps (100%)
16:21:48:WU02:FS01:Connecting to 171.67.108.45:80
16:21:48:WU02:FS01:Assigned to work server 140.163.4.243
16:21:48:WU02:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GM204 [GeForce GTX 980] from 140.163.4.243
16:21:48:WU02:FS01:Connecting to 140.163.4.243:8080
16:21:49:WU02:FS01:Downloading 3.98MiB
16:21:52:WU02:FS01:Download complete
16:21:52:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:11704 run:0 clone:52 gen:7 core:0x21 unit:0x000000098ca304f356896234c4f5fd77
16:21:55:WU01:FS01:0x18:Saving result file logfile_01.txt
16:21:55:WU01:FS01:0x18:Saving result file checkpointState.xml
16:21:56:WU01:FS01:0x18:Saving result file checkpt.crc
16:21:56:WU01:FS01:0x18:Saving result file log.txt
16:21:56:WU01:FS01:0x18:Saving result file positions.xtc
16:22:05:WU01:FS01:0x18:Folding@home Core Shutdown: FINISHED_UNIT
16:22:05:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
16:22:05:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:9430 run:6 clone:8 gen:178 core:0x18 unit:0x000000dfab40413855474b81c7a730e0
16:22:05:WU01:FS01:Uploading 24.07MiB to 171.64.65.56
16:22:05:WU01:FS01:Connecting to 171.64.65.56:8080
16:22:05:WU02:FS01:Starting
16:22:05:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/win1/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 5808 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
16:22:05:WU02:FS01:Started FahCore on PID 25484
16:22:05:WU02:FS01:Core PID:29980
16:22:05:WU02:FS01:FahCore 0x21 started
16:22:06:WU02:FS01:0x21:*********************** Log Started 2016-01-24T16:22:05Z ***********************
16:22:06:WU02:FS01:0x21:Project: 11704 (Run 0, Clone 52, Gen 7)
16:22:06:WU02:FS01:0x21:Unit: 0x000000098ca304f356896234c4f5fd77
16:22:06:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
16:22:06:WU02:FS01:0x21:Machine: 1
16:22:06:WU02:FS01:0x21:Reading tar file core.xml
16:22:06:WU02:FS01:0x21:Reading tar file system.xml
16:22:06:WU02:FS01:0x21:Reading tar file integrator.xml
16:22:06:WU02:FS01:0x21:Reading tar file state.xml
16:22:07:WU02:FS01:0x21:Digital signatures verified
16:22:07:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
16:22:07:WU02:FS01:0x21:Version 0.0.17
16:22:11:WU01:FS01:Upload 36.35%
16:22:17:WU01:FS01:Upload 62.83%
16:22:17:WU02:FS01:0x21:Completed 0 out of 5000000 steps (0%)
16:22:17:WU02:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
16:22:23:WU01:FS01:Upload 98.66%
16:22:26:WU01:FS01:Upload complete
16:22:26:WU01:FS01:Server responded WORK_QUIT (404)
16:22:26:WARNING:WU01:FS01:Server did not like results, dumping
16:22:26:WU01:FS01:Cleaning up
16:26:00:WU02:FS01:0x21:Completed 50000 out of 5000000 steps (1%)
Re: Project: 9430 (Run 5, Clone 1, Gen 230) - WORK_QUIT (404
Posted: Tue Jan 26, 2016 1:48 am
by bruce
I'm moving this topic from "specific WU" to "specific Server" since it seems to be more than just one WU.
Re: Projects: 94xx - WORK_QUIT (404)
Posted: Tue Jan 26, 2016 8:41 pm
by davidcoton
@ricky:
Just to clarify, it's the Work Server 171.64.65.56 that dumped your WU. The Collection Server is the backup return method, which did not come into play here.
Re: Projects: 94xx - WORK_QUIT (404)
Posted: Wed Jan 27, 2016 5:00 am
by bruce
One problem: Unlike most other communications failures, the WS dumps the WU rather than telling the client that it needs to retry using the CS. Unfortunately I don't know how to bypass that problem. since the logic is buried somewhere deep in the sofware.
Re: Projects: 94xx - WORK_QUIT (404)
Posted: Wed Jan 27, 2016 6:49 pm
by Mstenholm
So dumping them before "don´t like" it is the best way to get the attention of you people. This is an old problem. Killing them when you see them slows down the project but if no action is taken then.....
Re: Projects: 94xx - WORK_QUIT (404)
Posted: Wed Jan 27, 2016 7:52 pm
by bruce
"You people" (meaning the Stanford support folks) rarely visit this site and you're unlikely to get their attention either way.
I'm not convinced this is an "old problem" but is more likely related to the fact that they had to replace a defunct server with a new one.
Re: Projects: 94xx - WORK_QUIT (404)
Posted: Thu Jan 28, 2016 5:19 pm
by Mstenholm
And in the process didn't find the time to inform us. This part off their job relay on our HW investments and running cost. Don't want to keep it, just keep it up. If the ongoing server replacement/upgrade is dragging out I predict that not only the few that post here will be disappointed.