gpu keeps getting stuck at 0 or 99.99 percent

It seems that a lot of GPU problems revolve around specific versions of drivers. Though AMD has their own support structure, you can often learn from information reported by others who fold.

Moderators: Site Moderators, FAHC Science Team

Post Reply
Mastermine
Posts: 14
Joined: Tue May 13, 2014 2:42 am

gpu keeps getting stuck at 0 or 99.99 percent

Post by Mastermine »

Code: Select all

*********************** Log Started 2014-05-18T01:16:46Z ***********************
01:16:46:************************* Folding@home Client *************************
01:16:46:      Website: http://folding.stanford.edu/
01:16:46:    Copyright: (c) 2009-2014 Stanford University
01:16:46:       Author: Joseph Coffland <[email protected]>
01:16:46:         Args: --open-web-control
01:16:46:       Config: C:/Users/KaZ/AppData/Roaming/FAHClient/config.xml
01:16:46:******************************** Build ********************************
01:16:46:      Version: 7.4.4
01:16:46:         Date: Mar 4 2014
01:16:46:         Time: 20:26:54
01:16:46:      SVN Rev: 4130
01:16:46:       Branch: fah/trunk/client
01:16:46:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
01:16:46:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
01:16:46:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
01:16:46:     Platform: win32 XP
01:16:46:         Bits: 32
01:16:46:         Mode: Release
01:16:46:******************************* System ********************************
01:16:46:          CPU: AMD FX(tm)-8350 Eight-Core Processor
01:16:46:       CPU ID: AuthenticAMD Family 21 Model 2 Stepping 0
01:16:46:         CPUs: 8
01:16:46:       Memory: 8.00GiB
01:16:46:  Free Memory: 6.40GiB
01:16:46:      Threads: WINDOWS_THREADS
01:16:46:   OS Version: 6.1
01:16:46:  Has Battery: false
01:16:46:   On Battery: false
01:16:46:   UTC Offset: -7
01:16:46:          PID: 4440
01:16:46:          CWD: C:/Users/KaZ/AppData/Roaming/FAHClient
01:16:46:           OS: Windows 7 Professional
01:16:46:      OS Arch: AMD64
01:16:46:         GPUs: 3
01:16:46:        GPU 0: ATI:5 Hawaii [Radeon R9 200 Series]
01:16:46:        GPU 1: ATI:5 Pitcairn []
01:16:46:        GPU 2: ATI:5 Pitcairn [Radeon HD 7800]
01:16:46:         CUDA: Not detected
01:16:46:Win32 Service: false
01:16:46:***********************************************************************
01:16:46:<config>
01:16:46:  <!-- Folding Core -->
01:16:46:  <core-priority v='low'/>
01:16:46:
01:16:46:  <!-- Network -->
01:16:46:  <proxy v=':8080'/>
01:16:46:
01:16:46:  <!-- Slot Control -->
01:16:46:  <power v='full'/>
01:16:46:
01:16:46:  <!-- User Information -->
01:16:46:  <passkey v='********************************'/>
01:16:46:  <team v='224497'/>
01:16:46:  <user v='dmfree88'/>
01:16:46:
01:16:46:  <!-- Folding Slots -->
01:16:46:  <slot id='0' type='CPU'>
01:16:46:    <client-type v='bigadv'/>
01:16:46:    <cpus v='2'/>
01:16:46:    <paused v='true'/>
01:16:46:  </slot>
01:16:46:  <slot id='1' type='GPU'>
01:16:46:    <paused v='true'/>
01:16:46:  </slot>
01:16:46:  <slot id='2' type='GPU'>
01:16:46:    <paused v='true'/>
01:16:46:  </slot>
01:16:46:  <slot id='3' type='GPU'>
01:16:46:    <paused v='true'/>
01:16:46:  </slot>
01:16:46:</config>
01:16:46:Trying to access database...
01:16:46:Successfully acquired database lock
01:16:46:Enabled folding slot 00: PAUSED cpu:2 (by user)
01:16:46:Enabled folding slot 01: PAUSED gpu:0:Hawaii [Radeon R9 200 Series] (by user)
01:16:46:Enabled folding slot 02: PAUSED gpu:1:Pitcairn [] (by user)
01:16:46:Enabled folding slot 03: PAUSED gpu:2:Pitcairn [Radeon HD 7800] (by user)
01:16:49:9:127.0.0.1:New Web connection
01:18:04:Removing old file 'configs/config-20140513-233414.xml'
01:18:04:Saving configuration to config.xml
01:18:04:<config>
01:18:04:  <!-- Folding Core -->
01:18:04:  <core-priority v='low'/>
01:18:04:
01:18:04:  <!-- Network -->
01:18:04:  <proxy v=':8080'/>
01:18:04:
01:18:04:  <!-- Slot Control -->
01:18:04:  <power v='full'/>
01:18:04:
01:18:04:  <!-- User Information -->
01:18:04:  <passkey v='********************************'/>
01:18:04:  <team v='224497'/>
01:18:04:  <user v='dmfree88'/>
01:18:04:
01:18:04:  <!-- Folding Slots -->
01:18:04:  <slot id='0' type='CPU'>
01:18:04:    <client-type v='bigadv'/>
01:18:04:    <cpus v='4'/>
01:18:04:    <paused v='true'/>
01:18:04:  </slot>
01:18:04:  <slot id='1' type='GPU'>
01:18:04:    <paused v='true'/>
01:18:04:  </slot>
01:18:04:  <slot id='2' type='GPU'>
01:18:04:    <paused v='true'/>
01:18:04:  </slot>
01:18:04:  <slot id='3' type='GPU'>
01:18:04:    <paused v='true'/>
01:18:04:  </slot>
01:18:04:</config>
01:18:06:FS00:Unpaused
01:18:06:FS01:Unpaused
01:18:06:FS02:Unpaused
01:18:06:FS03:Unpaused
01:18:06:WU00:FS00:Starting
01:18:06:WARNING:WU00:FS00:Changed SMP threads from 2 to 4 this can cause some work units to fail
01:18:06:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/KaZ/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 00 -suffix 01 -version 704 -lifeline 4440 -checkpoint 15 -np 4
01:18:06:WU00:FS00:Started FahCore on PID 1140
01:18:06:WU00:FS00:Core PID:2972
01:18:06:WU00:FS00:FahCore 0xa3 started
01:18:06:WU03:FS02:Starting
01:18:06:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/KaZ/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 704 -lifeline 4440 -checkpoint 15 -gpu 1 -gpu-vendor ati
01:18:06:WU03:FS02:Started FahCore on PID 2904
01:18:06:WU03:FS02:Core PID:4668
01:18:06:WU03:FS02:FahCore 0x17 started
01:18:06:WU02:FS01:Starting
01:18:06:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/KaZ/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 4440 -checkpoint 15 -gpu 0 -gpu-vendor ati
01:18:06:WU02:FS01:Started FahCore on PID 4100
01:18:07:WU02:FS01:Core PID:5112
01:18:07:WU02:FS01:FahCore 0x17 started
01:18:07:WU01:FS03:Starting
01:18:07:WU01:FS03:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/KaZ/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 4440 -checkpoint 15 -gpu 2 -gpu-vendor ati
01:18:07:WU01:FS03:Started FahCore on PID 2632
01:18:07:WU01:FS03:Core PID:960
01:18:07:WU01:FS03:FahCore 0x17 started
01:18:07:WU00:FS00:0xa3:
01:18:07:WU00:FS00:0xa3:*------------------------------*
01:18:07:WU00:FS00:0xa3:Folding@Home Gromacs SMP Core
01:18:07:WU00:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
01:18:07:WU00:FS00:0xa3:
01:18:07:WU00:FS00:0xa3:Preparing to commence simulation
01:18:07:WU00:FS00:0xa3:- Looking at optimizations...
01:18:07:WU00:FS00:0xa3:- Files status OK
01:18:07:WU00:FS00:0xa3:- Expanded 3847766 -> 4385040 (decompressed 113.9 percent)
01:18:07:WU00:FS00:0xa3:Called DecompressByteArray: compressed_data_size=3847766 data_size=4385040, decompressed_data_size=4385040 diff=0
01:18:07:WU00:FS00:0xa3:- Digital signature verified
01:18:07:WU00:FS00:0xa3:
01:18:07:WU00:FS00:0xa3:Project: 8577 (Run 1, Clone 3, Gen 400)
01:18:07:WU00:FS00:0xa3:
01:18:07:WU00:FS00:0xa3:Assembly optimizations on if available.
01:18:07:WU00:FS00:0xa3:Entering M.D.
01:18:07:WU03:FS02:0x17:*********************** Log Started 2014-05-18T01:18:07Z ***********************
01:18:07:WU03:FS02:0x17:Project: 9408 (Run 2121, Clone 0, Gen 16)
01:18:07:WU03:FS02:0x17:Unit: 0x000000170a3b1e5c53433a805512d05f
01:18:07:WU03:FS02:0x17:CPU: 0x00000000000000000000000000000000
01:18:07:WU03:FS02:0x17:Machine: 2
01:18:07:WU03:FS02:0x17:Digital signatures verified
01:18:07:WU03:FS02:0x17:Folding@home GPU core17
01:18:07:WU03:FS02:0x17:Version 0.0.52
01:18:07:WU02:FS01:0x17:*********************** Log Started 2014-05-18T01:18:07Z ***********************
01:18:07:WU02:FS01:0x17:Project: 9408 (Run 1971, Clone 0, Gen 6)
01:18:07:WU02:FS01:0x17:Unit: 0x0000000a0a3b1e5c5343362c91d5a2d9
01:18:07:WU02:FS01:0x17:CPU: 0x00000000000000000000000000000000
01:18:07:WU02:FS01:0x17:Machine: 1
01:18:07:WU02:FS01:0x17:Digital signatures verified
01:18:07:WU02:FS01:0x17:Folding@home GPU core17
01:18:07:WU02:FS01:0x17:Version 0.0.52
01:18:07:WU01:FS03:0x17:*********************** Log Started 2014-05-18T01:18:07Z ***********************
01:18:07:WU01:FS03:0x17:Project: 9408 (Run 669, Clone 0, Gen 6)
01:18:07:WU01:FS03:0x17:Unit: 0x0000000c0a3b1e5c5342e0a685727690
01:18:07:WU01:FS03:0x17:CPU: 0x00000000000000000000000000000000
01:18:07:WU01:FS03:0x17:Machine: 3
01:18:07:WU01:FS03:0x17:Digital signatures verified
01:18:07:WU01:FS03:0x17:Folding@home GPU core17
01:18:07:WU01:FS03:0x17:Version 0.0.52
01:18:08:WU02:FS01:0x17:  Found a checkpoint file
01:18:08:WU03:FS02:0x17:  Found a checkpoint file
01:18:08:WU01:FS03:0x17:  Found a checkpoint file
01:18:13:WU00:FS00:0xa3:Mapping NT from 4 to 4 
01:18:14:WU00:FS00:0xa3:Completed 0 out of 500000 steps  (0%)
01:18:47:FS00:Paused
01:18:47:FS00:Shutting core down
01:18:48:Removing old file 'configs/config-20140513-233717.xml'
01:18:48:Saving configuration to config.xml
01:18:48:<config>
01:18:48:  <!-- Folding Core -->
01:18:48:  <core-priority v='low'/>
01:18:48:
01:18:48:  <!-- Network -->
01:18:48:  <proxy v=':8080'/>
01:18:48:
01:18:48:  <!-- Slot Control -->
01:18:48:  <power v='full'/>
01:18:48:
01:18:48:  <!-- User Information -->
01:18:48:  <passkey v='********************************'/>
01:18:48:  <team v='224497'/>
01:18:48:  <user v='dmfree88'/>
01:18:48:
01:18:48:  <!-- Folding Slots -->
01:18:48:  <slot id='0' type='CPU'>
01:18:48:    <client-type v='bigadv'/>
01:18:48:    <cpus v='4'/>
01:18:48:    <paused v='true'/>
01:18:48:  </slot>
01:18:48:  <slot id='1' type='GPU'/>
01:18:48:  <slot id='2' type='GPU'/>
01:18:48:  <slot id='3' type='GPU'/>
01:18:48:</config>
01:18:57:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
01:19:55:WU03:FS02:0x17:Completed 2300000 out of 5000000 steps (46%)
01:19:55:WU03:FS02:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:20:23:WU02:FS01:0x17:Completed 1100000 out of 5000000 steps (22%)
01:20:23:WU02:FS01:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:20:52:WU01:FS03:0x17:Completed 3000000 out of 5000000 steps (60%)
01:20:52:WU01:FS03:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:29:40:WU03:FS02:0x17:Completed 2350000 out of 5000000 steps (47%)
01:31:05:WU02:FS01:0x17:Completed 1150000 out of 5000000 steps (23%)
01:32:29:WU01:FS03:0x17:Completed 3050000 out of 5000000 steps (61%)
01:39:30:WU03:FS02:0x17:Completed 2400000 out of 5000000 steps (48%)
01:41:50:WU02:FS01:0x17:Completed 1200000 out of 5000000 steps (24%)
01:44:12:WU01:FS03:0x17:Completed 3100000 out of 5000000 steps (62%)
01:49:14:WU03:FS02:0x17:Completed 2450000 out of 5000000 steps (49%)
01:52:36:WU02:FS01:0x17:Completed 1250000 out of 5000000 steps (25%)
01:55:54:WU01:FS03:0x17:Completed 3150000 out of 5000000 steps (63%)
01:59:00:WU03:FS02:0x17:Completed 2500000 out of 5000000 steps (50%)
02:03:21:WU02:FS01:0x17:Completed 1300000 out of 5000000 steps (26%)
02:07:36:WU01:FS03:0x17:Completed 3200000 out of 5000000 steps (64%)
02:08:46:WU03:FS02:0x17:Completed 2550000 out of 5000000 steps (51%)
02:14:09:WU02:FS01:0x17:Completed 1350000 out of 5000000 steps (27%)
02:18:33:WU03:FS02:0x17:Completed 2600000 out of 5000000 steps (52%)
02:19:18:WU01:FS03:0x17:Completed 3250000 out of 5000000 steps (65%)
02:24:58:WU02:FS01:0x17:Completed 1400000 out of 5000000 steps (28%)
02:28:21:WU03:FS02:0x17:Completed 2650000 out of 5000000 steps (53%)
02:31:03:WU01:FS03:0x17:Completed 3300000 out of 5000000 steps (66%)
02:35:47:WU02:FS01:0x17:Completed 1450000 out of 5000000 steps (29%)
02:38:10:WU03:FS02:0x17:Completed 2700000 out of 5000000 steps (54%)
02:42:47:WU01:FS03:0x17:Completed 3350000 out of 5000000 steps (67%)
02:46:33:WU02:FS01:0x17:Completed 1500000 out of 5000000 steps (30%)
02:47:56:WU03:FS02:0x17:Completed 2750000 out of 5000000 steps (55%)
02:54:29:WU01:FS03:0x17:Completed 3400000 out of 5000000 steps (68%)
02:57:19:WU02:FS01:0x17:Completed 1550000 out of 5000000 steps (31%)
02:57:43:WU03:FS02:0x17:Completed 2800000 out of 5000000 steps (56%)
03:06:12:WU01:FS03:0x17:Completed 3450000 out of 5000000 steps (69%)
03:07:32:WU03:FS02:0x17:Completed 2850000 out of 5000000 steps (57%)
03:08:09:WU02:FS01:0x17:Completed 1600000 out of 5000000 steps (32%)
03:17:20:WU03:FS02:0x17:Completed 2900000 out of 5000000 steps (58%)
03:17:56:WU01:FS03:0x17:Completed 3500000 out of 5000000 steps (70%)
03:18:56:WU02:FS01:0x17:Completed 1650000 out of 5000000 steps (33%)
03:27:10:WU03:FS02:0x17:Completed 2950000 out of 5000000 steps (59%)
03:29:41:WU01:FS03:0x17:Completed 3550000 out of 5000000 steps (71%)
03:29:46:WU02:FS01:0x17:Completed 1700000 out of 5000000 steps (34%)
03:36:58:WU03:FS02:0x17:Completed 3000000 out of 5000000 steps (60%)
03:40:36:WU02:FS01:0x17:Completed 1750000 out of 5000000 steps (35%)
03:41:27:WU01:FS03:0x17:Completed 3600000 out of 5000000 steps (72%)
03:46:49:WU03:FS02:0x17:Completed 3050000 out of 5000000 steps (61%)
03:51:27:WU02:FS01:0x17:Completed 1800000 out of 5000000 steps (36%)
03:53:13:WU01:FS03:0x17:Completed 3650000 out of 5000000 steps (73%)
03:56:39:WU03:FS02:0x17:Completed 3100000 out of 5000000 steps (62%)
04:02:16:WU02:FS01:0x17:Completed 1850000 out of 5000000 steps (37%)
04:04:57:WU01:FS03:0x17:Completed 3700000 out of 5000000 steps (74%)
04:06:27:WU03:FS02:0x17:Completed 3150000 out of 5000000 steps (63%)
04:13:05:WU02:FS01:0x17:Completed 1900000 out of 5000000 steps (38%)
04:16:15:WU03:FS02:0x17:Completed 3200000 out of 5000000 steps (64%)
04:16:41:WU01:FS03:0x17:Completed 3750000 out of 5000000 steps (75%)
04:23:54:WU02:FS01:0x17:Completed 1950000 out of 5000000 steps (39%)
04:26:04:WU03:FS02:0x17:Completed 3250000 out of 5000000 steps (65%)
04:28:24:WU01:FS03:0x17:Completed 3800000 out of 5000000 steps (76%)
04:34:40:WU02:FS01:0x17:Completed 2000000 out of 5000000 steps (40%)
04:35:47:WU03:FS02:0x17:Completed 3300000 out of 5000000 steps (66%)
04:40:06:WU01:FS03:0x17:Completed 3850000 out of 5000000 steps (77%)
04:45:30:WU02:FS01:0x17:Completed 2050000 out of 5000000 steps (41%)
04:45:35:WU03:FS02:0x17:Completed 3350000 out of 5000000 steps (67%)
04:51:51:WU01:FS03:0x17:Completed 3900000 out of 5000000 steps (78%)
04:55:24:WU03:FS02:0x17:Completed 3400000 out of 5000000 steps (68%)
04:56:19:WU02:FS01:0x17:Completed 2100000 out of 5000000 steps (42%)
05:03:36:WU01:FS03:0x17:Completed 3950000 out of 5000000 steps (79%)
05:05:13:WU03:FS02:0x17:Completed 3450000 out of 5000000 steps (69%)
05:07:09:WU02:FS01:0x17:Completed 2150000 out of 5000000 steps (43%)
05:15:03:WU03:FS02:0x17:Completed 3500000 out of 5000000 steps (70%)
05:15:22:WU01:FS03:0x17:Completed 4000000 out of 5000000 steps (80%)
05:17:59:WU02:FS01:0x17:Completed 2200000 out of 5000000 steps (44%)
05:24:53:WU03:FS02:0x17:Completed 3550000 out of 5000000 steps (71%)
05:27:08:WU01:FS03:0x17:Completed 4050000 out of 5000000 steps (81%)
05:28:50:WU02:FS01:0x17:Completed 2250000 out of 5000000 steps (45%)
05:34:43:WU03:FS02:0x17:Completed 3600000 out of 5000000 steps (72%)
05:38:54:WU01:FS03:0x17:Completed 4100000 out of 5000000 steps (82%)
05:39:40:WU02:FS01:0x17:Completed 2300000 out of 5000000 steps (46%)
05:44:33:WU03:FS02:0x17:Completed 3650000 out of 5000000 steps (73%)
05:50:26:WU02:FS01:0x17:Completed 2350000 out of 5000000 steps (47%)
05:50:38:WU01:FS03:0x17:Completed 4150000 out of 5000000 steps (83%)
05:54:23:WU03:FS02:0x17:Completed 3700000 out of 5000000 steps (74%)
06:01:12:WU02:FS01:0x17:Completed 2400000 out of 5000000 steps (48%)
06:02:21:WU01:FS03:0x17:Completed 4200000 out of 5000000 steps (84%)
06:04:10:WU03:FS02:0x17:Completed 3750000 out of 5000000 steps (75%)
06:11:54:WU02:FS01:0x17:Completed 2450000 out of 5000000 steps (49%)
06:13:54:WU03:FS02:0x17:Completed 3800000 out of 5000000 steps (76%)
06:14:03:WU01:FS03:0x17:Completed 4250000 out of 5000000 steps (85%)
06:22:44:WU02:FS01:0x17:Completed 2500000 out of 5000000 steps (50%)
06:23:44:WU03:FS02:0x17:Completed 3850000 out of 5000000 steps (77%)
06:25:49:WU01:FS03:0x17:Completed 4300000 out of 5000000 steps (86%)
06:33:32:WU02:FS01:0x17:Completed 2550000 out of 5000000 steps (51%)
06:33:34:WU03:FS02:0x17:Completed 3900000 out of 5000000 steps (78%)
06:37:34:WU01:FS03:0x17:Completed 4350000 out of 5000000 steps (87%)
06:43:24:WU03:FS02:0x17:Completed 3950000 out of 5000000 steps (79%)
06:44:21:WU02:FS01:0x17:Completed 2600000 out of 5000000 steps (52%)
06:49:18:WU01:FS03:0x17:Completed 4400000 out of 5000000 steps (88%)
06:53:13:WU03:FS02:0x17:Completed 4000000 out of 5000000 steps (80%)
06:55:09:WU02:FS01:0x17:Completed 2650000 out of 5000000 steps (53%)
07:01:04:WU01:FS03:0x17:Completed 4450000 out of 5000000 steps (89%)
07:03:02:WU03:FS02:0x17:Completed 4050000 out of 5000000 steps (81%)
07:05:56:WU02:FS01:0x17:Completed 2700000 out of 5000000 steps (54%)
07:12:46:WU01:FS03:0x17:Completed 4500000 out of 5000000 steps (90%)
07:12:49:WU03:FS02:0x17:Completed 4100000 out of 5000000 steps (82%)
07:16:44:WU02:FS01:0x17:Completed 2750000 out of 5000000 steps (55%)
******************************* Date: 2014-05-18 *******************************
07:22:40:WU03:FS02:0x17:Completed 4150000 out of 5000000 steps (83%)
07:24:33:WU01:FS03:0x17:Completed 4550000 out of 5000000 steps (91%)
07:27:33:WU02:FS01:0x17:Completed 2800000 out of 5000000 steps (56%)
07:32:29:WU03:FS02:0x17:Completed 4200000 out of 5000000 steps (84%)
07:36:18:WU01:FS03:0x17:Completed 4600000 out of 5000000 steps (92%)
07:38:19:WU02:FS01:0x17:Completed 2850000 out of 5000000 steps (57%)
07:42:12:WU03:FS02:0x17:Completed 4250000 out of 5000000 steps (85%)
07:48:00:WU01:FS03:0x17:Completed 4650000 out of 5000000 steps (93%)
07:49:04:WU02:FS01:0x17:Completed 2900000 out of 5000000 steps (58%)
07:52:01:WU03:FS02:0x17:Completed 4300000 out of 5000000 steps (86%)
07:59:44:WU01:FS03:0x17:Completed 4700000 out of 5000000 steps (94%)
07:59:51:WU02:FS01:0x17:Completed 2950000 out of 5000000 steps (59%)
08:01:42:WU03:FS02:0x17:Completed 4350000 out of 5000000 steps (87%)
08:10:47:WU02:FS01:0x17:Completed 3000000 out of 5000000 steps (60%)
08:11:19:WU01:FS03:0x17:Completed 4750000 out of 5000000 steps (95%)
08:11:29:WU03:FS02:0x17:Completed 4400000 out of 5000000 steps (88%)
08:21:18:WU03:FS02:0x17:Completed 4450000 out of 5000000 steps (89%)
08:21:35:WU02:FS01:0x17:Completed 3050000 out of 5000000 steps (61%)
08:23:04:WU01:FS03:0x17:Completed 4800000 out of 5000000 steps (96%)
08:31:04:WU03:FS02:0x17:Completed 4500000 out of 5000000 steps (90%)
08:32:19:WU02:FS01:0x17:Completed 3100000 out of 5000000 steps (62%)
08:34:46:WU01:FS03:0x17:Completed 4850000 out of 5000000 steps (97%)
08:40:52:WU03:FS02:0x17:Completed 4550000 out of 5000000 steps (91%)
08:43:07:WU02:FS01:0x17:Completed 3150000 out of 5000000 steps (63%)
08:46:30:WU01:FS03:0x17:Completed 4900000 out of 5000000 steps (98%)
08:50:41:WU03:FS02:0x17:Completed 4600000 out of 5000000 steps (92%)
08:53:54:WU02:FS01:0x17:Completed 3200000 out of 5000000 steps (64%)
08:58:12:WU01:FS03:0x17:Completed 4950000 out of 5000000 steps (99%)
08:58:13:WU04:FS03:Connecting to 171.67.108.201:80
08:58:13:WU04:FS03:Assigned to work server 171.64.65.56
08:58:13:WU04:FS03:Requesting new work unit for slot 03: RUNNING gpu:2:Pitcairn [Radeon HD 7800] from 171.64.65.56
08:58:13:WU04:FS03:Connecting to 171.64.65.56:8080
08:58:14:WU04:FS03:Downloading 5.60MiB
08:58:17:WU04:FS03:Download complete
08:58:17:WU04:FS03:Received Unit: id:04 state:DOWNLOAD error:NO_ERROR project:9406 run:924 clone:0 gen:1 core:0x17 unit:0x000000030a3b1e5c533e92369f785cf5
09:00:26:WU03:FS02:0x17:Completed 4650000 out of 5000000 steps (93%)
09:04:39:WU02:FS01:0x17:Completed 3250000 out of 5000000 steps (65%)
09:09:54:WU01:FS03:0x17:Completed 5000000 out of 5000000 steps (100%)
09:10:10:WU01:FS03:0x17:Saving result file logfile_01.txt
09:10:10:WU01:FS03:0x17:Saving result file checkpointState.xml
09:10:12:WU01:FS03:0x17:Saving result file checkpt.crc
09:10:12:WU01:FS03:0x17:Saving result file log.txt
09:10:13:WU01:FS03:0x17:Saving result file positions.xtc
09:10:14:WU03:FS02:0x17:Completed 4700000 out of 5000000 steps (94%)
09:10:17:WU01:FS03:0x17:Folding@home Core Shutdown: FINISHED_UNIT
09:10:18:WU01:FS03:FahCore returned: FINISHED_UNIT (100 = 0x64)
09:10:18:WU01:FS03:Sending unit results: id:01 state:SEND error:NO_ERROR project:9408 run:669 clone:0 gen:6 core:0x17 unit:0x0000000c0a3b1e5c5342e0a685727690
09:10:18:WU01:FS03:Uploading 23.30MiB to 171.64.65.56
09:10:18:WU01:FS03:Connecting to 171.64.65.56:8080
09:10:18:WU04:FS03:Starting
09:10:18:WU04:FS03:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/KaZ/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 04 -suffix 01 -version 704 -lifeline 4440 -checkpoint 15 -gpu 2 -gpu-vendor ati
09:10:18:WU04:FS03:Started FahCore on PID 1128
09:10:18:WU04:FS03:Core PID:4552
09:10:18:WU04:FS03:FahCore 0x17 started
09:10:18:WU04:FS03:0x17:*********************** Log Started 2014-05-18T09:10:18Z ***********************
09:10:18:WU04:FS03:0x17:Project: 9406 (Run 924, Clone 0, Gen 1)
09:10:18:WU04:FS03:0x17:Unit: 0x000000030a3b1e5c533e92369f785cf5
09:10:18:WU04:FS03:0x17:CPU: 0x00000000000000000000000000000000
09:10:18:WU04:FS03:0x17:Machine: 3
09:10:18:WU04:FS03:0x17:Reading tar file state.xml
09:10:20:WU04:FS03:0x17:Reading tar file system.xml
09:10:20:WU04:FS03:0x17:Reading tar file integrator.xml
09:10:20:WU04:FS03:0x17:Reading tar file core.xml
09:10:20:WU04:FS03:0x17:Digital signatures verified
09:10:20:WU04:FS03:0x17:Folding@home GPU core17
09:10:20:WU04:FS03:0x17:Version 0.0.52
09:10:24:WU01:FS03:Upload 18.78%
09:10:30:WU01:FS03:Upload 34.88%
09:10:36:WU01:FS03:Upload 52.58%
09:10:42:WU01:FS03:Upload 70.02%
09:10:48:WU01:FS03:Upload 87.72%
09:11:04:WU01:FS03:Upload complete
09:11:04:WU01:FS03:Server responded WORK_ACK (400)
09:11:04:WU01:FS03:Final credit estimate, 43104.00 points
09:11:04:WU01:FS03:Cleaning up
09:14:28:WU04:FS03:0x17:Completed 0 out of 2000000 steps (0%)
09:14:28:WU04:FS03:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
09:15:25:WU02:FS01:0x17:Completed 3300000 out of 5000000 steps (66%)
09:20:03:WU03:FS02:0x17:Completed 4750000 out of 5000000 steps (95%)
09:21:15:WU04:FS03:0x17:Completed 20000 out of 2000000 steps (1%)
09:26:12:WU02:FS01:0x17:Completed 3350000 out of 5000000 steps (67%)
09:27:33:WU04:FS03:0x17:Completed 40000 out of 2000000 steps (2%)
09:29:52:WU03:FS02:0x17:Completed 4800000 out of 5000000 steps (96%)
09:34:12:WU04:FS03:0x17:Completed 60000 out of 2000000 steps (3%)
09:36:59:WU02:FS01:0x17:Completed 3400000 out of 5000000 steps (68%)
09:39:41:WU03:FS02:0x17:Completed 4850000 out of 5000000 steps (97%)
09:40:31:WU04:FS03:0x17:Completed 80000 out of 2000000 steps (4%)
09:46:48:WU04:FS03:0x17:Completed 100000 out of 2000000 steps (5%)
09:47:44:WU02:FS01:0x17:Completed 3450000 out of 5000000 steps (69%)
09:49:26:WU03:FS02:0x17:Completed 4900000 out of 5000000 steps (98%)
09:53:25:WU04:FS03:0x17:Completed 120000 out of 2000000 steps (6%)
09:58:27:WU02:FS01:0x17:Completed 3500000 out of 5000000 steps (70%)
09:59:09:WU03:FS02:0x17:Completed 4950000 out of 5000000 steps (99%)
09:59:10:WU01:FS02:Connecting to 171.67.108.201:80
09:59:10:WU01:FS02:Assigned to work server 171.64.65.56
09:59:10:WU01:FS02:Requesting new work unit for slot 02: RUNNING gpu:1:Pitcairn [] from 171.64.65.56
09:59:10:WU01:FS02:Connecting to 171.64.65.56:8080
09:59:10:WU01:FS02:Downloading 4.94MiB
09:59:14:WU01:FS02:Download complete
09:59:14:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9406 run:56 clone:1 gen:30 core:0x17 unit:0x0000002e0a3b1e5c533dd672102a3b64
09:59:42:WU04:FS03:0x17:Completed 140000 out of 2000000 steps (7%)
10:06:19:WU04:FS03:0x17:Completed 160000 out of 2000000 steps (8%)
10:08:54:WU03:FS02:0x17:Completed 5000000 out of 5000000 steps (100%)
10:09:06:WU03:FS02:0x17:Saving result file logfile_01.txt
10:09:06:WU03:FS02:0x17:Saving result file checkpointState.xml
10:09:08:WU03:FS02:0x17:Saving result file checkpt.crc
10:09:08:WU03:FS02:0x17:Saving result file log.txt
10:09:08:WU03:FS02:0x17:Saving result file positions.xtc
10:09:12:WU03:FS02:0x17:Folding@home Core Shutdown: FINISHED_UNIT
10:09:12:WU03:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
10:09:12:WU03:FS02:Sending unit results: id:03 state:SEND error:NO_ERROR project:9408 run:2121 clone:0 gen:16 core:0x17 unit:0x000000170a3b1e5c53433a805512d05f
10:09:12:WU03:FS02:Uploading 18.10MiB to 171.64.65.56
10:09:12:WU03:FS02:Connecting to 171.64.65.56:8080
10:09:12:WU02:FS01:0x17:Completed 3550000 out of 5000000 steps (71%)
10:09:12:WU01:FS02:Starting
10:09:12:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/KaZ/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 4440 -checkpoint 15 -gpu 1 -gpu-vendor ati
10:09:12:WU01:FS02:Started FahCore on PID 960
10:09:12:WU01:FS02:Core PID:4420
10:09:12:WU01:FS02:FahCore 0x17 started
10:09:13:WU01:FS02:0x17:*********************** Log Started 2014-05-18T10:09:12Z ***********************
10:09:13:WU01:FS02:0x17:Project: 9406 (Run 56, Clone 1, Gen 30)
10:09:13:WU01:FS02:0x17:Unit: 0x0000002e0a3b1e5c533dd672102a3b64
10:09:13:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
10:09:13:WU01:FS02:0x17:Machine: 2
10:09:13:WU01:FS02:0x17:Reading tar file state.xml
10:09:13:WU01:FS02:0x17:Reading tar file system.xml
10:09:14:WU01:FS02:0x17:Reading tar file integrator.xml
10:09:14:WU01:FS02:0x17:Reading tar file core.xml
10:09:14:WU01:FS02:0x17:Digital signatures verified
10:09:14:WU01:FS02:0x17:Folding@home GPU core17
10:09:14:WU01:FS02:0x17:Version 0.0.52
10:09:18:WU03:FS02:Upload 22.10%
10:09:25:WU03:FS02:Upload 48.34%
10:09:31:WU03:FS02:Upload 70.79%
10:09:37:WU03:FS02:Upload 94.96%
10:09:48:WU03:FS02:Upload complete
10:09:48:WU03:FS02:Server responded WORK_ACK (400)
10:09:48:WU03:FS02:Final credit estimate, 46484.00 points
10:09:48:WU03:FS02:Cleaning up
10:12:31:WU01:FS02:0x17:Completed 0 out of 2000000 steps (0%)
10:12:31:WU01:FS02:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
10:12:36:WU04:FS03:0x17:Completed 180000 out of 2000000 steps (9%)
10:18:26:WU01:FS02:0x17:Completed 20000 out of 2000000 steps (1%)
10:18:56:WU04:FS03:0x17:Completed 200000 out of 2000000 steps (10%)
10:19:59:WU02:FS01:0x17:Completed 3600000 out of 5000000 steps (72%)
10:24:05:WU01:FS02:0x17:Completed 40000 out of 2000000 steps (2%)
10:25:34:WU04:FS03:0x17:Completed 220000 out of 2000000 steps (11%)
10:30:03:WU01:FS02:0x17:Completed 60000 out of 2000000 steps (3%)
10:30:47:WU02:FS01:0x17:Completed 3650000 out of 5000000 steps (73%)
10:31:54:WU04:FS03:0x17:Completed 240000 out of 2000000 steps (12%)
10:35:43:WU01:FS02:0x17:Completed 80000 out of 2000000 steps (4%)
10:38:33:WU04:FS03:0x17:Completed 260000 out of 2000000 steps (13%)
10:41:22:WU01:FS02:0x17:Completed 100000 out of 2000000 steps (5%)
10:41:36:WU02:FS01:0x17:Completed 3700000 out of 5000000 steps (74%)
10:44:52:WU04:FS03:0x17:Completed 280000 out of 2000000 steps (14%)
10:47:20:WU01:FS02:0x17:Completed 120000 out of 2000000 steps (6%)
10:51:12:WU04:FS03:0x17:Completed 300000 out of 2000000 steps (15%)
10:52:26:WU02:FS01:0x17:Completed 3750000 out of 5000000 steps (75%)
10:53:01:WU01:FS02:0x17:Completed 140000 out of 2000000 steps (7%)
10:57:50:WU04:FS03:0x17:Completed 320000 out of 2000000 steps (16%)
10:58:58:WU01:FS02:0x17:Completed 160000 out of 2000000 steps (8%)
11:03:13:WU02:FS01:0x17:Completed 3800000 out of 5000000 steps (76%)
11:04:09:WU04:FS03:0x17:Completed 340000 out of 2000000 steps (17%)
11:04:37:WU01:FS02:0x17:Completed 180000 out of 2000000 steps (9%)
11:10:16:WU01:FS02:0x17:Completed 200000 out of 2000000 steps (10%)
11:10:47:WU04:FS03:0x17:Completed 360000 out of 2000000 steps (18%)
11:14:00:WU02:FS01:0x17:Completed 3850000 out of 5000000 steps (77%)
11:16:14:WU01:FS02:0x17:Completed 220000 out of 2000000 steps (11%)
11:17:06:WU04:FS03:0x17:Completed 380000 out of 2000000 steps (19%)
11:21:53:WU01:FS02:0x17:Completed 240000 out of 2000000 steps (12%)
11:23:26:WU04:FS03:0x17:Completed 400000 out of 2000000 steps (20%)
11:24:49:WU02:FS01:0x17:Completed 3900000 out of 5000000 steps (78%)
11:27:51:WU01:FS02:0x17:Completed 260000 out of 2000000 steps (13%)
11:30:05:WU04:FS03:0x17:Completed 420000 out of 2000000 steps (21%)
11:33:32:WU01:FS02:0x17:Completed 280000 out of 2000000 steps (14%)
11:35:37:WU02:FS01:0x17:Completed 3950000 out of 5000000 steps (79%)
11:36:24:WU04:FS03:0x17:Completed 440000 out of 2000000 steps (22%)
11:39:11:WU01:FS02:0x17:Completed 300000 out of 2000000 steps (15%)
11:43:03:WU04:FS03:0x17:Completed 460000 out of 2000000 steps (23%)
11:45:08:WU01:FS02:0x17:Completed 320000 out of 2000000 steps (16%)
11:46:24:WU02:FS01:0x17:Completed 4000000 out of 5000000 steps (80%)
11:49:22:WU04:FS03:0x17:Completed 480000 out of 2000000 steps (24%)
11:50:47:WU01:FS02:0x17:Completed 340000 out of 2000000 steps (17%)
11:55:42:WU04:FS03:0x17:Completed 500000 out of 2000000 steps (25%)
11:56:44:WU01:FS02:0x17:Completed 360000 out of 2000000 steps (18%)
11:57:13:WU02:FS01:0x17:Completed 4050000 out of 5000000 steps (81%)
12:02:19:WU04:FS03:0x17:Completed 520000 out of 2000000 steps (26%)
12:02:24:WU01:FS02:0x17:Completed 380000 out of 2000000 steps (19%)
12:08:01:WU02:FS01:0x17:Completed 4100000 out of 5000000 steps (82%)
12:08:03:WU01:FS02:0x17:Completed 400000 out of 2000000 steps (20%)
12:08:38:WU04:FS03:0x17:Completed 540000 out of 2000000 steps (27%)
12:14:00:WU01:FS02:0x17:Completed 420000 out of 2000000 steps (21%)
12:15:16:WU04:FS03:0x17:Completed 560000 out of 2000000 steps (28%)
12:18:47:WU02:FS01:0x17:Completed 4150000 out of 5000000 steps (83%)
12:19:39:WU01:FS02:0x17:Completed 440000 out of 2000000 steps (22%)
12:21:35:WU04:FS03:0x17:Completed 580000 out of 2000000 steps (29%)
12:25:37:WU01:FS02:0x17:Completed 460000 out of 2000000 steps (23%)
12:27:54:WU04:FS03:0x17:Completed 600000 out of 2000000 steps (30%)
12:29:34:WU02:FS01:0x17:Completed 4200000 out of 5000000 steps (84%)
12:31:16:WU01:FS02:0x17:Completed 480000 out of 2000000 steps (24%)
12:34:32:WU04:FS03:0x17:Completed 620000 out of 2000000 steps (31%)
12:36:54:WU01:FS02:0x17:Completed 500000 out of 2000000 steps (25%)
12:40:20:WU02:FS01:0x17:Completed 4250000 out of 5000000 steps (85%)
12:40:51:WU04:FS03:0x17:Completed 640000 out of 2000000 steps (32%)
12:42:51:WU01:FS02:0x17:Completed 520000 out of 2000000 steps (26%)
12:48:28:WU01:FS02:0x17:Completed 540000 out of 2000000 steps (27%)
12:51:07:WU02:FS01:0x17:Completed 4300000 out of 5000000 steps (86%)
12:54:24:WU01:FS02:0x17:Completed 560000 out of 2000000 steps (28%)
13:00:01:WU01:FS02:0x17:Completed 580000 out of 2000000 steps (29%)
13:01:53:WU02:FS01:0x17:Completed 4350000 out of 5000000 steps (87%)
13:05:39:WU01:FS02:0x17:Completed 600000 out of 2000000 steps (30%)
13:11:35:WU01:FS02:0x17:Completed 620000 out of 2000000 steps (31%)
13:12:39:WU02:FS01:0x17:Completed 4400000 out of 5000000 steps (88%)
13:17:15:WU01:FS02:0x17:Completed 640000 out of 2000000 steps (32%)
******************************* Date: 2014-05-18 *******************************
13:23:11:WU01:FS02:0x17:Completed 660000 out of 2000000 steps (33%)
13:23:27:WU02:FS01:0x17:Completed 4450000 out of 5000000 steps (89%)
13:28:49:WU01:FS02:0x17:Completed 680000 out of 2000000 steps (34%)
13:34:12:WU02:FS01:0x17:Completed 4500000 out of 5000000 steps (90%)
13:34:28:WU01:FS02:0x17:Completed 700000 out of 2000000 steps (35%)
13:40:24:WU01:FS02:0x17:Completed 720000 out of 2000000 steps (36%)
13:44:58:WU02:FS01:0x17:Completed 4550000 out of 5000000 steps (91%)
13:46:02:WU01:FS02:0x17:Completed 740000 out of 2000000 steps (37%)
13:51:58:WU01:FS02:0x17:Completed 760000 out of 2000000 steps (38%)
13:55:46:WU02:FS01:0x17:Completed 4600000 out of 5000000 steps (92%)
13:57:36:WU01:FS02:0x17:Completed 780000 out of 2000000 steps (39%)
14:03:14:WU01:FS02:0x17:Completed 800000 out of 2000000 steps (40%)
14:06:34:WU02:FS01:0x17:Completed 4650000 out of 5000000 steps (93%)
14:09:10:WU01:FS02:0x17:Completed 820000 out of 2000000 steps (41%)
14:14:49:WU01:FS02:0x17:Completed 840000 out of 2000000 steps (42%)
14:17:22:WU02:FS01:0x17:Completed 4700000 out of 5000000 steps (94%)
14:20:46:WU01:FS02:0x17:Completed 860000 out of 2000000 steps (43%)
14:26:24:WU01:FS02:0x17:Completed 880000 out of 2000000 steps (44%)
14:28:08:WU02:FS01:0x17:Completed 4750000 out of 5000000 steps (95%)
14:32:03:WU01:FS02:0x17:Completed 900000 out of 2000000 steps (45%)
14:37:58:WU01:FS02:0x17:Completed 920000 out of 2000000 steps (46%)
14:38:55:WU02:FS01:0x17:Completed 4800000 out of 5000000 steps (96%)
14:43:37:WU01:FS02:0x17:Completed 940000 out of 2000000 steps (47%)
14:49:34:WU01:FS02:0x17:Completed 960000 out of 2000000 steps (48%)
14:49:44:WU02:FS01:0x17:Completed 4850000 out of 5000000 steps (97%)
14:55:13:WU01:FS02:0x17:Completed 980000 out of 2000000 steps (49%)
15:00:29:WU02:FS01:0x17:Completed 4900000 out of 5000000 steps (98%)
15:00:52:WU01:FS02:0x17:Completed 1000000 out of 2000000 steps (50%)
15:06:48:WU01:FS02:0x17:Completed 1020000 out of 2000000 steps (51%)
15:11:17:WU02:FS01:0x17:Completed 4950000 out of 5000000 steps (99%)
15:11:18:WU03:FS01:Connecting to 171.67.108.201:80
15:11:18:WU03:FS01:Assigned to work server 171.64.65.56
15:11:18:WU03:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:Hawaii [Radeon R9 200 Series] from 171.64.65.56
15:11:18:WU03:FS01:Connecting to 171.64.65.56:8080
15:11:18:WU03:FS01:Downloading 5.89MiB
15:11:21:WU03:FS01:Download complete
15:11:21:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:9406 run:392 clone:0 gen:38 core:0x17 unit:0x000000310a3b1e5c533e11474a722d7e
15:12:27:WU01:FS02:0x17:Completed 1040000 out of 2000000 steps (52%)
15:18:22:WU01:FS02:0x17:Completed 1060000 out of 2000000 steps (53%)
15:22:04:WU02:FS01:0x17:Completed 5000000 out of 5000000 steps (100%)
15:22:17:WU02:FS01:0x17:Saving result file logfile_01.txt
15:22:17:WU02:FS01:0x17:Saving result file checkpointState.xml
15:22:19:WU02:FS01:0x17:Saving result file checkpt.crc
15:22:19:WU02:FS01:0x17:Saving result file log.txt
15:22:19:WU02:FS01:0x17:Saving result file positions.xtc
15:22:24:WU02:FS01:0x17:Folding@home Core Shutdown: FINISHED_UNIT
15:22:24:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
15:22:24:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:9408 run:1971 clone:0 gen:6 core:0x17 unit:0x0000000a0a3b1e5c5343362c91d5a2d9
15:22:24:WU02:FS01:Uploading 20.69MiB to 171.64.65.56
15:22:24:WU02:FS01:Connecting to 171.64.65.56:8080
15:22:24:WU03:FS01:Starting
15:22:24:WU03:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/KaZ/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 704 -lifeline 4440 -checkpoint 15 -gpu 0 -gpu-vendor ati
15:22:24:WU03:FS01:Started FahCore on PID 3048
15:22:24:WU03:FS01:Core PID:1400
15:22:24:WU03:FS01:FahCore 0x17 started
15:22:25:WU03:FS01:0x17:*********************** Log Started 2014-05-18T15:22:25Z ***********************
15:22:25:WU03:FS01:0x17:Project: 9406 (Run 392, Clone 0, Gen 38)
15:22:25:WU03:FS01:0x17:Unit: 0x000000310a3b1e5c533e11474a722d7e
15:22:25:WU03:FS01:0x17:CPU: 0x00000000000000000000000000000000
15:22:25:WU03:FS01:0x17:Machine: 1
15:22:25:WU03:FS01:0x17:Reading tar file state.xml
15:22:26:WU03:FS01:0x17:Reading tar file system.xml
15:22:27:WU03:FS01:0x17:Reading tar file integrator.xml
15:22:27:WU03:FS01:0x17:Reading tar file core.xml
15:22:27:WU03:FS01:0x17:Digital signatures verified
15:22:27:WU03:FS01:0x17:Folding@home GPU core17
15:22:27:WU03:FS01:0x17:Version 0.0.52
15:22:30:WU02:FS01:Upload 19.33%
15:22:36:WU02:FS01:Upload 38.97%
15:22:42:WU02:FS01:Upload 58.90%
15:22:48:WU02:FS01:Upload 77.33%
15:22:54:WU02:FS01:Upload 97.87%
15:23:06:WU02:FS01:Upload complete
15:23:06:WU02:FS01:Server responded WORK_ACK (400)
15:23:06:WU02:FS01:Final credit estimate, 44485.00 points
15:23:06:WU02:FS01:Cleaning up
15:23:59:WU01:FS02:0x17:Completed 1080000 out of 2000000 steps (54%)
15:29:37:WU01:FS02:0x17:Completed 1100000 out of 2000000 steps (55%)
15:35:33:WU01:FS02:0x17:Completed 1120000 out of 2000000 steps (56%)
15:41:11:WU01:FS02:0x17:Completed 1140000 out of 2000000 steps (57%)
15:47:07:WU01:FS02:0x17:Completed 1160000 out of 2000000 steps (58%)
15:52:45:WU01:FS02:0x17:Completed 1180000 out of 2000000 steps (59%)
15:58:24:WU01:FS02:0x17:Completed 1200000 out of 2000000 steps (60%)
16:04:20:WU01:FS02:0x17:Completed 1220000 out of 2000000 steps (61%)
16:09:59:WU01:FS02:0x17:Completed 1240000 out of 2000000 steps (62%)
16:15:55:WU01:FS02:0x17:Completed 1260000 out of 2000000 steps (63%)
16:21:33:WU01:FS02:0x17:Completed 1280000 out of 2000000 steps (64%)
16:27:11:WU01:FS02:0x17:Completed 1300000 out of 2000000 steps (65%)
16:33:06:WU01:FS02:0x17:Completed 1320000 out of 2000000 steps (66%)
16:38:45:WU01:FS02:0x17:Completed 1340000 out of 2000000 steps (67%)
16:44:42:WU01:FS02:0x17:Completed 1360000 out of 2000000 steps (68%)
16:50:19:WU01:FS02:0x17:Completed 1380000 out of 2000000 steps (69%)
16:55:58:WU01:FS02:0x17:Completed 1400000 out of 2000000 steps (70%)
17:01:53:WU01:FS02:0x17:Completed 1420000 out of 2000000 steps (71%)
17:07:32:WU01:FS02:0x17:Completed 1440000 out of 2000000 steps (72%)
17:13:27:WU01:FS02:0x17:Completed 1460000 out of 2000000 steps (73%)
17:19:06:WU01:FS02:0x17:Completed 1480000 out of 2000000 steps (74%)
17:24:45:WU01:FS02:0x17:Completed 1500000 out of 2000000 steps (75%)
17:30:40:WU01:FS02:0x17:Completed 1520000 out of 2000000 steps (76%)
17:36:18:WU01:FS02:0x17:Completed 1540000 out of 2000000 steps (77%)
17:42:13:WU01:FS02:0x17:Completed 1560000 out of 2000000 steps (78%)
17:47:51:WU01:FS02:0x17:Completed 1580000 out of 2000000 steps (79%)
17:53:28:WU01:FS02:0x17:Completed 1600000 out of 2000000 steps (80%)
17:54:50:FS01:Paused
17:54:50:FS01:Shutting core down
17:54:50:WU03:FS01:0x17:WARNING:Console control signal 1 on PID 1400
17:54:50:WU03:FS01:0x17:Exiting, please wait. . .
17:55:08:Removing old file 'configs/config-20140513-234809.xml'
17:55:08:Saving configuration to config.xml
17:55:08:<config>
17:55:08:  <!-- Folding Core -->
17:55:08:  <core-priority v='low'/>
17:55:08:
17:55:08:  <!-- Network -->
17:55:08:  <proxy v=':8080'/>
17:55:08:
17:55:08:  <!-- Slot Control -->
17:55:08:  <power v='full'/>
17:55:08:
17:55:08:  <!-- User Information -->
17:55:08:  <passkey v='********************************'/>
17:55:08:  <team v='224497'/>
17:55:08:  <user v='dmfree88'/>
17:55:08:
17:55:08:  <!-- Folding Slots -->
17:55:08:  <slot id='0' type='CPU'>
17:55:08:    <client-type v='bigadv'/>
17:55:08:    <cpus v='4'/>
17:55:08:    <paused v='true'/>
17:55:08:  </slot>
17:55:08:  <slot id='1' type='GPU'>
17:55:08:    <paused v='true'/>
17:55:08:  </slot>
17:55:08:  <slot id='2' type='GPU'/>
17:55:08:  <slot id='3' type='GPU'/>
17:55:08:</config>
17:55:51:WARNING:FS01:Killing WU03
17:55:51:WARNING:FS01:Killing WU03
17:55:51:WARNING:FS01:Killing WU03
17:55:51:WARNING:FS01:Killing WU03
17:55:52:WARNING:FS01:Killing WU03
17:55:52:WARNING:FS01:Killing WU03
17:55:52:WARNING:FS01:Killing WU03
17:55:52:WARNING:FS01:Killing WU03
17:55:53:WARNING:FS01:Killing WU03
17:55:53:WARNING:FS01:Killing WU03
17:55:53:WARNING:FS01:Killing WU03
17:55:53:WARNING:FS01:Killing WU03
17:55:54:WARNING:FS01:Killing WU03
17:55:54:WARNING:FS01:Killing WU03
17:55:54:WARNING:FS01:Killing WU03
17:55:54:WARNING:FS01:Killing WU03
17:55:55:WARNING:FS01:Killing WU03
17:55:55:WARNING:FS01:Killing WU03
17:55:55:WARNING:FS01:Killing WU03
17:55:55:WARNING:FS01:Killing WU03
17:55:56:WARNING:FS01:Killing WU03
17:55:56:WARNING:FS01:Killing WU03
17:55:56:WARNING:FS01:Killing WU03
17:55:56:WARNING:FS01:Killing WU03
17:55:57:WARNING:FS01:Killing WU03
17:55:57:WARNING:FS01:Killing WU03
17:55:57:WARNING:FS01:Killing WU03
17:55:57:WARNING:FS01:Killing WU03
17:55:58:WARNING:FS01:Killing WU03
17:55:58:WARNING:FS01:Killing WU03
17:55:58:WARNING:FS01:Killing WU03
17:55:58:WARNING:FS01:Killing WU03
17:55:59:WARNING:FS01:Killing WU03
17:55:59:WARNING:FS01:Killing WU03
17:55:59:WARNING:FS01:Killing WU03
17:55:59:WARNING:FS01:Killing WU03
17:56:00:WARNING:FS01:Killing WU03
17:56:00:WARNING:FS01:Killing WU03
17:56:00:WARNING:FS01:Killing WU03
17:56:00:WARNING:FS01:Killing WU03
17:56:01:WARNING:FS01:Killing WU03
17:56:01:WARNING:FS01:Killing WU03
17:56:01:WARNING:FS01:Killing WU03
17:56:01:WARNING:FS01:Killing WU03
17:56:02:WARNING:FS01:Killing WU03
17:56:02:WARNING:FS01:Killing WU03
17:56:02:WARNING:FS01:Killing WU03
17:56:02:WARNING:FS01:Killing WU03
17:56:03:WARNING:FS01:Killing WU03
17:56:03:WARNING:FS01:Killing WU03
17:56:03:WARNING:FS01:Killing WU03
17:56:03:WARNING:FS01:Killing WU03
17:56:04:WARNING:FS01:Killing WU03
17:56:04:WARNING:FS01:Killing WU03
17:56:04:WARNING:FS01:Killing WU03
17:56:04:WARNING:FS01:Killing WU03
17:56:05:WARNING:FS01:Killing WU03
17:56:05:WARNING:FS01:Killing WU03
17:56:05:WARNING:FS01:Killing WU03
17:56:05:WARNING:FS01:Killing WU03
17:56:06:WARNING:FS01:Killing WU03
17:56:06:WARNING:FS01:Killing WU03
17:56:06:WARNING:FS01:Killing WU03
17:56:06:WARNING:FS01:Killing WU03
17:56:07:WARNING:FS01:Killing WU03
17:56:07:WARNING:FS01:Killing WU03
17:56:07:WARNING:FS01:Killing WU03
17:56:07:WARNING:FS01:Killing WU03
17:56:08:WARNING:FS01:Killing WU03
17:56:08:WARNING:FS01:Killing WU03
17:56:08:WARNING:FS01:Killing WU03
17:56:08:WARNING:FS01:Killing WU03
17:56:09:WARNING:FS01:Killing WU03
17:56:09:WARNING:FS01:Killing WU03
17:56:09:WARNING:FS01:Killing WU03
17:56:09:WARNING:FS01:Killing WU03
17:56:10:WARNING:FS01:Killing WU03
17:56:10:WARNING:FS01:Killing WU03
17:56:10:WARNING:FS01:Killing WU03
17:56:10:WARNING:FS01:Killing WU03
17:56:11:WARNING:FS01:Killing WU03
17:56:11:WARNING:FS01:Killing WU03
17:56:11:WARNING:FS01:Killing WU03
17:56:11:WARNING:FS01:Killing WU03
17:56:12:WARNING:FS01:Killing WU03
17:56:12:WARNING:FS01:Killing WU03
17:56:12:WARNING:FS01:Killing WU03
17:56:12:WARNING:FS01:Killing WU03
17:56:13:WARNING:FS01:Killing WU03
17:56:13:WARNING:FS01:Killing WU03
17:56:13:WARNING:FS01:Killing WU03
17:56:13:WARNING:FS01:Killing WU03
17:56:14:WARNING:FS01:Killing WU03
17:56:14:WARNING:FS01:Killing WU03
17:56:14:WARNING:FS01:Killing WU03
17:56:14:WARNING:FS01:Killing WU03
17:56:15:WARNING:FS01:Killing WU03
17:56:15:WARNING:FS01:Killing WU03
17:56:15:WARNING:FS01:Killing WU03
17:56:15:WARNING:FS01:Killing WU03
17:56:16:WARNING:FS01:Killing WU03
17:56:16:WARNING:FS01:Killing WU03
17:56:16:WARNING:FS01:Killing WU03
17:56:16:WARNING:FS01:Killing WU03
17:56:17:WARNING:FS01:Killing WU03
17:56:17:WARNING:FS01:Killing WU03
17:56:17:WARNING:FS01:Killing WU03
17:56:17:WARNING:FS01:Killing WU03
17:56:18:WARNING:FS01:Killing WU03
17:56:18:WARNING:FS01:Killing WU03
17:56:18:WARNING:FS01:Killing WU03
17:56:18:WARNING:FS01:Killing WU03
17:56:19:WARNING:FS01:Killing WU03
17:56:19:WARNING:FS01:Killing WU03
17:56:19:WARNING:FS01:Killing WU03
17:56:19:WARNING:FS01:Killing WU03
17:56:20:WARNING:FS01:Killing WU03
17:56:20:WARNING:FS01:Killing WU03
17:56:20:WARNING:FS01:Killing WU03
17:56:20:WARNING:FS01:Killing WU03
17:56:21:WARNING:FS01:Killing WU03
17:56:21:WARNING:FS01:Killing WU03
17:56:21:WARNING:FS01:Killing WU03
17:56:21:WARNING:FS01:Killing WU03
17:56:22:WARNING:FS01:Killing WU03
17:56:22:WARNING:FS01:Killing WU03
17:56:22:WARNING:FS01:Killing WU03
17:56:22:WARNING:FS01:Killing WU03
17:56:23:WARNING:FS01:Killing WU03
17:56:23:WARNING:FS01:Killing WU03
17:56:23:WARNING:FS01:Killing WU03
17:56:23:WARNING:FS01:Killing WU03
17:56:24:WARNING:FS01:Killing WU03
17:56:24:WARNING:FS01:Killing WU03
17:56:24:WARNING:FS01:Killing WU03
17:56:24:WARNING:FS01:Killing WU03
17:56:25:WARNING:FS01:Killing WU03
17:56:25:WARNING:FS01:Killing WU03
17:56:25:WARNING:FS01:Killing WU03
17:56:25:WARNING:FS01:Killing WU03
17:56:26:WARNING:FS01:Killing WU03
17:56:26:WARNING:FS01:Killing WU03
17:56:26:WARNING:FS01:Killing WU03
17:56:26:WARNING:FS01:Killing WU03
17:56:27:WARNING:FS01:Killing WU03
17:56:27:WARNING:FS01:Killing WU03
17:56:27:WARNING:FS01:Killing WU03
17:56:27:WARNING:FS01:Killing WU03
17:56:28:WARNING:FS01:Killing WU03
17:56:28:WARNING:FS01:Killing WU03
17:56:28:WARNING:FS01:Killing WU03
17:56:28:WARNING:FS01:Killing WU03
17:56:29:WARNING:FS01:Killing WU03
17:56:29:WARNING:FS01:Killing WU03
17:56:29:WARNING:FS01:Killing WU03
17:56:29:WARNING:FS01:Killing WU03
17:56:30:WARNING:FS01:Killing WU03
17:56:30:WARNING:FS01:Killing WU03
17:56:30:WARNING:FS01:Killing WU03
17:56:30:WARNING:FS01:Killing WU03
17:56:31:WARNING:FS01:Killing WU03
17:56:31:WARNING:FS01:Killing WU03
17:56:31:WARNING:FS01:Killing WU03
17:56:31:WARNING:FS01:Killing WU03
17:56:32:WARNING:FS01:Killing WU03
17:56:32:WARNING:FS01:Killing WU03
17:56:32:WARNING:FS01:Killing WU03
17:56:32:WARNING:FS01:Killing WU03
17:56:33:WARNING:FS01:Killing WU03
17:56:33:WARNING:FS01:Killing WU03
17:56:33:WARNING:FS01:Killing WU03
17:56:33:WARNING:FS01:Killing WU03
17:56:34:WARNING:FS01:Killing WU03
17:56:34:WARNING:FS01:Killing WU03
17:56:34:WARNING:FS01:Killing WU03
17:56:34:WARNING:FS01:Killing WU03
17:56:35:WARNING:FS01:Killing WU03
17:56:35:WARNING:FS01:Killing WU03
17:56:35:WARNING:FS01:Killing WU03
17:56:35:WARNING:FS01:Killing WU03
17:56:36:WARNING:FS01:Killing WU03
17:56:36:WARNING:FS01:Killing WU03
17:56:36:WARNING:FS01:Killing WU03
17:56:36:WARNING:FS01:Killing WU03
17:56:37:WARNING:FS01:Killing WU03
17:56:37:WARNING:FS01:Killing WU03
17:56:37:WARNING:FS01:Killing WU03
17:56:37:WARNING:FS01:Killing WU03
17:56:37:WARNING:FS01:Killing WU03
17:56:38:WARNING:FS01:Killing WU03
17:56:38:WARNING:FS01:Killing WU03
17:56:38:WARNING:FS01:Killing WU03
17:56:38:WARNING:FS01:Killing WU03
17:56:39:WARNING:FS01:Killing WU03
17:56:39:WARNING:FS01:Killing WU03
17:56:39:WARNING:FS01:Killing WU03
17:56:39:WARNING:FS01:Killing WU03
17:56:40:WARNING:FS01:Killing WU03
17:56:40:WARNING:FS01:Killing WU03
17:56:40:WARNING:FS01:Killing WU03
17:56:40:WARNING:FS01:Killing WU03
17:56:41:WARNING:FS01:Killing WU03
17:56:41:WARNING:FS01:Killing WU03
17:56:41:WARNING:FS01:Killing WU03
17:56:41:WARNING:FS01:Killing WU03
17:56:42:WARNING:FS01:Killing WU03
17:56:42:WARNING:FS01:Killing WU03
17:56:42:WARNING:FS01:Killing WU03
17:56:42:WARNING:FS01:Killing WU03
17:56:43:WARNING:FS01:Killing WU03
17:56:43:WARNING:FS01:Killing WU03
17:56:43:WARNING:FS01:Killing WU03
17:56:43:WARNING:FS01:Killing WU03
17:56:44:WARNING:FS01:Killing WU03
17:56:44:WARNING:FS01:Killing WU03
17:56:44:WARNING:FS01:Killing WU03
17:56:44:WARNING:FS01:Killing WU03
17:56:45:WARNING:FS01:Killing WU03
17:56:45:WARNING:FS01:Killing WU03
17:56:45:WARNING:FS01:Killing WU03
17:56:45:WARNING:FS01:Killing WU03
17:56:46:WARNING:FS01:Killing WU03
17:56:46:WARNING:FS01:Killing WU03
17:56:46:WARNING:FS01:Killing WU03
17:56:46:WARNING:FS01:Killing WU03
17:56:47:WARNING:FS01:Killing WU03
17:56:47:WARNING:FS01:Killing WU03
17:56:47:WARNING:FS01:Killing WU03
17:56:47:WARNING:FS01:Killing WU03
17:56:48:WARNING:FS01:Killing WU03
17:56:48:WARNING:FS01:Killing WU03
17:56:48:WARNING:FS01:Killing WU03
17:56:48:WARNING:FS01:Killing WU03
17:56:49:WARNING:FS01:Killing WU03
17:56:49:WARNING:FS01:Killing WU03
17:56:49:WARNING:FS01:Killing WU03
17:56:49:WARNING:FS01:Killing WU03
17:56:50:WARNING:FS01:Killing WU03
17:56:50:WARNING:FS01:Killing WU03
17:56:50:WARNING:FS01:Killing WU03
17:56:50:WARNING:FS01:Killing WU03
17:56:51:WARNING:FS01:Killing WU03
17:56:51:WARNING:FS01:Killing WU03
17:56:51:WARNING:FS01:Killing WU03
17:56:51:WARNING:FS01:Killing WU03
17:56:52:WARNING:FS01:Killing WU03
17:56:52:WARNING:FS01:Killing WU03
17:56:52:WARNING:FS01:Killing WU03
17:56:52:WARNING:FS01:Killing WU03
17:56:53:WARNING:FS01:Killing WU03
17:56:53:WARNING:FS01:Killing WU03
17:56:53:FS01:Unpaused
17:57:10:Removing old file 'configs/config-20140513-235816.xml'
17:57:10:Saving configuration to config.xml
17:57:10:<config>
17:57:10:  <!-- Folding Core -->
17:57:10:  <core-priority v='low'/>
17:57:10:
17:57:10:  <!-- Network -->
17:57:10:  <proxy v=':8080'/>
17:57:10:
17:57:10:  <!-- Slot Control -->
17:57:10:  <power v='full'/>
17:57:10:
17:57:10:  <!-- User Information -->
17:57:10:  <passkey v='********************************'/>
17:57:10:  <team v='224497'/>
17:57:10:  <user v='dmfree88'/>
17:57:10:
17:57:10:  <!-- Folding Slots -->
17:57:10:  <slot id='0' type='CPU'>
17:57:10:    <client-type v='bigadv'/>
17:57:10:    <cpus v='4'/>
17:57:10:    <paused v='true'/>
17:57:10:  </slot>
17:57:10:  <slot id='1' type='GPU'/>
17:57:10:  <slot id='2' type='GPU'/>
17:57:10:  <slot id='3' type='GPU'/>
17:57:10:</config>
17:59:10:WU01:FS02:0x17:Completed 1620000 out of 2000000 steps (81%)
18:04:48:WU01:FS02:0x17:Completed 1640000 out of 2000000 steps (82%)
18:10:36:WU01:FS02:0x17:Completed 1660000 out of 2000000 steps (83%)
18:16:02:WU01:FS02:0x17:Completed 1680000 out of 2000000 steps (84%)
18:21:28:WU01:FS02:0x17:Completed 1700000 out of 2000000 steps (85%)
18:27:08:WU01:FS02:0x17:Completed 1720000 out of 2000000 steps (86%)
18:32:36:WU01:FS02:0x17:Completed 1740000 out of 2000000 steps (87%)
18:38:19:WU01:FS02:0x17:Completed 1760000 out of 2000000 steps (88%)
18:43:47:WU01:FS02:0x17:Completed 1780000 out of 2000000 steps (89%)
18:49:15:WU01:FS02:0x17:Completed 1800000 out of 2000000 steps (90%)
18:54:58:WU01:FS02:0x17:Completed 1820000 out of 2000000 steps (91%)
19:00:26:WU01:FS02:0x17:Completed 1840000 out of 2000000 steps (92%)
19:06:09:WU01:FS02:0x17:Completed 1860000 out of 2000000 steps (93%)
19:11:36:WU01:FS02:0x17:Completed 1880000 out of 2000000 steps (94%)
19:17:03:WU01:FS02:0x17:Completed 1900000 out of 2000000 steps (95%)
19:22:46:WU01:FS02:0x17:Completed 1920000 out of 2000000 steps (96%)
******************************* Date: 2014-05-18 *******************************
19:28:13:WU01:FS02:0x17:Completed 1940000 out of 2000000 steps (97%)
19:33:55:WU01:FS02:0x17:Completed 1960000 out of 2000000 steps (98%)
19:39:21:WU01:FS02:0x17:Completed 1980000 out of 2000000 steps (99%)
19:44:47:WU01:FS02:0x17:Completed 2000000 out of 2000000 steps (100%)
19:44:47:WU02:FS02:Connecting to 171.67.108.201:80
19:44:47:WU02:FS02:Assigned to work server 171.64.65.56
19:44:47:WU02:FS02:Requesting new work unit for slot 02: RUNNING gpu:1:Pitcairn [] from 171.64.65.56
19:44:47:WU02:FS02:Connecting to 171.64.65.56:8080
19:44:47:WU02:FS02:Downloading 4.72MiB
19:44:50:WU02:FS02:Download complete
19:44:51:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9406 run:1037 clone:0 gen:1 core:0x17 unit:0x000000070a3b1e5c533ea4b45b1d440a
19:45:02:WU01:FS02:0x17:Saving result file logfile_01.txt
19:45:02:WU01:FS02:0x17:Saving result file checkpointState.xml
19:45:04:WU01:FS02:0x17:Saving result file checkpt.crc
19:45:04:WU01:FS02:0x17:Saving result file log.txt
19:45:04:WU01:FS02:0x17:Saving result file positions.xtc
19:45:06:WU01:FS02:0x17:Folding@home Core Shutdown: FINISHED_UNIT
19:45:06:WU01:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
19:45:06:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:9406 run:56 clone:1 gen:30 core:0x17 unit:0x0000002e0a3b1e5c533dd672102a3b64
19:45:06:WU01:FS02:Uploading 13.15MiB to 171.64.65.56
19:45:06:WU01:FS02:Connecting to 171.64.65.56:8080
19:45:06:WU02:FS02:Starting
19:45:06:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/KaZ/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 4440 -checkpoint 15 -gpu 1 -gpu-vendor ati
19:45:06:WU02:FS02:Started FahCore on PID 5824
19:45:06:WU02:FS02:Core PID:5996
19:45:06:WU02:FS02:FahCore 0x17 started
19:45:07:WU02:FS02:0x17:*********************** Log Started 2014-05-18T19:45:07Z ***********************
19:45:07:WU02:FS02:0x17:Project: 9406 (Run 1037, Clone 0, Gen 1)
19:45:07:WU02:FS02:0x17:Unit: 0x000000070a3b1e5c533ea4b45b1d440a
19:45:07:WU02:FS02:0x17:CPU: 0x00000000000000000000000000000000
19:45:07:WU02:FS02:0x17:Machine: 2
19:45:07:WU02:FS02:0x17:Reading tar file state.xml
19:45:07:WU02:FS02:0x17:Reading tar file system.xml
19:45:08:WU02:FS02:0x17:Reading tar file integrator.xml
19:45:08:WU02:FS02:0x17:Reading tar file core.xml
19:45:08:WU02:FS02:0x17:Digital signatures verified
19:45:08:WU02:FS02:0x17:Folding@home GPU core17
19:45:08:WU02:FS02:0x17:Version 0.0.52
19:45:12:WU01:FS02:Upload 27.09%
19:45:18:WU01:FS02:Upload 61.78%
19:45:24:WU01:FS02:Upload 92.66%
19:45:38:WU01:FS02:Upload complete
19:45:38:WU01:FS02:Server responded WORK_ACK (400)
19:45:38:WU01:FS02:Final credit estimate, 30226.00 points
19:45:38:WU01:FS02:Cleaning up
cant figure it out at this moment the 270x got stuck at 0.00%.. then i noticed my 7870 was no longer saving at each percent. Last saved percent was 32%.. so i decided to wait before restarting my pc to fix the 270x until after the 7870 was complete with its work unit... so i waited and the 7870 is now stuck at 99.99% and will not complete.. never saved since 32% and the 270x is still "folding" at 0.00%.

you will see in the middle of the log i tried to pause the 270x and it attempted to "kill" it but it was endless attempts and it never paused to i hit rusume in hopes it would start folding.. nothing happened still at 0.00%.. restarting my pc now and I am pretty sure it will just resume at 32% on the 7870 and the 270x will start folding (this has happened before). But id like to pinpoint the issue to avoid it in the future ive wasted hours on 0.00% and 99.99% now multiple times

This keeps happening pretty much everyday after wu are complete i seem to have this issue
Mastermine
Posts: 14
Joined: Tue May 13, 2014 2:42 am

Re: gpu keeps getting stuck at 0 or 99.99 percent

Post by Mastermine »

actually upon further review the 270 that was seemingly saving and working fine.. is now also stuck at 0.00% after submitting its last wu... all 3 gpu now not folding.. 270 and 270x at 0.00% and the 7870 stuck at 99.99%.. log ends at cleaning up no further entries.
Mastermine
Posts: 14
Joined: Tue May 13, 2014 2:42 am

Re: gpu keeps getting stuck at 0 or 99.99 percent

Post by Mastermine »

ok i guess restart didnt fix it this time.. all 3 gpu still stuck.. 270 and 270x stuck at 0.00% and 7870 stuck at 99.99%... first restart attempt failed.. i hit restart desktop dissappeared but then there was a hard freeze before it restart... so I cold booted and got it running again.. same results.. thought maybe it was because of bad restart so i restarted again.. this time it restart fine but its still showing same crap in f@h... i dont know what to do all 3 are frozen now?
Mastermine
Posts: 14
Joined: Tue May 13, 2014 2:42 am

Re: gpu keeps getting stuck at 0 or 99.99 percent

Post by Mastermine »

WOW I dunno wtf the 270 just started running.. 270x and 7870 still stuck tho.. please help?

Code: Select all

*********************** Log Started 2014-05-18T20:52:58Z ***********************
20:52:58:************************* Folding@home Client *************************
20:52:58:      Website: http://folding.stanford.edu/
20:52:58:    Copyright: (c) 2009-2014 Stanford University
20:52:58:       Author: Joseph Coffland <[email protected]>
20:52:58:         Args: --open-web-control
20:52:58:       Config: C:/Users/KaZ/AppData/Roaming/FAHClient/config.xml
20:52:58:******************************** Build ********************************
20:52:58:      Version: 7.4.4
20:52:58:         Date: Mar 4 2014
20:52:58:         Time: 20:26:54
20:52:58:      SVN Rev: 4130
20:52:58:       Branch: fah/trunk/client
20:52:58:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
20:52:58:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
20:52:58:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
20:52:58:     Platform: win32 XP
20:52:58:         Bits: 32
20:52:58:         Mode: Release
20:52:58:******************************* System ********************************
20:52:58:          CPU: AMD FX(tm)-8350 Eight-Core Processor
20:52:58:       CPU ID: AuthenticAMD Family 21 Model 2 Stepping 0
20:52:58:         CPUs: 8
20:52:58:       Memory: 8.00GiB
20:52:58:  Free Memory: 6.72GiB
20:52:58:      Threads: WINDOWS_THREADS
20:52:58:   OS Version: 6.1
20:52:58:  Has Battery: false
20:52:58:   On Battery: false
20:52:58:   UTC Offset: -7
20:52:58:          PID: 4600
20:52:58:          CWD: C:/Users/KaZ/AppData/Roaming/FAHClient
20:52:58:           OS: Windows 7 Professional
20:52:58:      OS Arch: AMD64
20:52:58:         GPUs: 3
20:52:58:        GPU 0: ATI:5 Hawaii [Radeon R9 200 Series]
20:52:58:        GPU 1: ATI:5 Pitcairn []
20:52:58:        GPU 2: ATI:5 Pitcairn [Radeon HD 7800]
20:52:58:         CUDA: Not detected
20:52:58:Win32 Service: false
20:52:58:***********************************************************************
20:52:58:<config>
20:52:58:  <!-- Folding Core -->
20:52:58:  <core-priority v='low'/>
20:52:58:
20:52:58:  <!-- Network -->
20:52:58:  <proxy v=':8080'/>
20:52:58:
20:52:58:  <!-- Slot Control -->
20:52:58:  <power v='full'/>
20:52:58:
20:52:58:  <!-- User Information -->
20:52:58:  <passkey v='********************************'/>
20:52:58:  <team v='224497'/>
20:52:58:  <user v='dmfree88'/>
20:52:58:
20:52:58:  <!-- Folding Slots -->
20:52:58:  <slot id='0' type='CPU'>
20:52:58:    <client-type v='bigadv'/>
20:52:58:    <cpus v='4'/>
20:52:58:    <paused v='true'/>
20:52:58:  </slot>
20:52:58:  <slot id='1' type='GPU'/>
20:52:58:  <slot id='2' type='GPU'/>
20:52:58:  <slot id='3' type='GPU'/>
20:52:58:</config>
20:52:58:Trying to access database...
20:52:58:Successfully acquired database lock
20:52:58:Enabled folding slot 00: PAUSED cpu:4 (by user)
20:52:58:Enabled folding slot 01: READY gpu:0:Hawaii [Radeon R9 200 Series]
20:52:58:Enabled folding slot 02: READY gpu:1:Pitcairn []
20:52:58:Enabled folding slot 03: READY gpu:2:Pitcairn [Radeon HD 7800]
20:52:58:WU03:FS01:Starting
20:52:58:WU03:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/KaZ/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 704 -lifeline 4600 -checkpoint 15 -gpu 0 -gpu-vendor ati
20:52:58:WU03:FS01:Started FahCore on PID 4704
20:52:58:WU03:FS01:Core PID:4720
20:52:58:WU03:FS01:FahCore 0x17 started
20:52:58:WU02:FS02:Starting
20:52:58:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/KaZ/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 4600 -checkpoint 15 -gpu 1 -gpu-vendor ati
20:52:58:WU02:FS02:Started FahCore on PID 4744
20:52:58:WU02:FS02:Core PID:4756
20:52:58:WU02:FS02:FahCore 0x17 started
20:52:58:WU04:FS03:Starting
20:52:58:WU04:FS03:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/KaZ/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/ATI/R600/Core_17.fah/FahCore_17.exe -dir 04 -suffix 01 -version 704 -lifeline 4600 -checkpoint 15 -gpu 2 -gpu-vendor ati
20:52:58:WU04:FS03:Started FahCore on PID 4764
20:52:58:WU04:FS03:Core PID:4776
20:52:58:WU04:FS03:FahCore 0x17 started
20:52:59:WU02:FS02:0x17:*********************** Log Started 2014-05-18T20:52:58Z ***********************
20:52:59:WU02:FS02:0x17:Project: 9406 (Run 1037, Clone 0, Gen 1)
20:52:59:WU02:FS02:0x17:Unit: 0x000000070a3b1e5c533ea4b45b1d440a
20:52:59:WU02:FS02:0x17:CPU: 0x00000000000000000000000000000000
20:52:59:WU02:FS02:0x17:Machine: 2
20:52:59:WU02:FS02:0x17:Reading tar file state.xml
20:52:59:WU04:FS03:0x17:*********************** Log Started 2014-05-18T20:52:58Z ***********************
20:52:59:WU04:FS03:0x17:Project: 9406 (Run 924, Clone 0, Gen 1)
20:52:59:WU04:FS03:0x17:Unit: 0x000000030a3b1e5c533e92369f785cf5
20:52:59:WU04:FS03:0x17:CPU: 0x00000000000000000000000000000000
20:52:59:WU04:FS03:0x17:Machine: 3
20:52:59:WU04:FS03:0x17:Digital signatures verified
20:52:59:WU04:FS03:0x17:Folding@home GPU core17
20:52:59:WU04:FS03:0x17:Version 0.0.52
20:52:59:WU03:FS01:0x17:*********************** Log Started 2014-05-18T20:52:58Z ***********************
20:52:59:WU03:FS01:0x17:Project: 9406 (Run 392, Clone 0, Gen 38)
20:52:59:WU03:FS01:0x17:Unit: 0x000000310a3b1e5c533e11474a722d7e
20:52:59:WU03:FS01:0x17:CPU: 0x00000000000000000000000000000000
20:52:59:WU03:FS01:0x17:Machine: 1
20:52:59:WU03:FS01:0x17:Reading tar file state.xml
20:52:59:WU02:FS02:0x17:Reading tar file system.xml
20:52:59:WU04:FS03:0x17:  Found a checkpoint file
20:53:00:WU03:FS01:0x17:Reading tar file system.xml
20:53:00:WU02:FS02:0x17:Reading tar file integrator.xml
20:53:00:WU02:FS02:0x17:Reading tar file core.xml
20:53:00:WU02:FS02:0x17:Digital signatures verified
20:53:00:WU02:FS02:0x17:Folding@home GPU core17
20:53:00:WU02:FS02:0x17:Version 0.0.52
20:53:00:WU03:FS01:0x17:Reading tar file integrator.xml
20:53:00:WU03:FS01:0x17:Reading tar file core.xml
20:53:00:WU03:FS01:0x17:Digital signatures verified
20:53:00:WU03:FS01:0x17:Folding@home GPU core17
20:53:00:WU03:FS01:0x17:Version 0.0.52
20:53:03:18:127.0.0.1:New Web connection
20:55:35:WU02:FS02:0x17:Completed 0 out of 2000000 steps (0%)
20:55:35:WU02:FS02:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
20:56:33:WU04:FS03:0x17:Completed 600000 out of 2000000 steps (30%)
20:56:33:WU04:FS03:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
20:56:58:WU03:FS01:0x17:Completed 0 out of 2000000 steps (0%)
20:56:58:WU03:FS01:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
Mastermine
Posts: 14
Joined: Tue May 13, 2014 2:42 am

Re: gpu keeps getting stuck at 0 or 99.99 percent

Post by Mastermine »

sorry for the reply blowup but the 270x just got 0.01% and is running extremely slow.. all 3 gpu at 98-99% gpu useage but unbearably slow 270x and 7870 still stuck... will respond if anything changes gonna keep it running a bit...
bollix47
Posts: 2957
Joined: Sun Dec 02, 2007 5:04 am
Location: Canada

Re: gpu keeps getting stuck at 0 or 99.99 percent

Post by bollix47 »

Are you using the latest AMD 14.4 drivers?

Were all GPUs in the computer when you installed the drivers and when you installed folding@home?

If not you may want to completely uninstall folding@home including data, install the 14.4 drivers from AMD, reboot and reinstall folding@home.
Image
Joe_H
Site Admin
Posts: 7926
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: gpu keeps getting stuck at 0 or 99.99 percent

Post by Joe_H »

Looking at your log you are fine up until 12:40:51. Then WU04 just stopped being processed. That is usually a sign that the driver for that card crashed and reset. Check your system logs for that having occurred around that time after making the adjustment from UTC in the folding log to your local time. There may be a similar failure for another GPU, but I stopped looking at that point.

Usual causes for GPU resets are overheating or overclocking. Fix that and you should not run into this problem. A future version of Core_17 may have better recovery from a GPU reset, but nothing has been released yet.

P.S. You should remove the bigadv setting from your CPU slot. Those projects require at least 24 cores/threads and the setting can interfere with getting appropriate assignments.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Mastermine
Posts: 14
Joined: Tue May 13, 2014 2:42 am

Re: gpu keeps getting stuck at 0 or 99.99 percent

Post by Mastermine »

Ok so after a wait I noticed the log showed all 3 gpus working. the status page on both the webbrowser and in advanced control said differently. For some reason it was majorly delayed and eventually has now caught up. I stopped watching after it seemed to be working in the log. So I dont know why it wasnt displaying but after restarting the pc it seemed to fix it. I will check my PC logs later to see if it crashed but i am underclocked on all gpu. 1000/1350 both 270/270x and 1025/1360 on the 7870 hawk. Ill see what the logs reflect for windows.
Mastermine
Posts: 14
Joined: Tue May 13, 2014 2:42 am

Re: gpu keeps getting stuck at 0 or 99.99 percent

Post by Mastermine »

No errors in the log for windows. not sure if this was the issue or not i did have issues with that in the past.. but thats why i downclocked so low to avoid any possibilities of future crashing.. maybe i should go lower on the 7870... i dont know :/ these same gpus are very good overclockers for anything else :/...

Also the 7870 and the 270x are both running pretty low ppd at 48k..
P5-133XL
Posts: 2948
Joined: Sun Dec 02, 2007 4:36 am
Hardware configuration: Machine #1:

Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).

Machine #2:

Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.

Machine 3:

Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32

I am currently folding just on the 5x GTX 460's for aprox. 70K PPD
Location: Salem. OR USA

Re: gpu keeps getting stuck at 0 or 99.99 percent

Post by P5-133XL »

Check your Windows event logs to see if you are getting any video driver errors.
Image
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: gpu keeps getting stuck at 0 or 99.99 percent

Post by PantherX »

Mastermine wrote:...i did have issues with that in the past.. but thats why i downclocked so low to avoid any possibilities of future crashing.. maybe i should go lower on the 7870... i dont know :/ these same gpus are very good overclockers for anything else...
If the system is unstable, then unexpected errors may occur. Here are some pointers:
Are the GPUs running at optimum temperatures?
Is your PSU beefy enough to maintain the 24/7 load?
Did you try using the AMD stock settings?
Is it a motherboard issue?
Can you successfully fold on 1 or 2 GPUs without any issues (either pause the GPU Slot(s) or remove the GPU(s) from your system)?
Is there a hotspot (heat build-up) in your system?

Please note that different applications use different parts of the GPUs in varying amounts so if the overclock is stable for games, rendering, etc, it can be unstable for folding.
Mastermine wrote:...Also the 7870 and the 270x are both running pretty low ppd at 48k..
That usually happens after the driver resets and the GPU is stuck in 2D mode. Since the frequencies are reduced, the folding performance would be impacted in a negative manner (low PPD). Rebooting the system will allow the GPU to function in 3D mode but the long term solution is to eliminate the cause of the driver reset.
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: gpu keeps getting stuck at 0 or 99.99 percent

Post by bruce »

Joe_H wrote:Usual causes for GPU resets are overheating or overclocking. Fix that and you should not run into this problem. A future version of Core_17 may have better recovery from a GPU reset, but nothing has been released yet.
PantherX wrote: Here are some pointers:
Are the GPUs running at optimum temperatures?
Is your PSU beefy enough to maintain the 24/7 load?
Did you try using the AMD stock settings?
Is it a motherboard issue?
Can you successfully fold on 1 or 2 GPUs without any issues (either pause the GPU Slot(s) or remove the GPU(s) from your system)?
Is there a hotspot (heat build-up) in your system?
Let me add one more semi-common cause for GPU-resets. Microsoft's RemoteDesktop and some screensavers disable the GPU drivers and revert to VGA drivers with very limited capabilities, thereby killing FAH when the GPU is reset. You need to avoid those resets at all costs. When the GPU is reset, no more actual folding progress will be computed, but you'll still see messages with the percent increasing, until it gets to 100% without being finished so it appears to hang at 99%. I've been able to PAUSE the GPU and then resume work with a FOLD and resume work from the last checkpoint that was written (which may be many percent earlier). That doesn't exactly match your problem description, though.
Mastermine
Posts: 14
Joined: Tue May 13, 2014 2:42 am

Re: gpu keeps getting stuck at 0 or 99.99 percent

Post by Mastermine »

Gpus running under 55 degrees, PSU is 1300 watts from 2 seperate PSU which have been mining scrypt for months now (hotter + more power consumption). My case has too many fans i dont foresee a hot spot of any kind. I could revert to stock settings but it would be higher clocks then im running now so theres really no reason underclocking should make it worse? My fans are locked in at 80% and I just replaced the thermal paste on cpu + the 7870 yesterday (270x and 270 dont need it yet) problems have happened prior and still seem to happen randomly.

I also have no screensaver or remote desktop setup. Monitors set to never turn off i turn them off by hand.

Everything seems to be working fine now.. all GPU seem to be working. all 3 have submitted a work unit now and continue to go. Hopefully I wake up in the morning without this issue. Seems to happen overnight everytime. Ill post if the problem persists.

I would like to add though i did not change anything just let it run. The 270x is still stuck at 48k ppd but the 7870 is back up at 70k ppd.. No reset nothing it just decided to work fine.. but the 270x is still being sluggish :(.
Post Reply