I am having rampant failures with the newest NVIDIA drivers

It seems that a lot of GPU problems revolve around specific versions of drivers. Though NVidia has their own support structure, you can often learn from information reported by others who fold.

Moderators: Site Moderators, FAHC Science Team

PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: I am having rampant failures with the newest NVIDIA driv

Post by PantherX »

Turbo_T wrote:Correct, the second GPU is failing in all folding operations and the primary does also if the SLI is enabled. iwhen SLI is disabled and the sli connectors are disconnected the primary GPU is able to fold all Cores fine. The second GPU passes all memory and cuda benchmark tests fine but will not fold successfully. The errors quoted above repeat and the unit fails.
Can you please provide us with a fresh log which includes:
1) The initial section which contains the system configuration and F@H settings
2) The errors that is generated by the FahCore

Also, please tell us the driver being used and if the GPU Model is factory overclocked or not?
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Turbo_T
Posts: 26
Joined: Mon Mar 11, 2013 1:46 am

Re: I am having rampant failures with the newest NVIDIA driv

Post by Turbo_T »

I have not been invited nor am I (to my knowledge) running a beta process/flag. I have enclosed the log from my failures today. The computer in question is not overclocked in any way and has been completely stable during folding since my start in 2011. my only recent addition to the system was a second GPU, which has proven to be unable to fold at all. This GPU has been a steady producer since the PC was built(by me).

Code: Select all

*********************** Log Started 2014-03-12T23:29:27Z ***********************
23:29:28:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
23:29:28:WU00:FS00:News: Welcome to Folding@Home
23:29:28:WU00:FS00:Assigned to work server 171.64.65.69
23:29:28:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
23:29:28:WU00:FS00:Connecting to 171.64.65.69:8080
23:29:29:WU00:FS00:Downloading 4.17MiB
23:29:31:WU00:FS00:Download complete
23:29:31:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:198 clone:5 gen:41 core:0x17 unit:0x0000004b028c126651a652ad5cdceb60
23:29:31:WU00:FS00:Starting
23:29:31:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
23:29:31:WU00:FS00:Started FahCore on PID 4056
23:29:32:WU00:FS00:Core PID:5296
23:29:32:WU00:FS00:FahCore 0x17 started
23:29:32:WU00:FS00:0x17:*********************** Log Started 2014-03-12T23:29:32Z ***********************
23:29:32:WU00:FS00:0x17:Project: 8900 (Run 198, Clone 5, Gen 41)
23:29:32:WU00:FS00:0x17:Unit: 0x0000004b028c126651a652ad5cdceb60
23:29:32:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:29:32:WU00:FS00:0x17:Machine: 0
23:29:32:WU00:FS00:0x17:Reading tar file state.xml
23:29:33:WU00:FS00:0x17:Reading tar file system.xml
23:29:33:WU00:FS00:0x17:Reading tar file integrator.xml
23:29:33:WU00:FS00:0x17:Reading tar file core.xml
23:29:33:WU00:FS00:0x17:Digital signatures verified
23:29:33:WU00:FS00:0x17:Folding@home GPU core17
23:29:33:WU00:FS00:0x17:Version 0.0.52
23:33:00:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
23:33:00:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
23:53:40:WU00:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
23:53:40:WU00:FS00:0x17:Saving result file logfile_01.txt
23:53:40:WU00:FS00:0x17:Saving result file log.txt
23:53:40:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:53:40:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:53:41:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:198 clone:5 gen:41 core:0x17 unit:0x0000004b028c126651a652ad5cdceb60
23:53:41:WU00:FS00:Uploading 2.47KiB to 171.64.65.69
23:53:41:WU00:FS00:Connecting to 171.64.65.69:8080
23:53:41:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
23:53:41:WU00:FS00:Upload complete
23:53:41:WU00:FS00:Server responded WORK_ACK (400)
23:53:41:WU00:FS00:Cleaning up
23:53:42:WU02:FS00:News: Welcome to Folding@Home
23:53:42:WU02:FS00:Assigned to work server 171.64.65.69
23:53:42:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
23:53:42:WU02:FS00:Connecting to 171.64.65.69:8080
23:53:42:WU02:FS00:Downloading 4.17MiB
23:53:45:WU02:FS00:Download complete
23:53:45:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:449 clone:10 gen:25 core:0x17 unit:0x00000023028c126652b4e6e108ddee21
23:53:45:WU02:FS00:Starting
23:53:45:WU02:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 02 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
23:53:45:WU02:FS00:Started FahCore on PID 4192
23:53:45:WU02:FS00:Core PID:6880
23:53:45:WU02:FS00:FahCore 0x17 started
23:53:45:WU02:FS00:0x17:*********************** Log Started 2014-03-12T23:53:45Z ***********************
23:53:45:WU02:FS00:0x17:Project: 8900 (Run 449, Clone 10, Gen 25)
23:53:45:WU02:FS00:0x17:Unit: 0x00000023028c126652b4e6e108ddee21
23:53:45:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:53:45:WU02:FS00:0x17:Machine: 0
23:53:45:WU02:FS00:0x17:Reading tar file state.xml
23:53:46:WU02:FS00:0x17:Reading tar file system.xml
23:53:47:WU02:FS00:0x17:Reading tar file integrator.xml
23:53:47:WU02:FS00:0x17:Reading tar file core.xml
23:53:47:WU02:FS00:0x17:Digital signatures verified
23:53:47:WU02:FS00:0x17:Folding@home GPU core17
23:53:47:WU02:FS00:0x17:Version 0.0.52
23:57:16:WU02:FS00:0x17:Completed 0 out of 2500000 steps (0%)
23:57:16:WU02:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:17:59:WU02:FS00:0x17:Completed 25000 out of 2500000 steps (1%)
00:20:10:WU02:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
00:20:10:WU02:FS00:0x17:Saving result file logfile_01.txt
00:20:10:WU02:FS00:0x17:Saving result file log.txt
00:20:10:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
00:20:10:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:20:10:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:449 clone:10 gen:25 core:0x17 unit:0x00000023028c126652b4e6e108ddee21
00:20:10:WU02:FS00:Uploading 2.50KiB to 171.64.65.69
00:20:10:WU02:FS00:Connecting to 171.64.65.69:8080
00:20:10:WU02:FS00:Upload complete
00:20:10:WU02:FS00:Server responded WORK_ACK (400)
00:20:10:WU02:FS00:Cleaning up
00:20:10:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
00:20:11:WU00:FS00:News: Welcome to Folding@Home
00:20:11:WU00:FS00:Assigned to work server 171.64.65.69
00:20:11:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
00:20:11:WU00:FS00:Connecting to 171.64.65.69:8080
00:20:11:WU00:FS00:Downloading 4.17MiB
00:20:14:WU00:FS00:Download complete
00:20:14:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:861 clone:8 gen:25 core:0x17 unit:0x00000030028c126651a6e657e0fa077a
00:20:14:WU00:FS00:Starting
00:20:14:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
00:20:14:WU00:FS00:Started FahCore on PID 5148
00:20:14:WU00:FS00:Core PID:7016
00:20:14:WU00:FS00:FahCore 0x17 started
00:20:15:WU00:FS00:0x17:*********************** Log Started 2014-03-13T00:20:14Z ***********************
00:20:15:WU00:FS00:0x17:Project: 8900 (Run 861, Clone 8, Gen 25)
00:20:15:WU00:FS00:0x17:Unit: 0x00000030028c126651a6e657e0fa077a
00:20:15:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
00:20:15:WU00:FS00:0x17:Machine: 0
00:20:15:WU00:FS00:0x17:Reading tar file state.xml
00:20:15:WU00:FS00:0x17:Reading tar file system.xml
00:20:16:WU00:FS00:0x17:Reading tar file integrator.xml
00:20:16:WU00:FS00:0x17:Reading tar file core.xml
00:20:16:WU00:FS00:0x17:Digital signatures verified
00:20:16:WU00:FS00:0x17:Folding@home GPU core17
00:20:16:WU00:FS00:0x17:Version 0.0.52
00:23:44:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
00:23:44:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:43:21:WU00:FS00:0x17:ERROR:exception: First periodic box vector must be parallel to x.
00:43:21:WU00:FS00:0x17:Saving result file logfile_01.txt
00:43:21:WU00:FS00:0x17:Saving result file log.txt
00:43:21:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
00:43:21:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:43:21:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:861 clone:8 gen:25 core:0x17 unit:0x00000030028c126651a6e657e0fa077a
00:43:21:WU00:FS00:Uploading 2.45KiB to 171.64.65.69
00:43:21:WU00:FS00:Connecting to 171.64.65.69:8080
00:43:21:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
00:43:22:WU00:FS00:Upload complete
00:43:22:WU00:FS00:Server responded WORK_ACK (400)
00:43:22:WU00:FS00:Cleaning up
00:43:22:WU02:FS00:News: Welcome to Folding@Home
00:43:22:WU02:FS00:Assigned to work server 171.64.65.69
00:43:22:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
00:43:22:WU02:FS00:Connecting to 171.64.65.69:8080
00:43:23:WU02:FS00:Downloading 4.18MiB
00:43:25:WU02:FS00:Download complete
00:43:26:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:302 clone:7 gen:38 core:0x17 unit:0x00000044028c126651a669eb7f0aed05
00:43:26:WU02:FS00:Starting
00:43:26:WU02:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 02 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
00:43:26:WU02:FS00:Started FahCore on PID 3876
00:43:26:WU02:FS00:Core PID:1108
00:43:26:WU02:FS00:FahCore 0x17 started
00:43:26:WU02:FS00:0x17:*********************** Log Started 2014-03-13T00:43:26Z ***********************
00:43:26:WU02:FS00:0x17:Project: 8900 (Run 302, Clone 7, Gen 38)
00:43:26:WU02:FS00:0x17:Unit: 0x00000044028c126651a669eb7f0aed05
00:43:26:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
00:43:26:WU02:FS00:0x17:Machine: 0
00:43:26:WU02:FS00:0x17:Reading tar file state.xml
00:43:27:WU02:FS00:0x17:Reading tar file system.xml
00:43:28:WU02:FS00:0x17:Reading tar file integrator.xml
00:43:28:WU02:FS00:0x17:Reading tar file core.xml
00:43:28:WU02:FS00:0x17:Digital signatures verified
00:43:28:WU02:FS00:0x17:Folding@home GPU core17
00:43:28:WU02:FS00:0x17:Version 0.0.52
00:46:55:WU02:FS00:0x17:Completed 0 out of 2500000 steps (0%)
00:46:55:WU02:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:02:26:WU02:FS00:0x17:ERROR:exception: First periodic box vector must be parallel to x.
01:02:26:WU02:FS00:0x17:Saving result file logfile_01.txt
01:02:26:WU02:FS00:0x17:Saving result file log.txt
01:02:26:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
01:02:26:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
01:02:26:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:302 clone:7 gen:38 core:0x17 unit:0x00000044028c126651a669eb7f0aed05
01:02:26:WU02:FS00:Uploading 2.45KiB to 171.64.65.69
01:02:26:WU02:FS00:Connecting to 171.64.65.69:8080
01:02:27:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
01:02:27:WU02:FS00:Upload complete
01:02:27:WU02:FS00:Server responded WORK_ACK (400)
01:02:27:WU02:FS00:Cleaning up
01:02:27:WU00:FS00:News: Welcome to Folding@Home
01:02:27:WU00:FS00:Assigned to work server 171.64.65.69
01:02:27:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
01:02:27:WU00:FS00:Connecting to 171.64.65.69:8080
01:02:28:WU00:FS00:Downloading 4.18MiB
01:02:30:WU00:FS00:Download complete
01:02:31:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:220 clone:7 gen:24 core:0x17 unit:0x0000002d028c126651a6579eea91b6fa
01:02:31:WU00:FS00:Starting
01:02:31:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
01:02:31:WU00:FS00:Started FahCore on PID 4068
01:02:31:WU00:FS00:Core PID:6876
01:02:31:WU00:FS00:FahCore 0x17 started
01:02:31:WU00:FS00:0x17:*********************** Log Started 2014-03-13T01:02:31Z ***********************
01:02:31:WU00:FS00:0x17:Project: 8900 (Run 220, Clone 7, Gen 24)
01:02:31:WU00:FS00:0x17:Unit: 0x0000002d028c126651a6579eea91b6fa
01:02:31:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
01:02:31:WU00:FS00:0x17:Machine: 0
01:02:31:WU00:FS00:0x17:Reading tar file state.xml
01:02:32:WU00:FS00:0x17:Reading tar file system.xml
01:02:33:WU00:FS00:0x17:Reading tar file integrator.xml
01:02:33:WU00:FS00:0x17:Reading tar file core.xml
01:02:33:WU00:FS00:0x17:Digital signatures verified
01:02:33:WU00:FS00:0x17:Folding@home GPU core17
01:02:33:WU00:FS00:0x17:Version 0.0.52
01:06:01:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
01:06:01:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:26:40:WU00:FS00:0x17:Completed 25000 out of 2500000 steps (1%)
01:29:00:WU00:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
01:29:00:WU00:FS00:0x17:Saving result file logfile_01.txt
01:29:01:WU00:FS00:0x17:Saving result file log.txt
01:29:01:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
01:29:01:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
01:29:01:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:220 clone:7 gen:24 core:0x17 unit:0x0000002d028c126651a6579eea91b6fa
01:29:01:WU00:FS00:Uploading 2.48KiB to 171.64.65.69
01:29:01:WU00:FS00:Connecting to 171.64.65.69:8080
01:29:01:WU00:FS00:Upload complete
01:29:01:WU00:FS00:Server responded WORK_ACK (400)
01:29:01:WU00:FS00:Cleaning up
03:16:31:FS00:Finishing
03:16:41:FS00:Paused
03:16:45:FS00:Unpaused
03:16:45:FS00:Finishing
Mod edit: Added code tags to log file
P5-133XL
Posts: 2948
Joined: Sun Dec 02, 2007 4:36 am
Hardware configuration: Machine #1:

Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).

Machine #2:

Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.

Machine 3:

Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32

I am currently folding just on the 5x GTX 460's for aprox. 70K PPD
Location: Salem. OR USA

Re: I am having rampant failures with the newest NVIDIA driv

Post by P5-133XL »

PantherX wrote: Can you please provide us with a fresh log which includes:
1) The initial section which contains the system configuration and F@H settings
2) The errors that is generated by the FahCore

Also, please tell us the driver being used and if the GPU Model is factory overclocked or not?
If necessary, click the refresh button before copy/Paste.
Image
Turbo_T
Posts: 26
Joined: Mon Mar 11, 2013 1:46 am

Re: I am having rampant failures with the newest NVIDIA driv

Post by Turbo_T »

I am using the recommended drivers 327.23. The latest log is below. I have disabled the secondary GPU and been able to fold all day on the CPU and Primary GPU it appears.

Code: Select all

*********************** Log Started 2014-03-12T23:29:27Z ***********************
23:29:27:************************* Folding@home Client *************************
23:29:27:      Website: http://folding.stanford.edu/
23:29:27:    Copyright: (c) 2009-2013 Stanford University
23:29:27:       Author: Joseph Coffland <[email protected]>
23:29:27:         Args: --open-web-control
23:29:27:       Config: E:/Stanford FAH/config.xml
23:29:27:******************************** Build ********************************
23:29:27:      Version: 7.3.6
23:29:27:         Date: Feb 18 2013
23:29:27:         Time: 15:25:17
23:29:27:      SVN Rev: 3923
23:29:27:       Branch: fah/trunk/client
23:29:27:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
23:29:27:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
23:29:27:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
23:29:27:     Platform: win32 XP
23:29:27:         Bits: 32
23:29:27:         Mode: Release
23:29:27:******************************* System ********************************
23:29:27:          CPU: Intel(R) Core(TM) i7 CPU X 980 @ 3.33GHz
23:29:27:       CPU ID: GenuineIntel Family 6 Model 44 Stepping 2
23:29:27:         CPUs: 12
23:29:27:       Memory: 11.99GiB
23:29:27:  Free Memory: 9.81GiB
23:29:27:      Threads: WINDOWS_THREADS
23:29:27:  Has Battery: false
23:29:27:   On Battery: false
23:29:27:   UTC offset: -4
23:29:27:          PID: 4444
23:29:27:          CWD: E:/Stanford FAH
23:29:27:           OS: Windows 7 Professional
23:29:27:      OS Arch: AMD64
23:29:27:         GPUs: 2
23:29:27:        GPU 0: NVIDIA:2 GF100 [GeForce GTX 480]
23:29:27:        GPU 1: NVIDIA:2 GF100 [GeForce GTX 480]
23:29:27:         CUDA: 2.0
23:29:27:  CUDA Driver: 5050
23:29:27:Win32 Service: false
23:29:27:***********************************************************************
23:29:27:<config>
23:29:27:  <service-description v='Folding@home Client'/>
23:29:27:  <service-restart v='true'/>
23:29:27:  <service-restart-delay v='5000'/>
23:29:27:
23:29:27:  <!-- Client Control -->
23:29:27:  <client-threads v='4'/>
23:29:27:  <cycle-rate v='4'/>
23:29:27:  <cycles v='-1'/>
23:29:27:  <data-directory v='.'/>
23:29:27:  <disable-sleep-when-active v='true'/>
23:29:27:  <exec-directory v='E:\Stanford FAH\FAHClient'/>
23:29:27:  <exit-when-done v='false'/>
23:29:27:  <fold-anon v='false'/>
23:29:27:  <open-web-control v='true'/>
23:29:27:
23:29:27:  <!-- Configuration -->
23:29:27:  <config-rotate v='true'/>
23:29:27:  <config-rotate-dir v='configs'/>
23:29:27:  <config-rotate-max v='16'/>
23:29:27:
23:29:27:  <!-- Debugging -->
23:29:27:  <assignment-servers>
23:29:27:    assign3.stanford.edu:8080 assign4.stanford.edu:80
23:29:27:  </assignment-servers>
23:29:27:  <capture-directory v='capture'/>
23:29:27:  <capture-on-error v='false'/>
23:29:27:  <capture-packets v='false'/>
23:29:27:  <capture-requests v='false'/>
23:29:27:  <capture-responses v='false'/>
23:29:27:  <capture-sockets v='false'/>
23:29:27:  <debug-sockets v='false'/>
23:29:27:  <exception-locations v='true'/>
23:29:27:  <gpu-assignment-servers>
23:29:27:    assign-GPU.stanford.edu:80 assign-GPU.stanford.edu:8080
23:29:27:  </gpu-assignment-servers>
23:29:27:  <stack-traces v='false'/>
23:29:27:
23:29:27:  <!-- Error Handling -->
23:29:27:  <max-slot-errors v='5'/>
23:29:27:  <max-unit-errors v='5'/>
23:29:27:
23:29:27:  <!-- Folding Core -->
23:29:27:  <checkpoint v='3'/>
23:29:27:  <core-dir v='cores'/>
23:29:27:  <core-priority v='idle'/>
23:29:27:  <cpu-affinity v='false'/>
23:29:27:  <cpu-usage v='100'/>
23:29:27:  <gpu-usage v='100'/>
23:29:27:  <no-assembly v='false'/>
23:29:27:
23:29:27:  <!-- Folding Slot Configuration -->
23:29:27:  <cause v='ANY'/>
23:29:27:  <client-subtype v='STDCLI'/>
23:29:27:  <client-type v='normal'/>
23:29:27:  <cpu-species v='X86_PENTIUM_II'/>
23:29:27:  <cpu-type v='AMD64'/>
23:29:27:  <cpus v='-1'/>
23:29:27:  <cuda-index v='0'/>
23:29:27:  <gpu v='true'/>
23:29:27:  <max-packet-size v='normal'/>
23:29:27:  <opencl-index v='0'/>
23:29:27:  <os-species v='UNKNOWN'/>
23:29:27:  <os-type v='WIN32'/>
23:29:27:  <power v='full'/>
23:29:27:  <project-key v='0'/>
23:29:27:  <smp v='true'/>
23:29:27:
23:29:27:  <!-- HTTP Server -->
23:29:27:  <allow v='127.0.0.1 192.168.1.100/25'/>
23:29:27:  <connection-timeout v='60'/>
23:29:27:  <deny v='0/0'/>
23:29:27:  <http-addresses v='0:7396'/>
23:29:27:  <https-addresses v=''/>
23:29:27:  <max-connect-time v='900'/>
23:29:27:  <max-connections v='800'/>
23:29:27:  <max-request-length v='52428800'/>
23:29:27:  <min-connect-time v='300'/>
23:29:27:  <threads v='12'/>
23:29:27:
23:29:27:  <!-- Logging -->
23:29:27:  <log v='log.txt'/>
23:29:27:  <log-color v='false'/>
23:29:27:  <log-crlf v='true'/>
23:29:27:  <log-date v='false'/>
23:29:27:  <log-date-periodically v='21600'/>
23:29:27:  <log-debug v='true'/>
23:29:27:  <log-domain v='false'/>
23:29:27:  <log-header v='true'/>
23:29:27:  <log-level v='true'/>
23:29:27:  <log-no-info-header v='true'/>
23:29:27:  <log-redirect v='false'/>
23:29:27:  <log-rotate v='true'/>
23:29:27:  <log-rotate-dir v='logs'/>
23:29:27:  <log-rotate-max v='16'/>
23:29:27:  <log-short-level v='false'/>
23:29:27:  <log-simple-domains v='true'/>
23:29:27:  <log-thread-id v='false'/>
23:29:27:  <log-thread-prefix v='true'/>
23:29:27:  <log-time v='true'/>
23:29:27:  <log-to-screen v='true'/>
23:29:27:  <log-truncate v='false'/>
23:29:27:  <verbosity v='4'/>
23:29:27:
23:29:27:  <!-- Network -->
23:29:27:  <proxy v=':8080'/>
23:29:27:  <proxy-enable v='false'/>
23:29:27:  <proxy-pass v=''/>
23:29:27:  <proxy-user v=''/>
23:29:27:
23:29:27:  <!-- Process Control -->
23:29:27:  <child v='false'/>
23:29:27:  <daemon v='false'/>
23:29:27:  <pid v='false'/>
23:29:27:  <pid-file v='Folding@home Client.pid'/>
23:29:27:  <respawn v='false'/>
23:29:27:  <service v='false'/>
23:29:27:
23:29:27:  <!-- Remote Command Server -->
23:29:27:  <command-address v='0.0.0.0'/>
23:29:27:  <command-allow-no-pass v='127.0.0.1 192.168.1.100/25'/>
23:29:27:  <command-deny-no-pass v='0/0'/>
23:29:27:  <command-port v='36330'/>
23:29:27:  <password v=''/>
23:29:27:
23:29:27:  <!-- Slot Control -->
23:29:27:  <idle v='false'/>
23:29:27:  <max-shutdown-wait v='60'/>
23:29:27:  <pause-on-battery v='false'/>
23:29:27:  <pause-on-start v='false'/>
23:29:27:
23:29:27:  <!-- User Information -->
23:29:27:  <machine-id v='0'/>
23:29:27:  <passkey v='********************************'/>
23:29:27:  <team v='111065'/>
23:29:27:  <user v='Turbo_T'/>
23:29:27:
23:29:27:  <!-- Web Server -->
23:29:27:  <session-timeout v='3600'/>
23:29:27:  <web-allow v='127.0.0.1'/>
23:29:27:  <web-deny v='0/0'/>
23:29:27:
23:29:27:  <!-- Work Unit Control -->
23:29:27:  <dump-after-deadline v='true'/>
23:29:27:  <max-queue v='16'/>
23:29:27:  <max-units v='0'/>
23:29:27:  <next-unit-percentage v='99'/>
23:29:27:
23:29:27:  <!-- Folding Slots -->
23:29:27:  <slot id='2' type='CPU'>
23:29:27:    <cpus v='10'/>
23:29:27:  </slot>
23:29:27:  <slot id='0' type='GPU'/>
23:29:27:</config>
23:29:27:Trying to access database...
23:29:27:Successfully acquired database lock
23:29:27:Enabled folding slot 02: READY cpu:10
23:29:27:Enabled folding slot 00: READY gpu:0:GF100 [GeForce GTX 480]
23:29:27:WU01:FS02:Starting
23:29:27:WU01:FS02:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe" -dir 01 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -np 10
23:29:27:WU01:FS02:Started FahCore on PID 7080
23:29:27:WU01:FS02:Core PID:2592
23:29:27:WU01:FS02:FahCore 0xa3 started
23:29:28:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
23:29:28:1:127.0.0.1 GET /ping?_=1394666968358&callback=jQuery19009469368797726929_1394666968357
23:29:28:WU01:FS02:0xa3:
23:29:28:WU01:FS02:0xa3:*------------------------------*
23:29:28:WU01:FS02:0xa3:Folding@Home Gromacs SMP Core
23:29:28:WU01:FS02:0xa3:Version 2.27 (Dec. 15, 2010)
23:29:28:WU01:FS02:0xa3:
23:29:28:WU01:FS02:0xa3:Preparing to commence simulation
23:29:28:WU01:FS02:0xa3:- Looking at optimizations...
23:29:28:WU01:FS02:0xa3:- Files status OK
23:29:28:WU00:FS00:News: Welcome to Folding@Home
23:29:28:WU00:FS00:Assigned to work server 171.64.65.69
23:29:28:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
23:29:28:WU00:FS00:Connecting to 171.64.65.69:8080
23:29:28:2:127.0.0.1 GET /?nocache=0.802401150809601
23:29:29:WU01:FS02:0xa3:- Expanded 3848665 -> 4392432 (decompressed 114.1 percent)
23:29:29:WU01:FS02:0xa3:Called DecompressByteArray: compressed_data_size=3848665 data_size=4392432, decompressed_data_size=4392432 diff=0
23:29:29:WU01:FS02:0xa3:- Digital signature verified
23:29:29:WU01:FS02:0xa3:
23:29:29:WU01:FS02:0xa3:Project: 8581 (Run 0, Clone 2, Gen 473)
23:29:29:WU01:FS02:0xa3:
23:29:29:WU01:FS02:0xa3:Assembly optimizations on if available.
23:29:29:WU01:FS02:0xa3:Entering M.D.
23:29:29:WU00:FS00:Downloading 4.17MiB
23:29:29:3:127.0.0.1 GET /js/main.js?nocache=0.11671217205002904
23:29:29:3:127.0.0.1:New Web connection
23:29:29:4:127.0.0.1 GET /css/style.css?nocache=0.6547354967333376
23:29:30:5:127.0.0.1 GET /api/updates/set?sid=0xc41c3813eea1ba24b5e64715a8a294ae&update_id=0&update_path=/api/basic&update_rate=1
23:29:30:6:127.0.0.1 GET /api/updates/set?sid=0xc41c3813eea1ba24b5e64715a8a294ae&update_id=1&update_path=/api/slots&update_rate=1
23:29:30:7:127.0.0.1 GET /api/configured?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:30:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:30:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:31:WU00:FS00:Download complete
23:29:31:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:198 clone:5 gen:41 core:0x17 unit:0x0000004b028c126651a652ad5cdceb60
23:29:31:WU00:FS00:Starting
23:29:31:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
23:29:31:WU00:FS00:Started FahCore on PID 4056
23:29:32:WU00:FS00:Core PID:5296
23:29:32:WU00:FS00:FahCore 0x17 started
23:29:32:WU00:FS00:0x17:*********************** Log Started 2014-03-12T23:29:32Z ***********************
23:29:32:WU00:FS00:0x17:Project: 8900 (Run 198, Clone 5, Gen 41)
23:29:32:WU00:FS00:0x17:Unit: 0x0000004b028c126651a652ad5cdceb60
23:29:32:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:29:32:WU00:FS00:0x17:Machine: 0
23:29:32:WU00:FS00:0x17:Reading tar file state.xml
23:29:33:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:33:WU00:FS00:0x17:Reading tar file system.xml
23:29:33:WU00:FS00:0x17:Reading tar file integrator.xml
23:29:33:WU00:FS00:0x17:Reading tar file core.xml
23:29:33:WU00:FS00:0x17:Digital signatures verified
23:29:33:WU00:FS00:0x17:Folding@home GPU core17
23:29:33:WU00:FS00:0x17:Version 0.0.52
23:29:34:WU01:FS02:0xa3:Using Gromacs checkpoints
23:29:35:WU01:FS02:0xa3:Mapping NT from 10 to 10 
23:29:35:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:37:WU01:FS02:0xa3:Resuming from checkpoint
23:29:37:WU01:FS02:0xa3:Verified 01/wudata_01.log
23:29:37:WU01:FS02:0xa3:Verified 01/wudata_01.trr
23:29:37:WU01:FS02:0xa3:Verified 01/wudata_01.edr
23:29:38:WU01:FS02:0xa3:Completed 240595 out of 500000 steps  (48%)
23:29:40:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:44:WARNING:Exception: 8:127.0.0.1: Send error: 10053: An established connection was aborted by the software in your host machine.
23:33:00:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
23:33:00:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
23:37:27:WU01:FS02:0xa3:Completed 245000 out of 500000 steps  (49%)
23:46:13:WU01:FS02:0xa3:Completed 250000 out of 500000 steps  (50%)
23:53:40:WU00:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
23:53:40:WU00:FS00:0x17:Saving result file logfile_01.txt
23:53:40:WU00:FS00:0x17:Saving result file log.txt
23:53:40:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:53:40:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:53:41:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:198 clone:5 gen:41 core:0x17 unit:0x0000004b028c126651a652ad5cdceb60
23:53:41:WU00:FS00:Uploading 2.47KiB to 171.64.65.69
23:53:41:WU00:FS00:Connecting to 171.64.65.69:8080
23:53:41:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
23:53:41:WU00:FS00:Upload complete
23:53:41:WU00:FS00:Server responded WORK_ACK (400)
23:53:41:WU00:FS00:Cleaning up
23:53:42:WU02:FS00:News: Welcome to Folding@Home
23:53:42:WU02:FS00:Assigned to work server 171.64.65.69
23:53:42:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
23:53:42:WU02:FS00:Connecting to 171.64.65.69:8080
23:53:42:WU02:FS00:Downloading 4.17MiB
23:53:45:WU02:FS00:Download complete
23:53:45:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:449 clone:10 gen:25 core:0x17 unit:0x00000023028c126652b4e6e108ddee21
23:53:45:WU02:FS00:Starting
23:53:45:WU02:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 02 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
23:53:45:WU02:FS00:Started FahCore on PID 4192
23:53:45:WU02:FS00:Core PID:6880
23:53:45:WU02:FS00:FahCore 0x17 started
23:53:45:WU02:FS00:0x17:*********************** Log Started 2014-03-12T23:53:45Z ***********************
23:53:45:WU02:FS00:0x17:Project: 8900 (Run 449, Clone 10, Gen 25)
23:53:45:WU02:FS00:0x17:Unit: 0x00000023028c126652b4e6e108ddee21
23:53:45:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:53:45:WU02:FS00:0x17:Machine: 0
23:53:45:WU02:FS00:0x17:Reading tar file state.xml
23:53:46:WU02:FS00:0x17:Reading tar file system.xml
23:53:47:WU02:FS00:0x17:Reading tar file integrator.xml
23:53:47:WU02:FS00:0x17:Reading tar file core.xml
23:53:47:WU02:FS00:0x17:Digital signatures verified
23:53:47:WU02:FS00:0x17:Folding@home GPU core17
23:53:47:WU02:FS00:0x17:Version 0.0.52
23:55:02:WU01:FS02:0xa3:Completed 255000 out of 500000 steps  (51%)
23:57:16:WU02:FS00:0x17:Completed 0 out of 2500000 steps (0%)
23:57:16:WU02:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:03:50:WU01:FS02:0xa3:Completed 260000 out of 500000 steps  (52%)
00:12:36:WU01:FS02:0xa3:Completed 265000 out of 500000 steps  (53%)
00:17:59:WU02:FS00:0x17:Completed 25000 out of 2500000 steps (1%)
00:20:10:WU02:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
00:20:10:WU02:FS00:0x17:Saving result file logfile_01.txt
00:20:10:WU02:FS00:0x17:Saving result file log.txt
00:20:10:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
00:20:10:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:20:10:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:449 clone:10 gen:25 core:0x17 unit:0x00000023028c126652b4e6e108ddee21
00:20:10:WU02:FS00:Uploading 2.50KiB to 171.64.65.69
00:20:10:WU02:FS00:Connecting to 171.64.65.69:8080
00:20:10:WU02:FS00:Upload complete
00:20:10:WU02:FS00:Server responded WORK_ACK (400)
00:20:10:WU02:FS00:Cleaning up
00:20:10:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
00:20:11:WU00:FS00:News: Welcome to Folding@Home
00:20:11:WU00:FS00:Assigned to work server 171.64.65.69
00:20:11:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
00:20:11:WU00:FS00:Connecting to 171.64.65.69:8080
00:20:11:WU00:FS00:Downloading 4.17MiB
00:20:14:WU00:FS00:Download complete
00:20:14:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:861 clone:8 gen:25 core:0x17 unit:0x00000030028c126651a6e657e0fa077a
00:20:14:WU00:FS00:Starting
00:20:14:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
00:20:14:WU00:FS00:Started FahCore on PID 5148
00:20:14:WU00:FS00:Core PID:7016
00:20:14:WU00:FS00:FahCore 0x17 started
00:20:15:WU00:FS00:0x17:*********************** Log Started 2014-03-13T00:20:14Z ***********************
00:20:15:WU00:FS00:0x17:Project: 8900 (Run 861, Clone 8, Gen 25)
00:20:15:WU00:FS00:0x17:Unit: 0x00000030028c126651a6e657e0fa077a
00:20:15:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
00:20:15:WU00:FS00:0x17:Machine: 0
00:20:15:WU00:FS00:0x17:Reading tar file state.xml
00:20:15:WU00:FS00:0x17:Reading tar file system.xml
00:20:16:WU00:FS00:0x17:Reading tar file integrator.xml
00:20:16:WU00:FS00:0x17:Reading tar file core.xml
00:20:16:WU00:FS00:0x17:Digital signatures verified
00:20:16:WU00:FS00:0x17:Folding@home GPU core17
00:20:16:WU00:FS00:0x17:Version 0.0.52
00:21:24:WU01:FS02:0xa3:Completed 270000 out of 500000 steps  (54%)
00:23:44:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
00:23:44:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:30:12:WU01:FS02:0xa3:Completed 275000 out of 500000 steps  (55%)
00:38:59:WU01:FS02:0xa3:Completed 280000 out of 500000 steps  (56%)
00:43:21:WU00:FS00:0x17:ERROR:exception: First periodic box vector must be parallel to x.
00:43:21:WU00:FS00:0x17:Saving result file logfile_01.txt
00:43:21:WU00:FS00:0x17:Saving result file log.txt
00:43:21:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
00:43:21:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:43:21:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:861 clone:8 gen:25 core:0x17 unit:0x00000030028c126651a6e657e0fa077a
00:43:21:WU00:FS00:Uploading 2.45KiB to 171.64.65.69
00:43:21:WU00:FS00:Connecting to 171.64.65.69:8080
00:43:21:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
00:43:22:WU00:FS00:Upload complete
00:43:22:WU00:FS00:Server responded WORK_ACK (400)
00:43:22:WU00:FS00:Cleaning up
00:43:22:WU02:FS00:News: Welcome to Folding@Home
00:43:22:WU02:FS00:Assigned to work server 171.64.65.69
00:43:22:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
00:43:22:WU02:FS00:Connecting to 171.64.65.69:8080
00:43:23:WU02:FS00:Downloading 4.18MiB
00:43:25:WU02:FS00:Download complete
00:43:26:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:302 clone:7 gen:38 core:0x17 unit:0x00000044028c126651a669eb7f0aed05
00:43:26:WU02:FS00:Starting
00:43:26:WU02:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 02 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
00:43:26:WU02:FS00:Started FahCore on PID 3876
00:43:26:WU02:FS00:Core PID:1108
00:43:26:WU02:FS00:FahCore 0x17 started
00:43:26:WU02:FS00:0x17:*********************** Log Started 2014-03-13T00:43:26Z ***********************
00:43:26:WU02:FS00:0x17:Project: 8900 (Run 302, Clone 7, Gen 38)
00:43:26:WU02:FS00:0x17:Unit: 0x00000044028c126651a669eb7f0aed05
00:43:26:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
00:43:26:WU02:FS00:0x17:Machine: 0
00:43:26:WU02:FS00:0x17:Reading tar file state.xml
00:43:27:WU02:FS00:0x17:Reading tar file system.xml
00:43:28:WU02:FS00:0x17:Reading tar file integrator.xml
00:43:28:WU02:FS00:0x17:Reading tar file core.xml
00:43:28:WU02:FS00:0x17:Digital signatures verified
00:43:28:WU02:FS00:0x17:Folding@home GPU core17
00:43:28:WU02:FS00:0x17:Version 0.0.52
00:46:55:WU02:FS00:0x17:Completed 0 out of 2500000 steps (0%)
00:46:55:WU02:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:47:50:WU01:FS02:0xa3:Completed 285000 out of 500000 steps  (57%)
00:56:36:WU01:FS02:0xa3:Completed 290000 out of 500000 steps  (58%)
01:02:26:WU02:FS00:0x17:ERROR:exception: First periodic box vector must be parallel to x.
01:02:26:WU02:FS00:0x17:Saving result file logfile_01.txt
01:02:26:WU02:FS00:0x17:Saving result file log.txt
01:02:26:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
01:02:26:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
01:02:26:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:302 clone:7 gen:38 core:0x17 unit:0x00000044028c126651a669eb7f0aed05
01:02:26:WU02:FS00:Uploading 2.45KiB to 171.64.65.69
01:02:26:WU02:FS00:Connecting to 171.64.65.69:8080
01:02:27:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
01:02:27:WU02:FS00:Upload complete
01:02:27:WU02:FS00:Server responded WORK_ACK (400)
01:02:27:WU02:FS00:Cleaning up
01:02:27:WU00:FS00:News: Welcome to Folding@Home
01:02:27:WU00:FS00:Assigned to work server 171.64.65.69
01:02:27:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
01:02:27:WU00:FS00:Connecting to 171.64.65.69:8080
01:02:28:WU00:FS00:Downloading 4.18MiB
01:02:30:WU00:FS00:Download complete
01:02:31:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:220 clone:7 gen:24 core:0x17 unit:0x0000002d028c126651a6579eea91b6fa
01:02:31:WU00:FS00:Starting
01:02:31:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
01:02:31:WU00:FS00:Started FahCore on PID 4068
01:02:31:WU00:FS00:Core PID:6876
01:02:31:WU00:FS00:FahCore 0x17 started
01:02:31:WU00:FS00:0x17:*********************** Log Started 2014-03-13T01:02:31Z ***********************
01:02:31:WU00:FS00:0x17:Project: 8900 (Run 220, Clone 7, Gen 24)
01:02:31:WU00:FS00:0x17:Unit: 0x0000002d028c126651a6579eea91b6fa
01:02:31:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
01:02:31:WU00:FS00:0x17:Machine: 0
01:02:31:WU00:FS00:0x17:Reading tar file state.xml
01:02:32:WU00:FS00:0x17:Reading tar file system.xml
01:02:33:WU00:FS00:0x17:Reading tar file integrator.xml
01:02:33:WU00:FS00:0x17:Reading tar file core.xml
01:02:33:WU00:FS00:0x17:Digital signatures verified
01:02:33:WU00:FS00:0x17:Folding@home GPU core17
01:02:33:WU00:FS00:0x17:Version 0.0.52
01:05:27:WU01:FS02:0xa3:Completed 295000 out of 500000 steps  (59%)
01:06:01:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
01:06:01:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:14:14:WU01:FS02:0xa3:Completed 300000 out of 500000 steps  (60%)
01:23:01:WU01:FS02:0xa3:Completed 305000 out of 500000 steps  (61%)
01:26:40:WU00:FS00:0x17:Completed 25000 out of 2500000 steps (1%)
01:29:00:WU00:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
01:29:00:WU00:FS00:0x17:Saving result file logfile_01.txt
01:29:01:WU00:FS00:0x17:Saving result file log.txt
01:29:01:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
01:29:01:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
01:29:01:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:220 clone:7 gen:24 core:0x17 unit:0x0000002d028c126651a6579eea91b6fa
01:29:01:WU00:FS00:Uploading 2.48KiB to 171.64.65.69
01:29:01:WU00:FS00:Connecting to 171.64.65.69:8080
01:29:01:WU00:FS00:Upload complete
01:29:01:WU00:FS00:Server responded WORK_ACK (400)
01:29:01:WU00:FS00:Cleaning up
01:31:48:WU01:FS02:0xa3:Completed 310000 out of 500000 steps  (62%)
01:40:30:WU01:FS02:0xa3:Completed 315000 out of 500000 steps  (63%)
01:49:12:WU01:FS02:0xa3:Completed 320000 out of 500000 steps  (64%)
01:57:54:WU01:FS02:0xa3:Completed 325000 out of 500000 steps  (65%)
02:06:36:WU01:FS02:0xa3:Completed 330000 out of 500000 steps  (66%)
02:15:18:WU01:FS02:0xa3:Completed 335000 out of 500000 steps  (67%)
02:24:01:WU01:FS02:0xa3:Completed 340000 out of 500000 steps  (68%)
02:32:43:WU01:FS02:0xa3:Completed 345000 out of 500000 steps  (69%)
02:41:26:WU01:FS02:0xa3:Completed 350000 out of 500000 steps  (70%)
02:50:08:WU01:FS02:0xa3:Completed 355000 out of 500000 steps  (71%)
02:58:51:WU01:FS02:0xa3:Completed 360000 out of 500000 steps  (72%)
03:07:34:WU01:FS02:0xa3:Completed 365000 out of 500000 steps  (73%)
03:16:16:WU01:FS02:0xa3:Completed 370000 out of 500000 steps  (74%)
03:16:31:FS00:Finishing
03:16:41:FS00:Paused
03:16:45:FS00:Unpaused
03:16:45:FS00:Finishing
03:25:04:WU01:FS02:0xa3:Completed 375000 out of 500000 steps  (75%)
03:33:47:WU01:FS02:0xa3:Completed 380000 out of 500000 steps  (76%)
03:37:17:Removing old file 'configs/config-20140209-190711.xml'
03:37:17:Saving configuration to config.xml
03:37:17:<config>
03:37:17:  <!-- Folding Core -->
03:37:17:  <checkpoint v='3'/>
03:37:17:
03:37:17:  <!-- Folding Slot Configuration -->
03:37:17:  <power v='full'/>
03:37:17:
03:37:17:  <!-- HTTP Server -->
03:37:17:  <allow v='127.0.0.1 192.168.1.100/25'/>
03:37:17:
03:37:17:  <!-- Logging -->
03:37:17:  <verbosity v='4'/>
03:37:17:
03:37:17:  <!-- Network -->
03:37:17:  <proxy v=':8080'/>
03:37:17:
03:37:17:  <!-- Remote Command Server -->
03:37:17:  <command-allow-no-pass v='127.0.0.1 192.168.1.100/25'/>
03:37:17:  <password v=''/>
03:37:17:
03:37:17:  <!-- Slot Control -->
03:37:17:  <pause-on-battery v='false'/>
03:37:17:
03:37:17:  <!-- User Information -->
03:37:17:  <passkey v='********************************'/>
03:37:17:  <team v='111065'/>
03:37:17:  <user v='Turbo_T'/>
03:37:17:
03:37:17:  <!-- Folding Slots -->
03:37:17:  <slot id='2' type='CPU'>
03:37:17:    <cpus v='10'/>
03:37:17:  </slot>
03:37:17:</config>
03:40:38:Adding folding slot 00: READY gpu:0:GF100 [GeForce GTX 480]
03:40:38:Adding folding slot 01: READY gpu:1:GF100 [GeForce GTX 480]
03:40:38:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
03:40:38:Removing old file 'configs/config-20140212-113339.xml'
03:40:38:Saving configuration to config.xml
03:40:38:<config>
03:40:38:  <!-- Folding Core -->
03:40:38:  <checkpoint v='3'/>
03:40:38:
03:40:38:  <!-- Folding Slot Configuration -->
03:40:38:  <power v='full'/>
03:40:38:
03:40:38:  <!-- HTTP Server -->
03:40:38:  <allow v='127.0.0.1 192.168.1.100/25'/>
03:40:38:
03:40:38:  <!-- Logging -->
03:40:38:  <verbosity v='4'/>
03:40:38:
03:40:38:  <!-- Network -->
03:40:38:  <proxy v=':8080'/>
03:40:38:
03:40:38:  <!-- Remote Command Server -->
03:40:38:  <command-allow-no-pass v='127.0.0.1 192.168.1.100/25'/>
03:40:38:  <password v=''/>
03:40:38:
03:40:38:  <!-- Slot Control -->
03:40:38:  <pause-on-battery v='false'/>
03:40:38:
03:40:38:  <!-- User Information -->
03:40:38:  <passkey v='********************************'/>
03:40:38:  <team v='111065'/>
03:40:38:  <user v='Turbo_T'/>
03:40:38:
03:40:38:  <!-- Folding Slots -->
03:40:38:  <slot id='2' type='CPU'>
03:40:38:    <cpus v='10'/>
03:40:38:  </slot>
03:40:38:  <slot id='0' type='GPU'/>
03:40:38:  <slot id='1' type='GPU'/>
03:40:38:</config>
03:40:38:WU00:FS00:News: Welcome to Folding@Home
03:40:38:WU00:FS00:Assigned to work server 171.64.65.69
03:40:38:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
03:40:38:WU00:FS00:Connecting to 171.64.65.69:8080
03:40:38:WU02:FS01:Connecting to assign-GPU.stanford.edu:80
03:40:39:WU02:FS01:News: Welcome to Folding@Home
03:40:39:WU02:FS01:Assigned to work server 171.64.65.69
03:40:39:WU02:FS01:Requesting new work unit for slot 01: READY gpu:1:GF100 [GeForce GTX 480] from 171.64.65.69
03:40:39:WU02:FS01:Connecting to 171.64.65.69:8080
03:40:39:WU00:FS00:Downloading 4.17MiB
03:40:39:WU02:FS01:Downloading 4.18MiB
03:40:42:WU00:FS00:Download complete
03:40:42:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:613 clone:7 gen:23 core:0x17 unit:0x0000002c028c126651a6af20345d4c45
03:40:42:WU00:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah
03:40:42:WU00:FS00:Connecting to http://www.stanford.edu:80
03:40:43:WU00:FS00:FahCore 17: Downloading 2.55MiB
03:40:43:WU02:FS01:Download complete
03:40:43:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:623 clone:6 gen:23 core:0x17 unit:0x00000027028c126651a6b1514484e678
03:40:49:WU00:FS00:FahCore 17: 75.97%
03:40:50:WU00:FS00:FahCore 17: Download complete
03:40:50:WU00:FS00:Valid core signature
03:40:50:WU00:FS00:Unpacked 8.60MiB to cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe
03:40:51:WU00:FS00:Starting
03:40:51:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
03:40:51:WU00:FS00:Started FahCore on PID 5180
03:40:51:WU00:FS00:Core PID:4716
03:40:51:WU00:FS00:FahCore 0x17 started
03:40:51:WU02:FS01:Starting
03:40:51:WU02:FS01:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 02 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 1 -gpu-vendor nvidia
03:40:51:WU02:FS01:Started FahCore on PID 2228
03:40:51:WU02:FS01:Core PID:5360
03:40:51:WU02:FS01:FahCore 0x17 started
03:40:52:WU02:FS01:0x17:*********************** Log Started 2014-03-13T03:40:51Z ***********************
03:40:52:WU02:FS01:0x17:Project: 8900 (Run 623, Clone 6, Gen 23)
03:40:52:WU02:FS01:0x17:Unit: 0x00000027028c126651a6b1514484e678
03:40:52:WU02:FS01:0x17:CPU: 0x00000000000000000000000000000000
03:40:52:WU02:FS01:0x17:Machine: 1
03:40:52:WU02:FS01:0x17:Reading tar file state.xml
03:40:52:WU00:FS00:0x17:*********************** Log Started 2014-03-13T03:40:51Z ***********************
03:40:52:WU00:FS00:0x17:Project: 8900 (Run 613, Clone 7, Gen 23)
03:40:52:WU00:FS00:0x17:Unit: 0x0000002c028c126651a6af20345d4c45
03:40:52:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
03:40:52:WU00:FS00:0x17:Machine: 0
03:40:52:WU00:FS00:0x17:Reading tar file state.xml
03:40:52:WU00:FS00:0x17:Reading tar file system.xml
03:40:53:WU02:FS01:0x17:Reading tar file system.xml
03:40:53:WU02:FS01:0x17:Reading tar file integrator.xml
03:40:53:WU02:FS01:0x17:Reading tar file core.xml
03:40:53:WU02:FS01:0x17:Digital signatures verified
03:40:53:WU02:FS01:0x17:Folding@home GPU core17
03:40:53:WU02:FS01:0x17:Version 0.0.52
03:40:53:WU00:FS00:0x17:Reading tar file integrator.xml
03:40:53:WU00:FS00:0x17:Reading tar file core.xml
03:40:53:WU00:FS00:0x17:Digital signatures verified
03:40:53:WU00:FS00:0x17:Folding@home GPU core17
03:40:53:WU00:FS00:0x17:Version 0.0.52
03:42:55:WU01:FS02:0xa3:Completed 385000 out of 500000 steps  (77%)
03:44:31:WU02:FS01:0x17:Completed 0 out of 2500000 steps (0%)
03:44:31:WU02:FS01:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
03:44:33:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
03:44:33:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
03:52:04:WU01:FS02:0xa3:Completed 390000 out of 500000 steps  (78%)
03:53:25:WU02:FS01:0x17:Completed 25000 out of 2500000 steps (1%)
04:01:11:WU01:FS02:0xa3:Completed 395000 out of 500000 steps  (79%)
04:02:01:WU02:FS01:0x17:Completed 50000 out of 2500000 steps (2%)
*********************** Log Started 2014-03-12T23:29:27Z ***********************
23:29:27:************************* Folding@home Client *************************
23:29:27:      Website: http://folding.stanford.edu/
23:29:27:    Copyright: (c) 2009-2013 Stanford University
23:29:27:       Author: Joseph Coffland <[email protected]>
23:29:27:         Args: --open-web-control
23:29:27:       Config: E:/Stanford FAH/config.xml
23:29:27:******************************** Build ********************************
23:29:27:      Version: 7.3.6
23:29:27:         Date: Feb 18 2013
23:29:27:         Time: 15:25:17
23:29:27:      SVN Rev: 3923
23:29:27:       Branch: fah/trunk/client
23:29:27:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
23:29:27:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
23:29:27:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
23:29:27:     Platform: win32 XP
23:29:27:         Bits: 32
23:29:27:         Mode: Release
23:29:27:******************************* System ********************************
23:29:27:          CPU: Intel(R) Core(TM) i7 CPU X 980 @ 3.33GHz
23:29:27:       CPU ID: GenuineIntel Family 6 Model 44 Stepping 2
23:29:27:         CPUs: 12
23:29:27:       Memory: 11.99GiB
23:29:27:  Free Memory: 9.81GiB
23:29:27:      Threads: WINDOWS_THREADS
23:29:27:  Has Battery: false
23:29:27:   On Battery: false
23:29:27:   UTC offset: -4
23:29:27:          PID: 4444
23:29:27:          CWD: E:/Stanford FAH
23:29:27:           OS: Windows 7 Professional
23:29:27:      OS Arch: AMD64
23:29:27:         GPUs: 2
23:29:27:        GPU 0: NVIDIA:2 GF100 [GeForce GTX 480]
23:29:27:        GPU 1: NVIDIA:2 GF100 [GeForce GTX 480]
23:29:27:         CUDA: 2.0
23:29:27:  CUDA Driver: 5050
23:29:27:Win32 Service: false
23:29:27:***********************************************************************
23:29:27:<config>
23:29:27:  <service-description v='Folding@home Client'/>
23:29:27:  <service-restart v='true'/>
23:29:27:  <service-restart-delay v='5000'/>
23:29:27:
23:29:27:  <!-- Client Control -->
23:29:27:  <client-threads v='4'/>
23:29:27:  <cycle-rate v='4'/>
23:29:27:  <cycles v='-1'/>
23:29:27:  <data-directory v='.'/>
23:29:27:  <disable-sleep-when-active v='true'/>
23:29:27:  <exec-directory v='E:\Stanford FAH\FAHClient'/>
23:29:27:  <exit-when-done v='false'/>
23:29:27:  <fold-anon v='false'/>
23:29:27:  <open-web-control v='true'/>
23:29:27:
23:29:27:  <!-- Configuration -->
23:29:27:  <config-rotate v='true'/>
23:29:27:  <config-rotate-dir v='configs'/>
23:29:27:  <config-rotate-max v='16'/>
23:29:27:
23:29:27:  <!-- Debugging -->
23:29:27:  <assignment-servers>
23:29:27:    assign3.stanford.edu:8080 assign4.stanford.edu:80
23:29:27:  </assignment-servers>
23:29:27:  <capture-directory v='capture'/>
23:29:27:  <capture-on-error v='false'/>
23:29:27:  <capture-packets v='false'/>
23:29:27:  <capture-requests v='false'/>
23:29:27:  <capture-responses v='false'/>
23:29:27:  <capture-sockets v='false'/>
23:29:27:  <debug-sockets v='false'/>
23:29:27:  <exception-locations v='true'/>
23:29:27:  <gpu-assignment-servers>
23:29:27:    assign-GPU.stanford.edu:80 assign-GPU.stanford.edu:8080
23:29:27:  </gpu-assignment-servers>
23:29:27:  <stack-traces v='false'/>
23:29:27:
23:29:27:  <!-- Error Handling -->
23:29:27:  <max-slot-errors v='5'/>
23:29:27:  <max-unit-errors v='5'/>
23:29:27:
23:29:27:  <!-- Folding Core -->
23:29:27:  <checkpoint v='3'/>
23:29:27:  <core-dir v='cores'/>
23:29:27:  <core-priority v='idle'/>
23:29:27:  <cpu-affinity v='false'/>
23:29:27:  <cpu-usage v='100'/>
23:29:27:  <gpu-usage v='100'/>
23:29:27:  <no-assembly v='false'/>
23:29:27:
23:29:27:  <!-- Folding Slot Configuration -->
23:29:27:  <cause v='ANY'/>
23:29:27:  <client-subtype v='STDCLI'/>
23:29:27:  <client-type v='normal'/>
23:29:27:  <cpu-species v='X86_PENTIUM_II'/>
23:29:27:  <cpu-type v='AMD64'/>
23:29:27:  <cpus v='-1'/>
23:29:27:  <cuda-index v='0'/>
23:29:27:  <gpu v='true'/>
23:29:27:  <max-packet-size v='normal'/>
23:29:27:  <opencl-index v='0'/>
23:29:27:  <os-species v='UNKNOWN'/>
23:29:27:  <os-type v='WIN32'/>
23:29:27:  <power v='full'/>
23:29:27:  <project-key v='0'/>
23:29:27:  <smp v='true'/>
23:29:27:
23:29:27:  <!-- HTTP Server -->
23:29:27:  <allow v='127.0.0.1 192.168.1.100/25'/>
23:29:27:  <connection-timeout v='60'/>
23:29:27:  <deny v='0/0'/>
23:29:27:  <http-addresses v='0:7396'/>
23:29:27:  <https-addresses v=''/>
23:29:27:  <max-connect-time v='900'/>
23:29:27:  <max-connections v='800'/>
23:29:27:  <max-request-length v='52428800'/>
23:29:27:  <min-connect-time v='300'/>
23:29:27:  <threads v='12'/>
23:29:27:
23:29:27:  <!-- Logging -->
23:29:27:  <log v='log.txt'/>
23:29:27:  <log-color v='false'/>
23:29:27:  <log-crlf v='true'/>
23:29:27:  <log-date v='false'/>
23:29:27:  <log-date-periodically v='21600'/>
23:29:27:  <log-debug v='true'/>
23:29:27:  <log-domain v='false'/>
23:29:27:  <log-header v='true'/>
23:29:27:  <log-level v='true'/>
23:29:27:  <log-no-info-header v='true'/>
23:29:27:  <log-redirect v='false'/>
23:29:27:  <log-rotate v='true'/>
23:29:27:  <log-rotate-dir v='logs'/>
23:29:27:  <log-rotate-max v='16'/>
23:29:27:  <log-short-level v='false'/>
23:29:27:  <log-simple-domains v='true'/>
23:29:27:  <log-thread-id v='false'/>
23:29:27:  <log-thread-prefix v='true'/>
23:29:27:  <log-time v='true'/>
23:29:27:  <log-to-screen v='true'/>
23:29:27:  <log-truncate v='false'/>
23:29:27:  <verbosity v='4'/>
23:29:27:
23:29:27:  <!-- Network -->
23:29:27:  <proxy v=':8080'/>
23:29:27:  <proxy-enable v='false'/>
23:29:27:  <proxy-pass v=''/>
23:29:27:  <proxy-user v=''/>
23:29:27:
23:29:27:  <!-- Process Control -->
23:29:27:  <child v='false'/>
23:29:27:  <daemon v='false'/>
23:29:27:  <pid v='false'/>
23:29:27:  <pid-file v='Folding@home Client.pid'/>
23:29:27:  <respawn v='false'/>
23:29:27:  <service v='false'/>
23:29:27:
23:29:27:  <!-- Remote Command Server -->
23:29:27:  <command-address v='0.0.0.0'/>
23:29:27:  <command-allow-no-pass v='127.0.0.1 192.168.1.100/25'/>
23:29:27:  <command-deny-no-pass v='0/0'/>
23:29:27:  <command-port v='36330'/>
23:29:27:  <password v=''/>
23:29:27:
23:29:27:  <!-- Slot Control -->
23:29:27:  <idle v='false'/>
23:29:27:  <max-shutdown-wait v='60'/>
23:29:27:  <pause-on-battery v='false'/>
23:29:27:  <pause-on-start v='false'/>
23:29:27:
23:29:27:  <!-- User Information -->
23:29:27:  <machine-id v='0'/>
23:29:27:  <passkey v='********************************'/>
23:29:27:  <team v='111065'/>
23:29:27:  <user v='Turbo_T'/>
23:29:27:
23:29:27:  <!-- Web Server -->
23:29:27:  <session-timeout v='3600'/>
23:29:27:  <web-allow v='127.0.0.1'/>
23:29:27:  <web-deny v='0/0'/>
23:29:27:
23:29:27:  <!-- Work Unit Control -->
23:29:27:  <dump-after-deadline v='true'/>
23:29:27:  <max-queue v='16'/>
23:29:27:  <max-units v='0'/>
23:29:27:  <next-unit-percentage v='99'/>
23:29:27:
23:29:27:  <!-- Folding Slots -->
23:29:27:  <slot id='2' type='CPU'>
23:29:27:    <cpus v='10'/>
23:29:27:  </slot>
23:29:27:  <slot id='0' type='GPU'/>
23:29:27:</config>
23:29:27:Trying to access database...
23:29:27:Successfully acquired database lock
23:29:27:Enabled folding slot 02: READY cpu:10
23:29:27:Enabled folding slot 00: READY gpu:0:GF100 [GeForce GTX 480]
23:29:27:WU01:FS02:Starting
23:29:27:WU01:FS02:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe" -dir 01 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -np 10
23:29:27:WU01:FS02:Started FahCore on PID 7080
23:29:27:WU01:FS02:Core PID:2592
23:29:27:WU01:FS02:FahCore 0xa3 started
23:29:28:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
23:29:28:1:127.0.0.1 GET /ping?_=1394666968358&callback=jQuery19009469368797726929_1394666968357
23:29:28:WU01:FS02:0xa3:
23:29:28:WU01:FS02:0xa3:*------------------------------*
23:29:28:WU01:FS02:0xa3:Folding@Home Gromacs SMP Core
23:29:28:WU01:FS02:0xa3:Version 2.27 (Dec. 15, 2010)
23:29:28:WU01:FS02:0xa3:
23:29:28:WU01:FS02:0xa3:Preparing to commence simulation
23:29:28:WU01:FS02:0xa3:- Looking at optimizations...
23:29:28:WU01:FS02:0xa3:- Files status OK
23:29:28:WU00:FS00:News: Welcome to Folding@Home
23:29:28:WU00:FS00:Assigned to work server 171.64.65.69
23:29:28:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
23:29:28:WU00:FS00:Connecting to 171.64.65.69:8080
23:29:28:2:127.0.0.1 GET /?nocache=0.802401150809601
23:29:29:WU01:FS02:0xa3:- Expanded 3848665 -> 4392432 (decompressed 114.1 percent)
23:29:29:WU01:FS02:0xa3:Called DecompressByteArray: compressed_data_size=3848665 data_size=4392432, decompressed_data_size=4392432 diff=0
23:29:29:WU01:FS02:0xa3:- Digital signature verified
23:29:29:WU01:FS02:0xa3:
23:29:29:WU01:FS02:0xa3:Project: 8581 (Run 0, Clone 2, Gen 473)
23:29:29:WU01:FS02:0xa3:
23:29:29:WU01:FS02:0xa3:Assembly optimizations on if available.
23:29:29:WU01:FS02:0xa3:Entering M.D.
23:29:29:WU00:FS00:Downloading 4.17MiB
23:29:29:3:127.0.0.1 GET /js/main.js?nocache=0.11671217205002904
23:29:29:3:127.0.0.1:New Web connection
23:29:29:4:127.0.0.1 GET /css/style.css?nocache=0.6547354967333376
23:29:30:5:127.0.0.1 GET /api/updates/set?sid=0xc41c3813eea1ba24b5e64715a8a294ae&update_id=0&update_path=/api/basic&update_rate=1
23:29:30:6:127.0.0.1 GET /api/updates/set?sid=0xc41c3813eea1ba24b5e64715a8a294ae&update_id=1&update_path=/api/slots&update_rate=1
23:29:30:7:127.0.0.1 GET /api/configured?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:30:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:30:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:31:WU00:FS00:Download complete
23:29:31:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:198 clone:5 gen:41 core:0x17 unit:0x0000004b028c126651a652ad5cdceb60
23:29:31:WU00:FS00:Starting
23:29:31:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
23:29:31:WU00:FS00:Started FahCore on PID 4056
23:29:32:WU00:FS00:Core PID:5296
23:29:32:WU00:FS00:FahCore 0x17 started
23:29:32:WU00:FS00:0x17:*********************** Log Started 2014-03-12T23:29:32Z ***********************
23:29:32:WU00:FS00:0x17:Project: 8900 (Run 198, Clone 5, Gen 41)
23:29:32:WU00:FS00:0x17:Unit: 0x0000004b028c126651a652ad5cdceb60
23:29:32:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:29:32:WU00:FS00:0x17:Machine: 0
23:29:32:WU00:FS00:0x17:Reading tar file state.xml
23:29:33:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:33:WU00:FS00:0x17:Reading tar file system.xml
23:29:33:WU00:FS00:0x17:Reading tar file integrator.xml
23:29:33:WU00:FS00:0x17:Reading tar file core.xml
23:29:33:WU00:FS00:0x17:Digital signatures verified
23:29:33:WU00:FS00:0x17:Folding@home GPU core17
23:29:33:WU00:FS00:0x17:Version 0.0.52
23:29:34:WU01:FS02:0xa3:Using Gromacs checkpoints
23:29:35:WU01:FS02:0xa3:Mapping NT from 10 to 10 
23:29:35:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:37:WU01:FS02:0xa3:Resuming from checkpoint
23:29:37:WU01:FS02:0xa3:Verified 01/wudata_01.log
23:29:37:WU01:FS02:0xa3:Verified 01/wudata_01.trr
23:29:37:WU01:FS02:0xa3:Verified 01/wudata_01.edr
23:29:38:WU01:FS02:0xa3:Completed 240595 out of 500000 steps  (48%)
23:29:40:8:127.0.0.1 GET /api/updates?sid=0xc41c3813eea1ba24b5e64715a8a294ae
23:29:44:WARNING:Exception: 8:127.0.0.1: Send error: 10053: An established connection was aborted by the software in your host machine.
23:33:00:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
23:33:00:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
23:37:27:WU01:FS02:0xa3:Completed 245000 out of 500000 steps  (49%)
23:46:13:WU01:FS02:0xa3:Completed 250000 out of 500000 steps  (50%)
23:53:40:WU00:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
23:53:40:WU00:FS00:0x17:Saving result file logfile_01.txt
23:53:40:WU00:FS00:0x17:Saving result file log.txt
23:53:40:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
23:53:40:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
23:53:41:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:198 clone:5 gen:41 core:0x17 unit:0x0000004b028c126651a652ad5cdceb60
23:53:41:WU00:FS00:Uploading 2.47KiB to 171.64.65.69
23:53:41:WU00:FS00:Connecting to 171.64.65.69:8080
23:53:41:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
23:53:41:WU00:FS00:Upload complete
23:53:41:WU00:FS00:Server responded WORK_ACK (400)
23:53:41:WU00:FS00:Cleaning up
23:53:42:WU02:FS00:News: Welcome to Folding@Home
23:53:42:WU02:FS00:Assigned to work server 171.64.65.69
23:53:42:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
23:53:42:WU02:FS00:Connecting to 171.64.65.69:8080
23:53:42:WU02:FS00:Downloading 4.17MiB
23:53:45:WU02:FS00:Download complete
23:53:45:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:449 clone:10 gen:25 core:0x17 unit:0x00000023028c126652b4e6e108ddee21
23:53:45:WU02:FS00:Starting
23:53:45:WU02:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 02 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
23:53:45:WU02:FS00:Started FahCore on PID 4192
23:53:45:WU02:FS00:Core PID:6880
23:53:45:WU02:FS00:FahCore 0x17 started
23:53:45:WU02:FS00:0x17:*********************** Log Started 2014-03-12T23:53:45Z ***********************
23:53:45:WU02:FS00:0x17:Project: 8900 (Run 449, Clone 10, Gen 25)
23:53:45:WU02:FS00:0x17:Unit: 0x00000023028c126652b4e6e108ddee21
23:53:45:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
23:53:45:WU02:FS00:0x17:Machine: 0
23:53:45:WU02:FS00:0x17:Reading tar file state.xml
23:53:46:WU02:FS00:0x17:Reading tar file system.xml
23:53:47:WU02:FS00:0x17:Reading tar file integrator.xml
23:53:47:WU02:FS00:0x17:Reading tar file core.xml
23:53:47:WU02:FS00:0x17:Digital signatures verified
23:53:47:WU02:FS00:0x17:Folding@home GPU core17
23:53:47:WU02:FS00:0x17:Version 0.0.52
23:55:02:WU01:FS02:0xa3:Completed 255000 out of 500000 steps  (51%)
23:57:16:WU02:FS00:0x17:Completed 0 out of 2500000 steps (0%)
23:57:16:WU02:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:03:50:WU01:FS02:0xa3:Completed 260000 out of 500000 steps  (52%)
00:12:36:WU01:FS02:0xa3:Completed 265000 out of 500000 steps  (53%)
00:17:59:WU02:FS00:0x17:Completed 25000 out of 2500000 steps (1%)
00:20:10:WU02:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
00:20:10:WU02:FS00:0x17:Saving result file logfile_01.txt
00:20:10:WU02:FS00:0x17:Saving result file log.txt
00:20:10:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
00:20:10:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:20:10:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:449 clone:10 gen:25 core:0x17 unit:0x00000023028c126652b4e6e108ddee21
00:20:10:WU02:FS00:Uploading 2.50KiB to 171.64.65.69
00:20:10:WU02:FS00:Connecting to 171.64.65.69:8080
00:20:10:WU02:FS00:Upload complete
00:20:10:WU02:FS00:Server responded WORK_ACK (400)
00:20:10:WU02:FS00:Cleaning up
00:20:10:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
00:20:11:WU00:FS00:News: Welcome to Folding@Home
00:20:11:WU00:FS00:Assigned to work server 171.64.65.69
00:20:11:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
00:20:11:WU00:FS00:Connecting to 171.64.65.69:8080
00:20:11:WU00:FS00:Downloading 4.17MiB
00:20:14:WU00:FS00:Download complete
00:20:14:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:861 clone:8 gen:25 core:0x17 unit:0x00000030028c126651a6e657e0fa077a
00:20:14:WU00:FS00:Starting
00:20:14:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
00:20:14:WU00:FS00:Started FahCore on PID 5148
00:20:14:WU00:FS00:Core PID:7016
00:20:14:WU00:FS00:FahCore 0x17 started
00:20:15:WU00:FS00:0x17:*********************** Log Started 2014-03-13T00:20:14Z ***********************
00:20:15:WU00:FS00:0x17:Project: 8900 (Run 861, Clone 8, Gen 25)
00:20:15:WU00:FS00:0x17:Unit: 0x00000030028c126651a6e657e0fa077a
00:20:15:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
00:20:15:WU00:FS00:0x17:Machine: 0
00:20:15:WU00:FS00:0x17:Reading tar file state.xml
00:20:15:WU00:FS00:0x17:Reading tar file system.xml
00:20:16:WU00:FS00:0x17:Reading tar file integrator.xml
00:20:16:WU00:FS00:0x17:Reading tar file core.xml
00:20:16:WU00:FS00:0x17:Digital signatures verified
00:20:16:WU00:FS00:0x17:Folding@home GPU core17
00:20:16:WU00:FS00:0x17:Version 0.0.52
00:21:24:WU01:FS02:0xa3:Completed 270000 out of 500000 steps  (54%)
00:23:44:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
00:23:44:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:30:12:WU01:FS02:0xa3:Completed 275000 out of 500000 steps  (55%)
00:38:59:WU01:FS02:0xa3:Completed 280000 out of 500000 steps  (56%)
00:43:21:WU00:FS00:0x17:ERROR:exception: First periodic box vector must be parallel to x.
00:43:21:WU00:FS00:0x17:Saving result file logfile_01.txt
00:43:21:WU00:FS00:0x17:Saving result file log.txt
00:43:21:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
00:43:21:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:43:21:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:861 clone:8 gen:25 core:0x17 unit:0x00000030028c126651a6e657e0fa077a
00:43:21:WU00:FS00:Uploading 2.45KiB to 171.64.65.69
00:43:21:WU00:FS00:Connecting to 171.64.65.69:8080
00:43:21:WU02:FS00:Connecting to assign-GPU.stanford.edu:80
00:43:22:WU00:FS00:Upload complete
00:43:22:WU00:FS00:Server responded WORK_ACK (400)
00:43:22:WU00:FS00:Cleaning up
00:43:22:WU02:FS00:News: Welcome to Folding@Home
00:43:22:WU02:FS00:Assigned to work server 171.64.65.69
00:43:22:WU02:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
00:43:22:WU02:FS00:Connecting to 171.64.65.69:8080
00:43:23:WU02:FS00:Downloading 4.18MiB
00:43:25:WU02:FS00:Download complete
00:43:26:WU02:FS00:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:8900 run:302 clone:7 gen:38 core:0x17 unit:0x00000044028c126651a669eb7f0aed05
00:43:26:WU02:FS00:Starting
00:43:26:WU02:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 02 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
00:43:26:WU02:FS00:Started FahCore on PID 3876
00:43:26:WU02:FS00:Core PID:1108
00:43:26:WU02:FS00:FahCore 0x17 started
00:43:26:WU02:FS00:0x17:*********************** Log Started 2014-03-13T00:43:26Z ***********************
00:43:26:WU02:FS00:0x17:Project: 8900 (Run 302, Clone 7, Gen 38)
00:43:26:WU02:FS00:0x17:Unit: 0x00000044028c126651a669eb7f0aed05
00:43:26:WU02:FS00:0x17:CPU: 0x00000000000000000000000000000000
00:43:26:WU02:FS00:0x17:Machine: 0
00:43:26:WU02:FS00:0x17:Reading tar file state.xml
00:43:27:WU02:FS00:0x17:Reading tar file system.xml
00:43:28:WU02:FS00:0x17:Reading tar file integrator.xml
00:43:28:WU02:FS00:0x17:Reading tar file core.xml
00:43:28:WU02:FS00:0x17:Digital signatures verified
00:43:28:WU02:FS00:0x17:Folding@home GPU core17
00:43:28:WU02:FS00:0x17:Version 0.0.52
00:46:55:WU02:FS00:0x17:Completed 0 out of 2500000 steps (0%)
00:46:55:WU02:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
00:47:50:WU01:FS02:0xa3:Completed 285000 out of 500000 steps  (57%)
00:56:36:WU01:FS02:0xa3:Completed 290000 out of 500000 steps  (58%)
01:02:26:WU02:FS00:0x17:ERROR:exception: First periodic box vector must be parallel to x.
01:02:26:WU02:FS00:0x17:Saving result file logfile_01.txt
01:02:26:WU02:FS00:0x17:Saving result file log.txt
01:02:26:WU02:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
01:02:26:WARNING:WU02:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
01:02:26:WU02:FS00:Sending unit results: id:02 state:SEND error:FAULTY project:8900 run:302 clone:7 gen:38 core:0x17 unit:0x00000044028c126651a669eb7f0aed05
01:02:26:WU02:FS00:Uploading 2.45KiB to 171.64.65.69
01:02:26:WU02:FS00:Connecting to 171.64.65.69:8080
01:02:27:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
01:02:27:WU02:FS00:Upload complete
01:02:27:WU02:FS00:Server responded WORK_ACK (400)
01:02:27:WU02:FS00:Cleaning up
01:02:27:WU00:FS00:News: Welcome to Folding@Home
01:02:27:WU00:FS00:Assigned to work server 171.64.65.69
01:02:27:WU00:FS00:Requesting new work unit for slot 00: READY gpu:0:GF100 [GeForce GTX 480] from 171.64.65.69
01:02:27:WU00:FS00:Connecting to 171.64.65.69:8080
01:02:28:WU00:FS00:Downloading 4.18MiB
01:02:30:WU00:FS00:Download complete
01:02:31:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:8900 run:220 clone:7 gen:24 core:0x17 unit:0x0000002d028c126651a6579eea91b6fa
01:02:31:WU00:FS00:Starting
01:02:31:WU00:FS00:Running FahCore: "E:\Stanford FAH\FAHClient/FAHCoreWrapper.exe" "E:/Stanford FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe" -dir 00 -suffix 01 -version 703 -lifeline 4444 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
01:02:31:WU00:FS00:Started FahCore on PID 4068
01:02:31:WU00:FS00:Core PID:6876
01:02:31:WU00:FS00:FahCore 0x17 started
01:02:31:WU00:FS00:0x17:*********************** Log Started 2014-03-13T01:02:31Z ***********************
01:02:31:WU00:FS00:0x17:Project: 8900 (Run 220, Clone 7, Gen 24)
01:02:31:WU00:FS00:0x17:Unit: 0x0000002d028c126651a6579eea91b6fa
01:02:31:WU00:FS00:0x17:CPU: 0x00000000000000000000000000000000
01:02:31:WU00:FS00:0x17:Machine: 0
01:02:31:WU00:FS00:0x17:Reading tar file state.xml
01:02:32:WU00:FS00:0x17:Reading tar file system.xml
01:02:33:WU00:FS00:0x17:Reading tar file integrator.xml
01:02:33:WU00:FS00:0x17:Reading tar file core.xml
01:02:33:WU00:FS00:0x17:Digital signatures verified
01:02:33:WU00:FS00:0x17:Folding@home GPU core17
01:02:33:WU00:FS00:0x17:Version 0.0.52
01:05:27:WU01:FS02:0xa3:Completed 295000 out of 500000 steps  (59%)
01:06:01:WU00:FS00:0x17:Completed 0 out of 2500000 steps (0%)
01:06:01:WU00:FS00:0x17:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
01:14:14:WU01:FS02:0xa3:Completed 300000 out of 500000 steps  (60%)
01:23:01:WU01:FS02:0xa3:Completed 305000 out of 500000 steps  (61%)
01:26:40:WU00:FS00:0x17:Completed 25000 out of 2500000 steps (1%)
01:29:00:WU00:FS00:0x17:ERROR:exception: The periodic box size has decreased to less than twice the nonbonded cutoff.
01:29:00:WU00:FS00:0x17:Saving result file logfile_01.txt
01:29:01:WU00:FS00:0x17:Saving result file log.txt
01:29:01:WU00:FS00:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
01:29:01:WARNING:WU00:FS00:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
01:29:01:WU00:FS00:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:220 clone:7 gen:24 core:0x17 unit:0x0000002d028c126651a6579eea91b6fa
01:29:01:WU00:FS00:Uploading 2.48KiB to 171.64.65.69
01:29:01:WU00:FS00:Connecting to 171.64.65.69:8080
01:29:01:WU00:FS00:Upload complete
01:29:01:WU00:FS00:Server responded WORK_ACK (400)
01:29:01:WU00:FS00:Cleaning up
Mod edit: Added Code tags to log, please follow directions on how to post a log - viewtopic.php?f=61&t=16206&p=225958#p225958
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: I am having rampant failures with the newest NVIDIA driv

Post by bruce »

If you want further help, please remove the Verbosity 5 setting. The default of 3 is the best setting.
Turbo_T wrote:I am using the recommended drivers 327.23. The latest log is below. I have disabled the secondary GPU and been able to fold all day on the CPU and Primary GPU it appears.
Possibility 1: One GPU can tolerate your overclock settings and the other cannot.
Possibility 2: The total heat generated by 2 GPUs plus CPU exceeds the capacity of your system cooling subsystem.
Possibility 3: Your PS is having trouble supplying enough 12V current to run everything at once.
Turbo_T
Posts: 26
Joined: Mon Mar 11, 2013 1:46 am

Re: I am having rampant failures with the newest NVIDIA driv

Post by Turbo_T »

as for the GPU it is an EVGA GTX 480 Hydro Copper FTW, liquid cooled unit with GPU at 752 Mhz and ram at 1900 Mhz from the factory. I have attempted using the EVGA precision X software to tune it down but it will only affect the GPU clock and only reduce it by 2Mhz .
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: I am having rampant failures with the newest NVIDIA driv

Post by bruce »

To eliminate possibility 1, Finish the WU on one GPU and start the slot for the other GPU.
Joe_H
Site Admin
Posts: 7940
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: I am having rampant failures with the newest NVIDIA driv

Post by Joe_H »

Also, please return the logging level back to the default of verbosity=3. Higher levels rarely provide any useful information and do get in the way of analyzing the log for problems.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
P5-133XL
Posts: 2948
Joined: Sun Dec 02, 2007 4:36 am
Hardware configuration: Machine #1:

Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).

Machine #2:

Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.

Machine 3:

Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32

I am currently folding just on the 5x GTX 460's for aprox. 70K PPD
Location: Salem. OR USA

Re: I am having rampant failures with the newest NVIDIA driv

Post by P5-133XL »

Off-hand, I do not see anything particularly wrong with the config except the verbosity level and that is more an annoyance than a problem. Your driver version is fine. Hopefully you got those drivers from Nvidia so as to include OpenCl.

After that we get into HW or OC'ing. Can you run just one GPU slot and identify one particular video card having a problem? What's you power supply like? Have you paid attention to the rail system so you know that you are not either overloading the entire power supply or any rail?
Image
Turbo_T
Posts: 26
Joined: Mon Mar 11, 2013 1:46 am

Re: I am having rampant failures with the newest NVIDIA driv

Post by Turbo_T »

Verbosity corrected,

I have adequate cooling as demonstrated by the temps my systems shows with all three folding, I just break into the mid 60C range at the CPU and max temps on GPU's are mid 70's. All major components are liquid cooled and run through a 3X120 Swiftech double pass radiator. When I designed and built the system I over specified the power and cooling capacity in case I was able to get the SLI ready second GPU. I have a PC Power and cooling 1200 Turbo PSU rated for far more than I am drawing so far. It runs a single rail for the 12V so there are no balancing issues. The "new to me" and seemingly unstable GPU does run 5-7 degrees hotter than my original/primary GPU, but is tests fine in memory and processing benchmarks. When I enable SLI for gaming and benchmark the GPU's together there are no signs of any instability or failure. My original GPU folds fine, but the newer 480 does not tolerate folding as a single GPU at all. It doesn't matter if you run one or both simultaneously the newer card fails and the original one is fine, Very unfortunate for sure.
Turbo_T
Posts: 26
Joined: Mon Mar 11, 2013 1:46 am

Re: I am having rampant failures with the newest NVIDIA driv

Post by Turbo_T »

As a test case I have loaded the latest drivers, 335.23, and tested the benchmarks. my open CL marks went from :
327.23
Explicit-12.206 1ns/day
Implicit-48.0077 ns/day

to

335.23
Expicit-20.228 ns/day
Implicit-88.2339 ns/day

I am running both GPU's to see if they are any more stable as well.
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: I am having rampant failures with the newest NVIDIA driv

Post by bruce »

@Turbo_T

At some point, this topic changed from "rampant failures" to "performance is too low" I can't figure out what changed. Did you stop talking about one driver version and permanently move to another or did you lower your overclock expectations (or was it something else)?

There are other reports that changing drivers now does improve the performance, but that doesn't answer which change got rid of the rampant failures.
Turbo_T
Posts: 26
Joined: Mon Mar 11, 2013 1:46 am

Re: I am having rampant failures with the newest NVIDIA driv

Post by Turbo_T »

I am still having failure problems on the one GPU but I reported the attempt to correct the stability issue by loading the new drivers. I included a before and after benchmark to validate the driver impact on performance as a byproduct of the failure discussion. The same card continues to fail even now. I guess the GPU is just not going to be a folding asset.
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: I am having rampant failures with the newest NVIDIA driv

Post by bruce »

The GPU might become a folding asset if you under-clock it enough.
PantherX
Site Moderator
Posts: 6986
Joined: Wed Dec 23, 2009 9:33 am
Hardware configuration: V7.6.21 -> Multi-purpose 24/7
Windows 10 64-bit
CPU:2/3/4/6 -> Intel i7-6700K
GPU:1 -> Nvidia GTX 1080 Ti
§
Retired:
2x Nvidia GTX 1070
Nvidia GTX 675M
Nvidia GTX 660 Ti
Nvidia GTX 650 SC
Nvidia GTX 260 896 MB SOC
Nvidia 9600GT 1 GB OC
Nvidia 9500M GS
Nvidia 8800GTS 320 MB

Intel Core i7-860
Intel Core i7-3840QM
Intel i3-3240
Intel Core 2 Duo E8200
Intel Core 2 Duo E6550
Intel Core 2 Duo T8300
Intel Pentium E5500
Intel Pentium E5400
Location: Land Of The Long White Cloud
Contact:

Re: I am having rampant failures with the newest NVIDIA driv

Post by PantherX »

Another possible explanation is that the GPU is failing. I have read about at least one donor who was having issues only while folding and it turns out that the GPU was damaged and after the GPU was replaced, everything was back o normal. Usually, games will not mind an incorrect colour of a pixel or one of those tiny glitches. However, for F@H, it does cause a serious issue.

If you really want to see if it is a hardware issue or not, remove your GPU1 and replace it with GPU2 (it is now in PCI-E Slot one and the second slot is empty). Now, see if it folds on GPU2 or not with stock settings. If it still fails, a hardware issue could be possible. If it fold, then place GPU1 in the second PCI-E Slot and see if it folds or not. If it doesn't fold, then you know that it is a PCI-E issue and not your GPUs.
ETA:
Now ↞ Very Soon ↔ Soon ↔ Soon-ish ↔ Not Soon ↠ End Of Time

Welcome To The F@H Support Forum Ӂ Troubleshooting Bad WUs Ӂ Troubleshooting Server Connectivity Issues
Post Reply