Constant WU Failures on Both GPUs

If you think it might be a driver problem, see viewforum.php?f=79

Moderators: Site Moderators, FAHC Science Team

Post Reply
Joe_H
Site Admin
Posts: 7937
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: Constant WU Failures on Both GPUs

Post by Joe_H »

You may still have older logs, check the data folder to see if there is a folder of older logs that includes one with the older GPU still installed. By default the F@H client keeps the 16 most recent logs stored there. That could avoid reinstalling the card.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Constant WU Failures on Both GPUs

Post by bruce »

No need to reinstall. Previous logs are stored in a sub-directory called [Duuuuh] logs.
Top
Nirvana
Posts: 21
Joined: Tue Aug 19, 2014 4:20 pm

Re: Constant WU Failures on Both GPUs

Post by Nirvana »

I uninstalled the client yesterday, all logs were deleted :(
Image
Top
Nirvana
Posts: 21
Joined: Tue Aug 19, 2014 4:20 pm

Re: Constant WU Failures on Both GPUs

Post by Nirvana »

I've reinstalled the FX580. It looks like that failure is causing the K600 to stop folding too.


Log file here ->

Code: Select all

*********************** Log Started 2014-08-22T13:21:03Z ***********************
13:21:03:************************* Folding@home Client *************************
13:21:03:      Website: http://folding.stanford.edu/
13:21:03:    Copyright: (c) 2009-2014 Stanford University
13:21:03:       Author: Joseph Coffland <[email protected]>
13:21:03:         Args: 
13:21:03:       Config: C:/Users/ZZeppo/AppData/Roaming/FAHClient/config.xml
13:21:03:******************************** Build ********************************
13:21:03:      Version: 7.4.4
13:21:03:         Date: Mar 4 2014
13:21:03:         Time: 20:26:54
13:21:03:      SVN Rev: 4130
13:21:03:       Branch: fah/trunk/client
13:21:03:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
13:21:03:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
13:21:03:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
13:21:03:     Platform: win32 XP
13:21:03:         Bits: 32
13:21:03:         Mode: Release
13:21:03:******************************* System ********************************
13:21:03:          CPU: Intel(R) Xeon(R) CPU W3570 @ 3.20GHz
13:21:03:       CPU ID: GenuineIntel Family 6 Model 26 Stepping 5
13:21:03:         CPUs: 8
13:21:03:       Memory: 14.00GiB
13:21:03:  Free Memory: 12.66GiB
13:21:03:      Threads: WINDOWS_THREADS
13:21:03:   OS Version: 6.2
13:21:03:  Has Battery: false
13:21:03:   On Battery: false
13:21:03:   UTC Offset: -5
13:21:03:          PID: 3864
13:21:03:          CWD: C:/Users/ZZeppo/AppData/Roaming/FAHClient
13:21:03:           OS: Windows 8.1 Enterprise
13:21:03:      OS Arch: AMD64
13:21:03:         GPUs: 2
13:21:03:        GPU 0: NVIDIA:1 G96 [Quadro FX 580]
13:21:03:        GPU 1: NVIDIA:3 GK107 [Quadro K600]
13:21:03:         CUDA: 3.0
13:21:03:  CUDA Driver: 6050
13:21:03:Win32 Service: false
13:21:03:***********************************************************************
13:21:03:<config>
13:21:03:  <!-- Network -->
13:21:03:  <proxy v=':8080'/>
13:21:03:
13:21:03:  <!-- Slot Control -->
13:21:03:  <power v='FULL'/>
13:21:03:
13:21:03:  <!-- User Information -->
13:21:03:  <passkey v='********************************'/>
13:21:03:  <team v='111065'/>
13:21:03:  <user v='Zepppster'/>
13:21:03:
13:21:03:  <!-- Folding Slots -->
13:21:03:  <slot id='0' type='CPU'/>
13:21:03:  <slot id='1' type='GPU'/>
13:21:03:</config>
13:21:03:Trying to access database...
13:21:03:Successfully acquired database lock
13:21:03:Enabled folding slot 00: READY cpu:7
13:21:03:Enabled folding slot 01: READY gpu:0:G96 [Quadro FX 580]
13:21:03:WARNING:WU01:No longer matches Slot 1's configuration and there are no other matching slots, dumping
13:21:03:WU01:FS01:Sending unit results: id:01 state:SEND error:DUMPED project:9201 run:39 clone:1 gen:38 core:0x17 unit:0x000000506652edc45399d793e67d0c23
13:21:03:WU01:FS01:Connecting to 171.67.108.52:8080
13:21:03:WU00:FS00:Starting
13:21:03:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 00 -suffix 01 -version 704 -lifeline 3864 -checkpoint 15 -np 7
13:21:03:WU00:FS00:Started FahCore on PID 4840
13:21:03:WU00:FS00:Core PID:2596
13:21:03:WU00:FS00:FahCore 0xa3 started
13:21:03:WU02:FS01:Connecting to 171.67.108.201:80
13:21:03:WU00:FS00:0xa3:
13:21:03:WU00:FS00:0xa3:*------------------------------*
13:21:03:WU00:FS00:0xa3:Folding@Home Gromacs SMP Core
13:21:03:WU00:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
13:21:03:WU00:FS00:0xa3:
13:21:03:WU00:FS00:0xa3:Preparing to commence simulation
13:21:03:WU00:FS00:0xa3:- Ensuring status. Please wait.
13:21:04:WU01:FS01:Server responded WORK_ACK (400)
13:21:04:WU01:FS01:Cleaning up
13:21:04:WARNING:WU02:FS01:Failed to get assignment from '171.67.108.201:80': Empty work server assignment
13:21:04:WU02:FS01:Connecting to 171.64.65.160:80
13:21:05:WARNING:WU02:FS01:Failed to get assignment from '171.64.65.160:80': Empty work server assignment
13:21:05:ERROR:WU02:FS01:Exception: Could not get an assignment
13:21:06:WU02:FS01:Connecting to 171.67.108.201:80
13:21:06:WARNING:WU02:FS01:Failed to get assignment from '171.67.108.201:80': Empty work server assignment
13:21:06:WU02:FS01:Connecting to 171.64.65.160:80
13:21:07:WARNING:WU02:FS01:Failed to get assignment from '171.64.65.160:80': Empty work server assignment
13:21:07:ERROR:WU02:FS01:Exception: Could not get an assignment
13:21:13:WU00:FS00:0xa3:- Looking at optimizations...
13:21:13:WU00:FS00:0xa3:- Working with standard loops on this execution.
13:21:13:WU00:FS00:0xa3:- Previous termination of core was improper.
13:21:13:WU00:FS00:0xa3:- Going to use standard loops.
13:21:13:WU00:FS00:0xa3:- Files status OK
13:21:13:WU00:FS00:0xa3:- Expanded 3809350 -> 4136808 (decompressed 108.5 percent)
13:21:13:WU00:FS00:0xa3:Called DecompressByteArray: compressed_data_size=3809350 data_size=4136808, decompressed_data_size=4136808 diff=0
13:21:13:WU00:FS00:0xa3:- Digital signature verified
13:21:13:WU00:FS00:0xa3:
13:21:13:WU00:FS00:0xa3:Project: 6098 (Run 5, Clone 98, Gen 495)
13:21:13:WU00:FS00:0xa3:
13:21:13:WU00:FS00:0xa3:Entering M.D.
13:21:19:WU00:FS00:0xa3:Using Gromacs checkpoints
13:21:19:WU00:FS00:0xa3:Mapping NT from 7 to 7 
13:21:20:WU00:FS00:0xa3:Resuming from checkpoint
13:21:20:WU00:FS00:0xa3:Verified 00/wudata_01.log
13:21:20:WU00:FS00:0xa3:Verified 00/wudata_01.trr
13:21:20:WU00:FS00:0xa3:Verified 00/wudata_01.edr
13:21:20:WU00:FS00:0xa3:Completed 381390 out of 500000 steps  (76%)
13:22:06:WU02:FS01:Connecting to 171.67.108.201:80
13:22:06:WARNING:WU02:FS01:Failed to get assignment from '171.67.108.201:80': Empty work server assignment
13:22:06:WU02:FS01:Connecting to 171.64.65.160:80
13:22:06:WARNING:WU02:FS01:Failed to get assignment from '171.64.65.160:80': Empty work server assignment
13:22:06:ERROR:WU02:FS01:Exception: Could not get an assignment
13:23:07:16:127.0.0.1:New Web connection
13:23:43:WU02:FS01:Connecting to 171.67.108.201:80
13:23:43:WARNING:WU02:FS01:Failed to get assignment from '171.67.108.201:80': Empty work server assignment
13:23:43:WU02:FS01:Connecting to 171.64.65.160:80
13:23:43:WARNING:WU02:FS01:Failed to get assignment from '171.64.65.160:80': Empty work server assignment
13:23:43:ERROR:WU02:FS01:Exception: Could not get an assignment
13:26:20:WU02:FS01:Connecting to 171.67.108.201:80
13:26:20:WARNING:WU02:FS01:Failed to get assignment from '171.67.108.201:80': Empty work server assignment
13:26:20:WU02:FS01:Connecting to 171.64.65.160:80
13:26:20:WARNING:WU02:FS01:Failed to get assignment from '171.64.65.160:80': Empty work server assignment
13:26:20:ERROR:WU02:FS01:Exception: Could not get an assignment
13:29:19:Adding folding slot 02: READY gpu:1:GK107 [Quadro K600]
13:29:19:Saving configuration to config.xml
13:29:19:<config>
13:29:19:  <!-- Network -->
13:29:19:  <proxy v=':8080'/>
13:29:19:
13:29:19:  <!-- Slot Control -->
13:29:19:  <power v='FULL'/>
13:29:19:
13:29:19:  <!-- User Information -->
13:29:19:  <passkey v='********************************'/>
13:29:19:  <team v='111065'/>
13:29:19:  <user v='Zepppster'/>
13:29:19:
13:29:19:  <!-- Folding Slots -->
13:29:19:  <slot id='0' type='CPU'/>
13:29:19:  <slot id='1' type='GPU'/>
13:29:19:  <slot id='2' type='GPU'/>
13:29:19:</config>
13:29:20:FS00:Shutting core down
13:29:20:WU01:FS02:Connecting to 171.67.108.201:80
13:29:20:WU01:FS02:Assigned to work server 171.67.108.52
13:29:20:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
13:29:20:WU01:FS02:Connecting to 171.67.108.52:8080
13:29:20:WU01:FS02:Downloading 1.52MiB
13:29:21:WU01:FS02:Download complete
13:29:21:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9201 run:656 clone:0 gen:74 core:0x17 unit:0x000000716652edc45399efd5bcd699e6
13:29:21:WU01:FS02:Starting
13:29:21:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 3864 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
13:29:21:WU01:FS02:Started FahCore on PID 1100
13:29:21:WU01:FS02:Core PID:4372
13:29:21:WU01:FS02:FahCore 0x17 started
13:29:22:WU01:FS02:0x17:*********************** Log Started 2014-08-22T13:29:21Z ***********************
13:29:22:WU01:FS02:0x17:Project: 9201 (Run 656, Clone 0, Gen 74)
13:29:22:WU01:FS02:0x17:Unit: 0x000000716652edc45399efd5bcd699e6
13:29:22:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
13:29:22:WU01:FS02:0x17:Machine: 2
13:29:22:WU01:FS02:0x17:Reading tar file state.xml
13:29:22:WU01:FS02:0x17:Reading tar file system.xml
13:29:22:WU01:FS02:0x17:Reading tar file integrator.xml
13:29:22:WU01:FS02:0x17:Reading tar file core.xml
13:29:22:WU01:FS02:0x17:Digital signatures verified
13:29:22:WU01:FS02:0x17:Folding@home GPU core17
13:29:22:WU01:FS02:0x17:Version 0.0.52
13:29:23:WU00:FS00:0xa3:Client no longer detected. Shutting down core 
13:29:23:WU00:FS00:0xa3:
13:29:23:WU00:FS00:0xa3:Folding@home Core Shutdown: CLIENT_DIED
13:29:23:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
13:29:24:WU00:FS00:Starting
13:29:24:WARNING:WU00:FS00:Changed SMP threads from 7 to 6 this can cause some work units to fail
13:29:24:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 00 -suffix 01 -version 704 -lifeline 3864 -checkpoint 15 -np 6
13:29:24:WU00:FS00:Started FahCore on PID 3372
13:29:24:WU00:FS00:Core PID:4944
13:29:24:WU00:FS00:FahCore 0xa3 started
13:29:24:WU00:FS00:0xa3:
13:29:24:WU00:FS00:0xa3:*------------------------------*
13:29:24:WU00:FS00:0xa3:Folding@Home Gromacs SMP Core
13:29:24:WU00:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
13:29:24:WU00:FS00:0xa3:
13:29:24:WU00:FS00:0xa3:Preparing to commence simulation
13:29:24:WU00:FS00:0xa3:- Looking at optimizations...
13:29:24:WU00:FS00:0xa3:- Files status OK
13:29:24:WU00:FS00:0xa3:- Expanded 3809350 -> 4136808 (decompressed 108.5 percent)
13:29:24:WU00:FS00:0xa3:Called DecompressByteArray: compressed_data_size=3809350 data_size=4136808, decompressed_data_size=4136808 diff=0
13:29:24:WU00:FS00:0xa3:- Digital signature verified
13:29:24:WU00:FS00:0xa3:
13:29:24:WU00:FS00:0xa3:Project: 6098 (Run 5, Clone 98, Gen 495)
13:29:24:WU00:FS00:0xa3:
13:29:24:WU00:FS00:0xa3:Assembly optimizations on if available.
13:29:24:WU00:FS00:0xa3:Entering M.D.
13:29:30:WU00:FS00:0xa3:Using Gromacs checkpoints
13:29:30:WU00:FS00:0xa3:Mapping NT from 6 to 6 
13:29:31:WU00:FS00:0xa3:Resuming from checkpoint
13:29:31:WU00:FS00:0xa3:Verified 00/wudata_01.log
13:29:31:WU00:FS00:0xa3:Verified 00/wudata_01.trr
13:29:31:WU00:FS00:0xa3:Verified 00/wudata_01.edr
13:29:31:WU00:FS00:0xa3:Completed 381390 out of 500000 steps  (76%)
13:30:01:WU01:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
13:30:01:WU01:FS02:0x17:Saving result file logfile_01.txt
13:30:01:WU01:FS02:0x17:Saving result file log.txt
13:30:01:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
13:30:01:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
13:30:01:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:9201 run:656 clone:0 gen:74 core:0x17 unit:0x000000716652edc45399efd5bcd699e6
13:30:01:WU01:FS02:Uploading 2.39KiB to 171.67.108.52
13:30:01:WU01:FS02:Connecting to 171.67.108.52:8080
13:30:01:WU01:FS02:Upload complete
13:30:02:WU01:FS02:Server responded WORK_ACK (400)
13:30:02:WU01:FS02:Cleaning up
13:30:02:WU03:FS02:Connecting to 171.67.108.201:80
13:30:02:WU03:FS02:Assigned to work server 171.67.108.52
13:30:02:WU03:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
13:30:02:WU03:FS02:Connecting to 171.67.108.52:8080
13:30:02:WU03:FS02:Downloading 1.53MiB
13:30:03:WU03:FS02:Download complete
13:30:03:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:9201 run:143 clone:1 gen:31 core:0x17 unit:0x000000476652edc45399dba319d90504
13:30:03:WU03:FS02:Starting
13:30:03:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 704 -lifeline 3864 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
13:30:03:WU03:FS02:Started FahCore on PID 1080
13:30:03:WU03:FS02:Core PID:932
13:30:03:WU03:FS02:FahCore 0x17 started
13:30:04:WU03:FS02:0x17:*********************** Log Started 2014-08-22T13:30:03Z ***********************
13:30:04:WU03:FS02:0x17:Project: 9201 (Run 143, Clone 1, Gen 31)
13:30:04:WU03:FS02:0x17:Unit: 0x000000476652edc45399dba319d90504
13:30:04:WU03:FS02:0x17:CPU: 0x00000000000000000000000000000000
13:30:04:WU03:FS02:0x17:Machine: 2
13:30:04:WU03:FS02:0x17:Reading tar file state.xml
13:30:04:WU03:FS02:0x17:Reading tar file system.xml
13:30:04:WU03:FS02:0x17:Reading tar file integrator.xml
13:30:04:WU03:FS02:0x17:Reading tar file core.xml
13:30:04:WU03:FS02:0x17:Digital signatures verified
13:30:04:WU03:FS02:0x17:Folding@home GPU core17
13:30:04:WU03:FS02:0x17:Version 0.0.52
13:30:12:Saving configuration to config.xml
13:30:12:<config>
13:30:12:  <!-- Network -->
13:30:12:  <proxy v=':8080'/>
13:30:12:
13:30:12:  <!-- Slot Control -->
13:30:12:  <power v='FULL'/>
13:30:12:
13:30:12:  <!-- User Information -->
13:30:12:  <passkey v='********************************'/>
13:30:12:  <team v='111065'/>
13:30:12:  <user v='Zepppster'/>
13:30:12:
13:30:12:  <!-- Folding Slots -->
13:30:12:  <slot id='0' type='CPU'/>
13:30:12:  <slot id='1' type='GPU'/>
13:30:12:  <slot id='2' type='GPU'/>
13:30:12:</config>
13:30:34:WU02:FS01:Connecting to 171.67.108.201:80
13:30:34:WARNING:WU02:FS01:Failed to get assignment from '171.67.108.201:80': Empty work server assignment
13:30:34:WU02:FS01:Connecting to 171.64.65.160:80
13:30:36:WARNING:WU02:FS01:Failed to get assignment from '171.64.65.160:80': Empty work server assignment
13:30:36:ERROR:WU02:FS01:Exception: Could not get an assignment
13:30:38:WU03:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
13:30:38:WU03:FS02:0x17:Saving result file logfile_01.txt
13:30:38:WU03:FS02:0x17:Saving result file log.txt
13:30:38:WU03:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
13:30:38:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
13:30:38:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:9201 run:143 clone:1 gen:31 core:0x17 unit:0x000000476652edc45399dba319d90504
13:30:38:WU03:FS02:Uploading 2.39KiB to 171.67.108.52
13:30:38:WU03:FS02:Connecting to 171.67.108.52:8080
13:30:38:WU03:FS02:Upload complete
13:30:38:WU03:FS02:Server responded WORK_ACK (400)
13:30:38:WU03:FS02:Cleaning up
13:30:38:WU01:FS02:Connecting to 171.67.108.201:80
13:30:38:WU01:FS02:Assigned to work server 171.67.108.52
13:30:38:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
13:30:38:WU01:FS02:Connecting to 171.67.108.52:8080
13:30:39:WU01:FS02:Downloading 1.52MiB
13:30:40:WU01:FS02:Download complete
13:30:40:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9201 run:897 clone:0 gen:61 core:0x17 unit:0x0000006d6652edc45399f94abecfd680
13:30:40:WU01:FS02:Starting
13:30:40:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 3864 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
13:30:40:WU01:FS02:Started FahCore on PID 4252
13:30:40:WU01:FS02:Core PID:420
13:30:40:WU01:FS02:FahCore 0x17 started
13:30:40:WU01:FS02:0x17:*********************** Log Started 2014-08-22T13:30:40Z ***********************
13:30:40:WU01:FS02:0x17:Project: 9201 (Run 897, Clone 0, Gen 61)
13:30:40:WU01:FS02:0x17:Unit: 0x0000006d6652edc45399f94abecfd680
13:30:40:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
13:30:40:WU01:FS02:0x17:Machine: 2
13:30:40:WU01:FS02:0x17:Reading tar file state.xml
13:30:40:WU01:FS02:0x17:Reading tar file system.xml
13:30:41:WU01:FS02:0x17:Reading tar file integrator.xml
13:30:41:WU01:FS02:0x17:Reading tar file core.xml
13:30:41:WU01:FS02:0x17:Digital signatures verified
13:30:41:WU01:FS02:0x17:Folding@home GPU core17
13:30:41:WU01:FS02:0x17:Version 0.0.52
13:31:15:WU01:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
13:31:15:WU01:FS02:0x17:Saving result file logfile_01.txt
13:31:15:WU01:FS02:0x17:Saving result file log.txt
13:31:15:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
13:31:15:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
13:31:15:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:9201 run:897 clone:0 gen:61 core:0x17 unit:0x0000006d6652edc45399f94abecfd680
13:31:15:WU01:FS02:Uploading 2.38KiB to 171.67.108.52
13:31:15:WU01:FS02:Connecting to 171.67.108.52:8080
13:31:16:WU01:FS02:Upload complete
13:31:16:WU01:FS02:Server responded WORK_ACK (400)
13:31:16:WU01:FS02:Cleaning up
13:31:16:WU01:FS02:Connecting to 171.67.108.201:80
13:31:16:WU01:FS02:Assigned to work server 171.67.108.52
13:31:16:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
13:31:16:WU01:FS02:Connecting to 171.67.108.52:8080
13:31:16:WU01:FS02:Downloading 1.53MiB
13:31:17:WU01:FS02:Download complete
13:31:17:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9201 run:832 clone:1 gen:24 core:0x17 unit:0x000000466652edc45399f6be3755fec9
13:31:17:WU01:FS02:Starting
13:31:17:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 3864 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
13:31:17:WU01:FS02:Started FahCore on PID 4812
13:31:17:WU01:FS02:Core PID:3208
13:31:17:WU01:FS02:FahCore 0x17 started
13:31:17:WU01:FS02:0x17:*********************** Log Started 2014-08-22T13:31:17Z ***********************
13:31:17:WU01:FS02:0x17:Project: 9201 (Run 832, Clone 1, Gen 24)
13:31:17:WU01:FS02:0x17:Unit: 0x000000466652edc45399f6be3755fec9
13:31:17:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
13:31:17:WU01:FS02:0x17:Machine: 2
13:31:17:WU01:FS02:0x17:Reading tar file state.xml
13:31:17:WU01:FS02:0x17:Reading tar file system.xml
13:31:18:WU01:FS02:0x17:Reading tar file integrator.xml
13:31:18:WU01:FS02:0x17:Reading tar file core.xml
13:31:18:WU01:FS02:0x17:Digital signatures verified
13:31:18:WU01:FS02:0x17:Folding@home GPU core17
13:31:18:WU01:FS02:0x17:Version 0.0.52
13:31:51:WU01:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
13:31:51:WU01:FS02:0x17:Saving result file logfile_01.txt
13:31:51:WU01:FS02:0x17:Saving result file log.txt
13:31:51:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
13:31:52:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
13:31:52:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:9201 run:832 clone:1 gen:24 core:0x17 unit:0x000000466652edc45399f6be3755fec9
13:31:52:WU01:FS02:Uploading 2.39KiB to 171.67.108.52
13:31:52:WU01:FS02:Connecting to 171.67.108.52:8080
13:31:52:WU01:FS02:Upload complete
13:31:52:WU01:FS02:Server responded WORK_ACK (400)
13:31:52:WU01:FS02:Cleaning up
13:31:52:WU03:FS02:Connecting to 171.67.108.201:80
13:31:52:WU03:FS02:Assigned to work server 171.67.108.52
13:31:52:WU03:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
13:31:52:WU03:FS02:Connecting to 171.67.108.52:8080
13:31:53:WU03:FS02:Downloading 1.52MiB
13:31:53:WU03:FS02:Download complete
13:31:53:WU03:FS02:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:9201 run:922 clone:1 gen:24 core:0x17 unit:0x000000366652edc45399fa45e30c8e17
13:31:53:WU03:FS02:Starting
13:31:53:WU03:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 03 -suffix 01 -version 704 -lifeline 3864 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
13:31:53:WU03:FS02:Started FahCore on PID 1484
13:31:53:WU03:FS02:Core PID:1760
13:31:53:WU03:FS02:FahCore 0x17 started
13:31:54:WU03:FS02:0x17:*********************** Log Started 2014-08-22T13:31:54Z ***********************
13:31:54:WU03:FS02:0x17:Project: 9201 (Run 922, Clone 1, Gen 24)
13:31:54:WU03:FS02:0x17:Unit: 0x000000366652edc45399fa45e30c8e17
13:31:54:WU03:FS02:0x17:CPU: 0x00000000000000000000000000000000
13:31:54:WU03:FS02:0x17:Machine: 2
13:31:54:WU03:FS02:0x17:Reading tar file state.xml
13:31:54:WU03:FS02:0x17:Reading tar file system.xml
13:31:54:WU03:FS02:0x17:Reading tar file integrator.xml
13:31:54:WU03:FS02:0x17:Reading tar file core.xml
13:31:54:WU03:FS02:0x17:Digital signatures verified
13:31:54:WU03:FS02:0x17:Folding@home GPU core17
13:31:54:WU03:FS02:0x17:Version 0.0.52
13:32:29:WU03:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
13:32:29:WU03:FS02:0x17:Saving result file logfile_01.txt
13:32:29:WU03:FS02:0x17:Saving result file log.txt
13:32:29:WU03:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
13:32:29:WARNING:WU03:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
13:32:29:WU03:FS02:Sending unit results: id:03 state:SEND error:FAULTY project:9201 run:922 clone:1 gen:24 core:0x17 unit:0x000000366652edc45399fa45e30c8e17
13:32:29:WU03:FS02:Uploading 2.37KiB to 171.67.108.52
13:32:29:WU03:FS02:Connecting to 171.67.108.52:8080
13:32:29:WU03:FS02:Upload complete
13:32:29:WU03:FS02:Server responded WORK_ACK (400)
13:32:29:WU03:FS02:Cleaning up
13:32:29:WU01:FS02:Connecting to 171.67.108.201:80
13:32:29:WU01:FS02:Assigned to work server 171.67.108.52
13:32:29:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
13:32:29:WU01:FS02:Connecting to 171.67.108.52:8080
13:32:30:WU01:FS02:Downloading 1.53MiB
13:32:31:WU01:FS02:Download complete
13:32:31:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9201 run:936 clone:1 gen:24 core:0x17 unit:0x000000386652edc45399fad4e0f2758d
13:32:31:WU01:FS02:Starting
13:32:31:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 3864 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
13:32:31:WU01:FS02:Started FahCore on PID 4528
13:32:31:WU01:FS02:Core PID:2480
13:32:31:WU01:FS02:FahCore 0x17 started
13:32:31:WU01:FS02:0x17:*********************** Log Started 2014-08-22T13:32:31Z ***********************
13:32:31:WU01:FS02:0x17:Project: 9201 (Run 936, Clone 1, Gen 24)
13:32:31:WU01:FS02:0x17:Unit: 0x000000386652edc45399fad4e0f2758d
13:32:31:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
13:32:31:WU01:FS02:0x17:Machine: 2
13:32:31:WU01:FS02:0x17:Reading tar file state.xml
13:32:31:WU01:FS02:0x17:Reading tar file system.xml
13:32:31:WU01:FS02:0x17:Reading tar file integrator.xml
13:32:31:WU01:FS02:0x17:Reading tar file core.xml
13:32:31:WU01:FS02:0x17:Digital signatures verified
13:32:31:WU01:FS02:0x17:Folding@home GPU core17
13:32:31:WU01:FS02:0x17:Version 0.0.52
13:33:06:WU01:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
13:33:06:WU01:FS02:0x17:Saving result file logfile_01.txt
13:33:06:WU01:FS02:0x17:Saving result file log.txt
13:33:06:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
13:33:06:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
13:33:06:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:9201 run:936 clone:1 gen:24 core:0x17 unit:0x000000386652edc45399fad4e0f2758d
13:33:06:WU01:FS02:Uploading 2.38KiB to 171.67.108.52
13:33:06:WU01:FS02:Connecting to 171.67.108.52:8080
13:33:06:WU01:FS02:Upload complete
13:33:06:WU01:FS02:Server responded WORK_ACK (400)
13:33:06:WU01:FS02:Cleaning up
13:33:06:WU01:FS02:Connecting to 171.67.108.201:80
13:33:06:WU01:FS02:Assigned to work server 171.67.108.52
13:33:06:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
13:33:06:WU01:FS02:Connecting to 171.67.108.52:8080
13:33:07:WU01:FS02:Downloading 1.53MiB
13:33:08:WU01:FS02:Download complete
13:33:08:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9201 run:845 clone:0 gen:79 core:0x17 unit:0x0000006e6652edc45399f73fddd3e1d9
13:33:08:WU01:FS02:Starting
13:33:08:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 3864 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
13:33:08:WU01:FS02:Started FahCore on PID 3208
13:33:08:WU01:FS02:Core PID:4444
13:33:08:WU01:FS02:FahCore 0x17 started
13:33:08:WU01:FS02:0x17:*********************** Log Started 2014-08-22T13:33:08Z ***********************
13:33:08:WU01:FS02:0x17:Project: 9201 (Run 845, Clone 0, Gen 79)
13:33:08:WU01:FS02:0x17:Unit: 0x0000006e6652edc45399f73fddd3e1d9
13:33:08:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
13:33:08:WU01:FS02:0x17:Machine: 2
13:33:08:WU01:FS02:0x17:Reading tar file state.xml
13:33:08:WU01:FS02:0x17:Reading tar file system.xml
13:33:09:WU01:FS02:0x17:Reading tar file integrator.xml
13:33:09:WU01:FS02:0x17:Reading tar file core.xml
13:33:09:WU01:FS02:0x17:Digital signatures verified
13:33:09:WU01:FS02:0x17:Folding@home GPU core17
13:33:09:WU01:FS02:0x17:Version 0.0.52
13:33:22:Saving configuration to config.xml
13:33:22:<config>
13:33:22:  <!-- Network -->
13:33:22:  <proxy v=':8080'/>
13:33:22:
13:33:22:  <!-- Slot Control -->
13:33:22:  <power v='FULL'/>
13:33:22:
13:33:22:  <!-- User Information -->
13:33:22:  <passkey v='********************************'/>
13:33:22:  <team v='111065'/>
13:33:22:  <user v='Zepppster'/>
13:33:22:
13:33:22:  <!-- Folding Slots -->
13:33:22:  <slot id='0' type='CPU'/>
13:33:22:  <slot id='2' type='GPU'/>
13:33:22:</config>
13:33:22:FS00:Shutting core down
13:33:22:WU02:FS01:Slot ID 1 no longer exists and not yet downloaded, dumping
13:33:22:WU02:FS01:Cleaning up
13:33:24:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
13:33:24:WU00:FS00:Starting
13:33:24:WARNING:WU00:FS00:Changed SMP threads from 6 to 7 this can cause some work units to fail
13:33:24:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 00 -suffix 01 -version 704 -lifeline 3864 -checkpoint 15 -np 7
13:33:24:WU00:FS00:Started FahCore on PID 3788
13:33:24:WU00:FS00:Core PID:4528
13:33:24:WU00:FS00:FahCore 0xa3 started
13:33:25:WU00:FS00:0xa3:
13:33:25:WU00:FS00:0xa3:*------------------------------*
13:33:25:WU00:FS00:0xa3:Folding@Home Gromacs SMP Core
13:33:25:WU00:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
13:33:25:WU00:FS00:0xa3:
13:33:25:WU00:FS00:0xa3:Preparing to commence simulation
13:33:25:WU00:FS00:0xa3:- Looking at optimizations...
13:33:25:WU00:FS00:0xa3:- Files status OK
13:33:25:WU00:FS00:0xa3:- Expanded 3809350 -> 4136808 (decompressed 108.5 percent)
13:33:25:WU00:FS00:0xa3:Called DecompressByteArray: compressed_data_size=3809350 data_size=4136808, decompressed_data_size=4136808 diff=0
13:33:25:WU00:FS00:0xa3:- Digital signature verified
13:33:25:WU00:FS00:0xa3:
13:33:25:WU00:FS00:0xa3:Project: 6098 (Run 5, Clone 98, Gen 495)
13:33:25:WU00:FS00:0xa3:
13:33:25:WU00:FS00:0xa3:Assembly optimizations on if available.
13:33:25:WU00:FS00:0xa3:Entering M.D.
13:33:31:WU00:FS00:0xa3:Using Gromacs checkpoints
13:33:31:WU00:FS00:0xa3:Mapping NT from 7 to 7 
13:33:32:WU00:FS00:0xa3:Resuming from checkpoint
13:33:32:WU00:FS00:0xa3:Verified 00/wudata_01.log
13:33:32:WU00:FS00:0xa3:Verified 00/wudata_01.trr
13:33:32:WU00:FS00:0xa3:Verified 00/wudata_01.edr
13:33:32:WU00:FS00:0xa3:Completed 381390 out of 500000 steps  (76%)
13:33:40:WU01:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
13:33:40:WU01:FS02:0x17:Saving result file logfile_01.txt
13:33:40:WU01:FS02:0x17:Saving result file log.txt
13:33:40:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
13:33:40:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
13:33:40:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:9201 run:845 clone:0 gen:79 core:0x17 unit:0x0000006e6652edc45399f73fddd3e1d9
13:33:40:WU01:FS02:Uploading 2.38KiB to 171.67.108.52
13:33:40:WU01:FS02:Connecting to 171.67.108.52:8080
13:33:40:WU01:FS02:Upload complete
13:33:41:WU01:FS02:Server responded WORK_ACK (400)
13:33:41:WU01:FS02:Cleaning up
13:33:41:WU02:FS02:Connecting to 171.67.108.201:80
13:33:41:WU02:FS02:Assigned to work server 171.67.108.52
13:33:41:WU02:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
13:33:41:WU02:FS02:Connecting to 171.67.108.52:8080
13:33:41:WU02:FS02:Downloading 1.52MiB
13:33:42:WU02:FS02:Download complete
13:33:42:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9201 run:188 clone:1 gen:23 core:0x17 unit:0x000000326652edc45399dd66852bf31f
13:33:42:WU02:FS02:Starting
13:33:42:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 3864 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
13:33:42:WU02:FS02:Started FahCore on PID 2956
13:33:42:WU02:FS02:Core PID:4668
13:33:42:WU02:FS02:FahCore 0x17 started
13:33:43:WU02:FS02:0x17:*********************** Log Started 2014-08-22T13:33:42Z ***********************
13:33:43:WU02:FS02:0x17:Project: 9201 (Run 188, Clone 1, Gen 23)
13:33:43:WU02:FS02:0x17:Unit: 0x000000326652edc45399dd66852bf31f
13:33:43:WU02:FS02:0x17:CPU: 0x00000000000000000000000000000000
13:33:43:WU02:FS02:0x17:Machine: 2
13:33:43:WU02:FS02:0x17:Reading tar file state.xml
13:33:43:WU02:FS02:0x17:Reading tar file system.xml
13:33:43:WU02:FS02:0x17:Reading tar file integrator.xml
13:33:43:WU02:FS02:0x17:Reading tar file core.xml
13:33:43:WU02:FS02:0x17:Digital signatures verified
13:33:43:WU02:FS02:0x17:Folding@home GPU core17
13:33:43:WU02:FS02:0x17:Version 0.0.52
13:34:16:Saving configuration to config.xml
13:34:16:<config>
13:34:16:  <!-- Network -->
13:34:16:  <proxy v=':8080'/>
13:34:16:
13:34:16:  <!-- Slot Control -->
13:34:16:  <power v='FULL'/>
13:34:16:
13:34:16:  <!-- User Information -->
13:34:16:  <passkey v='********************************'/>
13:34:16:  <team v='111065'/>
13:34:16:  <user v='Zepppster'/>
13:34:16:
13:34:16:  <!-- Folding Slots -->
13:34:16:  <slot id='0' type='CPU'/>
13:34:16:  <slot id='2' type='GPU'/>
13:34:16:</config>
13:34:20:WU02:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
13:34:20:WU02:FS02:0x17:Saving result file logfile_01.txt
13:34:20:WU02:FS02:0x17:Saving result file log.txt
13:34:20:WU02:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
13:34:20:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
13:34:20:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:9201 run:188 clone:1 gen:23 core:0x17 unit:0x000000326652edc45399dd66852bf31f
13:34:20:WU02:FS02:Uploading 2.38KiB to 171.67.108.52
13:34:20:WU02:FS02:Connecting to 171.67.108.52:8080
13:34:20:WU02:FS02:Upload complete
13:34:20:WU02:FS02:Server responded WORK_ACK (400)
13:34:20:WU02:FS02:Cleaning up
13:34:21:WU01:FS02:Connecting to 171.67.108.201:80
13:34:21:WU01:FS02:Assigned to work server 171.67.108.52
13:34:21:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
13:34:21:WU01:FS02:Connecting to 171.67.108.52:8080
13:34:21:WU01:FS02:Downloading 1.52MiB
13:34:22:WU01:FS02:Download complete
13:34:22:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9201 run:461 clone:0 gen:156 core:0x17 unit:0x000000b46652edc45399e8281d0d62b3
13:34:22:WU01:FS02:Starting
13:34:22:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 3864 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
13:34:22:WU01:FS02:Started FahCore on PID 4280
13:34:22:WU01:FS02:Core PID:992
13:34:22:WU01:FS02:FahCore 0x17 started
13:34:23:WU01:FS02:0x17:*********************** Log Started 2014-08-22T13:34:22Z ***********************
13:34:23:WU01:FS02:0x17:Project: 9201 (Run 461, Clone 0, Gen 156)
13:34:23:WU01:FS02:0x17:Unit: 0x000000b46652edc45399e8281d0d62b3
13:34:23:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
13:34:23:WU01:FS02:0x17:Machine: 2
13:34:23:WU01:FS02:0x17:Reading tar file state.xml
13:34:23:WU01:FS02:0x17:Reading tar file system.xml
13:34:23:WU01:FS02:0x17:Reading tar file integrator.xml
13:34:23:WU01:FS02:0x17:Reading tar file core.xml
13:34:23:WU01:FS02:0x17:Digital signatures verified
13:34:23:WU01:FS02:0x17:Folding@home GPU core17
13:34:23:WU01:FS02:0x17:Version 0.0.52
13:34:35:FS00:Shutting core down
13:34:35:FS02:Shutting core down
13:34:35:WU01:FS02:0x17:WARNING:Console control signal 1 on PID 992
13:34:35:WU01:FS02:0x17:Exiting, please wait. . .
13:34:53:WU01:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
13:34:53:WU01:FS02:0x17:Saving result file logfile_01.txt
13:34:53:WU01:FS02:0x17:Saving result file log.txt
13:34:53:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
13:34:53:Clean exit
Image
Top
Joe_H
Site Admin
Posts: 7937
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp2
Location: W. MA

Re: Constant WU Failures on Both GPUs

Post by Joe_H »

As I mentioned in my earlier post, if you change the hardware configuration it is best to do a reinstall of the client. Otherwise it often gets the client configuration incorrect, especially for GPU slots. The client may have associated FS02 incorrectly with the K600 when actually the index values point to the FX580 and vice versa. The client sometimes gets the values wrong even on a new install, but it is more likely to occur after a change. The index values have even been reported to have changed by Windows after updating video drivers. There are posts on the forum on how to manually set the index values if a reinstall does not get them right.

Even if you get the K600 folding again this way, you might not get work for the FX580. The older card would have been assigned Core_11 work in the past, the servers for projects using that core went down a few weeks ago and it appears they are not coming back. Potentially the card might get assigned Core_15 projects, but as best as I can tell that is just being tested and not in general release. The K600 will be assigned projects using either Core_17 or Core_15.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3
Top
Nirvana
Posts: 21
Joined: Tue Aug 19, 2014 4:20 pm

Re: Constant WU Failures on Both GPUs

Post by Nirvana »

Should I give up on it then? It's not like the FX580 is a great folder anyways...
Image
Top
7im
Posts: 10179
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:
Contact 7im

Re: Constant WU Failures on Both GPUs

Post by 7im »

Give up? Depends. If this is a dedicated folding machine, yes. If you use this box for other purposes, you can make the FX580 the primary display. This is so that folding on the K600 doesn't produce any screen lag when trying to fold and use the computer.
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Constant WU Failures on Both GPUs

Post by bruce »

Probably. ... or move it to a machine where it's the only GPU.

The G80/G90 series has come close to being deprecated a couple of times and then somebody resurrects a project or two that can run on it.
Top
Nirvana
Posts: 21
Joined: Tue Aug 19, 2014 4:20 pm

Re: Constant WU Failures on Both GPUs

Post by Nirvana »

7im wrote:Give up? Depends. If this is a dedicated folding machine, yes. If you use this box for other purposes, you can make the FX580 the primary display. This is so that folding on the K600 doesn't produce any screen lag when trying to fold and use the computer.
This is a good idea...I'll probably do that.
Image
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Constant WU Failures on Both GPUs

Post by bruce »

The other question you should ask yourself is whether you notice screen lag.

Consider somebody who has a single GPU.

In one scenario, it's a high-powered GPU which is fast enough that interactive screen performance is acceptable. We recommend that they should be folding 24x7 with their GPU.

I another scenario, they have a low-end GPU (like your G98) and it takes a noticeable amount of time to finish processing whatever sized block of FAH work is in queue before the block from the OS can be processed. We recommend that their GPU be configured to process when the machine is considered idle so it does useful work while the person is AFK (over night, etc) but mouse/keyboard activity causes FAH to suspend processing when prompt interactive access to the GPU's resources is a good idea.

In any case, you'll need to be sure FAH has not mis-identified your GPUs. [Sometimes it gets them right and sometimes not.] You'll need to test that by selectively disabling one slot at a time and using a 3rd party GPU monitor to figure out which ones are doing FAH and which one is not.
Top
Nirvana
Posts: 21
Joined: Tue Aug 19, 2014 4:20 pm

Re: Constant WU Failures on Both GPUs

Post by Nirvana »

I definitely notice the screen lag, its pretty bad... I've set the FX 580 to not fold and the K600 to fold. But now the K600 is failing WUs. I'll upload the logs shortly.

I've also uninstalled the client, rebooted, then reinstalled. Then removed the FX580 from folding and kept the K600 in there.
Image
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Constant WU Failures on Both GPUs

Post by bruce »

Most likely the failing WUs are due to changing the physical setup without reinstalling. Notice that your GPUs are both NVIDIA, but one is subtype 1 and the other is subtype 3.

13:21:03: GPU 0: NVIDIA:1 G96 [Quadro FX 580]
13:21:03: GPU 1: NVIDIA:3 GK107 [Quadro K600]

WUs assigned to them are NOT interchangeable, and if FAH has misidentified them, that has to be corrected.
Top
Nirvana
Posts: 21
Joined: Tue Aug 19, 2014 4:20 pm

Re: Constant WU Failures on Both GPUs

Post by Nirvana »

I did re-install between hardware changes. Is there another way to disable the 580 in FAH than removing that slot?

Code: Select all

*********************** Log Started 2014-08-22T22:12:49Z ***********************
22:12:49:************************* Folding@home Client *************************
22:12:49:      Website: http://folding.stanford.edu/
22:12:49:    Copyright: (c) 2009-2014 Stanford University
22:12:49:       Author: Joseph Coffland <[email protected]>
22:12:49:         Args: --open-web-control
22:12:49:       Config: <none>
22:12:49:******************************** Build ********************************
22:12:49:      Version: 7.4.4
22:12:49:         Date: Mar 4 2014
22:12:49:         Time: 20:26:54
22:12:49:      SVN Rev: 4130
22:12:49:       Branch: fah/trunk/client
22:12:49:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
22:12:49:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
22:12:49:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
22:12:49:     Platform: win32 XP
22:12:49:         Bits: 32
22:12:49:         Mode: Release
22:12:49:******************************* System ********************************
22:12:49:          CPU: Intel(R) Xeon(R) CPU W3570 @ 3.20GHz
22:12:49:       CPU ID: GenuineIntel Family 6 Model 26 Stepping 5
22:12:49:         CPUs: 8
22:12:49:       Memory: 14.00GiB
22:12:49:  Free Memory: 12.43GiB
22:12:49:      Threads: WINDOWS_THREADS
22:12:49:   OS Version: 6.2
22:12:49:  Has Battery: false
22:12:49:   On Battery: false
22:12:49:   UTC Offset: -5
22:12:49:          PID: 6072
22:12:49:          CWD: C:/Users/ZZeppo/AppData/Roaming/FAHClient
22:12:49:           OS: Windows 8.1 Enterprise
22:12:49:      OS Arch: AMD64
22:12:49:         GPUs: 2
22:12:49:        GPU 0: NVIDIA:1 G96 [Quadro FX 580]
22:12:49:        GPU 1: NVIDIA:3 GK107 [Quadro K600]
22:12:49:         CUDA: 3.0
22:12:49:  CUDA Driver: 6050
22:12:49:Win32 Service: false
22:12:49:***********************************************************************
22:12:49:<config>
22:12:49:  <!-- Folding Slots -->
22:12:49:</config>
22:12:49:Connecting to assign-GPU.stanford.edu:80
22:12:49:Updated GPUs.txt
22:12:49:Read GPUs.txt
22:12:49:Trying to access database...
22:12:49:Successfully acquired database lock
22:12:49:Enabled folding slot 00: PAUSED cpu:5 (not configured)
22:12:49:Enabled folding slot 01: PAUSED gpu:0:G96 [Quadro FX 580] (not configured)
22:12:49:Enabled folding slot 02: PAUSED gpu:1:GK107 [Quadro K600] (not configured)
22:12:53:16:127.0.0.1:New Web connection
22:13:29:Saving configuration to config.xml
22:13:29:<config>
22:13:29:  <!-- Network -->
22:13:29:  <proxy v=':8080'/>
22:13:29:
22:13:29:  <!-- User Information -->
22:13:29:  <passkey v='********************************'/>
22:13:29:  <team v='111065'/>
22:13:29:  <user v='Zepppster'/>
22:13:29:
22:13:29:  <!-- Folding Slots -->
22:13:29:  <slot id='0' type='CPU'/>
22:13:29:  <slot id='1' type='GPU'/>
22:13:29:  <slot id='2' type='GPU'/>
22:13:29:</config>
22:13:29:FS00:Set client configured
22:13:29:WU00:FS00:Connecting to 171.67.108.200:8080
22:13:29:WU01:FS01:Connecting to 171.67.108.200:8080
22:13:29:WU00:FS00:Connecting to 171.67.108.200:8080
22:13:30:WU01:FS01:Connecting to 171.67.108.201:80
22:13:30:WU02:FS02:Connecting to 171.67.108.201:80
22:13:30:WU00:FS00:Assigned to work server 128.143.231.202
22:13:30:WU00:FS00:Requesting new work unit for slot 00: READY cpu:5 from 128.143.231.202
22:13:30:WU00:FS00:Connecting to 128.143.231.202:8080
22:13:30:WARNING:WU01:FS01:Failed to get assignment from '171.67.108.201:80': Empty work server assignment
22:13:30:WU01:FS01:Connecting to 171.64.65.160:80
22:13:30:WU02:FS02:Assigned to work server 171.67.108.52
22:13:30:WU02:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
22:13:30:WU02:FS02:Connecting to 171.67.108.52:8080
22:13:30:WU02:FS02:Downloading 1.52MiB
22:13:30:WARNING:WU01:FS01:Failed to get assignment from '171.64.65.160:80': Empty work server assignment
22:13:30:ERROR:WU01:FS01:Exception: Could not get an assignment
22:13:30:WU01:FS01:Connecting to 171.67.108.201:80
22:13:31:WARNING:WU01:FS01:Failed to get assignment from '171.67.108.201:80': Empty work server assignment
22:13:31:WU01:FS01:Connecting to 171.64.65.160:80
22:13:31:WARNING:WU01:FS01:Failed to get assignment from '171.64.65.160:80': Empty work server assignment
22:13:31:ERROR:WU01:FS01:Exception: Could not get an assignment
22:13:31:WU00:FS00:Downloading 3.63MiB
22:13:31:WU02:FS02:Download complete
22:13:31:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9201 run:530 clone:1 gen:51 core:0x17 unit:0x000000596652edc45399eadd3a97f7a0
22:13:31:WU02:FS02:Downloading core from http://web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah
22:13:31:WU02:FS02:Connecting to web.stanford.edu:80
22:13:32:WU00:FS00:Download complete
22:13:38:WU02:FS02:FahCore 17: Downloading 2.55MiB
22:13:38:WU02:FS02:FahCore 17: Download complete
22:13:38:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:6099 run:0 clone:10 gen:423 core:0xa3 unit:0x00007aea0a3b1e59513e873875178920
22:13:38:WU00:FS00:Downloading core from http://web.stanford.edu/~pande/Win32/AMD64/Core_a3.fah
22:13:38:WU00:FS00:Connecting to web.stanford.edu:80
22:13:39:WU02:FS02:Valid core signature
22:13:39:WU02:FS02:Unpacked 8.60MiB to cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe
22:13:39:WU02:FS02:Starting
22:13:39:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 6072 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
22:13:39:WU02:FS02:Started FahCore on PID 2504
22:13:39:WU02:FS02:Core PID:1724
22:13:39:WU02:FS02:FahCore 0x17 started
22:13:40:WU02:FS02:0x17:*********************** Log Started 2014-08-22T22:13:39Z ***********************
22:13:40:WU02:FS02:0x17:Project: 9201 (Run 530, Clone 1, Gen 51)
22:13:40:WU02:FS02:0x17:Unit: 0x000000596652edc45399eadd3a97f7a0
22:13:40:WU02:FS02:0x17:CPU: 0x00000000000000000000000000000000
22:13:40:WU02:FS02:0x17:Machine: 2
22:13:40:WU02:FS02:0x17:Reading tar file state.xml
22:13:40:WU02:FS02:0x17:Reading tar file system.xml
22:13:40:WU02:FS02:0x17:Reading tar file integrator.xml
22:13:40:WU02:FS02:0x17:Reading tar file core.xml
22:13:40:WU02:FS02:0x17:Digital signatures verified
22:13:40:WU02:FS02:0x17:Folding@home GPU core17
22:13:40:WU02:FS02:0x17:Version 0.0.52
22:13:46:WU00:FS00:FahCore a3: Downloading 2.89MiB
22:13:46:WU00:FS00:FahCore a3: Download complete
22:13:47:WU00:FS00:Valid core signature
22:13:47:WU00:FS00:Unpacked 9.59MiB to cores/web.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe
22:13:47:WU00:FS00:Starting
22:13:47:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 00 -suffix 01 -version 704 -lifeline 6072 -checkpoint 15 -np 5
22:13:47:WU00:FS00:Started FahCore on PID 4788
22:13:47:WU00:FS00:Core PID:2136
22:13:47:WU00:FS00:FahCore 0xa3 started
22:13:48:WU00:FS00:0xa3:
22:13:48:WU00:FS00:0xa3:*------------------------------*
22:13:48:WU00:FS00:0xa3:Folding@Home Gromacs SMP Core
22:13:48:WU00:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
22:13:48:WU00:FS00:0xa3:
22:13:48:WU00:FS00:0xa3:Preparing to commence simulation
22:13:48:WU00:FS00:0xa3:- Looking at optimizations...
22:13:48:WU00:FS00:0xa3:- Created dyn
22:13:48:WU00:FS00:0xa3:- Files status OK
22:13:48:WU00:FS00:0xa3:- Expanded 3810017 -> 4169428 (decompressed 109.4 percent)
22:13:48:WU00:FS00:0xa3:Called DecompressByteArray: compressed_data_size=3810017 data_size=4169428, decompressed_data_size=4169428 diff=0
22:13:48:WU00:FS00:0xa3:- Digital signature verified
22:13:48:WU00:FS00:0xa3:
22:13:48:WU00:FS00:0xa3:Project: 6099 (Run 0, Clone 10, Gen 423)
22:13:48:WU00:FS00:0xa3:
22:13:48:WU00:FS00:0xa3:Assembly optimizations on if available.
22:13:48:WU00:FS00:0xa3:Entering M.D.
22:13:50:Saving configuration to config.xml
22:13:50:<config>
22:13:50:  <!-- Network -->
22:13:50:  <proxy v=':8080'/>
22:13:50:
22:13:50:  <!-- User Information -->
22:13:50:  <passkey v='********************************'/>
22:13:50:  <team v='111065'/>
22:13:50:  <user v='Zepppster'/>
22:13:50:
22:13:50:  <!-- Folding Slots -->
22:13:50:  <slot id='0' type='CPU'/>
22:13:50:  <slot id='1' type='GPU'/>
22:13:50:  <slot id='2' type='GPU'/>
22:13:50:</config>
22:13:54:WU00:FS00:0xa3:Mapping NT from 5 to 5 
22:13:54:WU00:FS00:0xa3:Completed 0 out of 500000 steps  (0%)
22:13:59:Saving configuration to config.xml
22:13:59:<config>
22:13:59:  <!-- Network -->
22:13:59:  <proxy v=':8080'/>
22:13:59:
22:13:59:  <!-- User Information -->
22:13:59:  <passkey v='********************************'/>
22:13:59:  <team v='111065'/>
22:13:59:  <user v='Zepppster'/>
22:13:59:
22:13:59:  <!-- Folding Slots -->
22:13:59:  <slot id='0' type='CPU'/>
22:13:59:  <slot id='2' type='GPU'/>
22:13:59:</config>
22:14:00:FS00:Shutting core down
22:14:00:WU01:FS01:Slot ID 1 no longer exists and not yet downloaded, dumping
22:14:00:WU01:FS01:Cleaning up
22:14:08:WU02:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
22:14:08:WU02:FS02:0x17:Saving result file logfile_01.txt
22:14:08:WU02:FS02:0x17:Saving result file log.txt
22:14:08:WU02:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:14:08:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
22:14:08:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:14:08:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:9201 run:530 clone:1 gen:51 core:0x17 unit:0x000000596652edc45399eadd3a97f7a0
22:14:08:WU02:FS02:Uploading 2.38KiB to 171.67.108.52
22:14:08:WU00:FS00:Starting
22:14:08:WU02:FS02:Connecting to 171.67.108.52:8080
22:14:08:WARNING:WU00:FS00:Changed SMP threads from 5 to 6 this can cause some work units to fail
22:14:08:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 00 -suffix 01 -version 704 -lifeline 6072 -checkpoint 15 -np 6
22:14:08:WU00:FS00:Started FahCore on PID 4280
22:14:08:WU00:FS00:Core PID:172
22:14:08:WU00:FS00:FahCore 0xa3 started
22:14:08:WU02:FS02:Upload complete
22:14:08:WU01:FS02:Connecting to 171.67.108.201:80
22:14:08:WU02:FS02:Server responded WORK_ACK (400)
22:14:08:WU02:FS02:Cleaning up
22:14:08:WU01:FS02:Assigned to work server 171.67.108.52
22:14:08:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
22:14:08:WU01:FS02:Connecting to 171.67.108.52:8080
22:14:09:WU01:FS02:Downloading 1.53MiB
22:14:09:WU00:FS00:0xa3:
22:14:09:WU00:FS00:0xa3:*------------------------------*
22:14:09:WU00:FS00:0xa3:Folding@Home Gromacs SMP Core
22:14:09:WU00:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
22:14:09:WU00:FS00:0xa3:
22:14:09:WU00:FS00:0xa3:Preparing to commence simulation
22:14:09:WU00:FS00:0xa3:- Looking at optimizations...
22:14:09:WU00:FS00:0xa3:- Files status OK
22:14:09:WU00:FS00:0xa3:- Expanded 3810017 -> 4169428 (decompressed 109.4 percent)
22:14:09:WU00:FS00:0xa3:Called DecompressByteArray: compressed_data_size=3810017 data_size=4169428, decompressed_data_size=4169428 diff=0
22:14:09:WU00:FS00:0xa3:- Digital signature verified
22:14:09:WU00:FS00:0xa3:
22:14:09:WU00:FS00:0xa3:Project: 6099 (Run 0, Clone 10, Gen 423)
22:14:09:WU00:FS00:0xa3:
22:14:09:WU00:FS00:0xa3:Assembly optimizations on if available.
22:14:09:WU00:FS00:0xa3:Entering M.D.
22:14:10:WU01:FS02:Download complete
22:14:10:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9201 run:645 clone:1 gen:26 core:0x17 unit:0x000000376652edc45399ef62645c02f8
22:14:10:WU01:FS02:Starting
22:14:10:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 6072 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
22:14:10:WU01:FS02:Started FahCore on PID 5376
22:14:10:WU01:FS02:Core PID:4824
22:14:10:WU01:FS02:FahCore 0x17 started
22:14:10:WU01:FS02:0x17:*********************** Log Started 2014-08-22T22:14:10Z ***********************
22:14:10:WU01:FS02:0x17:Project: 9201 (Run 645, Clone 1, Gen 26)
22:14:10:WU01:FS02:0x17:Unit: 0x000000376652edc45399ef62645c02f8
22:14:10:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
22:14:10:WU01:FS02:0x17:Machine: 2
22:14:10:WU01:FS02:0x17:Reading tar file state.xml
22:14:10:WU01:FS02:0x17:Reading tar file system.xml
22:14:10:WU01:FS02:0x17:Reading tar file integrator.xml
22:14:10:WU01:FS02:0x17:Reading tar file core.xml
22:14:10:WU01:FS02:0x17:Digital signatures verified
22:14:10:WU01:FS02:0x17:Folding@home GPU core17
22:14:10:WU01:FS02:0x17:Version 0.0.52
22:14:15:WU00:FS00:0xa3:Mapping NT from 6 to 6 
22:14:15:WU00:FS00:0xa3:Completed 0 out of 500000 steps  (0%)
22:14:22:FS00:Shutting core down
22:14:29:WU00:FS00:0xa3:Client no longer detected. Shutting down core 
22:14:29:WU00:FS00:0xa3:
22:14:29:WU00:FS00:0xa3:Folding@home Core Shutdown: CLIENT_DIED
22:14:29:WU00:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
22:14:37:WU01:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
22:14:37:WU01:FS02:0x17:Saving result file logfile_01.txt
22:14:37:WU01:FS02:0x17:Saving result file log.txt
22:14:37:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:14:37:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:14:37:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:9201 run:645 clone:1 gen:26 core:0x17 unit:0x000000376652edc45399ef62645c02f8
22:14:38:WU01:FS02:Uploading 2.38KiB to 171.67.108.52
22:14:38:WU01:FS02:Connecting to 171.67.108.52:8080
22:14:38:WU01:FS02:Upload complete
22:14:38:WU01:FS02:Server responded WORK_ACK (400)
22:14:38:WU01:FS02:Cleaning up
22:14:38:WU02:FS02:Connecting to 171.67.108.201:80
22:14:38:WU02:FS02:Assigned to work server 171.67.108.52
22:14:38:WU02:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
22:14:38:WU02:FS02:Connecting to 171.67.108.52:8080
22:14:38:WU02:FS02:Downloading 1.52MiB
22:14:39:WU02:FS02:Download complete
22:14:40:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9201 run:44 clone:1 gen:19 core:0x17 unit:0x000000306652edc45399d7c5256c0ef6
22:14:40:WU02:FS02:Starting
22:14:40:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 6072 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
22:14:40:WU02:FS02:Started FahCore on PID 5744
22:14:40:WU02:FS02:Core PID:5508
22:14:40:WU02:FS02:FahCore 0x17 started
22:14:40:WU02:FS02:0x17:*********************** Log Started 2014-08-22T22:14:40Z ***********************
22:14:40:WU02:FS02:0x17:Project: 9201 (Run 44, Clone 1, Gen 19)
22:14:40:WU02:FS02:0x17:Unit: 0x000000306652edc45399d7c5256c0ef6
22:14:40:WU02:FS02:0x17:CPU: 0x00000000000000000000000000000000
22:14:40:WU02:FS02:0x17:Machine: 2
22:14:40:WU02:FS02:0x17:Reading tar file state.xml
22:14:40:WU02:FS02:0x17:Reading tar file system.xml
22:14:40:WU02:FS02:0x17:Reading tar file integrator.xml
22:14:40:WU02:FS02:0x17:Reading tar file core.xml
22:14:40:WU02:FS02:0x17:Digital signatures verified
22:14:40:WU02:FS02:0x17:Folding@home GPU core17
22:14:40:WU02:FS02:0x17:Version 0.0.52
22:14:51:Saving configuration to config.xml
22:14:51:<config>
22:14:51:  <!-- Network -->
22:14:51:  <proxy v=':8080'/>
22:14:51:
22:14:51:  <!-- Slot Control -->
22:14:51:  <power v='full'/>
22:14:51:
22:14:51:  <!-- User Information -->
22:14:51:  <passkey v='********************************'/>
22:14:51:  <team v='111065'/>
22:14:51:  <user v='Zepppster'/>
22:14:51:
22:14:51:  <!-- Folding Slots -->
22:14:51:  <slot id='0' type='CPU'/>
22:14:51:  <slot id='2' type='GPU'/>
22:14:51:</config>
22:15:03:WU02:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
22:15:03:WU02:FS02:0x17:Saving result file logfile_01.txt
22:15:03:WU02:FS02:0x17:Saving result file log.txt
22:15:03:WU02:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:15:03:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:15:03:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:9201 run:44 clone:1 gen:19 core:0x17 unit:0x000000306652edc45399d7c5256c0ef6
22:15:03:WU02:FS02:Uploading 2.38KiB to 171.67.108.52
22:15:03:WU02:FS02:Connecting to 171.67.108.52:8080
22:15:04:WU02:FS02:Upload complete
22:15:04:WU02:FS02:Server responded WORK_ACK (400)
22:15:04:WU02:FS02:Cleaning up
22:15:04:WU01:FS02:Connecting to 171.67.108.201:80
22:15:04:WU01:FS02:Assigned to work server 171.67.108.52
22:15:04:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
22:15:04:WU01:FS02:Connecting to 171.67.108.52:8080
22:15:04:WU01:FS02:Downloading 1.52MiB
22:15:05:WU01:FS02:Download complete
22:15:05:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9201 run:942 clone:1 gen:17 core:0x17 unit:0x000000276652edc45399fb10688b5ac3
22:15:05:WU01:FS02:Starting
22:15:05:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 6072 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
22:15:05:WU01:FS02:Started FahCore on PID 1684
22:15:05:WU01:FS02:Core PID:5784
22:15:05:WU01:FS02:FahCore 0x17 started
22:15:06:WU01:FS02:0x17:*********************** Log Started 2014-08-22T22:15:05Z ***********************
22:15:06:WU01:FS02:0x17:Project: 9201 (Run 942, Clone 1, Gen 17)
22:15:06:WU01:FS02:0x17:Unit: 0x000000276652edc45399fb10688b5ac3
22:15:06:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
22:15:06:WU01:FS02:0x17:Machine: 2
22:15:06:WU01:FS02:0x17:Reading tar file state.xml
22:15:06:WU01:FS02:0x17:Reading tar file system.xml
22:15:06:WU01:FS02:0x17:Reading tar file integrator.xml
22:15:06:WU01:FS02:0x17:Reading tar file core.xml
22:15:06:WU01:FS02:0x17:Digital signatures verified
22:15:06:WU01:FS02:0x17:Folding@home GPU core17
22:15:06:WU01:FS02:0x17:Version 0.0.52
22:15:08:WU00:FS00:Starting
22:15:08:WARNING:WU00:FS00:Changed SMP threads from 6 to 7 this can cause some work units to fail
22:15:08:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a3.fah/FahCore_a3.exe -dir 00 -suffix 01 -version 704 -lifeline 6072 -checkpoint 15 -np 7
22:15:08:WU00:FS00:Started FahCore on PID 4788
22:15:08:WU00:FS00:Core PID:5968
22:15:08:WU00:FS00:FahCore 0xa3 started
22:15:09:WU00:FS00:0xa3:
22:15:09:WU00:FS00:0xa3:*------------------------------*
22:15:09:WU00:FS00:0xa3:Folding@Home Gromacs SMP Core
22:15:09:WU00:FS00:0xa3:Version 2.27 (Dec. 15, 2010)
22:15:09:WU00:FS00:0xa3:
22:15:09:WU00:FS00:0xa3:Preparing to commence simulation
22:15:09:WU00:FS00:0xa3:- Looking at optimizations...
22:15:09:WU00:FS00:0xa3:- Files status OK
22:15:09:WU00:FS00:0xa3:- Expanded 3810017 -> 4169428 (decompressed 109.4 percent)
22:15:09:WU00:FS00:0xa3:Called DecompressByteArray: compressed_data_size=3810017 data_size=4169428, decompressed_data_size=4169428 diff=0
22:15:09:WU00:FS00:0xa3:- Digital signature verified
22:15:09:WU00:FS00:0xa3:
22:15:09:WU00:FS00:0xa3:Project: 6099 (Run 0, Clone 10, Gen 423)
22:15:09:WU00:FS00:0xa3:
22:15:09:WU00:FS00:0xa3:Assembly optimizations on if available.
22:15:09:WU00:FS00:0xa3:Entering M.D.
22:15:15:WU00:FS00:0xa3:Mapping NT from 7 to 7 
22:15:15:WU00:FS00:0xa3:Completed 0 out of 500000 steps  (0%)
22:15:38:WU01:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
22:15:38:WU01:FS02:0x17:Saving result file logfile_01.txt
22:15:38:WU01:FS02:0x17:Saving result file log.txt
22:15:38:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:15:38:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:15:38:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:9201 run:942 clone:1 gen:17 core:0x17 unit:0x000000276652edc45399fb10688b5ac3
22:15:38:WU01:FS02:Uploading 2.38KiB to 171.67.108.52
22:15:38:WU01:FS02:Connecting to 171.67.108.52:8080
22:15:38:WU01:FS02:Upload complete
22:15:38:WU01:FS02:Server responded WORK_ACK (400)
22:15:38:WU01:FS02:Cleaning up
22:15:39:WU02:FS02:Connecting to 171.67.108.201:80
22:15:39:WU02:FS02:Assigned to work server 171.67.108.52
22:15:39:WU02:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
22:15:39:WU02:FS02:Connecting to 171.67.108.52:8080
22:15:39:WU02:FS02:Downloading 1.52MiB
22:15:40:WU02:FS02:Download complete
22:15:40:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9201 run:334 clone:0 gen:124 core:0x17 unit:0x000000a26652edc45399e32c58a9c017
22:15:40:WU02:FS02:Starting
22:15:40:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 6072 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
22:15:40:WU02:FS02:Started FahCore on PID 5096
22:15:40:WU02:FS02:Core PID:2372
22:15:40:WU02:FS02:FahCore 0x17 started
22:15:40:WU02:FS02:0x17:*********************** Log Started 2014-08-22T22:15:40Z ***********************
22:15:40:WU02:FS02:0x17:Project: 9201 (Run 334, Clone 0, Gen 124)
22:15:40:WU02:FS02:0x17:Unit: 0x000000a26652edc45399e32c58a9c017
22:15:40:WU02:FS02:0x17:CPU: 0x00000000000000000000000000000000
22:15:40:WU02:FS02:0x17:Machine: 2
22:15:40:WU02:FS02:0x17:Reading tar file state.xml
22:15:41:WU02:FS02:0x17:Reading tar file system.xml
22:15:41:WU02:FS02:0x17:Reading tar file integrator.xml
22:15:41:WU02:FS02:0x17:Reading tar file core.xml
22:15:41:WU02:FS02:0x17:Digital signatures verified
22:15:41:WU02:FS02:0x17:Folding@home GPU core17
22:15:41:WU02:FS02:0x17:Version 0.0.52
22:16:17:WU02:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
22:16:17:WU02:FS02:0x17:Saving result file logfile_01.txt
22:16:17:WU02:FS02:0x17:Saving result file log.txt
22:16:17:WU02:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:16:18:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:16:18:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:9201 run:334 clone:0 gen:124 core:0x17 unit:0x000000a26652edc45399e32c58a9c017
22:16:18:WU02:FS02:Uploading 2.38KiB to 171.67.108.52
22:16:18:WU02:FS02:Connecting to 171.67.108.52:8080
22:16:18:WU02:FS02:Upload complete
22:16:18:WU02:FS02:Server responded WORK_ACK (400)
22:16:18:WU02:FS02:Cleaning up
22:16:18:WU01:FS02:Connecting to 171.67.108.201:80
22:16:18:WU01:FS02:Assigned to work server 171.67.108.52
22:16:18:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
22:16:18:WU01:FS02:Connecting to 171.67.108.52:8080
22:16:18:WU01:FS02:Downloading 1.52MiB
22:16:19:WU01:FS02:Download complete
22:16:19:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9201 run:282 clone:0 gen:113 core:0x17 unit:0x000000936652edc45399e120c79a3294
22:16:19:WU01:FS02:Starting
22:16:19:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 6072 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
22:16:19:WU01:FS02:Started FahCore on PID 5196
22:16:19:WU01:FS02:Core PID:3196
22:16:19:WU01:FS02:FahCore 0x17 started
22:16:20:WU01:FS02:0x17:*********************** Log Started 2014-08-22T22:16:19Z ***********************
22:16:20:WU01:FS02:0x17:Project: 9201 (Run 282, Clone 0, Gen 113)
22:16:20:WU01:FS02:0x17:Unit: 0x000000936652edc45399e120c79a3294
22:16:20:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
22:16:20:WU01:FS02:0x17:Machine: 2
22:16:20:WU01:FS02:0x17:Reading tar file state.xml
22:16:20:WU01:FS02:0x17:Reading tar file system.xml
22:16:20:WU01:FS02:0x17:Reading tar file integrator.xml
22:16:20:WU01:FS02:0x17:Reading tar file core.xml
22:16:20:WU01:FS02:0x17:Digital signatures verified
22:16:20:WU01:FS02:0x17:Folding@home GPU core17
22:16:20:WU01:FS02:0x17:Version 0.0.52
22:16:57:WU01:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
22:16:57:WU01:FS02:0x17:Saving result file logfile_01.txt
22:16:57:WU01:FS02:0x17:Saving result file log.txt
22:16:57:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:16:57:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:16:57:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:9201 run:282 clone:0 gen:113 core:0x17 unit:0x000000936652edc45399e120c79a3294
22:16:57:WU01:FS02:Uploading 2.39KiB to 171.67.108.52
22:16:57:WU01:FS02:Connecting to 171.67.108.52:8080
22:16:58:WU01:FS02:Upload complete
22:16:58:WU01:FS02:Server responded WORK_ACK (400)
22:16:58:WU01:FS02:Cleaning up
22:16:58:WU01:FS02:Connecting to 171.67.108.201:80
22:16:58:WU01:FS02:Assigned to work server 171.67.108.52
22:16:58:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
22:16:58:WU01:FS02:Connecting to 171.67.108.52:8080
22:16:58:WU01:FS02:Downloading 1.52MiB
22:16:59:WU01:FS02:Download complete
22:16:59:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9201 run:702 clone:0 gen:101 core:0x17 unit:0x0000008e6652edc45399f1a29c796b44
22:16:59:WU01:FS02:Starting
22:16:59:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 6072 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
22:16:59:WU01:FS02:Started FahCore on PID 1792
22:16:59:WU01:FS02:Core PID:5868
22:16:59:WU01:FS02:FahCore 0x17 started
22:17:00:WU01:FS02:0x17:*********************** Log Started 2014-08-22T22:16:59Z ***********************
22:17:00:WU01:FS02:0x17:Project: 9201 (Run 702, Clone 0, Gen 101)
22:17:00:WU01:FS02:0x17:Unit: 0x0000008e6652edc45399f1a29c796b44
22:17:00:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
22:17:00:WU01:FS02:0x17:Machine: 2
22:17:00:WU01:FS02:0x17:Reading tar file state.xml
22:17:00:WU01:FS02:0x17:Reading tar file system.xml
22:17:00:WU01:FS02:0x17:Reading tar file integrator.xml
22:17:00:WU01:FS02:0x17:Reading tar file core.xml
22:17:00:WU01:FS02:0x17:Digital signatures verified
22:17:00:WU01:FS02:0x17:Folding@home GPU core17
22:17:00:WU01:FS02:0x17:Version 0.0.52
22:17:36:WU01:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
22:17:36:WU01:FS02:0x17:Saving result file logfile_01.txt
22:17:36:WU01:FS02:0x17:Saving result file log.txt
22:17:36:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:17:36:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:17:36:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:9201 run:702 clone:0 gen:101 core:0x17 unit:0x0000008e6652edc45399f1a29c796b44
22:17:36:WU01:FS02:Uploading 2.38KiB to 171.67.108.52
22:17:36:WU01:FS02:Connecting to 171.67.108.52:8080
22:17:37:WU01:FS02:Upload complete
22:17:37:WU01:FS02:Server responded WORK_ACK (400)
22:17:37:WU01:FS02:Cleaning up
22:17:37:WU02:FS02:Connecting to 171.67.108.201:80
22:17:37:WU02:FS02:Assigned to work server 171.67.108.52
22:17:37:WU02:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
22:17:37:WU02:FS02:Connecting to 171.67.108.52:8080
22:17:37:WU02:FS02:Downloading 1.52MiB
22:17:38:WU02:FS02:Download complete
22:17:38:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9201 run:748 clone:0 gen:75 core:0x17 unit:0x0000006e6652edc45399f370d6b3666f
22:17:38:WU02:FS02:Starting
22:17:38:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 704 -lifeline 6072 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
22:17:38:WU02:FS02:Started FahCore on PID 6128
22:17:38:WU02:FS02:Core PID:3080
22:17:38:WU02:FS02:FahCore 0x17 started
22:17:39:WU02:FS02:0x17:*********************** Log Started 2014-08-22T22:17:39Z ***********************
22:17:39:WU02:FS02:0x17:Project: 9201 (Run 748, Clone 0, Gen 75)
22:17:39:WU02:FS02:0x17:Unit: 0x0000006e6652edc45399f370d6b3666f
22:17:39:WU02:FS02:0x17:CPU: 0x00000000000000000000000000000000
22:17:39:WU02:FS02:0x17:Machine: 2
22:17:39:WU02:FS02:0x17:Reading tar file state.xml
22:17:39:WU02:FS02:0x17:Reading tar file system.xml
22:17:39:WU02:FS02:0x17:Reading tar file integrator.xml
22:17:39:WU02:FS02:0x17:Reading tar file core.xml
22:17:39:WU02:FS02:0x17:Digital signatures verified
22:17:39:WU02:FS02:0x17:Folding@home GPU core17
22:17:39:WU02:FS02:0x17:Version 0.0.52
22:18:15:WU02:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
22:18:16:WU02:FS02:0x17:Saving result file logfile_01.txt
22:18:16:WU02:FS02:0x17:Saving result file log.txt
22:18:16:WU02:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:18:16:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:18:16:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:9201 run:748 clone:0 gen:75 core:0x17 unit:0x0000006e6652edc45399f370d6b3666f
22:18:16:WU02:FS02:Uploading 2.38KiB to 171.67.108.52
22:18:16:WU02:FS02:Connecting to 171.67.108.52:8080
22:18:16:WU02:FS02:Upload complete
22:18:16:WU02:FS02:Server responded WORK_ACK (400)
22:18:16:WU02:FS02:Cleaning up
22:18:16:WU01:FS02:Connecting to 171.67.108.201:80
22:18:16:WU01:FS02:Assigned to work server 171.67.108.52
22:18:16:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
22:18:16:WU01:FS02:Connecting to 171.67.108.52:8080
22:18:17:WU01:FS02:Downloading 1.53MiB
22:18:18:WU01:FS02:Download complete
22:18:18:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9201 run:56 clone:0 gen:110 core:0x17 unit:0x0000008b6652edc45399d83b86930048
22:18:18:WU01:FS02:Starting
22:18:18:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 6072 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
22:18:18:WU01:FS02:Started FahCore on PID 4492
22:18:18:WU01:FS02:Core PID:956
22:18:18:WU01:FS02:FahCore 0x17 started
22:18:18:WU01:FS02:0x17:*********************** Log Started 2014-08-22T22:18:18Z ***********************
22:18:18:WU01:FS02:0x17:Project: 9201 (Run 56, Clone 0, Gen 110)
22:18:18:WU01:FS02:0x17:Unit: 0x0000008b6652edc45399d83b86930048
22:18:18:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
22:18:18:WU01:FS02:0x17:Machine: 2
22:18:18:WU01:FS02:0x17:Reading tar file state.xml
22:18:19:WU01:FS02:0x17:Reading tar file system.xml
22:18:19:WU01:FS02:0x17:Reading tar file integrator.xml
22:18:19:WU01:FS02:0x17:Reading tar file core.xml
22:18:19:WU01:FS02:0x17:Digital signatures verified
22:18:19:WU01:FS02:0x17:Folding@home GPU core17
22:18:19:WU01:FS02:0x17:Version 0.0.52
22:18:55:WU01:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
22:18:55:WU01:FS02:0x17:Saving result file logfile_01.txt
22:18:55:WU01:FS02:0x17:Saving result file log.txt
22:18:55:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:18:55:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:18:55:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:9201 run:56 clone:0 gen:110 core:0x17 unit:0x0000008b6652edc45399d83b86930048
22:18:55:WU01:FS02:Uploading 2.38KiB to 171.67.108.52
22:18:55:WU01:FS02:Connecting to 171.67.108.52:8080
22:18:55:WU01:FS02:Upload complete
22:18:55:WU01:FS02:Server responded WORK_ACK (400)
22:18:55:WU01:FS02:Cleaning up
22:18:55:WU01:FS02:Connecting to 171.67.108.201:80
22:18:56:WU01:FS02:Assigned to work server 171.67.108.52
22:18:56:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
22:18:56:WU01:FS02:Connecting to 171.67.108.52:8080
22:18:56:WU01:FS02:Downloading 1.52MiB
22:18:57:WU01:FS02:Download complete
22:18:57:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9201 run:204 clone:0 gen:91 core:0x17 unit:0x000000826652edc45399de04b5f26436
22:18:57:WU01:FS02:Starting
22:18:57:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 6072 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
22:18:57:WU01:FS02:Started FahCore on PID 1872
22:18:57:WU01:FS02:Core PID:1724
22:18:57:WU01:FS02:FahCore 0x17 started
22:18:57:WU01:FS02:0x17:*********************** Log Started 2014-08-22T22:18:57Z ***********************
22:18:57:WU01:FS02:0x17:Project: 9201 (Run 204, Clone 0, Gen 91)
22:18:57:WU01:FS02:0x17:Unit: 0x000000826652edc45399de04b5f26436
22:18:57:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
22:18:57:WU01:FS02:0x17:Machine: 2
22:18:57:WU01:FS02:0x17:Reading tar file state.xml
22:18:58:WU01:FS02:0x17:Reading tar file system.xml
22:18:58:WU01:FS02:0x17:Reading tar file integrator.xml
22:18:58:WU01:FS02:0x17:Reading tar file core.xml
22:18:58:WU01:FS02:0x17:Digital signatures verified
22:18:58:WU01:FS02:0x17:Folding@home GPU core17
22:18:58:WU01:FS02:0x17:Version 0.0.52
22:19:35:WU01:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
22:19:35:WU01:FS02:0x17:Saving result file logfile_01.txt
22:19:35:WU01:FS02:0x17:Saving result file log.txt
22:19:35:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:19:35:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:19:35:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:9201 run:204 clone:0 gen:91 core:0x17 unit:0x000000826652edc45399de04b5f26436
22:19:35:WU01:FS02:Uploading 2.38KiB to 171.67.108.52
22:19:35:WU01:FS02:Connecting to 171.67.108.52:8080
22:19:35:WU01:FS02:Upload complete
22:19:35:WU01:FS02:Server responded WORK_ACK (400)
22:19:35:WU01:FS02:Cleaning up
22:19:35:WU01:FS02:Connecting to 171.67.108.201:80
22:19:36:WU01:FS02:Assigned to work server 171.67.108.52
22:19:36:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GK107 [Quadro K600] from 171.67.108.52
22:19:36:WU01:FS02:Connecting to 171.67.108.52:8080
22:19:36:WU01:FS02:Downloading 1.53MiB
22:19:37:WU01:FS02:Download complete
22:19:37:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9201 run:454 clone:0 gen:85 core:0x17 unit:0x000000686652edc45399e7e1e1ad0f3c
22:19:37:WU01:FS02:Starting
22:19:37:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/ZZeppo/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 6072 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
22:19:37:WU01:FS02:Started FahCore on PID 3568
22:19:37:WU01:FS02:Core PID:5652
22:19:37:WU01:FS02:FahCore 0x17 started
22:19:37:WU01:FS02:0x17:*********************** Log Started 2014-08-22T22:19:37Z ***********************
22:19:37:WU01:FS02:0x17:Project: 9201 (Run 454, Clone 0, Gen 85)
22:19:37:WU01:FS02:0x17:Unit: 0x000000686652edc45399e7e1e1ad0f3c
22:19:37:WU01:FS02:0x17:CPU: 0x00000000000000000000000000000000
22:19:37:WU01:FS02:0x17:Machine: 2
22:19:37:WU01:FS02:0x17:Reading tar file state.xml
22:19:38:WU01:FS02:0x17:Reading tar file system.xml
22:19:38:WU01:FS02:0x17:Reading tar file integrator.xml
22:19:38:WU01:FS02:0x17:Reading tar file core.xml
22:19:38:WU01:FS02:0x17:Digital signatures verified
22:19:38:WU01:FS02:0x17:Folding@home GPU core17
22:19:38:WU01:FS02:0x17:Version 0.0.52
22:20:11:WU01:FS02:0x17:ERROR:exception: Error invoking kernel computeNonbonded: clEnqueueNDRangeKernel (-5)
22:20:11:WU01:FS02:0x17:Saving result file logfile_01.txt
22:20:11:WU01:FS02:0x17:Saving result file log.txt
22:20:11:WU01:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:20:11:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:20:11:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:9201 run:454 clone:0 gen:85 core:0x17 unit:0x000000686652edc45399e7e1e1ad0f3c
22:20:11:WU01:FS02:Uploading 2.38KiB to 171.67.108.52
22:20:11:WU01:FS02:Connecting to 171.67.108.52:8080
22:20:12:WU01:FS02:Upload complete
22:20:12:WU01:FS02:Server responded WORK_ACK (400)
22:20:12:WU01:FS02:Cleaning up
22:27:22:WU00:FS00:0xa3:Completed 5000 out of 500000 steps  (1%)
22:39:13:WU00:FS00:0xa3:Completed 10000 out of 500000 steps  (2%)
22:41:58:FS00:Shutting core down
22:42:00:Clean exit
Image
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Constant WU Failures on Both GPUs

Post by bruce »

In FAHControl, the "pause" button will suspend processing of all slots. Right clicking on and individual slot in the "status" tab will bring up a context menu that applies only to that slot. The Pause status is preserved during a client restart. You'll still have to confirm that the device name reported on that screen is actually the device you think it should be.
Top
Nirvana
Posts: 21
Joined: Tue Aug 19, 2014 4:20 pm

Re: Constant WU Failures on Both GPUs

Post by Nirvana »

bruce wrote:In FAHControl, the "pause" button will suspend processing of all slots. Right clicking on and individual slot in the "status" tab will bring up a context menu that applies only to that slot. The Pause status is preserved during a client restart. You'll still have to confirm that the device name reported on that screen is actually the device you think it should be.
Not sure what you mean. Do I have to do this before removing the FX580 from folding?
Image
Top
Post Reply

Return to “GPU Projects and FahCores”