Page 1 of 11

9401 fails on GM107 but not GK106 {Hopefully fixed}

Posted: Tue Feb 25, 2014 4:13 pm
by uddarts
installed this card yesterday and 9401's fail consistently. i'm running 334.89 drivers.

Code: Select all

15:34:39:WU02:FS02:News: Welcome to Folding@Home
15:34:39:WU02:FS02:Assigned to work server 171.67.108.31
15:34:39:WU02:FS02:Requesting new work unit for slot 02: READY gpu:1:GM107 [GeForce GTX 750 Ti] from 171.67.108.31
15:34:39:WU02:FS02:Connecting to 171.67.108.31:8080
15:34:39:WU01:FS02:Upload complete
15:34:39:WU02:FS02:Downloading 4.32MiB
15:34:39:WU01:FS02:Server responded WORK_ACK (400)
15:34:39:WU01:FS02:Cleaning up
15:34:42:WU02:FS02:Download complete
15:34:42:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9401 run:142 clone:0 gen:19 core:0x17 unit:0x000000166652edaf52eae549760c75c1
15:34:42:WU02:FS02:Starting
15:34:42:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" E:/FAH/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/beta/Core_17.fah/FahCore_17.exe -dir 02 -suffix 01 -version 703 -lifeline 4436 -checkpoint 15 -gpu 1 -gpu-vendor nvidia
15:34:42:WU02:FS02:Started FahCore on PID 4172
15:34:42:WU02:FS02:Core PID:4216
15:34:42:WU02:FS02:FahCore 0x17 started
15:34:42:WU02:FS02:0x17:*********************** Log Started 2014-02-25T15:34:42Z ***********************
15:34:42:WU02:FS02:0x17:Project: 9401 (Run 142, Clone 0, Gen 19)
15:34:42:WU02:FS02:0x17:Unit: 0x000000166652edaf52eae549760c75c1
15:34:42:WU02:FS02:0x17:CPU: 0x00000000000000000000000000000000
15:34:42:WU02:FS02:0x17:Machine: 2
15:34:42:WU02:FS02:0x17:Reading tar file state.xml
15:34:43:WU02:FS02:0x17:Reading tar file system.xml
15:34:44:WU02:FS02:0x17:Reading tar file integrator.xml
15:34:44:WU02:FS02:0x17:Reading tar file core.xml
15:34:44:WU02:FS02:0x17:Digital signatures verified
15:34:44:WU02:FS02:0x17:Folding@home GPU core17
15:34:44:WU02:FS02:0x17:Version 0.0.52
15:37:09:WU02:FS02:0x17:ERROR:exception: Force RMSE error of 416.314 with threshold of 5
15:37:09:WU02:FS02:0x17:Saving result file logfile_01.txt
15:37:09:WU02:FS02:0x17:Saving result file log.txt
15:37:09:WU02:FS02:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
15:37:09:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
15:37:09:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:9401 run:142 clone:0 gen:19 core:0x17 unit:0x000000166652edaf52eae549760c75c1
15:37:09:WU02:FS02:Uploading 2.25KiB to 171.67.108.31
15:37:09:WU02:FS02:Connecting to 171.67.108.31:8080
15:37:09:WU02:FS02:Upload complete
15:37:09:WU02:FS02:Server responded WORK_ACK (400)
15:37:09:WU02:FS02:Cleaning up
ud

Re: 9401 fails on 750ti

Posted: Tue Feb 25, 2014 8:04 pm
by bruce
Was this a fresh install or (perhaps) were the slot and/or the drivers previously installed and used with an earlier GPU?

Re: 9401 fails on 750ti

Posted: Tue Feb 25, 2014 8:24 pm
by uddarts
there have been multiple cards in this rig and at the moment there is a 560ti running too. when it finishes, i'll pull it and do a clean install of the drivers. i flipped a coin when i installed the latest ones.

thought i'd ask for some direction since i'm dealing with a new card series.

i'll report back.

tks
ud

Re: 9401 fails on 750ti

Posted: Tue Feb 25, 2014 8:46 pm
by soa_rru
Having the exact same trouble myself, even the 8900wu does the same.

Code: Select all

20:53:57:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:8900 run:671 clone:0 gen:164 core:0x17 unit:0x000000ff028c126651a6bbdd829a15f2
20:53:57:WU01:FS01:Starting
20:53:57:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/K/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 01 -suffix 01 -version 704 -lifeline 2220 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
20:53:57:WU01:FS01:Started FahCore on PID 1072
20:53:57:WU01:FS01:Core PID:3692
20:53:57:WU01:FS01:FahCore 0x17 started
20:53:58:WU01:FS01:0x17:*********************** Log Started 2014-02-25T20:53:57Z ***********************
20:53:58:WU01:FS01:0x17:Project: 8900 (Run 671, Clone 0, Gen 164)
20:53:58:WU01:FS01:0x17:Unit: 0x000000ff028c126651a6bbdd829a15f2
20:53:58:WU01:FS01:0x17:CPU: 0x00000000000000000000000000000000
20:53:58:WU01:FS01:0x17:Machine: 1
20:53:58:WU01:FS01:0x17:Reading tar file state.xml
20:53:59:WU01:FS01:0x17:Reading tar file system.xml
20:53:59:WU01:FS01:0x17:Reading tar file integrator.xml
20:53:59:WU01:FS01:0x17:Reading tar file core.xml
20:53:59:WU01:FS01:0x17:Digital signatures verified
20:53:59:WU01:FS01:0x17:Folding@home GPU core17
20:53:59:WU01:FS01:0x17:Version 0.0.52
20:58:08:WU01:FS01:0x17:ERROR:exception: Force RMSE error of 409.522 with threshold of 5
20:58:08:WU01:FS01:0x17:Saving result file logfile_01.txt
20:58:08:WU01:FS01:0x17:Saving result file log.txt
20:58:08:WU01:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
20:58:08:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
20:58:08:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:8900 run:671 clone:0 gen:164 core:0x17 unit:0x000000ff028c126651a6bbdd829a15f2
20:58:08:WU01:FS01:Uploading 2.24KiB to 171.64.65.69
20:58:08:WU01:FS01:Connecting to 171.64.65.69:8080
20:58:09:WU00:FS01:Connecting to assign-GPU.stanford.edu:80
20:58:09:WU01:FS01:Upload complete
20:58:09:WU01:FS01:Server responded WORK_ACK (400)
Watching the card in MSI Afterburner & the card just sits idle.

Using the latest driver (fresh install for the 750Ti) & the latest client 7.4.2

Re: 9401 fails on 750ti

Posted: Tue Feb 25, 2014 10:07 pm
by heikosch
Up to date GPU.TXT?

Heiko

Re: 9401 fails on 750ti

Posted: Tue Feb 25, 2014 10:15 pm
by bruce
Post the information from the top of the log file or from the System_Info tab of FAHControl (Advanced Control). [Leave Verbosity set to the default value of 3.]

Re: 9401 fails on 750ti

Posted: Tue Feb 25, 2014 10:54 pm
by soa_rru

Code: Select all

*********************** Log Started 2014-02-25T22:42:43Z ***********************
22:42:43:************************* Folding@home Client *************************
22:42:43:      Website: http://folding.stanford.edu/
22:42:43:    Copyright: (c) 2009-2014 Stanford University
22:42:43:       Author: Joseph Coffland <[email protected]>
22:42:43:         Args: --open-web-control
22:42:43:       Config: C:/Users/K/AppData/Roaming/FAHClient/config.xml
22:42:43:******************************** Build ********************************
22:42:43:      Version: 7.4.2
22:42:43:         Date: Jan 24 2014
22:42:43:         Time: 13:51:17
22:42:43:      SVN Rev: 4112
22:42:43:       Branch: fah/trunk/client
22:42:43:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
22:42:43:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
22:42:43:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
22:42:43:     Platform: win32 XP
22:42:43:         Bits: 32
22:42:43:         Mode: Release
22:42:43:******************************* System ********************************
22:42:43:          CPU: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz
22:42:43:       CPU ID: GenuineIntel Family 6 Model 15 Stepping 11
22:42:43:         CPUs: 4
22:42:43:       Memory: 4.00GiB
22:42:43:  Free Memory: 2.79GiB
22:42:43:      Threads: WINDOWS_THREADS
22:42:43:   OS Version: 6.1
22:42:43:  Has Battery: false
22:42:43:   On Battery: false
22:42:43:   UTC Offset: 0
22:42:43:          PID: 1792
22:42:43:          CWD: C:/Users/K/AppData/Roaming/FAHClient
22:42:43:           OS: Windows 7
22:42:43:      OS Arch: AMD64
22:42:43:         GPUs: 1
22:42:43:        GPU 0: NVIDIA:4 GM107 [GeForce GTX 750 Ti]
22:42:43:         CUDA: 5.0
22:42:43:  CUDA Driver: 6000
22:42:43:Win32 Service: false
22:42:43:***********************************************************************
22:42:43:<config>
22:42:43:  <!-- Folding Core -->
22:42:43:  <checkpoint v='3'/>
22:42:43:
22:42:43:  <!-- Network -->
22:42:43:  <proxy v=':8080'/>
22:42:43:
22:42:43:  <!-- Slot Control -->
22:42:43:  <power v='full'/>
22:42:43:
22:42:43:  <!-- User Information -->
22:42:43:  <passkey v='********************************'/>
22:42:43:  <team v='98860'/>
22:42:43:  <user v='SOA_RRU'/>
22:42:43:
22:42:43:  <!-- Folding Slots -->
22:42:43:  <slot id='1' type='GPU'/>
22:42:43:</config>
22:42:43:Trying to access database...
22:42:43:Successfully acquired database lock
22:42:43:Enabled folding slot 01: READY gpu:0:GM107 [GeForce GTX 750 Ti]
22:42:43:WU00:FS01:Starting
22:42:43:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/K/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_17.fah/FahCore_17.exe -dir 00 -suffix 01 -version 704 -lifeline 1792 -checkpoint 3 -gpu 0 -gpu-vendor nvidia
22:42:43:WU00:FS01:Started FahCore on PID 3260
22:42:43:WU00:FS01:Core PID:5008
22:42:43:WU00:FS01:FahCore 0x17 started
22:42:44:WU00:FS01:0x17:*********************** Log Started 2014-02-25T22:42:44Z ***********************
22:42:44:WU00:FS01:0x17:Project: 8900 (Run 182, Clone 3, Gen 74)
22:42:44:WU00:FS01:0x17:Unit: 0x0000008d028c126651a64f10f9ae1081
22:42:44:WU00:FS01:0x17:CPU: 0x00000000000000000000000000000000
22:42:44:WU00:FS01:0x17:Machine: 1
22:42:44:WU00:FS01:0x17:Reading tar file state.xml
22:42:45:WU00:FS01:0x17:Reading tar file system.xml
22:42:45:WU00:FS01:0x17:Reading tar file integrator.xml
22:42:45:WU00:FS01:0x17:Reading tar file core.xml
22:42:45:WU00:FS01:0x17:Digital signatures verified
22:42:45:WU00:FS01:0x17:Folding@home GPU core17
22:42:45:WU00:FS01:0x17:Version 0.0.52
22:42:46:8:127.0.0.1:New Web connection
22:46:52:WU00:FS01:0x17:ERROR:exception: Force RMSE error of 409.206 with threshold of 5
22:46:52:WU00:FS01:0x17:Saving result file logfile_01.txt
22:46:52:WU00:FS01:0x17:Saving result file log.txt
22:46:52:WU00:FS01:0x17:Folding@home Core Shutdown: BAD_WORK_UNIT
22:46:52:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
22:46:52:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:8900 run:182 clone:3 gen:74 core:0x17 unit:0x0000008d028c126651a64f10f9ae1081
22:46:52:WU00:FS01:Uploading 2.24KiB to 171.64.65.69
22:46:52:WU00:FS01:Connecting to 171.64.65.69:8080
22:46:53:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
22:46:53:WU00:FS01:Upload complete
22:46:53:WU00:FS01:Server responded WORK_ACK (400)
22:46:53:WU00:FS01:Cleaning up

Re: 9401 fails on 750ti

Posted: Tue Feb 25, 2014 11:33 pm
by uddarts
i forgot to mention that it was able to complete a core 15.


ud

Re: 9401 fails on 750ti

Posted: Wed Feb 26, 2014 12:00 am
by 7im
heikosch wrote:Up to date GPU.TXT?

Heiko
V7.4.2 checks for updates to the GPUs.txt file much more frequently than previous versions, so this shouldn't be a problem.

If the card was not recognized, using the current GPUs.txt, it would not be getting any work units.


Is the card overclocked at all? Factory OC, or standard OEM clocks?

Re: 9401 fails on 750ti

Posted: Wed Feb 26, 2014 12:06 am
by Jim Saunders
If you ran the Feb 12 Windows updates, uninstall them. Core 17 units started failing after I installed them, and since uninstalling them I've got to 66% of a core 17 WU with no instability and stable frame times.

Jim

Re: 9401 fails on 750ti

Posted: Wed Feb 26, 2014 12:31 am
by 7im
Jim Saunders wrote:If you ran the Feb 12 Windows updates, uninstall them. Core 17 units started failing after I installed them, and since uninstalling them I've got to 66% of a core 17 WU with no instability and stable frame times.

Jim
Do you have a list of patches that you uninstalled, or just did a restore back before the update?

Re: 9401 fails on 750ti

Posted: Wed Feb 26, 2014 1:01 am
by Jim Saunders
A list:

KB2913751
KB890830
KB2830477
KB2901112
KB2919469
KB2909210
KB2910636
KB2898869
KB2898857
KB2843630
KB2901126
KB2862973
KB2912390
KB2911501
KB2909921

Jim

Re: 9401 fails on 750ti

Posted: Wed Feb 26, 2014 1:12 am
by 7im
Okay, wasn't KB2909921 (IE 10 Cumulative update). Just installed that one and rebooted. Still folds.

You sure they didn't add a driver when you weren't looking? ;)

Re: 9401 fails on 750ti

Posted: Wed Feb 26, 2014 1:33 am
by Jim Saunders
7im wrote:Okay, wasn't KB2909921 (IE 10 Cumulative update). Just installed that one and rebooted. Still folds.

You sure they didn't add a driver when you weren't looking? ;)
I wouldn't put trying past them, but I didn't see anything in the list of offerings which looked like a GPU driver update and I didn't do anything manually to them. I assume then by one mechanism or another that batch of updates broke something and removing them fixed it. Considering how much software it takes to run Windows alone never mind accomplish something I'm surprised this is unusual.

Jim

ETA - The three other Win7 boxes I have exhibited no issues in the same timeframe, and I never ran any of those updates on them.

Re: 9401 fails on 750ti

Posted: Wed Feb 26, 2014 2:52 am
by PinHead
Jim,

I haven't run my patches yet and I see an NVidia optional patch sitting there. It might be an old one that I never applied since it says it's release date was Oct 2013. Do you see an "Optional" driver update on one of the systems that you haven't patched?