Fermi Cards were assigned non-Fermi WUs

[TheCraiks]

Thanks this problem caught me at the same time I updated to 7.2.9 and threw me completely was sure it was due to update and was contemplating either downgrading or trying different drivers. Sure this fix saved me a world of pain and effort.

[Naki]

Click on Start>All Programs>FAHClient>Data Directory>work and delete 00.

My Folding@Home client got a non-working unit AGAIN! Why?
When will the server that is down be back online?

Code: Select all

04:37:59:WU01:FS02:0x15:Completed  37200000 out of 40000000 steps (93%).
04:38:56:WU02:FS00:0xa4:Completed 30000 out of 750000 steps  (4%)
04:43:14:WU01:FS02:0x15:Completed  37600000 out of 40000000 steps (94%).
04:43:21:WU02:FS00:0xa4:Completed 37500 out of 750000 steps  (5%)
04:47:45:WU02:FS00:0xa4:Completed 45000 out of 750000 steps  (6%)
04:48:30:WU01:FS02:0x15:Completed  38000000 out of 40000000 steps (95%).
04:52:10:WU02:FS00:0xa4:Completed 52500 out of 750000 steps  (7%)
04:53:45:WU01:FS02:0x15:Completed  38400000 out of 40000000 steps (96%).
04:56:35:WU02:FS00:0xa4:Completed 60000 out of 750000 steps  (8%)
04:59:00:WU01:FS02:0x15:Completed  38800000 out of 40000000 steps (97%).
05:01:00:WU02:FS00:0xa4:Completed 67500 out of 750000 steps  (9%)
05:04:16:WU01:FS02:0x15:Completed  39200000 out of 40000000 steps (98%).
05:05:24:WU02:FS00:0xa4:Completed 75000 out of 750000 steps  (10%)
05:09:31:WU01:FS02:0x15:Completed  39600000 out of 40000000 steps (99%).
05:09:49:WU02:FS00:0xa4:Completed 82500 out of 750000 steps  (11%)
05:14:13:WU02:FS00:0xa4:Completed 90000 out of 750000 steps  (12%)
05:14:47:WU01:FS02:0x15:Completed  40000000 out of 40000000 steps (100%).
05:14:47:WU01:FS02:0x15:Finished fah_main status=0
05:14:47:WU01:FS02:0x15:Successful run
05:14:47:WU01:FS02:0x15:DynamicWrapper: Finished Work Unit: sleep=10000
05:14:57:WU01:FS02:0x15:Reserved 769204 bytes for xtc file; Cosm status=0
05:14:57:WU01:FS02:0x15:Allocated 769204 bytes for xtc file
05:14:57:WU01:FS02:0x15:- Reading up to 769204 from "01/wudata_01.xtc": Read 769204
05:14:57:WU01:FS02:0x15:Read 769204 bytes from xtc file; available packet space=785661260
05:14:57:WU01:FS02:0x15:xtc file hash check passed.
05:14:57:WU01:FS02:0x15:Reserved 48264 48264 785661260 bytes for arc file=<01/wudata_01.trr> Cosm status=0
05:14:57:WU01:FS02:0x15:Allocated 48264 bytes for arc file
05:14:57:WU01:FS02:0x15:- Reading up to 48264 from "01/wudata_01.trr": Read 48264
05:14:57:WU01:FS02:0x15:Read 48264 bytes from arc file; available packet space=785612996
05:14:57:WU01:FS02:0x15:trr file hash check passed.
05:14:57:WU01:FS02:0x15:Allocated 544 bytes for edr file
05:14:57:WU01:FS02:0x15:Read bedfile
05:14:57:WU01:FS02:0x15:edr file hash check passed.
05:14:57:WU01:FS02:0x15:Allocated 37352 bytes for logfile
05:14:57:WU01:FS02:0x15:Read logfile
05:14:57:WU01:FS02:0x15:GuardedRun: success in DynamicWrapper
05:14:57:WU01:FS02:0x15:GuardedRun: done
05:14:57:WU01:FS02:0x15:Run: GuardedRun completed.
05:14:57:WU01:FS02:0x15:+ Opened results file
05:14:57:WU01:FS02:0x15:- Writing 855876 bytes of core data to disk...
05:14:58:WU01:FS02:0x15:Done: 855364 -> 827001 (compressed to 96.6 percent)
05:14:58:WU01:FS02:0x15:  ... Done.
05:14:58:WU01:FS02:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
05:14:58:WU01:FS02:0x15:Shutting down core 
05:14:58:WU01:FS02:0x15:
05:14:58:WU01:FS02:0x15:Folding@home Core Shutdown: FINISHED_UNIT
05:14:58:WU00:FS02:Starting
05:14:58:WU00:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Vlado/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_11.fah/FahCore_11.exe -dir 00 -suffix 01 -version 702 -lifeline 6588 -checkpoint 15 -cpu 75 -gpu 0
05:14:58:WU00:FS02:Started FahCore on PID 6456
05:14:58:WU00:FS02:Core PID:4752
05:14:58:WU00:FS02:FahCore 0x11 started
05:14:58:WU01:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
05:14:58:WU01:FS02:Sending unit results: id:01 state:SEND error:NO_ERROR project:7624 run:320 clone:0 gen:55 core:0x15 unit:0x0000005b664f2dd14fe6125f96762e4f
05:14:58:WU01:FS02:Uploading 808.12KiB to 171.64.65.105
05:14:58:WU01:FS02:Connecting to 171.64.65.105:8080
05:14:58:WU00:FS02:0x11:
05:14:58:WU00:FS02:0x11:*------------------------------*
05:14:58:WU00:FS02:0x11:Folding@Home GPU Core
05:14:58:WU00:FS02:0x11:Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
05:14:58:WU00:FS02:0x11:
05:14:58:WU00:FS02:0x11:Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86 
05:14:58:WU00:FS02:0x11:Build host: amoeba
05:14:58:WU00:FS02:0x11:Board Type: Nvidia
05:14:58:WU00:FS02:0x11:Core      : 
05:14:58:WU00:FS02:0x11:Preparing to commence simulation
05:14:58:WU00:FS02:0x11:- Ensuring status. Please wait.
05:15:04:WU01:FS02:Upload 47.52%
05:15:08:WU00:FS02:0x11:- Looking at optimizations...
05:15:08:WU00:FS02:0x11:- Working with standard loops on this execution.
05:15:08:WU00:FS02:0x11:- Previous termination of core was improper.
05:15:08:WU00:FS02:0x11:- Going to use standard loops.
05:15:08:WU00:FS02:0x11:- Files status OK
05:15:08:WU00:FS02:0x11:- Expanded 45328 -> 251112 (decompressed 553.9 percent)
05:15:08:WU00:FS02:0x11:Called DecompressByteArray: compressed_data_size=45328 data_size=251112, decompressed_data_size=251112 diff=0
05:15:08:WU00:FS02:0x11:- Digital signature verified
05:15:08:WU00:FS02:0x11:
05:15:08:WU00:FS02:0x11:Project: 5770 (Run 7, Clone 330, Gen 8)
05:15:08:WU00:FS02:0x11:
05:15:08:WU00:FS02:0x11:Entering M.D.
05:15:10:WU01:FS02:Upload 87.12%
05:15:12:WU01:FS02:Upload complete
05:15:12:WU01:FS02:Server responded WORK_ACK (400)
05:15:12:WU01:FS02:Final credit estimate, 5187.00 points
05:15:12:WU01:FS02:Cleaning up
05:15:14:WU00:FS02:0x11:Tpr hash 00/wudata_01.tpr:  3831397381 3153655113 374275599 2996951355 4083534532
05:15:14:WU00:FS02:0x11:
05:15:14:WU00:FS02:0x11:Calling fah_main args: 14 usage=100
05:15:14:WU00:FS02:0x11:
05:18:36:WU02:FS00:0xa4:Completed 97500 out of 750000 steps  (13%)
05:23:01:WU02:FS00:0xa4:Completed 105000 out of 750000 steps  (14%)
05:27:25:WU02:FS00:0xa4:Completed 112500 out of 750000 steps  (15%)
05:31:48:WU02:FS00:0xa4:Completed 120000 out of 750000 steps  (16%)
05:36:12:WU02:FS00:0xa4:Completed 127500 out of 750000 steps  (17%)
05:40:36:WU02:FS00:0xa4:Completed 135000 out of 750000 steps  (18%)
05:44:59:WU02:FS00:0xa4:Completed 142500 out of 750000 steps  (19%)
05:49:22:WU02:FS00:0xa4:Completed 150000 out of 750000 steps  (20%)
05:53:45:WU02:FS00:0xa4:Completed 157500 out of 750000 steps  (21%)
05:58:08:WU02:FS00:0xa4:C

[bollix47]

It did come back online: viewtopic.php?f=24&t=23051&p=229806#p229806

However, according to the Server Status link it appears to have gone down again a few hours ago.

I would pause that slot for now, delete the WU00 as explained above and then check the Server Status link at the top of this page periodically to see if it's accepting. It's very early so it may be a few hours before it's back in business again.

[neilrieck]

Team,
I've got an NVIDIA GT560 on Windows-XP which just decided to stop folding. The error message reads:

13:38:31:Trying to access database...
13:38:31:Successfully acquired database lock
13:38:31:Enabled folding slot 00: READY gpu:0:"GF114 [GeForce GTX 560]"
13:38:31:WU00:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/x8 ... ore_11.fah
13:38:31:WU00:FS00:Connecting to www.stanford.edu:80
13:38:31:ERROR:WU00:FS00:Exception: Failed to access core package.
13:38:34:Server connection id=1 on 0.0.0.0:36330 from 127.0.0.1
13:39:31:WU00:FS00:Downloading core from http://www.stanford.edu/~pande/Win32/x8 ... ore_11.fah
13:39:31:WU00:FS00:Connecting to www.stanford.edu:80
13:39:31:ERROR:WU00:FS00:Exception: Failed to access core package.

[P5-133XL]

FAHCore_11 is GPU2 and WU's needing it should not be being assigned to a Fermi. You need to delete the WU that is currently being assigned to the GPU slot and hopefully you'll get a WU that will fold on that card.

Pause FAHControl. Remember the work queue number associated with your GTX 560. Go to the work folder (Start->All Programs->FAHClient->Data Directory->work) and delete the folder that has the same name as the work queue number. Now you can un-pause FAHControl and it should download a new WU and hopefully one without the same problem.

[neilrieck]

Hey, thanks for the tip (it worked). I don't know why I was sent that WU (stamped Nov-19) so it looks like this machine didn't do any folding for the past three days. Oh well

[P5-133XL]

It's happening again! GPU2 WU being assigned to a Fermi

Code: Select all

*********************** Log Started 2012-12-04T00:59:53Z ***********************
00:59:53:************************* Folding@home Client *************************
00:59:53:      Website: http://folding.stanford.edu/
00:59:53:    Copyright: (c) 2009-2012 Stanford University
00:59:53:       Author: Joseph Coffland <[email protected]>
00:59:53:         Args: --lifeline 3844 --command-port=36330
00:59:53:       Config: C:/Users/Administrator/AppData/Roaming/FAHClient/config.xml
00:59:53:******************************** Build ********************************
00:59:53:      Version: 7.2.12
00:59:53:         Date: Nov 30 2012
00:59:53:         Time: 20:37:34
00:59:53:      SVN Rev: 3683
00:59:53:       Branch: fah/trunk/client
00:59:53:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
00:59:53:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
00:59:53:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
00:59:53:     Platform: win32 XP
00:59:53:         Bits: 32
00:59:53:         Mode: Release
00:59:53:******************************* System ********************************
00:59:53:          CPU: Intel(R) Core(TM)2 Quad CPU @ 2.40GHz
00:59:53:       CPU ID: GenuineIntel Family 6 Model 15 Stepping 7
00:59:53:         CPUs: 4
00:59:53:       Memory: 4.00GiB
00:59:53:  Free Memory: 2.21GiB
00:59:53:      Threads: WINDOWS_THREADS
00:59:53:   On Battery: false
00:59:53:   UTC offset: -8
00:59:53:          PID: 5096
00:59:53:          CWD: C:/Users/Administrator/AppData/Roaming/FAHClient
00:59:53:           OS: Windows 7 Ultimate
00:59:53:      OS Arch: AMD64
00:59:53:         GPUs: 2
00:59:53:        GPU 0: NVIDIA:2 GF104 [GeForce GTX 460]
00:59:53:        GPU 1: NVIDIA:2 GF104 [GeForce GTX 460]
00:59:53:         CUDA: 2.1
00:59:53:  CUDA Driver: 4020
00:59:53:Win32 Service: false
00:59:53:***********************************************************************
00:59:53:<config>
00:59:53:  <!-- Folding Slot Configuration -->
00:59:53:  <client-type v='beta'/>
00:59:53:  <extra-core-args v='-verbose'/>
00:59:53:  <power v='medium'/>
00:59:53:  <smp v='false'/>
00:59:53:
00:59:53:  <!-- HTTP Server -->
00:59:53:  <allow v='127.0.0.1 192.168.1.0/24'/>
00:59:53:
00:59:53:  <!-- Network -->
00:59:53:  <proxy v=':8080'/>
00:59:53:
00:59:53:  <!-- Remote Command Server -->
00:59:53:  <command-allow-no-pass v='127.0.0.1 192.168.1.0/24'/>
00:59:53:  <password v=''/>
00:59:53:
00:59:53:  <!-- User Information -->
00:59:53:  <passkey v='********************************'/>
00:59:53:  <team v='10047'/>
00:59:53:  <user v='P5_133XL'/>
00:59:53:
00:59:53:  <!-- Work Unit Control -->
00:59:53:  <next-unit-percentage v='100'/>
00:59:53:
00:59:53:  <!-- Folding Slots -->
00:59:53:  <slot id='0' type='GPU'/>
00:59:53:  <slot id='1' type='GPU'/>
00:59:53:</config>

17:45:48:WU01:FS01:Final credit estimate, 16810.00 points
17:45:49:WU01:FS01:Cleaning up
******************************** Date: 04/12/12 ********************************
******************************** Date: 05/12/12 ********************************
04:38:47:WU01:FS01:Connecting to assign-GPU.stanford.edu:80
04:38:48:WU01:FS01:News: Welcome to Folding@Home
04:38:48:WU01:FS01:Assigned to work server 171.67.108.11
04:38:48:WU01:FS01:Requesting new work unit for slot 01: RUNNING gpu:1:GF104 [GeForce GTX 460] from 171.67.108.11
04:38:48:WU01:FS01:Connecting to 171.67.108.11:8080
04:38:48:WU01:FS01:Downloading 44.84KiB
04:38:48:WU01:FS01:Download complete
04:38:48:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:5769 run:5 clone:268 gen:3491 core:0x11 unit:0x7f8a6df850becfd80da3010c00051689
04:38:49:WU01:FS01:Downloading core from http://www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_11.fah
04:38:49:WU01:FS01:Connecting to www.stanford.edu:80
04:38:49:WU01:FS01:FahCore 11: Downloading 648.82KiB
04:38:50:WU01:FS01:FahCore 11: Download complete
04:38:50:WU01:FS01:Valid core signature
04:38:50:WU01:FS01:Unpacked 1.82MiB to cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_11.fah/FahCore_11.exe
04:38:50:WU01:FS01:Downloading project 5769 description
04:38:50:WU01:FS01:Connecting to fah-web.stanford.edu:80
04:38:51:WU01:FS01:Project 5769 description downloaded successfully
04:38:59:WU01:FS01:Starting
04:38:59:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/Administrator/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_11.fah/FahCore_11.exe -dir 01 -suffix 01 -version 702 -lifeline 5096 -checkpoint 15 -cpu 90 -gpu 1 -verbose
04:38:59:WU01:FS01:Started FahCore on PID 3172
04:38:59:WU01:FS01:Core PID:5620
04:38:59:WU01:FS01:FahCore 0x11 started
04:39:00:WU01:FS01:0x11:
04:39:00:WU01:FS01:0x11:*------------------------------*
04:39:00:WU01:FS01:0x11:Folding@Home GPU Core
04:39:00:WU01:FS01:0x11:Version 1.31 (Tue Sep 15 10:57:42 PDT 2009)
04:39:00:WU01:FS01:0x11:
04:39:00:WU01:FS01:0x11:Compiler  : Microsoft (R) 32-bit C/C++ Optimizing Compiler Version 14.00.50727.762 for 80x86 
04:39:00:WU01:FS01:0x11:Build host: amoeba
04:39:00:WU01:FS01:0x11:Board Type: Nvidia
04:39:00:WU01:FS01:0x11:Core      : 
04:39:00:WU01:FS01:0x11:Preparing to commence simulation
04:39:00:WU01:FS01:0x11:- Looking at optimizations...
04:39:00:WU01:FS01:0x11:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
04:39:00:WU01:FS01:0x11:- Created dyn
04:39:00:WU01:FS01:0x11:- Files status OK
04:39:00:WU01:FS01:0x11:- Expanded 45409 -> 251112 (decompressed 553.0 percent)
04:39:00:WU01:FS01:0x11:Called DecompressByteArray: compressed_data_size=45409 data_size=251112, decompressed_data_size=251112 diff=0
04:39:00:WU01:FS01:0x11:- Digital signature verified
04:39:00:WU01:FS01:0x11:
04:39:00:WU01:FS01:0x11:Project: 5769 (Run 5, Clone 268, Gen 3491)
04:39:00:WU01:FS01:0x11:
04:39:00:WU01:FS01:0x11:Assembly optimizations on if available.
04:39:00:WU01:FS01:0x11:Entering M.D.
04:39:05:WU01:FS01:0x11:Tpr hash 01/wudata_01.tpr:  207233647 1658592569 227314520 551149834 3488851551
04:39:05:WU01:FS01:0x11:
04:39:05:WU01:FS01:0x11:Calling fah_main args: 14 usage=100
04:39:05:WU01:FS01:0x11:
******************************** Date: 05/12/12 ********************************

[HaloJones]

I got one too. GTX460 assigned and sat idle unable to do anything for four hours until I dumped the unit.

[GreyWhiskers]

I just posted my same experience in another thread - see link below.

http://foldingforum.org/viewtopic.php?f ... 31#p230929

[7im]

This problem started a while ago according to that link. When will this get permanently fixed?

[bruce]

The PG is aware of the problem. A short term fix was easy. A permanent fix requires changes to the WS code so it goes in the queue with other tickets.

[Xavier Zepherious]

you can add this

fermi assigned AMD core 16
http://www.evga.com/forums/fb.ashx?m=1810625

[codysluder]

Dr. Pande reported that they're having trouble with the Assignment Server. The reports are entirely different, but if the AS isn't working, all sorts of bad things can happen. See viewtopic.php?f=85&t=23200