This work unit fails with the error NANs detected- unstable machine. I have spent the last 4 days with this same work unit failing over and over after half way through it. Also I keep seeing the comment that there is "clock skew and adjusting". How many times does it take a work unit to fail before the system gives up and sends a different one? I think it is a waste of time. I have never had any issues like this till this week. Also the 764x wu's are painfully slow! How can I dump this wu? BTW, I am using the Ver. 7 beta client, latest release.
I am using a Nvidia Geforce GTX550Ti with the 275.33 drivers.
#890 Project7641(345 0 6)
Moderators: Site Moderators, FAHC Science Team
#890 Project7641(345 0 6)
Team Helix-
{RaW}Eagle1
- Posts: 25
- Joined: Wed Mar 21, 2012 10:11 pm
- Hardware configuration: AMD Phenom II 1090T hex core, over-clocked 3.85GHz (folding on 3 cores).
2 x ASUS Nvidia GTX480s, under-clocked by 8% for stability (both folding at 100%)
Intel Pentium Dual Core 1.86GHz, factory clock (folding on both cores, 100%)
Playstation 3 (folding all the time) - Location: Bristol, UK
- Contact:
Re: Project7641(345 0 6)
Technically you can go on failing work units from the same project over and over without a different one being assigned. Try adding the -advmethods flag (or removing it if you already have it). Clear the contents of the "work" directory and delete queue.dat, then restart folding at home. That should get you a different work unit.
Re: Project7641(345 0 6)
Thanks for the help. 
That worked and I got a good old fashioned WU. I didn't know how to dump it on my end.
That worked and I got a good old fashioned WU. I didn't know how to dump it on my end. Team Helix-
7im
- Posts: 10179
- Joined: Thu Nov 29, 2007 4:30 pm
- Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
- Location: Arizona
- Contact:
Re: Project7641(345 0 6)
Should probably use the 285 drivers, as people report those work well. Also the 76xx projects are much larger than previous work, so any OC that was stable may not be stable any more. And NaN errors are typically from too much OC...
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
Tell me and I forget. Teach me and I remember. Involve me and I learn.
Re: Project7641(345 0 6)
I haven't overclocked, running at stock. Also the 285 drivers had the same issue so I reverted to the 275. The drivers version. seem to have no bearing on the failure.7im wrote:Should probably use the 285 drivers, as people report those work well. Also the 76xx projects are much larger than previous work, so any OC that was stable may not be stable any more. And NaN errors are typically from too much OC...
Team Helix-
P5-133XL
- Posts: 2948
- Joined: Sun Dec 02, 2007 4:36 am
- Hardware configuration: Machine #1:
Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).
Machine #2:
Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.
Machine 3:
Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32
I am currently folding just on the 5x GTX 460's for aprox. 70K PPD - Location: Salem. OR USA
Re: Project7641(345 0 6)
72 to 75c that shouldn't be too bad, right?P5-133XL wrote:check your video card temperatures.
Team Helix-
P5-133XL
- Posts: 2948
- Joined: Sun Dec 02, 2007 4:36 am
- Hardware configuration: Machine #1:
Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).
Machine #2:
Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.
Machine 3:
Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32
I am currently folding just on the 5x GTX 460's for aprox. 70K PPD - Location: Salem. OR USA
Re: Project7641(345 0 6)
At what temp should I get concerned?P5-133XL wrote:Those are fine temps.
Team HelixRe: Project7641(345 0 6)
That depends on what it says in the log, but that wasn't posted so you don't really know that. If it's the V6 client and it says it deleted the WU, then you're right. The WU can keep on being reassigned. If it's the V7 client, there should always be a report returned to the server, In either case, the server will count the failure reports and after a prescribed number, it will assign a new WU.{RaW}Eagle1 wrote:Technically you can go on failing work units from the same project over and over without a different one being assigned.
If a client is completely unmonitored, the WU will eventually expire, too, but that takes a long time so for people who watch their clients and then post here, that's the equivalent of "forever" so it only counts in extreme cases.
Posting FAH's log:
How to provide enough info to get helpful support.
How to provide enough info to get helpful support.
-
P5-133XL
- Posts: 2948
- Joined: Sun Dec 02, 2007 4:36 am
- Hardware configuration: Machine #1:
Intel Q9450; 2x2GB=8GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460; Windows Server 2008 X64 (SP1).
Machine #2:
Intel Q6600; 2x2GB=4GB Ram; Gigabyte GA-X48-DS4 Motherboard; PC Power and Cooling Q750 PS; 2x GTX 460 video card; Windows 7 X64.
Machine 3:
Dell Dimension 8400, 3.2GHz P4 4x512GB Ram, Video card GTX 460, Windows 7 X32
I am currently folding just on the 5x GTX 460's for aprox. 70K PPD - Location: Salem. OR USA
Re: Project7641(345 0 6)
Typically anything near 100C. GPU's normally start going into self-preservation mode somewhere between 100C-110C depending upon the specific chip. Anything under 80C is normally fine and still gives plenty of headroom.
Most people start getting very uncomfortable when temps get near 100C Though I have a GTX 460 that I fold with at 95C-98C. I don't have any problems running it at that temp. When a plug entered It lost its fan that was built into the shroud and I replaced it with a 120mm case fan that is hanging from the card with zip ties. I could not get the original company to send me a new shroud with a new fan. I was not willing to buy a $50-$100 for a 3rd party cooling kit on a $100 card. So I improvised. Its not that I had anything to lose for in my mind the card was effectively dead already.
Most people start getting very uncomfortable when temps get near 100C Though I have a GTX 460 that I fold with at 95C-98C. I don't have any problems running it at that temp. When a plug entered It lost its fan that was built into the shroud and I replaced it with a 120mm case fan that is hanging from the card with zip ties. I could not get the original company to send me a new shroud with a new fan. I was not willing to buy a $50-$100 for a 3rd party cooling kit on a $100 card. So I improvised. Its not that I had anything to lose for in my mind the card was effectively dead already.
Re: Project7641(345 0 6)
bruce wrote:That depends on what it says in the log, but that wasn't posted so you don't really know that. If it's the V6 client and it says it deleted the WU, then you're right. The WU can keep on being reassigned. If it's the V7 client, there should always be a report returned to the server, In either case, the server will count the failure reports and after a prescribed number, it will assign a new WU.{RaW}Eagle1 wrote:Technically you can go on failing work units from the same project over and over without a different one being assigned.
If a client is completely unmonitored, the WU will eventually expire, too, but that takes a long time so for people who watch their clients and then post here, that's the equivalent of "forever" so it only counts in extreme cases.
Code: Select all
*********************** Log Started 2012-05-11T21:53:07Z ***********************
21:53:07:************************* Folding@home Client *************************
21:53:07: Website: http://folding.stanford.edu/
21:53:07: Copyright: (c) 2009-2012 Stanford University
21:53:07: Author: Joseph Coffland <[email protected]>
21:53:07: Args: --lifeline 1408 --command-port=36330
21:53:07: Config: C:/Users/Jimmy Nichols/AppData/Roaming/FAHClient/config.xml
21:53:07:******************************** Build ********************************
21:53:07: Version: 7.1.52
21:53:07: Date: Mar 20 2012
21:53:07: Time: 19:37:42
21:53:07: SVN Rev: 3515
21:53:07: Branch: fah/trunk/client
21:53:07: Compiler: Intel(R) C++ MSVC 1500 mode 1200
21:53:07: Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
21:53:07: /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT
21:53:07: Platform: win32 XP
21:53:07: Bits: 32
21:53:07: Mode: Release
21:53:07:******************************* System ********************************
21:53:07: CPU: Intel(R) Core(TM)2 Duo CPU E8400 @ 3.00GHz
21:53:07: CPU ID: GenuineIntel Family 6 Model 23 Stepping 10
21:53:07: CPUs: 2
21:53:07: Memory: 6.00GiB
21:53:07: Free Memory: 4.22GiB
21:53:07: Threads: WINDOWS_THREADS
21:53:07: On Battery: false
21:53:07: UTC offset: -4
21:53:07: PID: 5772
21:53:07: CWD: C:/Users/Jimmy Nichols/AppData/Roaming/FAHClient
21:53:07: OS: Windows 7 Ultimate
21:53:07: OS Arch: AMD64
21:53:07: GPUs: 1
21:53:07: GPU 0: FERMI:1 GF116 [GeForce GTX 550 Ti]
21:53:07: CUDA: 2.1
21:53:07: CUDA Driver: 4000
21:53:07:Win32 Service: false
21:53:07:***********************************************************************
21:53:07:<config>
21:53:07: <!-- Folding Slot Configuration -->
21:53:07: <gpu v='true'/>
21:53:07:
21:53:07: <!-- Network -->
21:53:07: <proxy v=':8080'/>
21:53:07:
21:53:07: <!-- User Information -->
21:53:07: <passkey v='********************************'/>
21:53:07: <team v='4'/>
21:53:07: <user v='jaynick65'/>
21:53:07:
21:53:07: <!-- Folding Slots -->
21:53:07: <slot id='1' type='SMP'/>
21:53:07: <slot id='0' type='GPU'>
21:53:07: <gpu-index v='0'/>
21:53:07: </slot>
21:53:07:</config>
21:53:07:Trying to access database...
21:53:07:Successfully acquired database lock
21:53:07:Enabled folding slot 01: READY smp:2
21:53:07:Enabled folding slot 00: READY gpu:0:"GF116 [GeForce GTX 550 Ti]"
21:53:07:WU00:FS00:Starting
21:53:07:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Jimmy Nichols/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe" -dir 00 -suffix 01 -version 701 -lifeline 5772 -checkpoint 15 -gpu 0
21:53:07:WU00:FS00:Started FahCore on PID 4796
21:53:07:WU00:FS00:Core PID:3644
21:53:07:WU00:FS00:FahCore 0x15 started
21:53:07:WU02:FS01:Starting
21:53:07:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Jimmy Nichols/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe" -dir 02 -suffix 01 -version 701 -lifeline 5772 -checkpoint 15 -np 2
21:53:07:WU02:FS01:Started FahCore on PID 3244
21:53:07:WU02:FS01:Core PID:2296
21:53:07:WU02:FS01:FahCore 0xa4 started
21:53:08:WU00:FS00:0x15:
21:53:08:WU00:FS00:0x15:*------------------------------*
21:53:08:WU00:FS00:0x15:Folding@Home GPU Core
21:53:08:WU00:FS00:0x15:Version 2.22 (Thu Dec 8 17:08:05 PST 2011)
21:53:08:WU00:FS00:0x15:Build host SimbiosNvdWin7
21:53:08:WU00:FS00:0x15:Board Type NVIDIA/CUDA
21:53:08:WU00:FS00:0x15:Core 15
21:53:08:WU00:FS00:0x15:
21:53:08:WU00:FS00:0x15:Window's signal control handler registered.
21:53:08:WU00:FS00:0x15:Preparing to commence simulation
21:53:08:WU00:FS00:0x15:- Ensuring status. Please wait.
21:53:08:WU02:FS01:0xa4:
21:53:08:WU02:FS01:0xa4:*------------------------------*
21:53:08:WU02:FS01:0xa4:Folding@Home Gromacs GB Core
21:53:08:WU02:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
21:53:08:WU02:FS01:0xa4:
21:53:08:WU02:FS01:0xa4:Preparing to commence simulation
21:53:08:WU02:FS01:0xa4:- Ensuring status. Please wait.
21:53:10:Server connection id=1 on 0.0.0.0:36330 from 127.0.0.1
21:53:17:WU02:FS01:0xa4:- Looking at optimizations...
21:53:17:WU00:FS00:0x15:- Looking at optimizations...
21:53:17:WU02:FS01:0xa4:- Working with standard loops on this execution.
21:53:17:WU00:FS00:0x15:- Working with standard loops on this execution.
21:53:17:WU02:FS01:0xa4:- Previous termination of core was improper.
21:53:17:WU00:FS00:0x15:- Previous termination of core was improper.
21:53:17:WU02:FS01:0xa4:- Files status OK
21:53:17:WU00:FS00:0x15:- Files status OK
21:53:17:WU02:FS01:0xa4:- Expanded 546574 -> 1326096 (decompressed 242.6 percent)
21:53:17:WU00:FS00:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
21:53:17:WU02:FS01:0xa4:Called DecompressByteArray: compressed_data_size=546574 data_size=1326096, decompressed_data_size=1326096 diff=0
21:53:17:WU00:FS00:0x15:- Expanded 548290 -> 972648 (decompressed 177.3 percent)
21:53:17:WU02:FS01:0xa4:- Digital signature verified
21:53:17:WU00:FS00:0x15:Called DecompressByteArray: compressed_data_size=548290 data_size=972648, decompressed_data_size=972648 diff=0
21:53:17:WU02:FS01:0xa4:
21:53:17:WU00:FS00:0x15:- Digital signature verified
21:53:17:WU02:FS01:0xa4:Project: 8014 (Run 3, Clone 571, Gen 4)
21:53:17:WU00:FS00:0x15:
21:53:17:WU02:FS01:0xa4:
21:53:17:WU00:FS00:0x15:Project: 7641 (Run 345, Clone 0, Gen 6)
21:53:17:WU02:FS01:0xa4:Entering M.D.
21:53:17:WU00:FS00:0x15:
21:53:17:WU00:FS00:0x15:Entering M.D.
21:53:19:WU00:FS00:0x15:Will resume from checkpoint file 00/wudata_01.ckp
21:53:19:WU00:FS00:0x15:Tpr hash 00/wudata_01.tpr: 912252799 3713396661 4228272458 301502995 1857969887
21:53:19:WU00:FS00:0x15:GPU device info: vendor=0 device=0 name=<NA> match=0
21:53:19:WU00:FS00:0x15:Working on Protein in water
21:53:19:WU00:FS00:0x15:Client config unavailable.
21:53:19:WU00:FS00:0x15:Starting GUI Server
21:53:23:WU02:FS01:0xa4:Using Gromacs checkpoints
21:53:23:WU02:FS01:0xa4:Mapping NT from 2 to 2
21:53:23:WU02:FS01:0xa4:Resuming from checkpoint
21:53:23:WU02:FS01:0xa4:Verified 02/wudata_01.log
21:53:23:WU02:FS01:0xa4:Verified 02/wudata_01.trr
21:53:23:WU02:FS01:0xa4:Verified 02/wudata_01.xtc
21:53:23:WU02:FS01:0xa4:Verified 02/wudata_01.edr
21:53:24:WU02:FS01:0xa4:Completed 13750 out of 250000 steps (5%)
21:55:14:WU02:FS01:0xa4:Completed 15000 out of 250000 steps (6%)
21:55:19:WU00:FS00:0x15:Resuming from checkpoint
21:55:19:WU00:FS00:0x15:fcCheckPointResume: retreived and current tpr file hash:
21:55:19:WU00:FS00:0x15: 0 912252799 912252799
21:55:19:WU00:FS00:0x15: 1 3713396661 3713396661
21:55:19:WU00:FS00:0x15: 2 4228272458 4228272458
21:55:19:WU00:FS00:0x15: 3 301502995 301502995
21:55:19:WU00:FS00:0x15: 4 1857969887 1857969887
21:55:19:WU00:FS00:0x15:fcCheckPointResume: file hashes same.
21:55:19:WU00:FS00:0x15:fcCheckPointResume: state restored.
21:55:19:WU00:FS00:0x15:fcCheckPointResume: name 00/wudata_01.log Verified 00/wudata_01.log
21:55:19:WU00:FS00:0x15:fcCheckPointResume: name 00/wudata_01.trr Verified 00/wudata_01.trr
21:55:19:WU00:FS00:0x15:fcCheckPointResume: name 00/wudata_01.xtc Verified 00/wudata_01.xtc
21:55:19:WU00:FS00:0x15:fcCheckPointResume: name 00/wudata_01.edr Verified 00/wudata_01.edr
21:55:19:WU00:FS00:0x15:fcCheckPointResume: state restored 2
21:55:19:WU00:FS00:0x15:Resumed from checkpoint
21:55:19:WU00:FS00:0x15:Setting checkpoint frequency: 25000
21:55:19:WU00:FS00:0x15:Completed 125001 out of 2500000 steps (5%).
21:55:20:WARNING:WU00:FS00:Detected clock skew, adjusting time estimates
21:58:41:WU02:FS01:0xa4:Completed 17500 out of 250000 steps (7%)
22:01:17:WU02:FS01:0xa4:Completed 20000 out of 250000 steps (8%)
22:03:55:Server connection id=2 on 0.0.0.0:36330 from 127.0.0.1
22:04:02:WU02:FS01:0xa4:Completed 22500 out of 250000 steps (9%)
22:06:37:WU02:FS01:0xa4:Completed 25000 out of 250000 steps (10%)
22:09:11:WU02:FS01:0xa4:Completed 27500 out of 250000 steps (11%)
22:11:45:WU02:FS01:0xa4:Completed 30000 out of 250000 steps (12%)
22:12:23:WU00:FS00:0x15:Completed 150000 out of 2500000 steps (6%).
22:14:24:WU02:FS01:0xa4:Completed 32500 out of 250000 steps (13%)
22:17:03:WU02:FS01:0xa4:Completed 35000 out of 250000 steps (14%)
22:19:52:WU02:FS01:0xa4:Completed 37500 out of 250000 steps (15%)
22:22:46:WU02:FS01:0xa4:Completed 40000 out of 250000 steps (16%)
22:25:31:WU02:FS01:0xa4:Completed 42500 out of 250000 steps (17%)
22:28:14:WU02:FS01:0xa4:Completed 45000 out of 250000 steps (18%)
22:29:17:WU00:FS00:0x15:Completed 175000 out of 2500000 steps (7%).
22:31:00:WU02:FS01:0xa4:Completed 47500 out of 250000 steps (19%)
22:33:42:WU02:FS01:0xa4:Completed 50000 out of 250000 steps (20%)
22:36:27:WU02:FS01:0xa4:Completed 52500 out of 250000 steps (21%)
22:39:08:WU02:FS01:0xa4:Completed 55000 out of 250000 steps (22%)
22:41:44:WU02:FS01:0xa4:Completed 57500 out of 250000 steps (23%)
22:44:21:WU02:FS01:0xa4:Completed 60000 out of 250000 steps (24%)
22:46:03:WU00:FS00:0x15:Completed 200000 out of 2500000 steps (8%).
22:46:57:WU02:FS01:0xa4:Completed 62500 out of 250000 steps (25%)
22:49:34:WU02:FS01:0xa4:Completed 65000 out of 250000 steps (26%)
22:52:12:WU02:FS01:0xa4:Completed 67500 out of 250000 steps (27%)
22:54:49:WU02:FS01:0xa4:Completed 70000 out of 250000 steps (28%)
22:57:25:WU02:FS01:0xa4:Completed 72500 out of 250000 steps (29%)
23:00:04:WU02:FS01:0xa4:Completed 75000 out of 250000 steps (30%)
23:02:46:WU02:FS01:0xa4:Completed 77500 out of 250000 steps (31%)
23:02:50:WU00:FS00:0x15:Completed 225000 out of 2500000 steps (9%).
23:05:52:WU02:FS01:0xa4:Completed 80000 out of 250000 steps (32%)
23:08:40:WU02:FS01:0xa4:Completed 82500 out of 250000 steps (33%)
23:11:25:WU02:FS01:0xa4:Completed 85000 out of 250000 steps (34%)
23:14:15:WU02:FS01:0xa4:Completed 87500 out of 250000 steps (35%)
23:17:07:WU02:FS01:0xa4:Completed 90000 out of 250000 steps (36%)
23:20:00:WU02:FS01:0xa4:Completed 92500 out of 250000 steps (37%)
23:20:05:WU00:FS00:0x15:Completed 250000 out of 2500000 steps (10%).
23:22:46:WU02:FS01:0xa4:Completed 95000 out of 250000 steps (38%)
23:25:31:WU02:FS01:0xa4:Completed 97500 out of 250000 steps (39%)
23:28:14:WU02:FS01:0xa4:Completed 100000 out of 250000 steps (40%)
23:30:45:WU02:FS01:0xa4:Completed 102500 out of 250000 steps (41%)
23:33:16:WU02:FS01:0xa4:Completed 105000 out of 250000 steps (42%)
23:35:47:WU02:FS01:0xa4:Completed 107500 out of 250000 steps (43%)
23:36:48:WU00:FS00:0x15:Completed 275000 out of 2500000 steps (11%).
23:38:21:WU02:FS01:0xa4:Completed 110000 out of 250000 steps (44%)
23:41:04:WU02:FS01:0xa4:Completed 112500 out of 250000 steps (45%)
23:43:47:WU02:FS01:0xa4:Completed 115000 out of 250000 steps (46%)
23:46:42:WU02:FS01:0xa4:Completed 117500 out of 250000 steps (47%)
23:49:17:WU02:FS01:0xa4:Completed 120000 out of 250000 steps (48%)
23:51:48:WU02:FS01:0xa4:Completed 122500 out of 250000 steps (49%)
23:53:41:WU00:FS00:0x15:Completed 300000 out of 2500000 steps (12%).
23:54:20:WU02:FS01:0xa4:Completed 125000 out of 250000 steps (50%)
23:56:51:WU02:FS01:0xa4:Completed 127500 out of 250000 steps (51%)
23:59:22:WU02:FS01:0xa4:Completed 130000 out of 250000 steps (52%)
00:02:02:WU02:FS01:0xa4:Completed 132500 out of 250000 steps (53%)
00:04:34:WU02:FS01:0xa4:Completed 135000 out of 250000 steps (54%)
00:07:05:WU02:FS01:0xa4:Completed 137500 out of 250000 steps (55%)
00:09:35:WU02:FS01:0xa4:Completed 140000 out of 250000 steps (56%)
00:10:29:WU00:FS00:0x15:Completed 325000 out of 2500000 steps (13%).
00:12:07:WU02:FS01:0xa4:Completed 142500 out of 250000 steps (57%)
00:14:38:WU02:FS01:0xa4:Completed 145000 out of 250000 steps (58%)
00:17:09:WU02:FS01:0xa4:Completed 147500 out of 250000 steps (59%)
00:19:40:WU02:FS01:0xa4:Completed 150000 out of 250000 steps (60%)
00:22:11:WU02:FS01:0xa4:Completed 152500 out of 250000 steps (61%)
00:24:40:WU02:FS01:0xa4:Completed 155000 out of 250000 steps (62%)
00:27:07:WU00:FS00:0x15:Completed 350000 out of 2500000 steps (14%).
00:27:18:WU02:FS01:0xa4:Completed 157500 out of 250000 steps (63%)
00:29:49:WU02:FS01:0xa4:Completed 160000 out of 250000 steps (64%)
00:32:22:WU02:FS01:0xa4:Completed 162500 out of 250000 steps (65%)
00:34:52:WU02:FS01:0xa4:Completed 165000 out of 250000 steps (66%)
00:37:23:WU02:FS01:0xa4:Completed 167500 out of 250000 steps (67%)
00:39:53:WU02:FS01:0xa4:Completed 170000 out of 250000 steps (68%)
00:42:25:WU02:FS01:0xa4:Completed 172500 out of 250000 steps (69%)
00:43:47:WU00:FS00:0x15:Completed 375000 out of 2500000 steps (15%).
00:44:55:WU02:FS01:0xa4:Completed 175000 out of 250000 steps (70%)
00:47:25:WU02:FS01:0xa4:Completed 177500 out of 250000 steps (71%)
00:49:56:WU02:FS01:0xa4:Completed 180000 out of 250000 steps (72%)
00:52:28:WU02:FS01:0xa4:Completed 182500 out of 250000 steps (73%)
00:54:59:WU02:FS01:0xa4:Completed 185000 out of 250000 steps (74%)
00:57:30:WU02:FS01:0xa4:Completed 187500 out of 250000 steps (75%)
01:00:00:WU02:FS01:0xa4:Completed 190000 out of 250000 steps (76%)
01:00:31:WU00:FS00:0x15:Completed 400000 out of 2500000 steps (16%).
01:02:34:WU02:FS01:0xa4:Completed 192500 out of 250000 steps (77%)
01:05:05:WU02:FS01:0xa4:Completed 195000 out of 250000 steps (78%)
01:07:35:WU02:FS01:0xa4:Completed 197500 out of 250000 steps (79%)
01:10:04:WU02:FS01:0xa4:Completed 200000 out of 250000 steps (80%)
01:12:36:WU02:FS01:0xa4:Completed 202500 out of 250000 steps (81%)
01:15:07:WU02:FS01:0xa4:Completed 205000 out of 250000 steps (82%)
01:17:13:WU00:FS00:0x15:Completed 425000 out of 2500000 steps (17%).
01:17:37:WU02:FS01:0xa4:Completed 207500 out of 250000 steps (83%)
01:20:07:WU02:FS01:0xa4:Completed 210000 out of 250000 steps (84%)
01:22:38:WU02:FS01:0xa4:Completed 212500 out of 250000 steps (85%)
01:25:09:WU02:FS01:0xa4:Completed 215000 out of 250000 steps (86%)
01:27:38:WU02:FS01:0xa4:Completed 217500 out of 250000 steps (87%)
01:30:08:WU02:FS01:0xa4:Completed 220000 out of 250000 steps (88%)
01:32:39:WU02:FS01:0xa4:Completed 222500 out of 250000 steps (89%)
01:33:56:WU00:FS00:0x15:Completed 450000 out of 2500000 steps (18%).
01:35:09:WU02:FS01:0xa4:Completed 225000 out of 250000 steps (90%)
01:37:38:WU02:FS01:0xa4:Completed 227500 out of 250000 steps (91%)
01:40:09:WU02:FS01:0xa4:Completed 230000 out of 250000 steps (92%)
01:42:40:WU02:FS01:0xa4:Completed 232500 out of 250000 steps (93%)
01:45:10:WU02:FS01:0xa4:Completed 235000 out of 250000 steps (94%)
01:47:40:WU02:FS01:0xa4:Completed 237500 out of 250000 steps (95%)
01:50:09:WU02:FS01:0xa4:Completed 240000 out of 250000 steps (96%)
01:50:39:WU00:FS00:0x15:Completed 475000 out of 2500000 steps (19%).
01:52:41:WU02:FS01:0xa4:Completed 242500 out of 250000 steps (97%)
01:55:12:WU02:FS01:0xa4:Completed 245000 out of 250000 steps (98%)
01:57:42:WU02:FS01:0xa4:Completed 247500 out of 250000 steps (99%)
02:00:12:WU02:FS01:0xa4:Completed 250000 out of 250000 steps (100%)
02:00:13:WU02:FS01:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
02:00:13:WU01:FS01:Connecting to assign3.stanford.edu:8080
02:00:13:WU01:FS01:News: Welcome to Folding@Home
02:00:13:WU01:FS01:Assigned to work server 171.67.108.58
02:00:13:WU01:FS01:Requesting new work unit for slot 01: RUNNING smp:2 from 171.67.108.58
02:00:13:WU01:FS01:Connecting to 171.67.108.58:8080
02:00:14:WU01:FS01:Downloading 534.43KiB
02:00:15:WU01:FS01:Download complete
02:00:15:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:OK project:8014 run:4 clone:878 gen:4 core:0xa4 unit:0x000000056652edca4f9b06d3792b8e26
02:00:23:WU02:FS01:0xa4:
02:00:23:WU02:FS01:0xa4:Finished Work Unit:
02:00:23:WU02:FS01:0xa4:- Reading up to 769164 from "02/wudata_01.trr": Read 769164
02:00:23:WU02:FS01:0xa4:trr file hash check passed.
02:00:23:WU02:FS01:0xa4:- Reading up to 455844 from "02/wudata_01.xtc": Read 455844
02:00:23:WU02:FS01:0xa4:xtc file hash check passed.
02:00:23:WU02:FS01:0xa4:edr file hash check passed.
02:00:23:WU02:FS01:0xa4:logfile size: 24134
02:00:23:WU02:FS01:0xa4:Leaving Run
02:00:27:WU02:FS01:0xa4:- Writing 1254546 bytes of core data to disk...
02:00:27:WU02:FS01:0xa4:Done: 1254034 -> 1192843 (compressed to 95.1 percent)
02:00:27:WU02:FS01:0xa4: ... Done.
02:00:28:WU02:FS01:0xa4:- Shutting down core
02:00:28:WU02:FS01:0xa4:
02:00:28:WU02:FS01:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
02:00:28:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
02:00:29:WU02:FS01:Sending unit results: id:02 state:SEND error:OK project:8014 run:3 clone:571 gen:4 core:0xa4 unit:0x000000066652edca4f9b05d89851cccc
02:00:29:WU02:FS01:Uploading 1.14MiB to 171.67.108.58
02:00:29:WU01:FS01:Starting
02:00:29:WU02:FS01:Connecting to 171.67.108.58:8080
02:00:29:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Jimmy Nichols/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe" -dir 01 -suffix 01 -version 701 -lifeline 5772 -checkpoint 15 -np 2
02:00:29:WU01:FS01:Started FahCore on PID 2344
02:00:29:WU01:FS01:Core PID:1820
02:00:29:WU01:FS01:FahCore 0xa4 started
02:00:29:WU01:FS01:0xa4:
02:00:29:WU01:FS01:0xa4:*------------------------------*
02:00:29:WU01:FS01:0xa4:Folding@Home Gromacs GB Core
02:00:29:WU01:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
02:00:29:WU01:FS01:0xa4:
02:00:29:WU01:FS01:0xa4:Preparing to commence simulation
02:00:29:WU01:FS01:0xa4:- Looking at optimizations...
02:00:29:WU01:FS01:0xa4:- Created dyn
02:00:29:WU01:FS01:0xa4:- Files status OK
02:00:29:WU01:FS01:0xa4:- Expanded 546748 -> 1326096 (decompressed 242.5 percent)
02:00:29:WU01:FS01:0xa4:Called DecompressByteArray: compressed_data_size=546748 data_size=1326096, decompressed_data_size=1326096 diff=0
02:00:29:WU01:FS01:0xa4:- Digital signature verified
02:00:29:WU01:FS01:0xa4:
02:00:29:WU01:FS01:0xa4:Project: 8014 (Run 4, Clone 878, Gen 4)
02:00:29:WU01:FS01:0xa4:
02:00:29:WU01:FS01:0xa4:Assembly optimizations on if available.
02:00:29:WU01:FS01:0xa4:Entering M.D.
02:00:35:WU02:FS01:Upload 60.41%
02:00:35:WU01:FS01:0xa4:Mapping NT from 2 to 2
02:00:35:WU01:FS01:0xa4:Completed 0 out of 250000 steps (0%)
02:00:39:WU02:FS01:Upload complete
02:00:39:WU02:FS01:Server responded WORK_ACK (400)
02:00:39:WU02:FS01:Final credit estimate, 444.00 points
02:00:39:WU02:FS01:Cleaning up
02:03:11:WU01:FS01:0xa4:Completed 2500 out of 250000 steps (1%)
02:05:45:WU01:FS01:0xa4:Completed 5000 out of 250000 steps (2%)
02:07:24:WU00:FS00:0x15:Completed 500000 out of 2500000 steps (20%).
02:08:19:WU01:FS01:0xa4:Completed 7500 out of 250000 steps (3%)
02:10:50:WU01:FS01:0xa4:Completed 10000 out of 250000 steps (4%)
02:13:25:WU01:FS01:0xa4:Completed 12500 out of 250000 steps (5%)
02:15:57:WU01:FS01:0xa4:Completed 15000 out of 250000 steps (6%)
02:18:30:WU01:FS01:0xa4:Completed 17500 out of 250000 steps (7%)
02:21:03:WU01:FS01:0xa4:Completed 20000 out of 250000 steps (8%)
02:23:36:WU01:FS01:0xa4:Completed 22500 out of 250000 steps (9%)
02:24:06:WU00:FS00:0x15:Completed 525000 out of 2500000 steps (21%).
02:26:08:WU01:FS01:0xa4:Completed 25000 out of 250000 steps (10%)
02:28:40:WU01:FS01:0xa4:Completed 27500 out of 250000 steps (11%)
02:31:14:WU01:FS01:0xa4:Completed 30000 out of 250000 steps (12%)
02:33:48:WU01:FS01:0xa4:Completed 32500 out of 250000 steps (13%)
02:36:21:WU01:FS01:0xa4:Completed 35000 out of 250000 steps (14%)
02:38:52:WU01:FS01:0xa4:Completed 37500 out of 250000 steps (15%)
02:40:46:WU00:FS00:0x15:Completed 550000 out of 2500000 steps (22%).
02:41:26:WU01:FS01:0xa4:Completed 40000 out of 250000 steps (16%)
02:43:58:WU01:FS01:0xa4:Completed 42500 out of 250000 steps (17%)
02:46:30:WU01:FS01:0xa4:Completed 45000 out of 250000 steps (18%)
02:49:02:WU01:FS01:0xa4:Completed 47500 out of 250000 steps (19%)
02:51:33:WU01:FS01:0xa4:Completed 50000 out of 250000 steps (20%)
02:54:08:WU01:FS01:0xa4:Completed 52500 out of 250000 steps (21%)
02:56:42:WU01:FS01:0xa4:Completed 55000 out of 250000 steps (22%)
02:57:28:WU00:FS00:0x15:Completed 575000 out of 2500000 steps (23%).
02:59:15:WU01:FS01:0xa4:Completed 57500 out of 250000 steps (23%)
03:01:50:WU01:FS01:0xa4:Completed 60000 out of 250000 steps (24%)
03:04:22:WU01:FS01:0xa4:Completed 62500 out of 250000 steps (25%)
03:06:53:WU01:FS01:0xa4:Completed 65000 out of 250000 steps (26%)
03:09:22:WU01:FS01:0xa4:Completed 67500 out of 250000 steps (27%)
03:11:55:WU01:FS01:0xa4:Completed 70000 out of 250000 steps (28%)
03:14:12:WU00:FS00:0x15:Completed 600000 out of 2500000 steps (24%).
03:14:30:WU01:FS01:0xa4:Completed 72500 out of 250000 steps (29%)
03:17:02:WU01:FS01:0xa4:Completed 75000 out of 250000 steps (30%)
03:19:36:WU01:FS01:0xa4:Completed 77500 out of 250000 steps (31%)
03:22:10:WU01:FS01:0xa4:Completed 80000 out of 250000 steps (32%)
03:24:45:WU01:FS01:0xa4:Completed 82500 out of 250000 steps (33%)
03:27:19:WU01:FS01:0xa4:Completed 85000 out of 250000 steps (34%)
03:29:53:WU01:FS01:0xa4:Completed 87500 out of 250000 steps (35%)
03:30:44:WU00:FS00:0x15:Completed 625000 out of 2500000 steps (25%).
03:32:28:WU01:FS01:0xa4:Completed 90000 out of 250000 steps (36%)
03:35:02:WU01:FS01:0xa4:Completed 92500 out of 250000 steps (37%)
03:37:36:WU01:FS01:0xa4:Completed 95000 out of 250000 steps (38%)
03:40:10:WU01:FS01:0xa4:Completed 97500 out of 250000 steps (39%)
03:42:44:WU01:FS01:0xa4:Completed 100000 out of 250000 steps (40%)
03:45:17:WU01:FS01:0xa4:Completed 102500 out of 250000 steps (41%)
03:47:12:WU00:FS00:0x15:Completed 650000 out of 2500000 steps (26%).
03:47:51:WU01:FS01:0xa4:Completed 105000 out of 250000 steps (42%)
03:50:26:WU01:FS01:0xa4:Completed 107500 out of 250000 steps (43%)
03:53:00:WU01:FS01:0xa4:Completed 110000 out of 250000 steps (44%)
******************************** Date: 12/05/12 ********************************
03:55:32:WU01:FS01:0xa4:Completed 112500 out of 250000 steps (45%)
03:58:06:WU01:FS01:0xa4:Completed 115000 out of 250000 steps (46%)
04:00:43:WU01:FS01:0xa4:Completed 117500 out of 250000 steps (47%)
04:03:27:WU01:FS01:0xa4:Completed 120000 out of 250000 steps (48%)
04:03:47:WU00:FS00:0x15:Completed 675000 out of 2500000 steps (27%).
04:06:01:WU01:FS01:0xa4:Completed 122500 out of 250000 steps (49%)
04:08:34:WU01:FS01:0xa4:Completed 125000 out of 250000 steps (50%)
04:11:09:WU01:FS01:0xa4:Completed 127500 out of 250000 steps (51%)
04:13:43:WU01:FS01:0xa4:Completed 130000 out of 250000 steps (52%)
04:16:17:WU01:FS01:0xa4:Completed 132500 out of 250000 steps (53%)
04:18:53:WU01:FS01:0xa4:Completed 135000 out of 250000 steps (54%)
04:20:25:WU00:FS00:0x15:Completed 700000 out of 2500000 steps (28%).
04:21:27:WU01:FS01:0xa4:Completed 137500 out of 250000 steps (55%)
04:23:59:WU01:FS01:0xa4:Completed 140000 out of 250000 steps (56%)
04:26:30:WU01:FS01:0xa4:Completed 142500 out of 250000 steps (57%)
04:29:05:WU01:FS01:0xa4:Completed 145000 out of 250000 steps (58%)
04:32:55:WU01:FS01:0xa4:Completed 147500 out of 250000 steps (59%)
04:35:34:WU01:FS01:0xa4:Completed 150000 out of 250000 steps (60%)
04:37:06:WU00:FS00:0x15:Completed 725000 out of 2500000 steps (29%).
04:38:09:WU01:FS01:0xa4:Completed 152500 out of 250000 steps (61%)
04:40:44:WU01:FS01:0xa4:Completed 155000 out of 250000 steps (62%)
04:43:21:WU01:FS01:0xa4:Completed 157500 out of 250000 steps (63%)
04:46:06:WU01:FS01:0xa4:Completed 160000 out of 250000 steps (64%)
04:48:57:WU01:FS01:0xa4:Completed 162500 out of 250000 steps (65%)
04:51:46:WU01:FS01:0xa4:Completed 165000 out of 250000 steps (66%)
04:53:53:WU00:FS00:0x15:Completed 750000 out of 2500000 steps (30%).
04:54:36:WU01:FS01:0xa4:Completed 167500 out of 250000 steps (67%)
04:57:18:WU01:FS01:0xa4:Completed 170000 out of 250000 steps (68%)
05:00:04:WU01:FS01:0xa4:Completed 172500 out of 250000 steps (69%)
05:02:56:WU01:FS01:0xa4:Completed 175000 out of 250000 steps (70%)
05:05:37:WU01:FS01:0xa4:Completed 177500 out of 250000 steps (71%)
05:08:23:WU01:FS01:0xa4:Completed 180000 out of 250000 steps (72%)
05:10:42:WU00:FS00:0x15:Completed 775000 out of 2500000 steps (31%).
05:11:12:WU01:FS01:0xa4:Completed 182500 out of 250000 steps (73%)
05:13:48:WU01:FS01:0xa4:Completed 185000 out of 250000 steps (74%)
05:16:31:WU01:FS01:0xa4:Completed 187500 out of 250000 steps (75%)
05:19:12:WU01:FS01:0xa4:Completed 190000 out of 250000 steps (76%)
05:21:50:WU01:FS01:0xa4:Completed 192500 out of 250000 steps (77%)
05:24:29:WU01:FS01:0xa4:Completed 195000 out of 250000 steps (78%)
05:27:07:WU01:FS01:0xa4:Completed 197500 out of 250000 steps (79%)
05:29:40:WU01:FS01:0xa4:Completed 200000 out of 250000 steps (80%)
05:32:17:WU01:FS01:0xa4:Completed 202500 out of 250000 steps (81%)
05:34:58:WU01:FS01:0xa4:Completed 205000 out of 250000 steps (82%)
05:37:37:WU01:FS01:0xa4:Completed 207500 out of 250000 steps (83%)
05:40:21:WU01:FS01:0xa4:Completed 210000 out of 250000 steps (84%)
05:43:00:WU01:FS01:0xa4:Completed 212500 out of 250000 steps (85%)
05:45:51:WU01:FS01:0xa4:Completed 215000 out of 250000 steps (86%)
05:48:30:WU01:FS01:0xa4:Completed 217500 out of 250000 steps (87%)
05:51:11:WU01:FS01:0xa4:Completed 220000 out of 250000 steps (88%)
05:53:52:WU01:FS01:0xa4:Completed 222500 out of 250000 steps (89%)
05:54:19:WU00:FS00:0x15:Completed 800000 out of 2500000 steps (32%).
05:54:20:WU00:FS00:0x15:mdrun_gpu returned 52
05:54:20:WU00:FS00:0x15:NANs detected on GPU
05:54:20:WU00:FS00:0x15:
05:54:20:WU00:FS00:0x15:Folding@home Core Shutdown: UNSTABLE_MACHINE
05:54:20:WU00:FS00:FahCore returned: UNSTABLE_MACHINE (122 = 0x7a)
05:54:20:WU00:FS00:Starting
05:54:20:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Jimmy Nichols/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe" -dir 00 -suffix 01 -version 701 -lifeline 5772 -checkpoint 15 -gpu 0
05:54:20:WU00:FS00:Started FahCore on PID 4660
05:54:20:WU00:FS00:Core PID:3164
05:54:20:WU00:FS00:FahCore 0x15 started
05:54:21:WU00:FS00:0x15:
05:54:21:WU00:FS00:0x15:*------------------------------*
05:54:21:WU00:FS00:0x15:Folding@Home GPU Core
05:54:21:WU00:FS00:0x15:Version 2.22 (Thu Dec 8 17:08:05 PST 2011)
05:54:21:WU00:FS00:0x15:Build host SimbiosNvdWin7
05:54:21:WU00:FS00:0x15:Board Type NVIDIA/CUDA
05:54:21:WU00:FS00:0x15:Core 15
05:54:21:WU00:FS00:0x15:
05:54:21:WU00:FS00:0x15:Window's signal control handler registered.
05:54:21:WU00:FS00:0x15:Preparing to commence simulation
05:54:21:WU00:FS00:0x15:- Looking at optimizations...
05:54:21:WU00:FS00:0x15:DeleteFrameFiles: successfully deleted file=00/wudata_01.ckp
05:54:21:WU00:FS00:0x15:- Created dyn
05:54:21:WU00:FS00:0x15:- Files status OK
05:54:21:WU00:FS00:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
05:54:22:WU00:FS00:0x15:- Expanded 548290 -> 972648 (decompressed 177.3 percent)
05:54:22:WU00:FS00:0x15:Called DecompressByteArray: compressed_data_size=548290 data_size=972648, decompressed_data_size=972648 diff=0
05:54:22:WU00:FS00:0x15:- Digital signature verified
05:54:22:WU00:FS00:0x15:
05:54:22:WU00:FS00:0x15:Project: 7641 (Run 345, Clone 0, Gen 6)
05:54:22:WU00:FS00:0x15:
05:54:22:WU00:FS00:0x15:Assembly optimizations on if available.
05:54:22:WU00:FS00:0x15:Entering M.D.
05:54:24:WU00:FS00:0x15:Tpr hash 00/wudata_01.tpr: 912252799 3713396661 4228272458 301502995 1857969887
05:54:24:WU00:FS00:0x15:GPU device info: vendor=0 device=0 name=<NA> match=0
05:54:24:WU00:FS00:0x15:Working on Protein in water
05:54:24:WU00:FS00:0x15:Client config unavailable.
05:54:24:WU00:FS00:0x15:Starting GUI Server
05:56:17:WU00:FS00:0x15:Setting checkpoint frequency: 25000
05:56:17:WU00:FS00:0x15:Completed 3 out of 2500000 steps (0%).
05:56:18:WARNING:WU00:FS00:Detected clock skew, adjusting time estimates
05:57:05:WU01:FS01:0xa4:Completed 225000 out of 250000 steps (90%)
06:00:12:WU01:FS01:0xa4:Completed 227500 out of 250000 steps (91%)
06:03:07:WU01:FS01:0xa4:Completed 230000 out of 250000 steps (92%)
06:05:56:WU01:FS01:0xa4:Completed 232500 out of 250000 steps (93%)
06:08:41:WU01:FS01:0xa4:Completed 235000 out of 250000 steps (94%)
06:11:33:WU01:FS01:0xa4:Completed 237500 out of 250000 steps (95%)
06:13:19:WU00:FS00:0x15:Completed 25000 out of 2500000 steps (1%).
06:14:20:WU01:FS01:0xa4:Completed 240000 out of 250000 steps (96%)
06:17:07:WU01:FS01:0xa4:Completed 242500 out of 250000 steps (97%)
06:19:58:WU01:FS01:0xa4:Completed 245000 out of 250000 steps (98%)
06:22:42:WU01:FS01:0xa4:Completed 247500 out of 250000 steps (99%)
06:25:36:WU01:FS01:0xa4:Completed 250000 out of 250000 steps (100%)
06:25:36:WU02:FS01:Connecting to assign3.stanford.edu:8080
06:25:36:WU01:FS01:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
06:25:37:WU02:FS01:News: Welcome to Folding@Home
06:25:37:WU02:FS01:Assigned to work server 171.67.108.58
06:25:37:WU02:FS01:Requesting new work unit for slot 01: RUNNING smp:2 from 171.67.108.58
06:25:37:WU02:FS01:Connecting to 171.67.108.58:8080
06:25:37:WU02:FS01:Downloading 532.14KiB
06:25:39:WU02:FS01:Download complete
06:25:39:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:OK project:8001 run:9 clone:40 gen:194 core:0xa4 unit:0x0000013c6652edca4eded80682d5174d
06:25:46:WU01:FS01:0xa4:
06:25:46:WU01:FS01:0xa4:Finished Work Unit:
06:25:46:WU01:FS01:0xa4:- Reading up to 769164 from "01/wudata_01.trr": Read 769164
06:25:46:WU01:FS01:0xa4:trr file hash check passed.
06:25:46:WU01:FS01:0xa4:- Reading up to 455856 from "01/wudata_01.xtc": Read 455856
06:25:46:WU01:FS01:0xa4:xtc file hash check passed.
06:25:46:WU01:FS01:0xa4:edr file hash check passed.
06:25:46:WU01:FS01:0xa4:logfile size: 23087
06:25:46:WU01:FS01:0xa4:Leaving Run
06:25:47:WU01:FS01:0xa4:- Writing 1253511 bytes of core data to disk...
06:25:48:WU01:FS01:0xa4:Done: 1252999 -> 1192420 (compressed to 95.1 percent)
06:25:48:WU01:FS01:0xa4: ... Done.
06:25:48:WU01:FS01:0xa4:- Shutting down core
06:25:48:WU01:FS01:0xa4:
06:25:48:WU01:FS01:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
06:25:48:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
06:25:49:WU01:FS01:Sending unit results: id:01 state:SEND error:OK project:8014 run:4 clone:878 gen:4 core:0xa4 unit:0x000000056652edca4f9b06d3792b8e26
06:25:49:WU01:FS01:Uploading 1.14MiB to 171.67.108.58
06:25:49:WU02:FS01:Starting
06:25:49:WU01:FS01:Connecting to 171.67.108.58:8080
06:25:49:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Jimmy Nichols/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe" -dir 02 -suffix 01 -version 701 -lifeline 5772 -checkpoint 15 -np 2
06:25:49:WU02:FS01:Started FahCore on PID 4588
06:25:49:WU02:FS01:Core PID:5936
06:25:49:WU02:FS01:FahCore 0xa4 started
06:25:49:WU02:FS01:0xa4:
06:25:49:WU02:FS01:0xa4:*------------------------------*
06:25:49:WU02:FS01:0xa4:Folding@Home Gromacs GB Core
06:25:49:WU02:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
06:25:49:WU02:FS01:0xa4:
06:25:49:WU02:FS01:0xa4:Preparing to commence simulation
06:25:49:WU02:FS01:0xa4:- Looking at optimizations...
06:25:49:WU02:FS01:0xa4:- Created dyn
06:25:49:WU02:FS01:0xa4:- Files status OK
06:25:49:WU02:FS01:0xa4:- Expanded 544397 -> 1305600 (decompressed 239.8 percent)
06:25:49:WU02:FS01:0xa4:Called DecompressByteArray: compressed_data_size=544397 data_size=1305600, decompressed_data_size=1305600 diff=0
06:25:49:WU02:FS01:0xa4:- Digital signature verified
06:25:49:WU02:FS01:0xa4:
06:25:49:WU02:FS01:0xa4:Project: 8001 (Run 9, Clone 40, Gen 194)
06:25:49:WU02:FS01:0xa4:
06:25:49:WU02:FS01:0xa4:Assembly optimizations on if available.
06:25:49:WU02:FS01:0xa4:Entering M.D.
06:25:55:WU01:FS01:Upload 54.94%
06:25:55:WU02:FS01:0xa4:Mapping NT from 2 to 2
06:25:55:WU02:FS01:0xa4:Completed 0 out of 250000 steps (0%)
06:26:00:WU01:FS01:Upload complete
06:26:00:WU01:FS01:Server responded WORK_ACK (400)
06:26:00:WU01:FS01:Final credit estimate, 461.00 points
06:26:00:WU01:FS01:Cleaning up
06:28:29:WU02:FS01:0xa4:Completed 2500 out of 250000 steps (1%)
06:30:16:WU00:FS00:0x15:Completed 50000 out of 2500000 steps (2%).
06:31:03:WU02:FS01:0xa4:Completed 5000 out of 250000 steps (2%)
06:33:38:WU02:FS01:0xa4:Completed 7500 out of 250000 steps (3%)
06:36:14:WU02:FS01:0xa4:Completed 10000 out of 250000 steps (4%)
06:38:53:WU02:FS01:0xa4:Completed 12500 out of 250000 steps (5%)
06:41:30:WU02:FS01:0xa4:Completed 15000 out of 250000 steps (6%)
06:44:06:WU02:FS01:0xa4:Completed 17500 out of 250000 steps (7%)
06:46:39:WU02:FS01:0xa4:Completed 20000 out of 250000 steps (8%)
06:47:10:WU00:FS00:0x15:Completed 75000 out of 2500000 steps (3%).
06:49:13:WU02:FS01:0xa4:Completed 22500 out of 250000 steps (9%)
06:51:46:WU02:FS01:0xa4:Completed 25000 out of 250000 steps (10%)
06:54:23:WU02:FS01:0xa4:Completed 27500 out of 250000 steps (11%)
06:56:56:WU02:FS01:0xa4:Completed 30000 out of 250000 steps (12%)
06:59:25:WU02:FS01:0xa4:Completed 32500 out of 250000 steps (13%)
07:02:03:WU02:FS01:0xa4:Completed 35000 out of 250000 steps (14%)
07:04:02:WU00:FS00:0x15:Completed 100000 out of 2500000 steps (4%).
07:04:43:WU02:FS01:0xa4:Completed 37500 out of 250000 steps (15%)
07:07:20:WU02:FS01:0xa4:Completed 40000 out of 250000 steps (16%)
07:10:01:WU02:FS01:0xa4:Completed 42500 out of 250000 steps (17%)
07:12:36:WU02:FS01:0xa4:Completed 45000 out of 250000 steps (18%)
07:15:14:WU02:FS01:0xa4:Completed 47500 out of 250000 steps (19%)
07:17:50:WU02:FS01:0xa4:Completed 50000 out of 250000 steps (20%)
07:20:23:WU02:FS01:0xa4:Completed 52500 out of 250000 steps (21%)
07:20:50:WU00:FS00:0x15:Completed 125000 out of 2500000 steps (5%).
07:22:52:WU02:FS01:0xa4:Completed 55000 out of 250000 steps (22%)
07:25:28:WU02:FS01:0xa4:Completed 57500 out of 250000 steps (23%)
07:28:02:WU02:FS01:0xa4:Completed 60000 out of 250000 steps (24%)
07:30:43:WU02:FS01:0xa4:Completed 62500 out of 250000 steps (25%)
07:33:23:WU02:FS01:0xa4:Completed 65000 out of 250000 steps (26%)
07:35:59:WU02:FS01:0xa4:Completed 67500 out of 250000 steps (27%)
07:37:35:WU00:FS00:0x15:Completed 150000 out of 2500000 steps (6%).
07:38:31:WU02:FS01:0xa4:Completed 70000 out of 250000 steps (28%)
07:41:08:WU02:FS01:0xa4:Completed 72500 out of 250000 steps (29%)
07:43:42:WU02:FS01:0xa4:Completed 75000 out of 250000 steps (30%)
07:46:23:WU02:FS01:0xa4:Completed 77500 out of 250000 steps (31%)
07:49:03:WU02:FS01:0xa4:Completed 80000 out of 250000 steps (32%)
07:51:43:WU02:FS01:0xa4:Completed 82500 out of 250000 steps (33%)
07:54:20:WU02:FS01:0xa4:Completed 85000 out of 250000 steps (34%)
07:54:26:WU00:FS00:0x15:Completed 175000 out of 2500000 steps (7%).
07:57:06:WU02:FS01:0xa4:Completed 87500 out of 250000 steps (35%)
07:59:44:WU02:FS01:0xa4:Completed 90000 out of 250000 steps (36%)
08:02:20:WU02:FS01:0xa4:Completed 92500 out of 250000 steps (37%)
08:05:06:WU02:FS01:0xa4:Completed 95000 out of 250000 steps (38%)
08:07:32:WU02:FS01:0xa4:Completed 97500 out of 250000 steps (39%)
08:09:56:WU02:FS01:0xa4:Completed 100000 out of 250000 steps (40%)
08:11:19:WU00:FS00:0x15:Completed 200000 out of 2500000 steps (8%).
08:12:21:WU02:FS01:0xa4:Completed 102500 out of 250000 steps (41%)
08:14:50:WU02:FS01:0xa4:Completed 105000 out of 250000 steps (42%)
08:17:25:WU02:FS01:0xa4:Completed 107500 out of 250000 steps (43%)
08:20:07:WU02:FS01:0xa4:Completed 110000 out of 250000 steps (44%)
08:22:49:WU02:FS01:0xa4:Completed 112500 out of 250000 steps (45%)
08:25:31:WU02:FS01:0xa4:Completed 115000 out of 250000 steps (46%)
08:27:55:WU02:FS01:0xa4:Completed 117500 out of 250000 steps (47%)
08:28:20:WU00:FS00:0x15:Completed 225000 out of 2500000 steps (9%).
08:30:26:WU02:FS01:0xa4:Completed 120000 out of 250000 steps (48%)
08:32:51:WU02:FS01:0xa4:Completed 122500 out of 250000 steps (49%)
08:35:20:WU02:FS01:0xa4:Completed 125000 out of 250000 steps (50%)
08:37:46:WU02:FS01:0xa4:Completed 127500 out of 250000 steps (51%)
08:40:11:WU02:FS01:0xa4:Completed 130000 out of 250000 steps (52%)
08:42:38:WU02:FS01:0xa4:Completed 132500 out of 250000 steps (53%)
08:45:04:WU00:FS00:0x15:Completed 250000 out of 2500000 steps (10%).
08:45:05:WU02:FS01:0xa4:Completed 135000 out of 250000 steps (54%)
08:47:31:WU02:FS01:0xa4:Completed 137500 out of 250000 steps (55%)
08:50:05:WU02:FS01:0xa4:Completed 140000 out of 250000 steps (56%)
08:52:33:WU02:FS01:0xa4:Completed 142500 out of 250000 steps (57%)
08:55:01:WU02:FS01:0xa4:Completed 145000 out of 250000 steps (58%)
08:57:28:WU02:FS01:0xa4:Completed 147500 out of 250000 steps (59%)
08:59:56:WU02:FS01:0xa4:Completed 150000 out of 250000 steps (60%)
09:01:49:WU00:FS00:0x15:Completed 275000 out of 2500000 steps (11%).
09:02:26:WU02:FS01:0xa4:Completed 152500 out of 250000 steps (61%)
09:04:53:WU02:FS01:0xa4:Completed 155000 out of 250000 steps (62%)
09:07:20:WU02:FS01:0xa4:Completed 157500 out of 250000 steps (63%)
09:09:45:WU02:FS01:0xa4:Completed 160000 out of 250000 steps (64%)
09:12:12:WU02:FS01:0xa4:Completed 162500 out of 250000 steps (65%)
09:14:40:WU02:FS01:0xa4:Completed 165000 out of 250000 steps (66%)
09:17:05:WU02:FS01:0xa4:Completed 167500 out of 250000 steps (67%)
09:18:32:WU00:FS00:0x15:Completed 300000 out of 2500000 steps (12%).
09:19:33:WU02:FS01:0xa4:Completed 170000 out of 250000 steps (68%)
09:22:00:WU02:FS01:0xa4:Completed 172500 out of 250000 steps (69%)
09:24:26:WU02:FS01:0xa4:Completed 175000 out of 250000 steps (70%)
09:26:52:WU02:FS01:0xa4:Completed 177500 out of 250000 steps (71%)
09:29:17:WU02:FS01:0xa4:Completed 180000 out of 250000 steps (72%)
09:31:43:WU02:FS01:0xa4:Completed 182500 out of 250000 steps (73%)
09:34:10:WU02:FS01:0xa4:Completed 185000 out of 250000 steps (74%)
09:35:12:WU00:FS00:0x15:Completed 325000 out of 2500000 steps (13%).
09:36:37:WU02:FS01:0xa4:Completed 187500 out of 250000 steps (75%)
09:39:02:WU02:FS01:0xa4:Completed 190000 out of 250000 steps (76%)
09:41:27:WU02:FS01:0xa4:Completed 192500 out of 250000 steps (77%)
09:43:54:WU02:FS01:0xa4:Completed 195000 out of 250000 steps (78%)
09:46:20:WU02:FS01:0xa4:Completed 197500 out of 250000 steps (79%)
09:48:45:WU02:FS01:0xa4:Completed 200000 out of 250000 steps (80%)
09:51:10:WU02:FS01:0xa4:Completed 202500 out of 250000 steps (81%)
09:51:54:WU00:FS00:0x15:Completed 350000 out of 2500000 steps (14%).
09:53:44:WU02:FS01:0xa4:Completed 205000 out of 250000 steps (82%)
******************************** Date: 12/05/12 ********************************
09:56:16:WU02:FS01:0xa4:Completed 207500 out of 250000 steps (83%)
09:58:47:WU02:FS01:0xa4:Completed 210000 out of 250000 steps (84%)
10:01:13:WU02:FS01:0xa4:Completed 212500 out of 250000 steps (85%)
10:03:43:WU02:FS01:0xa4:Completed 215000 out of 250000 steps (86%)
10:06:17:WU02:FS01:0xa4:Completed 217500 out of 250000 steps (87%)
10:08:33:WU00:FS00:0x15:Completed 375000 out of 2500000 steps (15%).
10:08:43:WU02:FS01:0xa4:Completed 220000 out of 250000 steps (88%)
10:11:10:WU02:FS01:0xa4:Completed 222500 out of 250000 steps (89%)
10:13:38:WU02:FS01:0xa4:Completed 225000 out of 250000 steps (90%)
10:16:12:WU02:FS01:0xa4:Completed 227500 out of 250000 steps (91%)
10:18:40:WU02:FS01:0xa4:Completed 230000 out of 250000 steps (92%)
10:21:06:WU02:FS01:0xa4:Completed 232500 out of 250000 steps (93%)
10:23:31:WU02:FS01:0xa4:Completed 235000 out of 250000 steps (94%)
10:25:15:WU00:FS00:0x15:Completed 400000 out of 2500000 steps (16%).
10:25:58:WU02:FS01:0xa4:Completed 237500 out of 250000 steps (95%)
10:28:24:WU02:FS01:0xa4:Completed 240000 out of 250000 steps (96%)
10:30:50:WU02:FS01:0xa4:Completed 242500 out of 250000 steps (97%)
10:33:20:WU02:FS01:0xa4:Completed 245000 out of 250000 steps (98%)
10:35:53:WU02:FS01:0xa4:Completed 247500 out of 250000 steps (99%)
10:38:19:WU02:FS01:0xa4:Completed 250000 out of 250000 steps (100%)
10:38:20:WU02:FS01:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
10:38:21:WU01:FS01:Connecting to assign3.stanford.edu:8080
10:38:21:WU01:FS01:News: Welcome to Folding@Home
10:38:21:WU01:FS01:Assigned to work server 129.74.85.15
10:38:21:WU01:FS01:Requesting new work unit for slot 01: RUNNING smp:2 from 129.74.85.15
10:38:21:WU01:FS01:Connecting to 129.74.85.15:8080
10:38:21:WU01:FS01:Downloading 52.66KiB
10:38:22:WU01:FS01:Download complete
10:38:22:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:OK project:7018 run:2 clone:112 gen:53 core:0xa4 unit:0x0000006d0001329c4dfba21619be6d43
10:38:22:WU01:FS01:Downloading project 7018 description
10:38:22:WU01:FS01:Connecting to fah-web.stanford.edu:80
10:38:22:WU01:FS01:Project 7018 description downloaded successfully
10:38:30:WU02:FS01:0xa4:
10:38:30:WU02:FS01:0xa4:Finished Work Unit:
10:38:30:WU02:FS01:0xa4:- Reading up to 770100 from "02/wudata_01.trr": Read 770100
10:38:30:WU02:FS01:0xa4:trr file hash check passed.
10:38:30:WU02:FS01:0xa4:- Reading up to 456272 from "02/wudata_01.xtc": Read 456272
10:38:30:WU02:FS01:0xa4:xtc file hash check passed.
10:38:30:WU02:FS01:0xa4:edr file hash check passed.
10:38:30:WU02:FS01:0xa4:logfile size: 23040
10:38:30:WU02:FS01:0xa4:Leaving Run
10:38:34:WU02:FS01:0xa4:- Writing 1254816 bytes of core data to disk...
10:38:34:WU02:FS01:0xa4:Done: 1254304 -> 1193542 (compressed to 95.1 percent)
10:38:34:WU02:FS01:0xa4: ... Done.
10:38:34:WU02:FS01:0xa4:- Shutting down core
10:38:34:WU02:FS01:0xa4:
10:38:34:WU02:FS01:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
10:38:35:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
10:38:35:WU02:FS01:Sending unit results: id:02 state:SEND error:OK project:8001 run:9 clone:40 gen:194 core:0xa4 unit:0x0000013c6652edca4eded80682d5174d
10:38:35:WU02:FS01:Uploading 1.14MiB to 171.67.108.58
10:38:35:WU01:FS01:Starting
10:38:35:WU02:FS01:Connecting to 171.67.108.58:8080
10:38:35:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:/Users/Jimmy Nichols/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe" -dir 01 -suffix 01 -version 701 -lifeline 5772 -checkpoint 15 -np 2
10:38:35:WU01:FS01:Started FahCore on PID 1820
10:38:35:WU01:FS01:Core PID:3292
10:38:35:WU01:FS01:FahCore 0xa4 started
10:38:36:WU01:FS01:0xa4:
10:38:36:WU01:FS01:0xa4:*------------------------------*
10:38:36:WU01:FS01:0xa4:Folding@Home Gromacs GB Core
10:38:36:WU01:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
10:38:36:WU01:FS01:0xa4:
10:38:36:WU01:FS01:0xa4:Preparing to commence simulation
10:38:36:WU01:FS01:0xa4:- Looking at optimizations...
10:38:36:WU01:FS01:0xa4:- Created dyn
10:38:36:WU01:FS01:0xa4:- Files status OK
10:38:36:WU01:FS01:0xa4:- Expanded 53409 -> 198744 (decompressed 372.1 percent)
10:38:36:WU01:FS01:0xa4:Called DecompressByteArray: compressed_data_size=53409 data_size=198744, decompressed_data_size=198744 diff=0
10:38:36:WU01:FS01:0xa4:- Digital signature verified
10:38:36:WU01:FS01:0xa4:
10:38:36:WU01:FS01:0xa4:Project: 7018 (Run 2, Clone 112, Gen 53)
10:38:36:WU01:FS01:0xa4:
10:38:36:WU01:FS01:0xa4:Assembly optimizations on if available.
10:38:36:WU01:FS01:0xa4:Entering M.D.
10:38:41:WU02:FS01:Upload 54.89%
10:38:41:WU01:FS01:0xa4:Mapping NT from 2 to 2
10:38:41:WU01:FS01:0xa4:Completed 0 out of 10000000 steps (0%)
10:38:46:WU02:FS01:Upload complete
10:38:46:WU02:FS01:Server responded WORK_ACK (400)
10:38:46:WU02:FS01:Final credit estimate, 344.00 points
10:38:46:WU02:FS01:Cleaning up
10:41:53:WU00:FS00:0x15:Completed 425000 out of 2500000 steps (17%).
10:45:28:WU01:FS01:0xa4:Completed 100000 out of 10000000 steps (1%)
10:52:13:WU01:FS01:0xa4:Completed 200000 out of 10000000 steps (2%)
10:58:28:WU00:FS00:0x15:Completed 450000 out of 2500000 steps (18%).
10:59:02:WU01:FS01:0xa4:Completed 300000 out of 10000000 steps (3%)
11:05:52:WU01:FS01:0xa4:Completed 400000 out of 10000000 steps (4%)
11:12:38:WU01:FS01:0xa4:Completed 500000 out of 10000000 steps (5%)
11:15:09:WU00:FS00:0x15:Completed 475000 out of 2500000 steps (19%).
11:19:25:WU01:FS01:0xa4:Completed 600000 out of 10000000 steps (6%)
11:26:11:WU01:FS01:0xa4:Completed 700000 out of 10000000 steps (7%)
11:31:46:WU00:FS00:0x15:Completed 500000 out of 2500000 steps (20%).
11:32:56:WU01:FS01:0xa4:Completed 800000 out of 10000000 steps (8%)
11:39:41:WU01:FS01:0xa4:Completed 900000 out of 10000000 steps (9%)
11:46:28:WU01:FS01:0xa4:Completed 1000000 out of 10000000 steps (10%)
11:48:23:WU00:FS00:0x15:Completed 525000 out of 2500000 steps (21%).
11:53:14:WU01:FS01:0xa4:Completed 1100000 out of 10000000 steps (11%)
12:00:02:WU01:FS01:0xa4:Completed 1200000 out of 10000000 steps (12%)
12:05:00:WU00:FS00:0x15:Completed 550000 out of 2500000 steps (22%).
12:06:52:WU01:FS01:0xa4:Completed 1300000 out of 10000000 steps (13%)
12:13:42:WU01:FS01:0xa4:Completed 1400000 out of 10000000 steps (14%)
12:20:29:WU01:FS01:0xa4:Completed 1500000 out of 10000000 steps (15%)
12:21:40:WU00:FS00:0x15:Completed 575000 out of 2500000 steps (23%).
12:27:15:WU01:FS01:0xa4:Completed 1600000 out of 10000000 steps (16%)
12:34:00:WU01:FS01:0xa4:Completed 1700000 out of 10000000 steps (17%)
12:38:17:WU00:FS00:0x15:Completed 600000 out of 2500000 steps (24%).
12:40:46:WU01:FS01:0xa4:Completed 1800000 out of 10000000 steps (18%)
12:47:35:WU01:FS01:0xa4:Completed 1900000 out of 10000000 steps (19%)
12:54:26:WU01:FS01:0xa4:Completed 2000000 out of 10000000 steps (20%)
12:54:56:WU00:FS00:0x15:Completed 625000 out of 2500000 steps (25%).
13:01:19:WU01:FS01:0xa4:Completed 2100000 out of 10000000 steps (21%)
13:08:09:WU01:FS01:0xa4:Completed 2200000 out of 10000000 steps (22%)
13:11:39:WU00:FS00:0x15:Completed 650000 out of 2500000 steps (26%).
13:14:56:WU01:FS01:0xa4:Completed 2300000 out of 10000000 steps (23%)
13:21:41:WU01:FS01:0xa4:Completed 2400000 out of 10000000 steps (24%)
13:28:13:WU00:FS00:0x15:Completed 675000 out of 2500000 steps (27%).
13:28:26:WU01:FS01:0xa4:Completed 2500000 out of 10000000 steps (25%)
13:35:12:WU01:FS01:0xa4:Completed 2600000 out of 10000000 steps (26%)
13:41:57:WU01:FS01:0xa4:Completed 2700000 out of 10000000 steps (27%)
13:44:49:WU00:FS00:0x15:Completed 700000 out of 2500000 steps (28%).
13:48:43:WU01:FS01:0xa4:Completed 2800000 out of 10000000 steps (28%)
13:55:45:Lost lifeline PID 1408, exiting
13:55:46:Server connection id=1 ended
13:55:46:FS01:Shutting core down
13:55:46:FS00:Shutting core down
13:55:55:WU01:FS01:0xa4:Completed 2900000 out of 10000000 steps (29%)
13:55:55:WU01:FS01:0xa4:Client no longer detected. Shutting down core
13:55:55:WU01:FS01:0xa4:
13:55:55:WU01:FS01:0xa4:Folding@home Core Shutdown: CLIENT_DIED
13:55:57:WU00:FS00:0x15:Client no longer detected. Shutting down core
13:55:57:Clean exit
13:55:57:WU00:FS00:0x15:
13:55:57:WU00:FS00:0x15:Folding@home Core Shutdown: CLIENT_DIED
Re: Project7641(345 0 6)
In the log you posted, one project was processed by your GPU.
21:53:17:WU00:FS00:0x15:Project: 7641 (Run 345, Clone 0, Gen 6)
21:53:19:WU00:FS00:0x15:Will resume from checkpoint file 00/wudata_01.ckp
21:55:19:WU00:FS00:0x15:Completed 125001 out of 2500000 steps (5%).
It had already been processed to 5%. It resumed from there and went to 32% before it encountered a hardware error.
05:54:19:WU00:FS00:0x15:Completed 800000 out of 2500000 steps (32%).
05:54:20:WU00:FS00:0x15:mdrun_gpu returned 52
05:54:20:WU00:FS00:0x15:NANs detected on GPU
05:54:20:WU00:FS00:0x15:Folding@home Core Shutdown: UNSTABLE_MACHINE
As a result of the hardware error it was restarted . . .
5:54:20:WU00:FS00:Starting
. . .
13:44:49:WU00:FS00:0x15:Completed 700000 out of 2500000 steps (28%).
. . . and it progressed to 28% before you stopped the client again.
13:55:57:WU00:FS00:0x15:Client no longer detected. Shutting down core - - WU still processing when you shut down the client.
13:55:57:WU00:FS00:0x15:Folding@home Core Shutdown: CLIENT_DIED
I see no reason to dump this WU. Yes, it failed once, but we don't know why. Unstable machine (NaNs) generally are the result of overclocking or overheating or low power levels.
21:53:17:WU00:FS00:0x15:Project: 7641 (Run 345, Clone 0, Gen 6)
21:53:19:WU00:FS00:0x15:Will resume from checkpoint file 00/wudata_01.ckp
21:55:19:WU00:FS00:0x15:Completed 125001 out of 2500000 steps (5%).
It had already been processed to 5%. It resumed from there and went to 32% before it encountered a hardware error.
05:54:19:WU00:FS00:0x15:Completed 800000 out of 2500000 steps (32%).
05:54:20:WU00:FS00:0x15:mdrun_gpu returned 52
05:54:20:WU00:FS00:0x15:NANs detected on GPU
05:54:20:WU00:FS00:0x15:Folding@home Core Shutdown: UNSTABLE_MACHINE
As a result of the hardware error it was restarted . . .
5:54:20:WU00:FS00:Starting
. . .
13:44:49:WU00:FS00:0x15:Completed 700000 out of 2500000 steps (28%).
. . . and it progressed to 28% before you stopped the client again.
13:55:57:WU00:FS00:0x15:Client no longer detected. Shutting down core - - WU still processing when you shut down the client.
13:55:57:WU00:FS00:0x15:Folding@home Core Shutdown: CLIENT_DIED
I see no reason to dump this WU. Yes, it failed once, but we don't know why. Unstable machine (NaNs) generally are the result of overclocking or overheating or low power levels.
Yes, Project 7641 is one of these new bigger GPU projects and they do take a long time to complete AND they tend to be somewhat more sensitive to overclocking/overheating. Look at the timeout which is 13.00 days and the final deadline which is 18.00 days. Four days, including one error isn't something that should concern you. Select this WU and tell us what the three date-time reports in the lower right panel of FAHControl are: Assigned/Timeout/Expiration. As science progresses, work units tend to get bigger but that's accommodated in the deadlines and the points per WU.jaynick65 wrote:I have spent the last 4 days with this same work unit failing over and over after half way through it. . . . How many times does it take a work unit to fail before the system gives up and sends a different one? I think it is a waste of time. I have never had any issues like this till this week. Also the 764x wu's are painfully slow! How can I dump this wu?
You can expect to see that message every time you stop and resume a WU or you adjust your clock. The time the WU has been processing is not continuous so there's an adjustment to accommodate the time the WU has NOT been processing. It's nothing to worry about.Also I keep seeing the comment that there is "clock skew and adjusting".
Posting FAH's log:
How to provide enough info to get helpful support.
How to provide enough info to get helpful support.
Re: Project7641(345 0 6)
While I was looking at your log, I also looked at the SMP slots.
21:53:17:WU02:FS01:0xa4:Project: 8014 (Run 3, Clone 571, Gen 4)
21:53:23:WU02:FS01:0xa4:Resuming from checkpoint
02:00:28:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
02:00:29:WU02:FS01:Sending unit results: id:02 state:SEND error:OK project:8014 run:3 clone:571 gen:4 core:0xa4
02:00:39:WU02:FS01:Server responded WORK_ACK (400)
02:00:39:WU02:FS01:Final credit estimate, 444.00 points
02:00:39:WU02:FS01:Cleaning up
This SMP WU successfully completed and credited.
Hi jaynick65 (team 4),
Your WU (P8014 R3 C571 G4) was added to the stats database on 2012-05-11 19:08:49 for 444.63 points of credit.
This looks like a bug in the V7 client. The WU was completed but the server assigned the same WU again and you completed it again. The download was called an error. I don't understand why.
02:00:15:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:OK project:8014 run:4 clone:878 gen:4 core:0xa4 unit
02:00:29:WU01:FS01:0xa4:Project: 8014 (Run 4, Clone 878, Gen 4)
06:25:48:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
06:25:49:WU01:FS01:Sending unit results: id:01 state:SEND error:OK project:8014 run:4 clone:878 gen:4 core:0xa4
06:26:00:WU01:FS01:Upload complete
06:26:00:WU01:FS01:Server responded WORK_ACK (400)
It was credited only once. Notice that the download was completed 24 seconds before the upload was completed. I think this might be a race condition. I'll report it as a bug in V7.7.1.52, though it might actually be a problem with the server code.
06:25:49:WU02:FS01:0xa4:Project: 8001 (Run 9, Clone 40, Gen 194) - - - new SMP WU started ... and completed and credited.
10:38:34:WU02:FS01:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
10:38:35:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
10:38:35:WU02:FS01:Sending unit results: id:02 state:SEND error:OK project:8001 run:9 clone:40 gen:194 core:0xa4
Hi jaynick65 (team 4),
Your WU (P8001 R9 C40 G194) was added to the stats database on 2012-05-12 04:08:15 for 344.26 points of credit.
10:38:36:WU01:FS01:0xa4:Project: 7018 (Run 2, Clone 112, Gen 53)
A new WU was started. That WU was still processing when you shut down the client.
13:55:55:WU01:FS01:0xa4:Client no longer detected. Shutting down core
13:55:55:WU01:FS01:0xa4:Folding@home Core Shutdown: CLIENT_DIED
https://fah-web.stanford.edu/projects/F ... ticket/890
21:53:17:WU02:FS01:0xa4:Project: 8014 (Run 3, Clone 571, Gen 4)
21:53:23:WU02:FS01:0xa4:Resuming from checkpoint
02:00:28:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
02:00:29:WU02:FS01:Sending unit results: id:02 state:SEND error:OK project:8014 run:3 clone:571 gen:4 core:0xa4
02:00:39:WU02:FS01:Server responded WORK_ACK (400)
02:00:39:WU02:FS01:Final credit estimate, 444.00 points
02:00:39:WU02:FS01:Cleaning up
This SMP WU successfully completed and credited.
Hi jaynick65 (team 4),
Your WU (P8014 R3 C571 G4) was added to the stats database on 2012-05-11 19:08:49 for 444.63 points of credit.
This looks like a bug in the V7 client. The WU was completed but the server assigned the same WU again and you completed it again. The download was called an error. I don't understand why.
02:00:15:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:OK project:8014 run:4 clone:878 gen:4 core:0xa4 unit
02:00:29:WU01:FS01:0xa4:Project: 8014 (Run 4, Clone 878, Gen 4)
06:25:48:WU01:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
06:25:49:WU01:FS01:Sending unit results: id:01 state:SEND error:OK project:8014 run:4 clone:878 gen:4 core:0xa4
06:26:00:WU01:FS01:Upload complete
06:26:00:WU01:FS01:Server responded WORK_ACK (400)
It was credited only once. Notice that the download was completed 24 seconds before the upload was completed. I think this might be a race condition. I'll report it as a bug in V7.7.1.52, though it might actually be a problem with the server code.
06:25:49:WU02:FS01:0xa4:Project: 8001 (Run 9, Clone 40, Gen 194) - - - new SMP WU started ... and completed and credited.
10:38:34:WU02:FS01:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
10:38:35:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
10:38:35:WU02:FS01:Sending unit results: id:02 state:SEND error:OK project:8001 run:9 clone:40 gen:194 core:0xa4
Hi jaynick65 (team 4),
Your WU (P8001 R9 C40 G194) was added to the stats database on 2012-05-12 04:08:15 for 344.26 points of credit.
10:38:36:WU01:FS01:0xa4:Project: 7018 (Run 2, Clone 112, Gen 53)
A new WU was started. That WU was still processing when you shut down the client.
13:55:55:WU01:FS01:0xa4:Client no longer detected. Shutting down core
13:55:55:WU01:FS01:0xa4:Folding@home Core Shutdown: CLIENT_DIED
https://fah-web.stanford.edu/projects/F ... ticket/890
Posting FAH's log:
How to provide enough info to get helpful support.
How to provide enough info to get helpful support.
Re: #890 Project7641(345 0 6)
That was just latest log as I playing around with drivers etc. trying to fix it. I have other logs where that WU failed also. This has happened at least 6 times over 4 days. Sometimes near the end also. The client was shut down so I could dump the 7641 WU. I am having no issues with smp folding. As I said, I am not overclocked and not overheating. Thanks. 
Mod Edit 07-24-2013: Project: 7641 (Run 345, Clone 0, Gen 6) has yet to be completed by anyone.
Mod Edit 07-24-2013: Project: 7641 (Run 345, Clone 0, Gen 6) has yet to be completed by anyone.
Last edited by jaynick65 on Sun May 13, 2012 2:58 am, edited 1 time in total.