P6801 (Run 4394, Clone 1, Gen 2)

werty316 · Post by **werty316** » Fri Mar 04, 2011 12:28 am

This WU with a particular Run/Clone/Gen fails to run on two of my video cards.
The two video cards in question are factory overclocked(715/1430/1800) GTX 460 video cards.
Running both video cards at their stock clocks(675/1350/1800) didn't help.
When folding the GPU temperature on both cards never goes over 60°C.
Deleting the Work folder and queue.dat file didn't help.

Has any other donor successfully completed and sent this WU back?

Code: Select all

[00:19:09] Folding@Home GPU Core
[00:19:09] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[00:19:09] 
[00:19:09] Build host: SimbiosNvdWin7
[00:19:09] Board Type: NVIDIA/CUDA
[00:19:09] Core      : x=15
[00:19:09]  Window's signal control handler registered.
[00:19:09] Preparing to commence simulation
[00:19:09] - Looking at optimizations...
[00:19:09] DeleteFrameFiles: successfully deleted file=work/wudata_01.ckp
[00:19:09] - Created dyn
[00:19:09] - Files status OK
[00:19:09] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:19:09] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[00:19:09] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[00:19:09] - Digital signature verified
[00:19:09] 
[00:19:09] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:19:09] 
[00:19:09] Assembly optimizations on if available.
[00:19:09] Entering M.D.
[00:19:11] Tpr hash work/wudata_01.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[00:19:12] Working on ALZHEIMER'S DISEASE AMYLOID
[00:19:12] Client config found, loading data.
[00:19:12] Starting GUI Server
[00:19:13] Setting checkpoint frequency: 500000
[00:19:13] Setting checkpoint frequency: 500000
[00:21:04] Completed    500000 out of 50000000 steps (1%).
[00:21:04] mdrun_gpu returned 52
[00:21:04] NANs detected on GPU
[00:21:04] 
[00:21:04] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:21:07] CoreStatus = 7A (122)
[00:21:07] Sending work to server
[00:21:07] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:21:07] - Error: Could not get length of results file work/wuresults_01.dat
[00:21:07] - Error: Could not read unit 01 file. Removing from queue.
[00:21:07] - Preparing to get new work unit...
[00:21:07] Cleaning up work directory
[00:21:07] + Attempting to get work packet
[00:21:07] Passkey found
[00:21:07] Gpu type=3 species=30.
[00:21:07] - Connecting to assignment server
[00:21:08] - Successful: assigned to (171.64.65.64).
[00:21:08] + News From Folding@Home: Welcome to Folding@Home
[00:21:08] Loaded queue successfully.
[00:21:08] Gpu type=3 species=30.
[00:21:09] + Closed connections
[00:21:14] 
[00:21:14] + Processing work unit
[00:21:14] Core required: FahCore_15.exe
[00:21:14] Core found.
[00:21:14] Working on queue slot 02 [March 4 00:21:14 UTC]
[00:21:14] + Working ...
[00:21:14] 
[00:21:14] *------------------------------*
[00:21:14] Folding@Home GPU Core
[00:21:14] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[00:21:14] 
[00:21:14] Build host: SimbiosNvdWin7
[00:21:14] Board Type: NVIDIA/CUDA
[00:21:14] Core      : x=15
[00:21:14]  Window's signal control handler registered.
[00:21:14] Preparing to commence simulation
[00:21:14] - Looking at optimizations...
[00:21:14] DeleteFrameFiles: successfully deleted file=work/wudata_02.ckp
[00:21:14] - Created dyn
[00:21:14] - Files status OK
[00:21:14] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:21:14] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[00:21:14] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[00:21:14] - Digital signature verified
[00:21:14] 
[00:21:14] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:21:14] 
[00:21:14] Assembly optimizations on if available.
[00:21:14] Entering M.D.
[00:21:16] Tpr hash work/wudata_02.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[00:21:16] Working on ALZHEIMER'S DISEASE AMYLOID
[00:21:16] Client config found, loading data.
[00:21:16] Starting GUI Server
[00:21:17] Setting checkpoint frequency: 500000
[00:21:17] Setting checkpoint frequency: 500000

The same WU from a different Run/Clone/Gen runs just fine though:

Code: Select all

[03:35:09] Folding@Home GPU Core
[03:35:09] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[03:35:09] 
[03:35:09] Build host: SimbiosNvdWin7
[03:35:09] Board Type: NVIDIA/CUDA
[03:35:09] Core      : x=15
[03:35:09]  Window's signal control handler registered.
[03:35:09] Preparing to commence simulation
[03:35:09] - Looking at optimizations...
[03:35:10] - Files status OK
[03:35:10] sizeof(CORE_PACKET_HDR) = 512 file=<>
[03:35:10] - Expanded 43575 -> 171827 (decompressed 394.3 percent)
[03:35:10] Called DecompressByteArray: compressed_data_size=43575 data_size=171827, decompressed_data_size=171827 diff=0
[03:35:10] - Digital signature verified
[03:35:10] 
[03:35:10] Project: 6801 (Run 4973, Clone 2, Gen 32)
[03:35:10] 
[03:35:10] Assembly optimizations on if available.
[03:35:10] Entering M.D.
[03:35:13] Will resume from checkpoint file work/wudata_05.ckp
[03:35:13] Tpr hash work/wudata_05.tpr:  1514002132 4237460176 2088203303 1177227995 2996086443
[03:35:15] Working on ALZHEIMER'S DISEASE AMYLOID
[03:35:15] Client config found, loading data.
[03:35:16] Starting GUI Server
[03:35:27] Resuming from checkpoint
[03:35:27] fcCheckPointResume: retreived and current tpr file hash:
[03:35:27]    0   1514002132   1514002132
[03:35:27]    1   4237460176   4237460176
[03:35:27]    2   2088203303   2088203303
[03:35:27]    3   1177227995   1177227995
[03:35:27]    4   2996086443   2996086443
[03:35:27] fcCheckPointResume: file hashes same.
[03:35:27] fcCheckPointResume: state restored.
[03:35:27] fcCheckPointResume: name work/wudata_05.log Verified work/wudata_05.log
[03:35:27] fcCheckPointResume: name work/wudata_05.trr Verified work/wudata_05.trr
[03:35:27] fcCheckPointResume: name work/wudata_05.xtc Verified work/wudata_05.xtc
[03:35:28] fcCheckPointResume: name work/wudata_05.edr Verified work/wudata_05.edr
[03:35:28] fcCheckPointResume: state restored 2
[03:35:28] Resumed from checkpoint
[03:35:28] Setting checkpoint frequency: 500000
[03:35:28] Completed  40500001 out of 50000000 steps (81%).
[03:37:30] Completed  40999999 out of 50000000 steps (82%).
[03:39:27] Completed  41499999 out of 50000000 steps (83%).
[03:41:24] Completed  41999999 out of 50000000 steps (84%).
[03:43:20] Completed  42499999 out of 50000000 steps (85%).
[03:45:17] Completed  42999999 out of 50000000 steps (86%).
[03:47:14] Completed  43499999 out of 50000000 steps (87%).
[03:49:11] Completed  43999999 out of 50000000 steps (88%).
[03:51:08] Completed  44499999 out of 50000000 steps (89%).
[03:53:04] Completed  44999999 out of 50000000 steps (90%).
[03:55:01] Completed  45499999 out of 50000000 steps (91%).
[03:56:58] Completed  45999999 out of 50000000 steps (92%).
[03:58:55] Completed  46499999 out of 50000000 steps (93%).
[04:00:52] Completed  46999999 out of 50000000 steps (94%).
[04:02:48] Completed  47499999 out of 50000000 steps (95%).
[04:04:45] Completed  47999999 out of 50000000 steps (96%).
[04:06:42] Completed  48499999 out of 50000000 steps (97%).
[04:08:39] Completed  48999999 out of 50000000 steps (98%).
[04:10:36] Completed  49499999 out of 50000000 steps (99%).
[04:12:33] Completed  49999999 out of 50000000 steps (100%).
[04:12:33] Finished fah_main
[04:12:33] 
[04:12:33] Successful run
[04:12:33] DynamicWrapper: Finished Work Unit: sleep=10000
[04:12:43] Reserved 2469276 bytes for xtc file; Cosm status=0
[04:12:43] Allocated 2469276 bytes for xtc file
[04:12:43] - Reading up to 2469276 from "work/wudata_05.xtc": Read 2469276
[04:12:43] Read 2469276 bytes from xtc file; available packet space=783961188
[04:12:43] xtc file hash check passed.
[04:12:43] Reserved 76680 76680 783961188 bytes for arc file=<work/wudata_05.trr> Cosm status=0
[04:12:43] Allocated 76680 bytes for arc file
[04:12:43] - Reading up to 76680 from "work/wudata_05.trr": Read 76680
[04:12:43] Read 76680 bytes from arc file; available packet space=783884508
[04:12:43] trr file hash check passed.
[04:12:43] Allocated 544 bytes for edr file
[04:12:43] Read bedfile
[04:12:43] edr file hash check passed.
[04:12:43] Allocated 121268 bytes for logfile
[04:12:43] Read logfile
[04:12:43] GuardedRun: success in DynamicWrapper
[04:12:43] GuardedRun: done
[04:12:43] Run: GuardedRun completed.
[04:12:45] + Opened results file
[04:12:45] - Writing 2668280 bytes of core data to disk...
[04:12:46] Done: 2667768 -> 2508094 (compressed to 94.0 percent)
[04:12:46]   ... Done.
[04:12:46] DeleteFrameFiles: successfully deleted file=work/wudata_05.ckp
[04:12:47] Shutting down core 
[04:12:47] 
[04:12:47] Folding@home Core Shutdown: FINISHED_UNIT
[04:12:50] CoreStatus = 64 (100)
[04:12:50] Sending work to server
[04:12:50] Project: 6801 (Run 4973, Clone 2, Gen 32)


[04:12:50] + Attempting to send results [March 2 04:12:50 UTC]
[04:12:50] Gpu type=3 species=30.
[04:13:33] + Results successfully sent
[04:13:33] Thank you for your contribution to Folding@Home.

Post by **toTOW** » Fri Mar 04, 2011 12:38 am

werty316 wrote:Has any other donor successfully completed and sent this WU back?

There's no result in the DB yet for this WU

Post by **bruce** » Fri Mar 04, 2011 3:29 am

Can you make a backup copy of the WORK directory after the download completes and before it gets the error? If so send it to me.

The only way I know to get rid of the WU is to change your MachineID (but after you capture that backup for me).

werty316 · Post by **werty316** » Fri Mar 04, 2011 4:11 am

After the files have been downloaded I will backup the WORK folder as a self extracting executable. How do I send you the file?

EDIT: The file has been sent.

rwh202 · Post by **rwh202** » Fri Mar 04, 2011 6:59 am

Hi,

I had this WU fail repeatedly about 10 days ago. I didn't report it because I assumed it was just my hardware issue - but apparently not!
It was on a stock GTX 460 with a broken fan that was running at 90+ C. (I've since cleaned out the dust and fitted some new fans)

Rob

Post by **PantherX** » Mon Mar 07, 2011 9:03 pm

No data in the WU database yet.

SupplyChain · Post by **SupplyChain** » Sat Mar 19, 2011 12:42 am

I'm now getting this same project, P6801 (Run 4394, Clone 1, Gen 2). I have 3 GTX470's in one of my folding rigs. On one card, I keep getting NANs detected on GPU for this project. I've tried to lower the shader clock, increasing voltage to the card, all on a card that hasn't had any issues in the past. I still can not get this wu to 1% completion. I've noticed others have posted on this wu as well. Is there anything I can provide regarding this wu? Thanks.

Post by **PantherX** » Sat Mar 19, 2011 1:01 am

Welcome to the F@H Forum SupplyChain,

We would need to see your FAHlog (viewtopic.php?p=160884#p160884). If I were to count both reports, it is 2 and we need a minimum of 3 to mark it as a bad WU (viewtopic.php?f=19&t=16526#p164322). There is still no data in the WU Database

SupplyChain · Post by **SupplyChain** » Sat Mar 19, 2011 1:13 am

This is my first try at this, so hopefully I get this right:

Code: Select all



--- Opening Log file [March 19 00:19:38 UTC] 


# Windows GPU Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.30r1

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: C:\FAH\GTX470-1
Executable: C:\FAH\GTX470-1\[email protected]
Arguments: -gpu 0 -verbosity 9 

[00:19:38] - Ask before connecting: No
[00:19:38] - User name: 
[00:19:38] - User ID: 
[00:19:38] - Machine ID: 2
[00:19:38] 
[00:19:38] Gpu type=3 species=30.
[00:19:38] Work directory not found. Creating...
[00:19:38] Could not open work queue, generating new queue...
[00:19:38] - Preparing to get new work unit...
[00:19:38] Cleaning up work directory
[00:19:38] + Attempting to get work packet
[00:19:38] Passkey found
[00:19:38] - Autosending finished units... [March 19 00:19:38 UTC]
[00:19:38] - Will indicate memory of 4093 MB
[00:19:38] Trying to send all finished work units
[00:19:38] Gpu type=3 species=30.
[00:19:38] + No unsent completed units remaining.
[00:19:38] - Detect CPU.[00:19:38] - Autosend completed
 Vendor: GenuineIntel, Family: 6, Model: 7, Stepping: 7
[00:19:38] - Connecting to assignment server
[00:19:38] Connecting to http://assign-GPU.stanford.edu:8080/
[00:19:39] Posted data.
[00:19:39] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[00:19:39] + News From Folding@Home: Welcome to Folding@Home
[00:19:39] Loaded queue successfully.
[00:19:39] Gpu type=3 species=30.
[00:19:39] Sent data
[00:19:39] Connecting to http://171.64.65.64:8080/
[00:19:39] Posted data.
[00:19:39] Initial: 0000; - Receiving payload (expected size: 39634)
[00:19:40] - Downloaded at ~38 kB/s
[00:19:40] - Averaged speed for that direction ~38 kB/s
[00:19:40] + Received work.
[00:19:40] + Closed connections
[00:19:40] 
[00:19:40] + Processing work unit
[00:19:40] Core required: FahCore_15.exe
[00:19:40] Core found.
[00:19:40] Working on queue slot 01 [March 19 00:19:40 UTC]
[00:19:40] + Working ...
[00:19:40] - Calling '.\FahCore_15.exe -dir work/ -suffix 01 -nice 19 -priority 96 -nocpulock -checkpoint 3 -verbose -lifeline 4444 -version 630'

[00:19:40] 
[00:19:40] *------------------------------*
[00:19:40] Folding@Home GPU Core
[00:19:40] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[00:19:40] 
[00:19:40] Build host: SimbiosNvdWin7
[00:19:40] Board Type: NVIDIA/CUDA
[00:19:40] Core      : x=15
[00:19:40]  Window's signal control handler registered.
[00:19:40] Preparing to commence simulation
[00:19:40] - Looking at optimizations...
[00:19:40] DeleteFrameFiles: successfully deleted file=work/wudata_01.ckp
[00:19:40] - Created dyn
[00:19:40] - Files status OK
[00:19:40] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:19:40] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[00:19:40] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[00:19:40] - Digital signature verified
[00:19:40] 
[00:19:40] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:19:40] 
[00:19:40] Assembly optimizations on if available.
[00:19:40] Entering M.D.
[00:19:42] Tpr hash work/wudata_01.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[00:19:42] Working on ALZHEIMER'S DISEASE AMYLOID
[00:19:42] Client config found, loading data.
[00:19:42] Starting GUI Server
[00:19:42] Setting checkpoint frequency: 500000
[00:19:42] Setting checkpoint frequency: 500000
[00:21:00] Completed    500000 out of 50000000 steps (1%).
[00:21:00] mdrun_gpu returned 52
[00:21:00] NANs detected on GPU
[00:21:00] 
[00:21:00] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:21:04] CoreStatus = 7A (122)
[00:21:04] Sending work to server
[00:21:04] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:21:04] - Read packet limit of 540015616... Set to 524286976.
[00:21:04] - Error: Could not get length of results file work/wuresults_01.dat
[00:21:04] - Error: Could not read unit 01 file. Removing from queue.
[00:21:04] Trying to send all finished work units
[00:21:04] + No unsent completed units remaining.
[00:21:04] - Preparing to get new work unit...
[00:21:04] Cleaning up work directory
[00:21:04] + Attempting to get work packet
[00:21:04] Passkey found
[00:21:04] - Will indicate memory of 4093 MB
[00:21:04] Gpu type=3 species=30.
[00:21:04] - Connecting to assignment server
[00:21:04] Connecting to http://assign-GPU.stanford.edu:8080/
[00:21:05] Posted data.
[00:21:05] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[00:21:05] + News From Folding@Home: Welcome to Folding@Home
[00:21:05] Loaded queue successfully.
[00:21:05] Gpu type=3 species=30.
[00:21:05] Sent data
[00:21:05] Connecting to http://171.64.65.64:8080/
[00:21:05] Posted data.
[00:21:05] Initial: 0000; - Receiving payload (expected size: 39634)
[00:21:06] - Downloaded at ~38 kB/s
[00:21:06] - Averaged speed for that direction ~38 kB/s
[00:21:06] + Received work.
[00:21:06] Trying to send all finished work units
[00:21:06] + No unsent completed units remaining.
[00:21:06] + Closed connections
[00:21:11] 
[00:21:11] + Processing work unit
[00:21:11] Core required: FahCore_15.exe
[00:21:11] Core found.
[00:21:11] Working on queue slot 02 [March 19 00:21:11 UTC]
[00:21:11] + Working ...
[00:21:11] - Calling '.\FahCore_15.exe -dir work/ -suffix 02 -nice 19 -priority 96 -nocpulock -checkpoint 3 -verbose -lifeline 4444 -version 630'

[00:21:11] 
[00:21:11] *------------------------------*
[00:21:11] Folding@Home GPU Core
[00:21:11] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[00:21:11] 
[00:21:11] Build host: SimbiosNvdWin7
[00:21:11] Board Type: NVIDIA/CUDA
[00:21:11] Core      : x=15
[00:21:11]  Window's signal control handler registered.
[00:21:11] Preparing to commence simulation
[00:21:11] - Looking at optimizations...
[00:21:11] DeleteFrameFiles: successfully deleted file=work/wudata_02.ckp
[00:21:11] - Created dyn
[00:21:11] - Files status OK
[00:21:11] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:21:11] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[00:21:11] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[00:21:11] - Digital signature verified
[00:21:11] 
[00:21:11] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:21:11] 
[00:21:11] Assembly optimizations on if available.
[00:21:11] Entering M.D.
[00:21:13] Tpr hash work/wudata_02.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[00:21:13] Working on ALZHEIMER'S DISEASE AMYLOID
[00:21:13] Client config found, loading data.
[00:21:13] Starting GUI Server
[00:21:13] Setting checkpoint frequency: 500000
[00:21:13] Setting checkpoint frequency: 500000
[00:22:31] Completed    500000 out of 50000000 steps (1%).
[00:22:31] mdrun_gpu returned 52
[00:22:31] NANs detected on GPU
[00:22:31] 
[00:22:31] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:22:35] CoreStatus = 7A (122)
[00:22:35] Sending work to server
[00:22:35] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:22:35] - Read packet limit of 540015616... Set to 524286976.
[00:22:35] - Error: Could not get length of results file work/wuresults_02.dat
[00:22:35] - Error: Could not read unit 02 file. Removing from queue.
[00:22:35] Trying to send all finished work units
[00:22:35] + No unsent completed units remaining.
[00:22:35] - Preparing to get new work unit...
[00:22:35] Cleaning up work directory
[00:22:35] + Attempting to get work packet
[00:22:35] Passkey found
[00:22:35] - Will indicate memory of 4093 MB
[00:22:35] Gpu type=3 species=30.
[00:22:35] - Connecting to assignment server
[00:22:35] Connecting to http://assign-GPU.stanford.edu:8080/
[00:22:36] Posted data.
[00:22:36] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[00:22:36] + News From Folding@Home: Welcome to Folding@Home
[00:22:36] Loaded queue successfully.
[00:22:36] Gpu type=3 species=30.
[00:22:36] Sent data
[00:22:36] Connecting to http://171.64.65.64:8080/
[00:22:36] Posted data.
[00:22:36] Initial: 0000; - Receiving payload (expected size: 39634)
[00:22:37] - Downloaded at ~38 kB/s
[00:22:37] - Averaged speed for that direction ~38 kB/s
[00:22:37] + Received work.
[00:22:37] Trying to send all finished work units
[00:22:37] + No unsent completed units remaining.
[00:22:37] + Closed connections
[00:22:42] 
[00:22:42] + Processing work unit
[00:22:42] Core required: FahCore_15.exe
[00:22:42] Core found.
[00:22:42] Working on queue slot 03 [March 19 00:22:42 UTC]
[00:22:42] + Working ...
[00:22:42] - Calling '.\FahCore_15.exe -dir work/ -suffix 03 -nice 19 -priority 96 -nocpulock -checkpoint 3 -verbose -lifeline 4444 -version 630'

[00:22:42] 
[00:22:42] *------------------------------*
[00:22:42] Folding@Home GPU Core
[00:22:42] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[00:22:42] 
[00:22:42] Build host: SimbiosNvdWin7
[00:22:42] Board Type: NVIDIA/CUDA
[00:22:42] Core      : x=15
[00:22:42]  Window's signal control handler registered.
[00:22:42] Preparing to commence simulation
[00:22:42] - Looking at optimizations...
[00:22:42] DeleteFrameFiles: successfully deleted file=work/wudata_03.ckp
[00:22:42] - Created dyn
[00:22:42] - Files status OK
[00:22:42] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:22:42] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[00:22:42] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[00:22:42] - Digital signature verified
[00:22:42] 
[00:22:42] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:22:42] 
[00:22:42] Assembly optimizations on if available.
[00:22:42] Entering M.D.
[00:22:44] Tpr hash work/wudata_03.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[00:22:44] Working on ALZHEIMER'S DISEASE AMYLOID
[00:22:44] Client config found, loading data.
[00:22:44] Starting GUI Server
[00:22:44] Setting checkpoint frequency: 500000
[00:22:44] Setting checkpoint frequency: 500000
[00:24:02] Completed    500000 out of 50000000 steps (1%).
[00:24:02] mdrun_gpu returned 52
[00:24:02] NANs detected on GPU
[00:24:02] 
[00:24:02] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:24:06] CoreStatus = 7A (122)
[00:24:06] Sending work to server
[00:24:06] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:24:06] - Read packet limit of 540015616... Set to 524286976.
[00:24:06] - Error: Could not get length of results file work/wuresults_03.dat
[00:24:06] - Error: Could not read unit 03 file. Removing from queue.
[00:24:06] Trying to send all finished work units
[00:24:06] + No unsent completed units remaining.
[00:24:06] - Preparing to get new work unit...
[00:24:06] Cleaning up work directory
[00:24:06] + Attempting to get work packet
[00:24:06] Passkey found
[00:24:06] - Will indicate memory of 4093 MB
[00:24:06] Gpu type=3 species=30.
[00:24:06] - Connecting to assignment server
[00:24:06] Connecting to http://assign-GPU.stanford.edu:8080/
[00:24:07] Posted data.
[00:24:07] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[00:24:07] + News From Folding@Home: Welcome to Folding@Home
[00:24:07] Loaded queue successfully.
[00:24:07] Gpu type=3 species=30.
[00:24:07] Sent data
[00:24:07] Connecting to http://171.64.65.64:8080/
[00:24:07] Posted data.
[00:24:07] Initial: 0000; - Receiving payload (expected size: 39634)
[00:24:08] - Downloaded at ~38 kB/s
[00:24:08] - Averaged speed for that direction ~38 kB/s
[00:24:08] + Received work.
[00:24:08] Trying to send all finished work units
[00:24:08] + No unsent completed units remaining.
[00:24:08] + Closed connections
[00:24:13] 
[00:24:13] + Processing work unit
[00:24:13] Core required: FahCore_15.exe
[00:24:13] Core found.
[00:24:13] Working on queue slot 04 [March 19 00:24:13 UTC]
[00:24:13] + Working ...
[00:24:13] - Calling '.\FahCore_15.exe -dir work/ -suffix 04 -nice 19 -priority 96 -nocpulock -checkpoint 3 -verbose -lifeline 4444 -version 630'

[00:24:13] 
[00:24:13] *------------------------------*
[00:24:13] Folding@Home GPU Core
[00:24:13] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[00:24:13] 
[00:24:13] Build host: SimbiosNvdWin7
[00:24:13] Board Type: NVIDIA/CUDA
[00:24:13] Core      : x=15
[00:24:13]  Window's signal control handler registered.
[00:24:13] Preparing to commence simulation
[00:24:13] - Looking at optimizations...
[00:24:13] DeleteFrameFiles: successfully deleted file=work/wudata_04.ckp
[00:24:13] - Created dyn
[00:24:13] - Files status OK
[00:24:13] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:24:13] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[00:24:13] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[00:24:13] - Digital signature verified
[00:24:13] 
[00:24:13] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:24:13] 
[00:24:13] Assembly optimizations on if available.
[00:24:13] Entering M.D.
[00:24:15] Tpr hash work/wudata_04.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[00:24:15] Working on ALZHEIMER'S DISEASE AMYLOID
[00:24:15] Client config found, loading data.
[00:24:15] Starting GUI Server
[00:24:15] Setting checkpoint frequency: 500000
[00:24:15] Setting checkpoint frequency: 500000
[00:25:33] Completed    500000 out of 50000000 steps (1%).
[00:25:33] mdrun_gpu returned 52
[00:25:33] NANs detected on GPU
[00:25:33] 
[00:25:33] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:25:37] CoreStatus = 7A (122)
[00:25:37] Sending work to server
[00:25:37] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:25:37] - Read packet limit of 540015616... Set to 524286976.
[00:25:37] - Error: Could not get length of results file work/wuresults_04.dat
[00:25:37] - Error: Could not read unit 04 file. Removing from queue.
[00:25:37] Trying to send all finished work units
[00:25:37] + No unsent completed units remaining.
[00:25:37] - Preparing to get new work unit...
[00:25:37] Cleaning up work directory
[00:25:37] + Attempting to get work packet
[00:25:37] Passkey found
[00:25:37] - Will indicate memory of 4093 MB
[00:25:37] Gpu type=3 species=30.
[00:25:37] - Connecting to assignment server
[00:25:37] Connecting to http://assign-GPU.stanford.edu:8080/
[00:25:37] Posted data.
[00:25:37] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[00:25:37] + News From Folding@Home: Welcome to Folding@Home
[00:25:38] Loaded queue successfully.
[00:25:38] Gpu type=3 species=30.
[00:25:38] Sent data
[00:25:38] Connecting to http://171.64.65.64:8080/
[00:25:38] Posted data.
[00:25:38] Initial: 0000; - Receiving payload (expected size: 39634)
[00:25:38] Conversation time very short, giving reduced weight in bandwidth avg
[00:25:38] - Downloaded at ~77 kB/s
[00:25:38] - Averaged speed for that direction ~43 kB/s
[00:25:38] + Received work.
[00:25:38] Trying to send all finished work units
[00:25:38] + No unsent completed units remaining.
[00:25:38] + Closed connections
[00:25:43] 
[00:25:43] + Processing work unit
[00:25:43] Core required: FahCore_15.exe
[00:25:43] Core found.
[00:25:43] Working on queue slot 05 [March 19 00:25:43 UTC]
[00:25:43] + Working ...
[00:25:43] - Calling '.\FahCore_15.exe -dir work/ -suffix 05 -nice 19 -priority 96 -nocpulock -checkpoint 3 -verbose -lifeline 4444 -version 630'

[00:25:44] 
[00:25:44] *------------------------------*
[00:25:44] Folding@Home GPU Core
[00:25:44] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[00:25:44] 
[00:25:44] Build host: SimbiosNvdWin7
[00:25:44] Board Type: NVIDIA/CUDA
[00:25:44] Core      : x=15
[00:25:44]  Window's signal control handler registered.
[00:25:44] Preparing to commence simulation
[00:25:44] - Looking at optimizations...
[00:25:44] DeleteFrameFiles: successfully deleted file=work/wudata_05.ckp
[00:25:44] - Created dyn
[00:25:44] - Files status OK
[00:25:44] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:25:44] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[00:25:44] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[00:25:44] - Digital signature verified
[00:25:44] 
[00:25:44] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:25:44] 
[00:25:44] Assembly optimizations on if available.
[00:25:44] Entering M.D.
[00:25:46] Tpr hash work/wudata_05.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[00:25:46] Working on ALZHEIMER'S DISEASE AMYLOID
[00:25:46] Client config found, loading data.
[00:25:46] Starting GUI Server
[00:25:46] Setting checkpoint frequency: 500000
[00:25:46] Setting checkpoint frequency: 500000
[00:27:04] Completed    500000 out of 50000000 steps (1%).
[00:27:04] mdrun_gpu returned 52
[00:27:04] NANs detected on GPU
[00:27:04] 
[00:27:04] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:27:08] CoreStatus = 7A (122)
[00:27:08] Sending work to server
[00:27:08] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:27:08] - Read packet limit of 540015616... Set to 524286976.
[00:27:08] - Error: Could not get length of results file work/wuresults_05.dat
[00:27:08] - Error: Could not read unit 05 file. Removing from queue.
[00:27:08] EUE limit exceeded. Pausing 24 hours.


--- Opening Log file [March 19 00:54:23 UTC] 


# Windows GPU Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.30r1

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: C:\FAH\GTX470-1
Executable: C:\FAH\GTX470-1\[email protected]
Arguments: -gpu 0 -verbosity 9 

[00:54:23] - Ask before connecting: No
[00:54:23] - User name: 
[00:54:23] - User ID:
[00:54:23] - Machine ID: 2
[00:54:23] 
[00:54:23] Gpu type=3 species=30.
[00:54:24] Loaded queue successfully.
[00:54:24] - Preparing to get new work unit...
[00:54:24] Cleaning up work directory
[00:54:24] - Autosending finished units... [March 19 00:54:24 UTC]
[00:54:24] Trying to send all finished work units
[00:54:24] + No unsent completed units remaining.
[00:54:24] - Autosend completed
[00:54:24] + Attempting to get work packet
[00:54:24] Passkey found
[00:54:24] - Will indicate memory of 4093 MB
[00:54:24] Gpu type=3 species=30.
[00:54:24] - Detect CPU. Vendor: GenuineIntel, Family: 6, Model: 7, Stepping: 7
[00:54:24] - Connecting to assignment server
[00:54:24] Connecting to http://assign-GPU.stanford.edu:8080/
[00:54:25] Posted data.
[00:54:25] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[00:54:25] + News From Folding@Home: Welcome to Folding@Home
[00:54:25] Loaded queue successfully.
[00:54:25] Gpu type=3 species=30.
[00:54:25] Sent data
[00:54:25] Connecting to http://171.64.65.64:8080/
[00:54:25] Posted data.
[00:54:25] Initial: 0000; - Receiving payload (expected size: 39634)
[00:54:26] - Downloaded at ~38 kB/s
[00:54:26] - Averaged speed for that direction ~42 kB/s
[00:54:26] + Received work.
[00:54:26] + Closed connections
[00:54:26] 
[00:54:26] + Processing work unit
[00:54:26] Core required: FahCore_15.exe
[00:54:26] Core found.
[00:54:26] Working on queue slot 06 [March 19 00:54:26 UTC]
[00:54:26] + Working ...
[00:54:26] - Calling '.\FahCore_15.exe -dir work/ -suffix 06 -nice 19 -priority 96 -nocpulock -checkpoint 3 -verbose -lifeline 5692 -version 630'

[00:54:26] 
[00:54:26] *------------------------------*
[00:54:26] Folding@Home GPU Core
[00:54:26] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[00:54:26] 
[00:54:26] Build host: SimbiosNvdWin7
[00:54:26] Board Type: NVIDIA/CUDA
[00:54:26] Core      : x=15
[00:54:26]  Window's signal control handler registered.
[00:54:26] Preparing to commence simulation
[00:54:26] - Looking at optimizations...
[00:54:26] DeleteFrameFiles: successfully deleted file=work/wudata_06.ckp
[00:54:26] - Created dyn
[00:54:26] - Files status OK
[00:54:26] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:54:26] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[00:54:26] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[00:54:26] - Digital signature verified
[00:54:27] 
[00:54:27] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:54:27] 
[00:54:27] Assembly optimizations on if available.
[00:54:27] Entering M.D.
[00:54:29] Tpr hash work/wudata_06.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[00:54:29] Working on ALZHEIMER'S DISEASE AMYLOID
[00:54:29] Client config found, loading data.
[00:54:29] Starting GUI Server
[00:54:29] Setting checkpoint frequency: 500000
[00:54:29] Setting checkpoint frequency: 500000
[00:55:49] Completed    500000 out of 50000000 steps (1%).
[00:55:49] mdrun_gpu returned 52
[00:55:49] NANs detected on GPU
[00:55:49] 
[00:55:49] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:55:52] CoreStatus = 7A (122)
[00:55:52] Sending work to server
[00:55:52] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:55:52] - Read packet limit of 540015616... Set to 524286976.
[00:55:52] - Error: Could not get length of results file work/wuresults_06.dat
[00:55:52] - Error: Could not read unit 06 file. Removing from queue.
[00:55:52] Trying to send all finished work units
[00:55:52] + No unsent completed units remaining.
[00:55:52] - Preparing to get new work unit...
[00:55:52] Cleaning up work directory
[00:55:52] + Attempting to get work packet
[00:55:52] Passkey found
[00:55:52] - Will indicate memory of 4093 MB
[00:55:52] Gpu type=3 species=30.
[00:55:52] - Connecting to assignment server
[00:55:52] Connecting to http://assign-GPU.stanford.edu:8080/
[00:55:53] Posted data.
[00:55:53] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[00:55:53] + News From Folding@Home: Welcome to Folding@Home
[00:55:53] Loaded queue successfully.
[00:55:53] Gpu type=3 species=30.
[00:55:53] Sent data
[00:55:53] Connecting to http://171.64.65.64:8080/
[00:55:53] Posted data.
[00:55:53] Initial: 0000; - Receiving payload (expected size: 39634)
[00:55:54] - Downloaded at ~38 kB/s
[00:55:54] - Averaged speed for that direction ~41 kB/s
[00:55:54] + Received work.
[00:55:54] Trying to send all finished work units
[00:55:54] + No unsent completed units remaining.
[00:55:54] + Closed connections
[00:55:59] 
[00:55:59] + Processing work unit
[00:55:59] Core required: FahCore_15.exe
[00:55:59] Core found.
[00:55:59] Working on queue slot 07 [March 19 00:55:59 UTC]
[00:55:59] + Working ...
[00:55:59] - Calling '.\FahCore_15.exe -dir work/ -suffix 07 -nice 19 -priority 96 -nocpulock -checkpoint 3 -verbose -lifeline 5692 -version 630'

[00:55:59] 
[00:55:59] *------------------------------*
[00:55:59] Folding@Home GPU Core
[00:55:59] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[00:55:59] 
[00:55:59] Build host: SimbiosNvdWin7
[00:55:59] Board Type: NVIDIA/CUDA
[00:55:59] Core      : x=15
[00:55:59]  Window's signal control handler registered.
[00:55:59] Preparing to commence simulation
[00:55:59] - Looking at optimizations...
[00:55:59] DeleteFrameFiles: successfully deleted file=work/wudata_07.ckp
[00:55:59] - Created dyn
[00:55:59] - Files status OK
[00:55:59] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:55:59] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[00:55:59] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[00:55:59] - Digital signature verified
[00:55:59] 
[00:55:59] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:55:59] 
[00:55:59] Assembly optimizations on if available.
[00:55:59] Entering M.D.
[00:56:01] Tpr hash work/wudata_07.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[00:56:01] Working on ALZHEIMER'S DISEASE AMYLOID
[00:56:01] Client config found, loading data.
[00:56:01] Starting GUI Server
[00:56:01] Setting checkpoint frequency: 500000
[00:56:01] Setting checkpoint frequency: 500000
[00:57:19] Completed    500000 out of 50000000 steps (1%).
[00:57:19] mdrun_gpu returned 52
[00:57:19] NANs detected on GPU
[00:57:19] 
[00:57:19] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:57:23] CoreStatus = 7A (122)
[00:57:23] Sending work to server
[00:57:23] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:57:23] - Read packet limit of 540015616... Set to 524286976.
[00:57:23] - Error: Could not get length of results file work/wuresults_07.dat
[00:57:23] - Error: Could not read unit 07 file. Removing from queue.
[00:57:23] Trying to send all finished work units
[00:57:23] + No unsent completed units remaining.
[00:57:23] - Preparing to get new work unit...
[00:57:23] Cleaning up work directory
[00:57:23] + Attempting to get work packet
[00:57:23] Passkey found
[00:57:23] - Will indicate memory of 4093 MB
[00:57:23] Gpu type=3 species=30.
[00:57:23] - Connecting to assignment server
[00:57:23] Connecting to http://assign-GPU.stanford.edu:8080/
[00:57:24] Posted data.
[00:57:24] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[00:57:24] + News From Folding@Home: Welcome to Folding@Home
[00:57:24] Loaded queue successfully.
[00:57:24] Gpu type=3 species=30.
[00:57:24] Sent data
[00:57:24] Connecting to http://171.64.65.64:8080/
[00:57:24] Posted data.
[00:57:24] Initial: 0000; - Receiving payload (expected size: 39634)
[00:57:25] - Downloaded at ~38 kB/s
[00:57:25] - Averaged speed for that direction ~40 kB/s
[00:57:25] + Received work.
[00:57:25] Trying to send all finished work units
[00:57:25] + No unsent completed units remaining.
[00:57:25] + Closed connections
[00:57:30] 
[00:57:30] + Processing work unit
[00:57:30] Core required: FahCore_15.exe
[00:57:30] Core found.
[00:57:30] Working on queue slot 08 [March 19 00:57:30 UTC]
[00:57:30] + Working ...
[00:57:30] - Calling '.\FahCore_15.exe -dir work/ -suffix 08 -nice 19 -priority 96 -nocpulock -checkpoint 3 -verbose -lifeline 5692 -version 630'

[00:57:30] 
[00:57:30] *------------------------------*
[00:57:30] Folding@Home GPU Core
[00:57:30] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[00:57:30] 
[00:57:30] Build host: SimbiosNvdWin7
[00:57:30] Board Type: NVIDIA/CUDA
[00:57:30] Core      : x=15
[00:57:30]  Window's signal control handler registered.
[00:57:30] Preparing to commence simulation
[00:57:30] - Looking at optimizations...
[00:57:30] DeleteFrameFiles: successfully deleted file=work/wudata_08.ckp
[00:57:30] - Created dyn
[00:57:30] - Files status OK
[00:57:30] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:57:30] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[00:57:30] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[00:57:30] - Digital signature verified
[00:57:30] 
[00:57:30] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:57:30] 
[00:57:30] Assembly optimizations on if available.
[00:57:30] Entering M.D.
[00:57:32] Tpr hash work/wudata_08.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[00:57:32] Working on ALZHEIMER'S DISEASE AMYLOID
[00:57:32] Client config found, loading data.
[00:57:32] Starting GUI Server
[00:57:32] Setting checkpoint frequency: 500000
[00:57:32] Setting checkpoint frequency: 500000
[00:58:51] Completed    500000 out of 50000000 steps (1%).
[00:58:51] mdrun_gpu returned 52
[00:58:51] NANs detected on GPU
[00:58:51] 
[00:58:51] Folding@home Core Shutdown: UNSTABLE_MACHINE
[00:58:54] CoreStatus = 7A (122)
[00:58:54] Sending work to server
[00:58:54] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:58:54] - Read packet limit of 540015616... Set to 524286976.
[00:58:54] - Error: Could not get length of results file work/wuresults_08.dat
[00:58:54] - Error: Could not read unit 08 file. Removing from queue.
[00:58:54] Trying to send all finished work units
[00:58:54] + No unsent completed units remaining.
[00:58:54] - Preparing to get new work unit...
[00:58:54] Cleaning up work directory
[00:58:54] + Attempting to get work packet
[00:58:54] Passkey found
[00:58:54] - Will indicate memory of 4093 MB
[00:58:54] Gpu type=3 species=30.
[00:58:54] - Connecting to assignment server
[00:58:54] Connecting to http://assign-GPU.stanford.edu:8080/
[00:58:54] Posted data.
[00:58:54] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[00:58:54] + News From Folding@Home: Welcome to Folding@Home
[00:58:55] Loaded queue successfully.
[00:58:55] Gpu type=3 species=30.
[00:58:55] Sent data
[00:58:55] Connecting to http://171.64.65.64:8080/
[00:58:55] Posted data.
[00:58:55] Initial: 0000; - Receiving payload (expected size: 39634)
[00:58:56] - Downloaded at ~38 kB/s
[00:58:56] - Averaged speed for that direction ~40 kB/s
[00:58:56] + Received work.
[00:58:56] Trying to send all finished work units
[00:58:56] + No unsent completed units remaining.
[00:58:56] + Closed connections
[00:59:01] 
[00:59:01] + Processing work unit
[00:59:01] Core required: FahCore_15.exe
[00:59:01] Core found.
[00:59:01] Working on queue slot 09 [March 19 00:59:01 UTC]
[00:59:01] + Working ...
[00:59:01] - Calling '.\FahCore_15.exe -dir work/ -suffix 09 -nice 19 -priority 96 -nocpulock -checkpoint 3 -verbose -lifeline 5692 -version 630'

[00:59:01] 
[00:59:01] *------------------------------*
[00:59:01] Folding@Home GPU Core
[00:59:01] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[00:59:01] 
[00:59:01] Build host: SimbiosNvdWin7
[00:59:01] Board Type: NVIDIA/CUDA
[00:59:01] Core      : x=15
[00:59:01]  Window's signal control handler registered.
[00:59:01] Preparing to commence simulation
[00:59:01] - Looking at optimizations...
[00:59:01] DeleteFrameFiles: successfully deleted file=work/wudata_09.ckp
[00:59:01] - Created dyn
[00:59:01] - Files status OK
[00:59:01] sizeof(CORE_PACKET_HDR) = 512 file=<>
[00:59:01] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[00:59:01] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[00:59:01] - Digital signature verified
[00:59:01] 
[00:59:01] Project: 6801 (Run 4394, Clone 1, Gen 2)
[00:59:01] 
[00:59:01] Assembly optimizations on if available.
[00:59:01] Entering M.D.
[00:59:03] Tpr hash work/wudata_09.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[00:59:03] Working on ALZHEIMER'S DISEASE AMYLOID
[00:59:03] Client config found, loading data.
[00:59:03] Starting GUI Server
[00:59:03] Setting checkpoint frequency: 500000
[00:59:03] Setting checkpoint frequency: 500000
[01:00:21] Completed    500000 out of 50000000 steps (1%).
[01:00:21] mdrun_gpu returned 52
[01:00:21] NANs detected on GPU
[01:00:21] 
[01:00:21] Folding@home Core Shutdown: UNSTABLE_MACHINE
[01:00:25] CoreStatus = 7A (122)
[01:00:25] Sending work to server
[01:00:25] Project: 6801 (Run 4394, Clone 1, Gen 2)
[01:00:25] - Read packet limit of 540015616... Set to 524286976.
[01:00:25] - Error: Could not get length of results file work/wuresults_09.dat
[01:00:25] - Error: Could not read unit 09 file. Removing from queue.
[01:00:25] Trying to send all finished work units
[01:00:25] + No unsent completed units remaining.
[01:00:25] - Preparing to get new work unit...
[01:00:25] Cleaning up work directory
[01:00:25] + Attempting to get work packet
[01:00:25] Passkey found
[01:00:25] - Will indicate memory of 4093 MB
[01:00:25] Gpu type=3 species=30.
[01:00:25] - Connecting to assignment server
[01:00:25] Connecting to http://assign-GPU.stanford.edu:8080/
[01:00:25] Posted data.
[01:00:25] Initial: 40AB; - Successful: assigned to (171.64.65.64).
[01:00:25] + News From Folding@Home: Welcome to Folding@Home
[01:00:26] Loaded queue successfully.
[01:00:26] Gpu type=3 species=30.
[01:00:26] Sent data
[01:00:26] Connecting to http://171.64.65.64:8080/
[01:00:26] Posted data.
[01:00:26] Initial: 0000; - Receiving payload (expected size: 39634)
[01:00:26] Conversation time very short, giving reduced weight in bandwidth avg
[01:00:26] - Downloaded at ~77 kB/s
[01:00:26] - Averaged speed for that direction ~44 kB/s
[01:00:26] + Received work.
[01:00:26] Trying to send all finished work units
[01:00:26] + No unsent completed units remaining.
[01:00:26] + Closed connections
[01:00:31] 
[01:00:31] + Processing work unit
[01:00:31] Core required: FahCore_15.exe
[01:00:31] Core found.
[01:00:31] Working on queue slot 00 [March 19 01:00:31 UTC]
[01:00:31] + Working ...
[01:00:31] - Calling '.\FahCore_15.exe -dir work/ -suffix 00 -nice 19 -priority 96 -nocpulock -checkpoint 3 -verbose -lifeline 5692 -version 630'

[01:00:32] 
[01:00:32] *------------------------------*
[01:00:32] Folding@Home GPU Core
[01:00:32] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[01:00:32] 
[01:00:32] Build host: SimbiosNvdWin7
[01:00:32] Board Type: NVIDIA/CUDA
[01:00:32] Core      : x=15
[01:00:32]  Window's signal control handler registered.
[01:00:32] Preparing to commence simulation
[01:00:32] - Looking at optimizations...
[01:00:32] DeleteFrameFiles: successfully deleted file=work/wudata_00.ckp
[01:00:32] - Created dyn
[01:00:32] - Files status OK
[01:00:32] sizeof(CORE_PACKET_HDR) = 512 file=<>
[01:00:32] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[01:00:32] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[01:00:32] - Digital signature verified
[01:00:32] 
[01:00:32] Project: 6801 (Run 4394, Clone 1, Gen 2)
[01:00:32] 
[01:00:32] Assembly optimizations on if available.
[01:00:32] Entering M.D.
[01:00:34] Tpr hash work/wudata_00.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[01:00:34] Working on ALZHEIMER'S DISEASE AMYLOID
[01:00:34] Client config found, loading data.
[01:00:34] Starting GUI Server
[01:00:34] Setting checkpoint frequency: 500000
[01:00:34] Setting checkpoint frequency: 500000
[01:01:53] Completed    500000 out of 50000000 steps (1%).
[01:01:53] mdrun_gpu returned 52
[01:01:53] NANs detected on GPU
[01:01:53] 
[01:01:53] Folding@home Core Shutdown: UNSTABLE_MACHINE
[01:01:56] CoreStatus = 7A (122)
[01:01:56] Sending work to server
[01:01:56] Project: 6801 (Run 4394, Clone 1, Gen 2)
[01:01:56] - Read packet limit of 540015616... Set to 524286976.
[01:01:56] - Error: Could not get length of results file work/wuresults_00.dat
[01:01:56] - Error: Could not read unit 00 file. Removing from queue.
[01:01:56] EUE limit exceeded. Pausing 24 hours.
[01:03:10] ***** Got a SIGTERM signal (2)
[01:03:10] Killing all core threads

Folding@Home Client Shutdown.

Post by **PantherX** » Thu Mar 24, 2011 1:25 am

A report of error is now in the WU Database:

Your WU (P6801 R4394 C1 G2) was added to the stats database on 2011-03-23 13:05:19 for 0 points of credit.

(Not sure who since I can't see the username in the FAHlogs and it doesn't match the Forum Names. You can either post it here or PM me if you want)

BigJohnFAH · Post by **BigJohnFAH** » Mon Mar 28, 2011 2:24 pm

Add one more with the issue.

Code: Select all

--- Opening Log file [March 9 15:25:18 UTC] 


# Windows GPU Console Edition #################################################
###############################################################################

                       Folding@Home Client Version 6.30r1

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: C:\FAH\gpu0
Executable: C:\FAH\gpu0\gpu0.exe
Arguments: -local -verbosity 7 -gpu 0 

[15:25:18] - Ask before connecting: No
[15:25:18] - User name: BigJohnFAH (Team 111065)
[15:25:18] - User ID: -----------
[15:25:18] - Machine ID: 1
.
.
. removed
.
.
[11:12:32] + Results successfully sent
[11:12:32] Thank you for your contribution to Folding@Home.
[11:12:32] + Number of Units Completed: 1442

[11:12:36] Trying to send all finished work units
[11:12:36] + No unsent completed units remaining.
[11:12:36] - Preparing to get new work unit...
[11:12:36] Cleaning up work directory
[11:12:36] + Attempting to get work packet
[11:12:36] Passkey found
[11:12:36] - Will indicate memory of 2814 MB
[11:12:36] Gpu type=3 species=30.
[11:12:36] - Connecting to assignment server
[11:12:36] Connecting to http://assign-GPU.stanford.edu:8080/
[11:12:37] - Successful: assigned to (171.64.65.64).
[11:12:37] + News From Folding@Home: Welcome to Folding@Home
[11:12:37] Loaded queue successfully.
[11:12:37] Gpu type=3 species=30.
[11:12:37] Sent data
[11:12:37] Connecting to http://171.64.65.64:8080/
[11:12:38] - Downloaded at ~38 kB/s
[11:12:38] - Averaged speed for that direction ~54 kB/s
[11:12:38] + Received work.
[11:12:38] Trying to send all finished work units
[11:12:38] + No unsent completed units remaining.
[11:12:38] + Closed connections
[11:12:38] 
[11:12:38] + Processing work unit
[11:12:38] Core required: FahCore_15.exe
[11:12:38] Core found.
[11:12:38] Working on queue slot 06 [March 28 11:12:38 UTC]
[11:12:38] + Working ...
[11:12:38] 
[11:12:38] *------------------------------*
[11:12:38] Folding@Home GPU Core
[11:12:38] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[11:12:38] 
[11:12:38] Build host: SimbiosNvdWin7
[11:12:38] Board Type: NVIDIA/CUDA
[11:12:38] Core      : x=15
[11:12:38]  Window's signal control handler registered.
[11:12:38] Preparing to commence simulation
[11:12:38] - Looking at optimizations...
[11:12:38] DeleteFrameFiles: successfully deleted file=work/wudata_06.ckp
[11:12:38] - Created dyn
[11:12:38] - Files status OK
[11:12:38] sizeof(CORE_PACKET_HDR) = 512 file=<>
[11:12:38] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[11:12:38] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[11:12:38] - Digital signature verified
[11:12:38] 
[11:12:38] Project: 6801 (Run 4394, Clone 1, Gen 2)
[11:12:38] 
[11:12:38] Assembly optimizations on if available.
[11:12:38] Entering M.D.
[11:12:40] Tpr hash work/wudata_06.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[11:12:40] Working on ALZHEIMER'S DISEASE AMYLOID
[11:12:40] Client config found, loading data.
[11:12:40] Starting GUI Server
[11:12:40] Setting checkpoint frequency: 500000
[11:12:40] Setting checkpoint frequency: 500000
[11:14:19] Completed    500000 out of 50000000 steps (1%).
[11:14:19] mdrun_gpu returned 52
[11:14:19] NANs detected on GPU
[11:14:19] 
[11:14:19] Folding@home Core Shutdown: UNSTABLE_MACHINE
[11:14:22] CoreStatus = 7A (122)
[11:14:22] Sending work to server
[11:14:22] Project: 6801 (Run 4394, Clone 1, Gen 2)
[11:14:22] - Read packet limit of 540015616... Set to 524286976.
[11:14:22] - Error: Could not get length of results file work/wuresults_06.dat
[11:14:22] - Error: Could not read unit 06 file. Removing from queue.
[11:14:22] Trying to send all finished work units
[11:14:22] + No unsent completed units remaining.
[11:14:22] - Preparing to get new work unit...
[11:14:22] Cleaning up work directory
[11:14:22] + Attempting to get work packet
[11:14:22] Passkey found
[11:14:22] - Will indicate memory of 2814 MB
[11:14:22] Gpu type=3 species=30.
[11:14:22] - Connecting to assignment server
[11:14:22] Connecting to http://assign-GPU.stanford.edu:8080/
[11:14:23] - Successful: assigned to (171.64.65.64).
[11:14:23] + News From Folding@Home: Welcome to Folding@Home
[11:14:23] Loaded queue successfully.
[11:14:23] Gpu type=3 species=30.
[11:14:23] Sent data
[11:14:23] Connecting to http://171.64.65.64:8080/
[11:14:24] - Downloaded at ~38 kB/s
[11:14:24] - Averaged speed for that direction ~51 kB/s
[11:14:24] + Received work.
[11:14:24] Trying to send all finished work units
[11:14:24] + No unsent completed units remaining.
[11:14:24] + Closed connections
[11:14:29] 
[11:14:29] + Processing work unit
[11:14:29] Core required: FahCore_15.exe
[11:14:29] Core found.
[11:14:29] Working on queue slot 07 [March 28 11:14:29 UTC]
[11:14:29] + Working ...
[11:14:29] 
[11:14:29] *------------------------------*
[11:14:29] Folding@Home GPU Core
[11:14:29] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[11:14:29] 
[11:14:29] Build host: SimbiosNvdWin7
[11:14:29] Board Type: NVIDIA/CUDA
[11:14:29] Core      : x=15
[11:14:29]  Window's signal control handler registered.
[11:14:29] Preparing to commence simulation
[11:14:29] - Looking at optimizations...
[11:14:29] DeleteFrameFiles: successfully deleted file=work/wudata_07.ckp
[11:14:29] - Created dyn
[11:14:29] - Files status OK
[11:14:29] sizeof(CORE_PACKET_HDR) = 512 file=<>
[11:14:29] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[11:14:29] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[11:14:29] - Digital signature verified
[11:14:29] 
[11:14:29] Project: 6801 (Run 4394, Clone 1, Gen 2)
[11:14:29] 
[11:14:29] Assembly optimizations on if available.
[11:14:29] Entering M.D.
[11:14:31] Tpr hash work/wudata_07.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[11:14:31] Working on ALZHEIMER'S DISEASE AMYLOID
[11:14:31] Client config found, loading data.
[11:14:31] Starting GUI Server
[11:14:31] Setting checkpoint frequency: 500000
[11:14:31] Setting checkpoint frequency: 500000
[11:16:10] Completed    500000 out of 50000000 steps (1%).
[11:16:10] mdrun_gpu returned 52
[11:16:10] NANs detected on GPU
[11:16:10] 
[11:16:10] Folding@home Core Shutdown: UNSTABLE_MACHINE
[11:16:13] CoreStatus = 7A (122)
[11:16:13] Sending work to server
[11:16:13] Project: 6801 (Run 4394, Clone 1, Gen 2)
[11:16:13] - Read packet limit of 540015616... Set to 524286976.
[11:16:13] - Error: Could not get length of results file work/wuresults_07.dat
[11:16:13] - Error: Could not read unit 07 file. Removing from queue.
[11:16:13] Trying to send all finished work units
[11:16:13] + No unsent completed units remaining.
[11:16:13] - Preparing to get new work unit...
[11:16:13] Cleaning up work directory
[11:16:13] + Attempting to get work packet
[11:16:13] Passkey found
[11:16:13] - Will indicate memory of 2814 MB
[11:16:13] Gpu type=3 species=30.
[11:16:13] - Connecting to assignment server
[11:16:13] Connecting to http://assign-GPU.stanford.edu:8080/
[11:16:13] - Successful: assigned to (171.64.65.64).
[11:16:13] + News From Folding@Home: Welcome to Folding@Home
[11:16:14] Loaded queue successfully.
[11:16:14] Gpu type=3 species=30.
[11:16:14] Sent data
[11:16:14] Connecting to http://171.64.65.64:8080/
[11:16:14] Conversation time very short, giving reduced weight in bandwidth avg
[11:16:14] - Downloaded at ~77 kB/s
[11:16:14] - Averaged speed for that direction ~54 kB/s
[11:16:14] + Received work.
[11:16:14] Trying to send all finished work units
[11:16:14] + No unsent completed units remaining.
[11:16:14] + Closed connections
[11:16:19] 
[11:16:19] + Processing work unit
[11:16:19] Core required: FahCore_15.exe
[11:16:19] Core found.
[11:16:19] Working on queue slot 08 [March 28 11:16:19 UTC]
[11:16:19] + Working ...
[11:16:19] 
[11:16:19] *------------------------------*
[11:16:19] Folding@Home GPU Core
[11:16:19] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[11:16:19] 
[11:16:19] Build host: SimbiosNvdWin7
[11:16:19] Board Type: NVIDIA/CUDA
[11:16:19] Core      : x=15
[11:16:19]  Window's signal control handler registered.
[11:16:19] Preparing to commence simulation
[11:16:19] - Looking at optimizations...
[11:16:19] DeleteFrameFiles: successfully deleted file=work/wudata_08.ckp
[11:16:19] - Created dyn
[11:16:19] - Files status OK
[11:16:19] sizeof(CORE_PACKET_HDR) = 512 file=<>
[11:16:19] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[11:16:19] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[11:16:19] - Digital signature verified
[11:16:19] 
[11:16:19] Project: 6801 (Run 4394, Clone 1, Gen 2)
[11:16:19] 
[11:16:19] Assembly optimizations on if available.
[11:16:19] Entering M.D.
[11:16:21] Tpr hash work/wudata_08.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[11:16:21] Working on ALZHEIMER'S DISEASE AMYLOID
[11:16:21] Client config found, loading data.
[11:16:22] Starting GUI Server
[11:16:22] Setting checkpoint frequency: 500000
[11:16:22] Setting checkpoint frequency: 500000
[11:18:00] Completed    500000 out of 50000000 steps (1%).
[11:18:00] mdrun_gpu returned 52
[11:18:00] NANs detected on GPU
[11:18:00] 
[11:18:00] Folding@home Core Shutdown: UNSTABLE_MACHINE
[11:18:04] CoreStatus = 7A (122)
[11:18:04] Sending work to server
[11:18:04] Project: 6801 (Run 4394, Clone 1, Gen 2)
[11:18:04] - Read packet limit of 540015616... Set to 524286976.
[11:18:04] - Error: Could not get length of results file work/wuresults_08.dat
[11:18:04] - Error: Could not read unit 08 file. Removing from queue.
[11:18:04] Trying to send all finished work units
[11:18:04] + No unsent completed units remaining.
[11:18:04] - Preparing to get new work unit...
[11:18:04] Cleaning up work directory
[11:18:04] + Attempting to get work packet
[11:18:04] Passkey found
[11:18:04] - Will indicate memory of 2814 MB
[11:18:04] Gpu type=3 species=30.
[11:18:04] - Connecting to assignment server
[11:18:04] Connecting to http://assign-GPU.stanford.edu:8080/
[11:18:04] - Successful: assigned to (171.64.65.64).
[11:18:04] + News From Folding@Home: Welcome to Folding@Home
[11:18:05] Loaded queue successfully.
[11:18:05] Gpu type=3 species=30.
[11:18:05] Sent data
[11:18:05] Connecting to http://171.64.65.64:8080/
[11:18:05] Conversation time very short, giving reduced weight in bandwidth avg
[11:18:05] - Downloaded at ~77 kB/s
[11:18:05] - Averaged speed for that direction ~56 kB/s
[11:18:05] + Received work.
[11:18:05] Trying to send all finished work units
[11:18:05] + No unsent completed units remaining.
[11:18:05] + Closed connections
[11:18:10] 
[11:18:10] + Processing work unit
[11:18:10] Core required: FahCore_15.exe
[11:18:10] Core found.
[11:18:10] Working on queue slot 09 [March 28 11:18:10 UTC]
[11:18:10] + Working ...
[11:18:11] 
[11:18:11] *------------------------------*
[11:18:11] Folding@Home GPU Core
[11:18:11] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[11:18:11] 
[11:18:11] Build host: SimbiosNvdWin7
[11:18:11] Board Type: NVIDIA/CUDA
[11:18:11] Core      : x=15
[11:18:11]  Window's signal control handler registered.
[11:18:11] Preparing to commence simulation
[11:18:11] - Looking at optimizations...
[11:18:11] DeleteFrameFiles: successfully deleted file=work/wudata_09.ckp
[11:18:11] - Created dyn
[11:18:11] - Files status OK
[11:18:11] sizeof(CORE_PACKET_HDR) = 512 file=<>
[11:18:11] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[11:18:11] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[11:18:11] - Digital signature verified
[11:18:11] 
[11:18:11] Project: 6801 (Run 4394, Clone 1, Gen 2)
[11:18:11] 
[11:18:11] Assembly optimizations on if available.
[11:18:11] Entering M.D.
[11:18:13] Tpr hash work/wudata_09.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[11:18:13] Working on ALZHEIMER'S DISEASE AMYLOID
[11:18:13] Client config found, loading data.
[11:18:13] Starting GUI Server
[11:18:13] Setting checkpoint frequency: 500000
[11:18:13] Setting checkpoint frequency: 500000
[11:19:52] Completed    500000 out of 50000000 steps (1%).
[11:19:52] mdrun_gpu returned 52
[11:19:52] NANs detected on GPU
[11:19:52] 
[11:19:52] Folding@home Core Shutdown: UNSTABLE_MACHINE
[11:19:55] CoreStatus = 7A (122)
[11:19:55] Sending work to server
[11:19:55] Project: 6801 (Run 4394, Clone 1, Gen 2)
[11:19:55] - Read packet limit of 540015616... Set to 524286976.
[11:19:55] - Error: Could not get length of results file work/wuresults_09.dat
[11:19:55] - Error: Could not read unit 09 file. Removing from queue.
[11:19:55] Trying to send all finished work units
[11:19:55] + No unsent completed units remaining.
[11:19:55] - Preparing to get new work unit...
[11:19:55] Cleaning up work directory
[11:19:55] + Attempting to get work packet
[11:19:55] Passkey found
[11:19:55] - Will indicate memory of 2814 MB
[11:19:55] Gpu type=3 species=30.
[11:19:55] - Connecting to assignment server
[11:19:55] Connecting to http://assign-GPU.stanford.edu:8080/
[11:19:55] - Successful: assigned to (171.64.65.64).
[11:19:55] + News From Folding@Home: Welcome to Folding@Home
[11:19:56] Loaded queue successfully.
[11:19:56] Gpu type=3 species=30.
[11:19:56] Sent data
[11:19:56] Connecting to http://171.64.65.64:8080/
[11:19:56] Conversation time very short, giving reduced weight in bandwidth avg
[11:19:56] - Downloaded at ~77 kB/s
[11:19:56] - Averaged speed for that direction ~59 kB/s
[11:19:56] + Received work.
[11:19:56] Trying to send all finished work units
[11:19:56] + No unsent completed units remaining.
[11:19:56] + Closed connections
[11:20:01] 
[11:20:01] + Processing work unit
[11:20:01] Core required: FahCore_15.exe
[11:20:01] Core found.
[11:20:01] Working on queue slot 00 [March 28 11:20:01 UTC]
[11:20:01] + Working ...
[11:20:02] 
[11:20:02] *------------------------------*
[11:20:02] Folding@Home GPU Core
[11:20:02] Version 2.15 (Tue Nov 16 09:05:18 PST 2010)
[11:20:02] 
[11:20:02] Build host: SimbiosNvdWin7
[11:20:02] Board Type: NVIDIA/CUDA
[11:20:02] Core      : x=15
[11:20:02]  Window's signal control handler registered.
[11:20:02] Preparing to commence simulation
[11:20:02] - Looking at optimizations...
[11:20:02] DeleteFrameFiles: successfully deleted file=work/wudata_00.ckp
[11:20:02] - Created dyn
[11:20:02] - Files status OK
[11:20:02] sizeof(CORE_PACKET_HDR) = 512 file=<>
[11:20:02] - Expanded 39122 -> 171827 (decompressed 439.2 percent)
[11:20:02] Called DecompressByteArray: compressed_data_size=39122 data_size=171827, decompressed_data_size=171827 diff=0
[11:20:02] - Digital signature verified
[11:20:02] 
[11:20:02] Project: 6801 (Run 4394, Clone 1, Gen 2)
[11:20:02] 
[11:20:02] Assembly optimizations on if available.
[11:20:02] Entering M.D.
[11:20:04] Tpr hash work/wudata_00.tpr:  3072867433 4181462573 2689415243 1031181546 1959007100
[11:20:04] Working on ALZHEIMER'S DISEASE AMYLOID
[11:20:04] Client config found, loading data.
[11:20:04] Starting GUI Server
[11:20:04] Setting checkpoint frequency: 500000
[11:20:04] Setting checkpoint frequency: 500000
[11:21:43] Completed    500000 out of 50000000 steps (1%).
[11:21:43] mdrun_gpu returned 52
[11:21:43] NANs detected on GPU
[11:21:43] 
[11:21:43] Folding@home Core Shutdown: UNSTABLE_MACHINE
[11:21:46] CoreStatus = 7A (122)
[11:21:46] Sending work to server
[11:21:46] Project: 6801 (Run 4394, Clone 1, Gen 2)
[11:21:46] - Read packet limit of 540015616... Set to 524286976.
[11:21:46] - Error: Could not get length of results file work/wuresults_00.dat
[11:21:46] - Error: Could not read unit 00 file. Removing from queue.
[11:21:46] EUE limit exceeded. Pausing 24 hours.

Post by **bruce** » Mon Mar 28, 2011 4:45 pm

Thank you for the reports.

The WU (P6801,R4394,C1,G2) has been reported as a bad WU.

tjmagneto · Post by **tjmagneto** » Tue Mar 29, 2011 12:09 am

Thanks for reporting that WU as being bad. I've been having similar problems to what has already posted above.

Folding Forum

P6801 (Run 4394, Clone 1, Gen 2)

P6801 (Run 4394, Clone 1, Gen 2)

Re: P6801 (Run 4394, Clone 1, Gen 2)

Re: P6801 (Run 4394, Clone 1, Gen 2)

Re: P6801 (Run 4394, Clone 1, Gen 2)

Re: P6801 (Run 4394, Clone 1, Gen 2)

Re: P6801 (Run 4394, Clone 1, Gen 2)

Re: P6801 (Run 4394, Clone 1, Gen 2)

Re: P6801 (Run 4394, Clone 1, Gen 2)

Re: P6801 (Run 4394, Clone 1, Gen 2)

Re: P6801 (Run 4394, Clone 1, Gen 2)

Re: P6801 (Run 4394, Clone 1, Gen 2)

Re: P6801 (Run 4394, Clone 1, Gen 2)

Re: P6801 (Run 4394, Clone 1, Gen 2)