Gather data: GPU Projects with 20000+ atoms,

If you think it might be a driver problem, see viewforum.php?f=79

Moderators: Site Moderators, FAHC Science Team

7im
Posts: 10179
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: Gather data: GPU Projects with 20000+ atoms,

Post by 7im »

Anyone tried the new 301 beta driver? Same lower %?
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
baz657
Posts: 55
Joined: Thu Nov 12, 2009 1:40 pm
Hardware configuration: Win 7 Ultimate x64, 2 X Nvidia Fermi cards, one 2 Core CPU and one quad and one very old laptop
Location: Chesterfield, UK
Contact:

Re: Gather data: GPU Projects with 20000+ atoms,

Post by baz657 »

301 beta running for around 24 hours and there was no noticible difference due to the driver change to PPD on two systems with previous project . Latest GPU project (on the system I am on now) is currently running Project: 8034 (Run 17, Clone 39, Gen 9) and PPD is back to previous values (from well less than 10,000 to currently 15,620) - at least 60% higher than the last few days.

24 hour log from installing beta driver for both GPU & CPU...

Code: Select all

*********************** Log Started 2012-04-10T19:11:24Z ***********************
19:11:24:************************* Folding@home Client *************************
19:11:24:      Website: http://folding.stanford.edu/
19:11:24:    Copyright: (c) 2009-2012 Stanford University
19:11:24:       Author: Joseph Coffland <[email protected]>
19:11:24:         Args: --lifeline 2080 --command-port=36330
19:11:24:       Config: C:/Users/HTPC/AppData/Roaming/FAHClient/config.xml
19:11:24:******************************** Build ********************************
19:11:24:      Version: 7.1.52
19:11:24:         Date: Mar 20 2012
19:11:24:         Time: 19:37:42
19:11:24:      SVN Rev: 3515
19:11:24:       Branch: fah/trunk/client
19:11:24:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
19:11:24:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
19:11:24:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT
19:11:24:     Platform: win32 XP
19:11:24:         Bits: 32
19:11:24:         Mode: Release
19:11:24:******************************* System ********************************
19:11:24:          CPU: AMD Athlon(tm) 64 X2 Dual Core Processor 5600+
19:11:24:       CPU ID: AuthenticAMD Family 15 Model 107 Stepping 2
19:11:24:         CPUs: 2
19:11:24:       Memory: 3.00GiB
19:11:24:  Free Memory: 1.92GiB
19:11:24:      Threads: WINDOWS_THREADS
19:11:24:   On Battery: false
19:11:24:   UTC offset: 1
19:11:24:          PID: 3552
19:11:24:          CWD: C:/Users/HTPC/AppData/Roaming/FAHClient
19:11:24:           OS: Windows 7 Ultimate
19:11:24:      OS Arch: AMD64
19:11:24:         GPUs: 1
19:11:24:        GPU 0: FERMI:1 GF104 [GeForce GTX 460]
19:11:24:         CUDA: 2.1
19:11:24:  CUDA Driver: 4020
19:11:24:Win32 Service: false
19:11:24:***********************************************************************
19:11:24:<config>
19:11:24:  <service-description v='Folding@home Client'/>
19:11:24:  <service-restart v='true'/>
19:11:24:  <service-restart-delay v='5000'/>
19:11:24:
19:11:24:  <!-- Client Control -->
19:11:24:  <cycle-rate v='4'/>
19:11:24:  <cycles v='-1'/>
19:11:24:  <data-directory v='.'/>
19:11:24:  <disable-project-lookup v='false'/>
19:11:24:  <exec-directory v='C:\Program Files (x86)\FAHClient'/>
19:11:24:  <exit-when-done v='false'/>
19:11:24:  <threads v='4'/>
19:11:24:
19:11:24:  <!-- Configuration -->
19:11:24:  <config-rotate v='true'/>
19:11:24:  <config-rotate-dir v='configs'/>
19:11:24:  <config-rotate-max v='16'/>
19:11:24:
19:11:24:  <!-- Debugging -->
19:11:24:  <assignment-servers>
19:11:24:    assign3.stanford.edu:8080 assign4.stanford.edu:80
19:11:24:  </assignment-servers>
19:11:24:  <capture-directory v='capture'/>
19:11:24:  <capture-sockets v='false'/>
19:11:24:  <debug-sockets v='false'/>
19:11:24:  <exception-locations v='true'/>
19:11:24:  <gpu-assignment-servers>
19:11:24:    assign-GPU.stanford.edu:80 assign-GPU.stanford.edu:8080
19:11:24:  </gpu-assignment-servers>
19:11:24:  <stack-traces v='false'/>
19:11:24:
19:11:24:  <!-- Error Handling -->
19:11:24:  <max-slot-errors v='5'/>
19:11:24:  <max-unit-errors v='5'/>
19:11:24:
19:11:24:  <!-- FahCore Control -->
19:11:24:  <checkpoint v='10'/>
19:11:24:  <core-dir v='cores'/>
19:11:24:  <core-priority v='idle'/>
19:11:24:  <cpu-affinity v='false'/>
19:11:24:  <cpu-usage v='100'/>
19:11:24:  <no-assembly v='false'/>
19:11:24:
19:11:24:  <!-- Folding Slot Configuration -->
19:11:24:  <client-subtype v='STDCLI'/>
19:11:24:  <client-type v='normal'/>
19:11:24:  <cpu-species v='X86_AMD'/>
19:11:24:  <cpu-type v='AMD64'/>
19:11:24:  <cpus v='-1'/>
19:11:24:  <cuda-index v='0'/>
19:11:24:  <gpu v='true'/>
19:11:24:  <gpu-usage v='100'/>
19:11:24:  <max-packet-size v='normal'/>
19:11:24:  <opencl-index v='0'/>
19:11:24:  <os-species v='UNKNOWN'/>
19:11:24:  <os-type v='WIN32'/>
19:11:24:  <project-key v='0'/>
19:11:24:  <smp v='true'/>
19:11:24:
19:11:24:  <!-- Logging -->
19:11:24:  <log v='log.txt'/>
19:11:24:  <log-color v='false'/>
19:11:24:  <log-crlf v='true'/>
19:11:24:  <log-date v='false'/>
19:11:24:  <log-date-periodically v='21600'/>
19:11:24:  <log-debug v='true'/>
19:11:24:  <log-domain v='false'/>
19:11:24:  <log-header v='true'/>
19:11:24:  <log-level v='true'/>
19:11:24:  <log-no-info-header v='true'/>
19:11:24:  <log-redirect v='false'/>
19:11:24:  <log-rotate v='true'/>
19:11:24:  <log-rotate-dir v='logs'/>
19:11:24:  <log-rotate-max v='16'/>
19:11:24:  <log-short-level v='false'/>
19:11:24:  <log-simple-domains v='true'/>
19:11:24:  <log-thread-id v='false'/>
19:11:24:  <log-thread-prefix v='true'/>
19:11:24:  <log-time v='true'/>
19:11:24:  <log-to-screen v='true'/>
19:11:24:  <log-truncate v='false'/>
19:11:24:  <verbosity v='4'/>
19:11:24:
19:11:24:  <!-- Network -->
19:11:24:  <proxy v=':8080'/>
19:11:24:  <proxy-enable v='false'/>
19:11:24:  <proxy-pass v=''/>
19:11:24:  <proxy-user v=''/>
19:11:24:
19:11:24:  <!-- Process Control -->
19:11:24:  <child v='false'/>
19:11:24:  <daemon v='false'/>
19:11:24:  <pid v='false'/>
19:11:24:  <pid-file v='Folding@home Client.pid'/>
19:11:24:  <respawn v='false'/>
19:11:24:  <service v='false'/>
19:11:24:
19:11:24:  <!-- Remote Command Server -->
19:11:24:  <command-address v='0.0.0.0'/>
19:11:24:  <command-allow v='127.0.0.1'/>
19:11:24:  <command-allow-no-pass v='127.0.0.1'/>
19:11:24:  <command-deny v='0.0.0.0/0'/>
19:11:24:  <command-deny-no-pass v='0.0.0.0/0'/>
19:11:24:  <command-port v='36330'/>
19:11:24:
19:11:24:  <!-- Slot Control -->
19:11:24:  <max-shutdown-wait v='60'/>
19:11:24:  <pause-on-battery v='false'/>
19:11:24:  <pause-on-start v='false'/>
19:11:24:
19:11:24:  <!-- User Information -->
19:11:24:  <machine-id v='0'/>
19:11:24:  <passkey v='********************************'/>
19:11:24:  <team v='76486'/>
19:11:24:  <user v='baz657'/>
19:11:24:
19:11:24:  <!-- Work Unit Control -->
19:11:24:  <dump-after-deadline v='true'/>
19:11:24:  <max-queue v='16'/>
19:11:24:  <max-units v='0'/>
19:11:24:  <next-unit-percentage v='99'/>
19:11:24:
19:11:24:  <!-- Folding Slots -->
19:11:24:  <slot id='0' type='GPU'/>
19:11:24:  <slot id='1' type='SMP'/>
19:11:24:</config>
19:11:25:Trying to access database...
19:11:27:Successfully acquired database lock
19:11:27:Enabled folding slot 00: READY gpu:0:"GF104 [GeForce GTX 460]"
19:11:27:Enabled folding slot 01: READY smp:2
19:11:27:WU01:FS00:Starting
19:11:27:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/HTPC/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 01 -suffix 01 -version 701 -lifeline 3552 -checkpoint 10 -gpu 0
19:11:28:Server connection id=1 on 0.0.0.0:36330 from 127.0.0.1
19:11:30:WU01:FS00:Started FahCore on PID 4280
19:11:33:WU01:FS00:Core PID:4336
19:11:33:WU01:FS00:FahCore 0x15 started
19:11:36:WU01:FS00:0x15:
19:11:36:WU01:FS00:0x15:*------------------------------*
19:11:36:WU00:FS01:Starting
19:11:36:WU01:FS00:0x15:Folding@Home GPU Core
19:11:36:WU01:FS00:0x15:Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
19:11:36:WU01:FS00:0x15:Build host             SimbiosNvdWin7
19:11:36:WU01:FS00:0x15:Board Type             NVIDIA/CUDA
19:11:36:WU01:FS00:0x15:Core                   15
19:11:36:WU01:FS00:0x15:
19:11:36:WU01:FS00:0x15:Window's signal control handler registered.
19:11:36:WU01:FS00:0x15:Preparing to commence simulation
19:11:36:WU01:FS00:0x15:- Ensuring status. Please wait.
19:11:36:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/HTPC/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 701 -lifeline 3552 -checkpoint 10 -np 2
19:11:36:WU00:FS01:Started FahCore on PID 4428
19:11:38:WU00:FS01:Core PID:4516
19:11:38:WU00:FS01:FahCore 0xa4 started
19:11:39:Server connection id=2 on 0.0.0.0:36330 from 127.0.0.1
19:11:39:WU00:FS01:0xa4:
19:11:39:WU00:FS01:0xa4:*------------------------------*
19:11:39:WU00:FS01:0xa4:Folding@Home Gromacs GB Core
19:11:39:WU00:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
19:11:39:WU00:FS01:0xa4:
19:11:39:WU00:FS01:0xa4:Preparing to commence simulation
19:11:39:WU00:FS01:0xa4:- Ensuring status. Please wait.
19:11:41:Server connection id=1 ended
19:11:45:WU01:FS00:0x15:- Looking at optimizations...
19:11:45:WU01:FS00:0x15:- Working with standard loops on this execution.
19:11:45:WU01:FS00:0x15:- Previous termination of core was improper.
19:11:45:WU01:FS00:0x15:- Files status OK
19:11:45:WU01:FS00:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
19:11:45:WU01:FS00:0x15:- Expanded 549492 -> 891652 (decompressed 162.2 percent)
19:11:45:WU01:FS00:0x15:Called DecompressByteArray: compressed_data_size=549492 data_size=891652, decompressed_data_size=891652 diff=0
19:11:45:WU01:FS00:0x15:- Digital signature verified
19:11:46:WU01:FS00:0x15:
19:11:46:WU01:FS00:0x15:Project: 7640 (Run 579, Clone 0, Gen 2)
19:11:46:WU01:FS00:0x15:
19:11:46:WU01:FS00:0x15:Entering M.D.
19:11:48:WU01:FS00:0x15:Will resume from checkpoint file 01/wudata_01.ckp
19:11:48:WU01:FS00:0x15:Tpr hash 01/wudata_01.tpr:  70628130 3771909435 3017222206 2091843894 1569825417
19:11:48:WU01:FS00:0x15:GPU device info: vendor=0 device=0 name=<NA> match=0
19:11:48:WU00:FS01:0xa4:- Looking at optimizations...
19:11:48:WU00:FS01:0xa4:- Working with standard loops on this execution.
19:11:48:WU00:FS01:0xa4:- Previous termination of core was improper.
19:11:48:WU01:FS00:0x15:Working on Generated by trjconv : 21521 p3064_lambda5_2003 t= 4100.00000 in water
19:11:48:WU00:FS01:0xa4:- Files status OK
19:11:48:WU01:FS00:0x15:Client config unavailable.
19:11:49:WU01:FS00:0x15:Starting GUI Server
19:11:49:WU00:FS01:0xa4:- Expanded 885515 -> 2025324 (decompressed 228.7 percent)
19:11:49:WU00:FS01:0xa4:Called DecompressByteArray: compressed_data_size=885515 data_size=2025324, decompressed_data_size=2025324 diff=0
19:11:49:WU00:FS01:0xa4:- Digital signature verified
19:11:49:WU00:FS01:0xa4:
19:11:49:WU00:FS01:0xa4:Project: 8013 (Run 143, Clone 24, Gen 8)
19:11:49:WU00:FS01:0xa4:
19:11:49:WU00:FS01:0xa4:Entering M.D.
19:11:55:WU00:FS01:0xa4:Using Gromacs checkpoints
19:11:55:WU00:FS01:0xa4:Mapping NT from 2 to 2 
19:11:56:WU00:FS01:0xa4:Resuming from checkpoint
19:11:56:WU00:FS01:0xa4:Verified 00/wudata_01.log
19:11:56:WU00:FS01:0xa4:Verified 00/wudata_01.trr
19:11:56:WU00:FS01:0xa4:Verified 00/wudata_01.xtc
19:11:56:WU00:FS01:0xa4:Verified 00/wudata_01.edr
19:11:57:WU00:FS01:0xa4:Completed 73910 out of 250000 steps  (29%)
19:14:26:WU01:FS00:0x15:Resuming from checkpoint
19:14:26:WU01:FS00:0x15:fcCheckPointResume: retreived and current tpr file hash:
19:14:26:WU01:FS00:0x15:   0     70628130     70628130
19:14:26:WU01:FS00:0x15:   1   3771909435   3771909435
19:14:26:WU01:FS00:0x15:   2   3017222206   3017222206
19:14:26:WU01:FS00:0x15:   3   2091843894   2091843894
19:14:26:WU01:FS00:0x15:   4   1569825417   1569825417
19:14:26:WU01:FS00:0x15:fcCheckPointResume: file hashes same.
19:14:26:WU01:FS00:0x15:fcCheckPointResume: state restored.
19:14:26:WU01:FS00:0x15:fcCheckPointResume: name 01/wudata_01.log Verified 01/wudata_01.log
19:14:26:WU01:FS00:0x15:fcCheckPointResume: name 01/wudata_01.trr Verified 01/wudata_01.trr
19:14:26:WU01:FS00:0x15:fcCheckPointResume: name 01/wudata_01.xtc Verified 01/wudata_01.xtc
19:14:26:WU01:FS00:0x15:fcCheckPointResume: name 01/wudata_01.edr Verified 01/wudata_01.edr
19:14:26:WU01:FS00:0x15:fcCheckPointResume: state restored 2
19:14:26:WU01:FS00:0x15:Resumed from checkpoint
19:14:26:WU01:FS00:0x15:Setting checkpoint frequency: 25000
19:14:26:WU01:FS00:0x15:Completed     25001 out of 2500000 steps (1%).
19:14:27:WARNING:WU01:FS00:Detected clock skew, adjusting time estimates
19:18:03:WU00:FS01:0xa4:Completed 75000 out of 250000 steps  (30%)
19:28:54:WU00:FS01:0xa4:Completed 77500 out of 250000 steps  (31%)
19:29:03:WU01:FS00:0x15:Completed     50000 out of 2500000 steps (2%).
19:38:28:WU00:FS01:0xa4:Completed 80000 out of 250000 steps  (32%)
19:43:35:WU01:FS00:0x15:Completed     75000 out of 2500000 steps (3%).
19:48:06:WU00:FS01:0xa4:Completed 82500 out of 250000 steps  (33%)
19:57:01:WU01:FS00:0x15:Completed    100000 out of 2500000 steps (4%).
19:57:56:WU00:FS01:0xa4:Completed 85000 out of 250000 steps  (34%)
20:07:55:WU00:FS01:0xa4:Completed 87500 out of 250000 steps  (35%)
20:08:56:WU01:FS00:0x15:Completed    125000 out of 2500000 steps (5%).
20:17:54:WU00:FS01:0xa4:Completed 90000 out of 250000 steps  (36%)
20:20:50:WU01:FS00:0x15:Completed    150000 out of 2500000 steps (6%).
20:27:43:WU00:FS01:0xa4:Completed 92500 out of 250000 steps  (37%)
20:32:44:WU01:FS00:0x15:Completed    175000 out of 2500000 steps (7%).
20:37:37:WU00:FS01:0xa4:Completed 95000 out of 250000 steps  (38%)
20:46:40:Server connection id=3 on 0.0.0.0:36330 from 127.0.0.1
20:46:55:Server connection id=2 ended
20:52:55:WU01:FS00:0x15:Completed    200000 out of 2500000 steps (8%).
20:53:20:WU00:FS01:0xa4:Completed 97500 out of 250000 steps  (39%)
21:03:03:WU00:FS01:0xa4:Completed 100000 out of 250000 steps  (40%)
21:08:43:WU01:FS00:0x15:Completed    225000 out of 2500000 steps (9%).
21:12:48:WU00:FS01:0xa4:Completed 102500 out of 250000 steps  (41%)
21:22:17:WU00:FS01:0xa4:Completed 105000 out of 250000 steps  (42%)
21:24:15:WU01:FS00:0x15:Completed    250000 out of 2500000 steps (10%).
21:31:58:WU00:FS01:0xa4:Completed 107500 out of 250000 steps  (43%)
21:40:21:WU01:FS00:0x15:Completed    275000 out of 2500000 steps (11%).
21:41:47:WU00:FS01:0xa4:Completed 110000 out of 250000 steps  (44%)
21:51:36:WU00:FS01:0xa4:Completed 112500 out of 250000 steps  (45%)
21:55:44:WU01:FS00:0x15:Completed    300000 out of 2500000 steps (12%).
22:00:48:WU00:FS01:0xa4:Completed 115000 out of 250000 steps  (46%)
22:10:37:WU00:FS01:0xa4:Completed 117500 out of 250000 steps  (47%)
22:12:09:WU01:FS00:0x15:Completed    325000 out of 2500000 steps (13%).
22:20:28:WU00:FS01:0xa4:Completed 120000 out of 250000 steps  (48%)
22:28:18:WU01:FS00:0x15:Completed    350000 out of 2500000 steps (14%).
22:30:07:WU00:FS01:0xa4:Completed 122500 out of 250000 steps  (49%)
22:39:50:WU00:FS01:0xa4:Completed 125000 out of 250000 steps  (50%)
22:41:48:WU01:FS00:0x15:Completed    375000 out of 2500000 steps (15%).
22:49:37:WU00:FS01:0xa4:Completed 127500 out of 250000 steps  (51%)
22:54:27:WU01:FS00:0x15:Completed    400000 out of 2500000 steps (16%).
22:59:24:WU00:FS01:0xa4:Completed 130000 out of 250000 steps  (52%)
23:07:07:WU01:FS00:0x15:Completed    425000 out of 2500000 steps (17%).
23:08:52:WU00:FS01:0xa4:Completed 132500 out of 250000 steps  (53%)
23:18:42:WU00:FS01:0xa4:Completed 135000 out of 250000 steps  (54%)
23:19:48:WU01:FS00:0x15:Completed    450000 out of 2500000 steps (18%).
23:28:25:WU00:FS01:0xa4:Completed 137500 out of 250000 steps  (55%)
23:34:54:WU01:FS00:0x15:Completed    475000 out of 2500000 steps (19%).
23:38:18:WU00:FS01:0xa4:Completed 140000 out of 250000 steps  (56%)
23:48:04:WU00:FS01:0xa4:Completed 142500 out of 250000 steps  (57%)
23:50:49:WU01:FS00:0x15:Completed    500000 out of 2500000 steps (20%).
23:57:23:WU00:FS01:0xa4:Completed 145000 out of 250000 steps  (58%)
00:06:21:WU01:FS00:0x15:Completed    525000 out of 2500000 steps (21%).
00:07:17:WU00:FS01:0xa4:Completed 147500 out of 250000 steps  (59%)
00:15:54:WU00:FS01:0xa4:Completed 150000 out of 250000 steps  (60%)
00:19:46:WU01:FS00:0x15:Completed    550000 out of 2500000 steps (22%).
00:23:22:WU00:FS01:0xa4:Completed 152500 out of 250000 steps  (61%)
00:30:49:WU00:FS01:0xa4:Completed 155000 out of 250000 steps  (62%)
00:32:02:WU01:FS00:0x15:Completed    575000 out of 2500000 steps (23%).
00:41:43:WU00:FS01:0xa4:Completed 157500 out of 250000 steps  (63%)
00:45:07:WU01:FS00:0x15:Completed    600000 out of 2500000 steps (24%).
00:57:12:WU00:FS01:0xa4:Completed 160000 out of 250000 steps  (64%)
00:57:29:WU01:FS00:0x15:Completed    625000 out of 2500000 steps (25%).
01:09:57:WU01:FS00:0x15:Completed    650000 out of 2500000 steps (26%).
******************************** Date: 11/04/12 ********************************
01:17:42:WU00:FS01:0xa4:Completed 162500 out of 250000 steps  (65%)
01:22:22:WU01:FS00:0x15:Completed    675000 out of 2500000 steps (27%).
01:26:40:WU00:FS01:0xa4:Completed 165000 out of 250000 steps  (66%)
01:34:07:WU00:FS01:0xa4:Completed 167500 out of 250000 steps  (67%)
01:34:37:WU01:FS00:0x15:Completed    700000 out of 2500000 steps (28%).
01:41:34:WU00:FS01:0xa4:Completed 170000 out of 250000 steps  (68%)
01:46:51:WU01:FS00:0x15:Completed    725000 out of 2500000 steps (29%).
01:49:01:WU00:FS01:0xa4:Completed 172500 out of 250000 steps  (69%)
01:56:28:WU00:FS01:0xa4:Completed 175000 out of 250000 steps  (70%)
02:00:45:WU01:FS00:0x15:Completed    750000 out of 2500000 steps (30%).
02:05:45:WU00:FS01:0xa4:Completed 177500 out of 250000 steps  (71%)
02:12:59:WU01:FS00:0x15:Completed    775000 out of 2500000 steps (31%).
02:13:12:WU00:FS01:0xa4:Completed 180000 out of 250000 steps  (72%)
02:20:37:WU00:FS01:0xa4:Completed 182500 out of 250000 steps  (73%)
02:25:12:WU01:FS00:0x15:Completed    800000 out of 2500000 steps (32%).
02:28:03:WU00:FS01:0xa4:Completed 185000 out of 250000 steps  (74%)
02:35:29:WU00:FS01:0xa4:Completed 187500 out of 250000 steps  (75%)
02:37:26:WU01:FS00:0x15:Completed    825000 out of 2500000 steps (33%).
02:42:56:WU00:FS01:0xa4:Completed 190000 out of 250000 steps  (76%)
02:49:39:WU01:FS00:0x15:Completed    850000 out of 2500000 steps (34%).
02:50:22:WU00:FS01:0xa4:Completed 192500 out of 250000 steps  (77%)
02:57:48:WU00:FS01:0xa4:Completed 195000 out of 250000 steps  (78%)
03:01:52:WU01:FS00:0x15:Completed    875000 out of 2500000 steps (35%).
03:05:14:WU00:FS01:0xa4:Completed 197500 out of 250000 steps  (79%)
03:12:43:WU00:FS01:0xa4:Completed 200000 out of 250000 steps  (80%)
03:14:08:WU01:FS00:0x15:Completed    900000 out of 2500000 steps (36%).
03:20:08:WU00:FS01:0xa4:Completed 202500 out of 250000 steps  (81%)
03:26:23:WU01:FS00:0x15:Completed    925000 out of 2500000 steps (37%).
03:27:34:WU00:FS01:0xa4:Completed 205000 out of 250000 steps  (82%)
03:35:00:WU00:FS01:0xa4:Completed 207500 out of 250000 steps  (83%)
03:38:37:WU01:FS00:0x15:Completed    950000 out of 2500000 steps (38%).
03:42:27:WU00:FS01:0xa4:Completed 210000 out of 250000 steps  (84%)
03:49:52:WU00:FS01:0xa4:Completed 212500 out of 250000 steps  (85%)
03:50:50:WU01:FS00:0x15:Completed    975000 out of 2500000 steps (39%).
03:57:18:WU00:FS01:0xa4:Completed 215000 out of 250000 steps  (86%)
04:03:05:WU01:FS00:0x15:Completed   1000000 out of 2500000 steps (40%).
04:04:47:WU00:FS01:0xa4:Completed 217500 out of 250000 steps  (87%)
04:12:13:WU00:FS01:0xa4:Completed 220000 out of 250000 steps  (88%)
04:15:19:WU01:FS00:0x15:Completed   1025000 out of 2500000 steps (41%).
04:19:39:WU00:FS01:0xa4:Completed 222500 out of 250000 steps  (89%)
04:27:05:WU00:FS01:0xa4:Completed 225000 out of 250000 steps  (90%)
04:27:32:WU01:FS00:0x15:Completed   1050000 out of 2500000 steps (42%).
04:34:32:WU00:FS01:0xa4:Completed 227500 out of 250000 steps  (91%)
04:39:46:WU01:FS00:0x15:Completed   1075000 out of 2500000 steps (43%).
04:41:59:WU00:FS01:0xa4:Completed 230000 out of 250000 steps  (92%)
04:49:26:WU00:FS01:0xa4:Completed 232500 out of 250000 steps  (93%)
04:52:00:WU01:FS00:0x15:Completed   1100000 out of 2500000 steps (44%).
04:56:52:WU00:FS01:0xa4:Completed 235000 out of 250000 steps  (94%)
05:04:15:WU01:FS00:0x15:Completed   1125000 out of 2500000 steps (45%).
05:04:18:WU00:FS01:0xa4:Completed 237500 out of 250000 steps  (95%)
05:11:45:WU00:FS01:0xa4:Completed 240000 out of 250000 steps  (96%)
05:16:28:WU01:FS00:0x15:Completed   1150000 out of 2500000 steps (46%).
05:19:12:WU00:FS01:0xa4:Completed 242500 out of 250000 steps  (97%)
05:26:39:WU00:FS01:0xa4:Completed 245000 out of 250000 steps  (98%)
05:28:41:WU01:FS00:0x15:Completed   1175000 out of 2500000 steps (47%).
05:34:04:WU00:FS01:0xa4:Completed 247500 out of 250000 steps  (99%)
05:40:56:WU01:FS00:0x15:Completed   1200000 out of 2500000 steps (48%).
05:41:31:WU00:FS01:0xa4:Completed 250000 out of 250000 steps  (100%)
05:41:31:WU02:FS01:Connecting to assign3.stanford.edu:8080
05:41:32:WU00:FS01:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
05:41:42:WU00:FS01:0xa4:
05:41:42:WU00:FS01:0xa4:Finished Work Unit:
05:41:42:WU00:FS01:0xa4:- Reading up to 1294800 from "00/wudata_01.trr": Read 1294800
05:41:42:WU00:FS01:0xa4:trr file hash check passed.
05:41:42:WU00:FS01:0xa4:- Reading up to 784000 from "00/wudata_01.xtc": Read 784000
05:41:42:WU00:FS01:0xa4:xtc file hash check passed.
05:41:42:WU00:FS01:0xa4:edr file hash check passed.
05:41:42:WU00:FS01:0xa4:logfile size: 29393
05:41:42:WU00:FS01:0xa4:Leaving Run
05:41:46:WU00:FS01:0xa4:- Writing 2113597 bytes of core data to disk...
05:41:47:WU00:FS01:0xa4:Done: 2113085 -> 2022140 (compressed to 95.6 percent)
05:41:47:WU00:FS01:0xa4:  ... Done.
05:41:47:WU00:FS01:0xa4:- Shutting down core
05:41:47:WU00:FS01:0xa4:
05:41:47:WU00:FS01:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
05:41:48:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
05:41:48:WU00:FS01:Sending unit results: id:00 state:SEND error:OK project:8013 run:143 clone:24 gen:8 core:0xa4 unit:0x0000000a6652edcc4f782f539f1aee21
05:41:48:WU00:FS01:Uploading 1.93MiB to 171.67.108.60
05:41:48:WU00:FS01:Connecting to 171.67.108.60:8080
05:41:54:WU00:FS01:Upload 25.92%
05:42:00:WU00:FS01:Upload 51.84%
05:42:06:WU00:FS01:Upload 77.76%
05:42:12:WU00:FS01:Upload complete
05:42:12:WU00:FS01:Server responded WORK_ACK (400)
05:42:12:WU00:FS01:Final credit estimate, 531.00 points
05:42:13:WU00:FS01:Cleaning up
05:42:32:WU02:FS01:News: Welcome to Folding@Home
05:42:32:WU02:FS01:Assigned to work server 171.64.65.99
05:42:32:WU02:FS01:Requesting new work unit for slot 01: READY smp:2 from 171.64.65.99
05:42:32:WU02:FS01:Connecting to 171.64.65.99:8080
05:42:35:WU02:FS01:Downloading 1.98MiB
05:42:40:WU02:FS01:Download complete
05:42:40:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:OK project:7809 run:8 clone:159 gen:10 core:0xa4 unit:0x0000000f0a3b1e874e311696fc4418b3
05:42:40:WU02:FS01:Starting
05:42:40:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/HTPC/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 02 -suffix 01 -version 701 -lifeline 3552 -checkpoint 10 -np 2
05:42:43:WU02:FS01:Started FahCore on PID 736
05:42:45:WU02:FS01:Core PID:2800
05:42:45:WU02:FS01:FahCore 0xa4 started
05:42:45:WU02:FS01:Downloading project 7809 description
05:42:45:WU02:FS01:Connecting to fah-web.stanford.edu:80
05:42:45:WU02:FS01:0xa4:
05:42:45:WU02:FS01:0xa4:*------------------------------*
05:42:45:WU02:FS01:0xa4:Folding@Home Gromacs GB Core
05:42:45:WU02:FS01:0xa4:Version 2.27 (Dec. 15, 2010)
05:42:45:WU02:FS01:0xa4:
05:42:45:WU02:FS01:0xa4:Preparing to commence simulation
05:42:45:WU02:FS01:0xa4:- Looking at optimizations...
05:42:45:WU02:FS01:0xa4:- Created dyn
05:42:45:WU02:FS01:0xa4:- Files status OK
05:42:45:WU02:FS01:0xa4:- Expanded 2079728 -> 5386224 (decompressed 258.9 percent)
05:42:45:WU02:FS01:0xa4:Called DecompressByteArray: compressed_data_size=2079728 data_size=5386224, decompressed_data_size=5386224 diff=0
05:42:46:WU02:FS01:0xa4:- Digital signature verified
05:42:46:WU02:FS01:0xa4:
05:42:46:WU02:FS01:0xa4:Project: 7809 (Run 8, Clone 159, Gen 10)
05:42:46:WU02:FS01:0xa4:
05:42:46:WU02:FS01:0xa4:Assembly optimizations on if available.
05:42:46:WU02:FS01:0xa4:Entering M.D.
05:42:46:WU02:FS01:Project 7809 description downloaded successfully
05:42:52:WU02:FS01:0xa4:Mapping NT from 2 to 2 
05:42:53:WU02:FS01:0xa4:Completed 0 out of 1500000 steps  (0%)
05:53:19:WU01:FS00:0x15:Completed   1225000 out of 2500000 steps (49%).
06:05:31:WU01:FS00:0x15:Completed   1250000 out of 2500000 steps (50%).
06:17:45:WU01:FS00:0x15:Completed   1275000 out of 2500000 steps (51%).
06:29:57:WU01:FS00:0x15:Completed   1300000 out of 2500000 steps (52%).
06:41:28:WU02:FS01:0xa4:Completed 15000 out of 1500000 steps  (1%)
06:42:11:WU01:FS00:0x15:Completed   1325000 out of 2500000 steps (53%).
06:54:25:WU01:FS00:0x15:Completed   1350000 out of 2500000 steps (54%).
07:06:38:WU01:FS00:0x15:Completed   1375000 out of 2500000 steps (55%).
******************************** Date: 11/04/12 ********************************
07:18:56:WU01:FS00:0x15:Completed   1400000 out of 2500000 steps (56%).
07:31:10:WU01:FS00:0x15:Completed   1425000 out of 2500000 steps (57%).
07:40:07:WU02:FS01:0xa4:Completed 30000 out of 1500000 steps  (2%)
07:43:24:WU01:FS00:0x15:Completed   1450000 out of 2500000 steps (58%).
07:55:37:WU01:FS00:0x15:Completed   1475000 out of 2500000 steps (59%).
08:07:49:WU01:FS00:0x15:Completed   1500000 out of 2500000 steps (60%).
08:20:01:WU01:FS00:0x15:Completed   1525000 out of 2500000 steps (61%).
08:32:15:WU01:FS00:0x15:Completed   1550000 out of 2500000 steps (62%).
08:38:40:WU02:FS01:0xa4:Completed 45000 out of 1500000 steps  (3%)
08:44:27:WU01:FS00:0x15:Completed   1575000 out of 2500000 steps (63%).
08:56:38:WU01:FS00:0x15:Completed   1600000 out of 2500000 steps (64%).
09:08:50:WU01:FS00:0x15:Completed   1625000 out of 2500000 steps (65%).
09:21:02:WU01:FS00:0x15:Completed   1650000 out of 2500000 steps (66%).
09:33:14:WU01:FS00:0x15:Completed   1675000 out of 2500000 steps (67%).
09:37:08:WU02:FS01:0xa4:Completed 60000 out of 1500000 steps  (4%)
09:45:27:WU01:FS00:0x15:Completed   1700000 out of 2500000 steps (68%).
09:57:39:WU01:FS00:0x15:Completed   1725000 out of 2500000 steps (69%).
10:09:52:WU01:FS00:0x15:Completed   1750000 out of 2500000 steps (70%).
10:22:04:WU01:FS00:0x15:Completed   1775000 out of 2500000 steps (71%).
10:34:19:WU01:FS00:0x15:Completed   1800000 out of 2500000 steps (72%).
10:35:38:WU02:FS01:0xa4:Completed 75000 out of 1500000 steps  (5%)
10:46:33:WU01:FS00:0x15:Completed   1825000 out of 2500000 steps (73%).
10:58:48:WU01:FS00:0x15:Completed   1850000 out of 2500000 steps (74%).
11:11:03:WU01:FS00:0x15:Completed   1875000 out of 2500000 steps (75%).
11:23:19:WU01:FS00:0x15:Completed   1900000 out of 2500000 steps (76%).
11:34:16:WU02:FS01:0xa4:Completed 90000 out of 1500000 steps  (6%)
11:35:34:WU01:FS00:0x15:Completed   1925000 out of 2500000 steps (77%).
11:47:49:WU01:FS00:0x15:Completed   1950000 out of 2500000 steps (78%).
12:00:03:WU01:FS00:0x15:Completed   1975000 out of 2500000 steps (79%).
12:12:18:WU01:FS00:0x15:Completed   2000000 out of 2500000 steps (80%).
12:24:31:WU01:FS00:0x15:Completed   2025000 out of 2500000 steps (81%).
12:32:39:WU02:FS01:0xa4:Completed 105000 out of 1500000 steps  (7%)
12:36:43:WU01:FS00:0x15:Completed   2050000 out of 2500000 steps (82%).
12:48:55:WU01:FS00:0x15:Completed   2075000 out of 2500000 steps (83%).
13:01:06:WU01:FS00:0x15:Completed   2100000 out of 2500000 steps (84%).
13:13:18:WU01:FS00:0x15:Completed   2125000 out of 2500000 steps (85%).
******************************** Date: 11/04/12 ********************************
13:25:32:WU01:FS00:0x15:Completed   2150000 out of 2500000 steps (86%).
13:31:06:WU02:FS01:0xa4:Completed 120000 out of 1500000 steps  (8%)
13:37:44:WU01:FS00:0x15:Completed   2175000 out of 2500000 steps (87%).
13:49:58:WU01:FS00:0x15:Completed   2200000 out of 2500000 steps (88%).
14:02:09:WU01:FS00:0x15:Completed   2225000 out of 2500000 steps (89%).
14:14:22:WU01:FS00:0x15:Completed   2250000 out of 2500000 steps (90%).
14:26:35:WU01:FS00:0x15:Completed   2275000 out of 2500000 steps (91%).
14:29:37:WU02:FS01:0xa4:Completed 135000 out of 1500000 steps  (9%)
14:38:48:WU01:FS00:0x15:Completed   2300000 out of 2500000 steps (92%).
14:51:01:WU01:FS00:0x15:Completed   2325000 out of 2500000 steps (93%).
15:03:14:WU01:FS00:0x15:Completed   2350000 out of 2500000 steps (94%).
15:15:27:WU01:FS00:0x15:Completed   2375000 out of 2500000 steps (95%).
15:27:40:WU01:FS00:0x15:Completed   2400000 out of 2500000 steps (96%).
15:28:08:WU02:FS01:0xa4:Completed 150000 out of 1500000 steps  (10%)
15:39:52:WU01:FS00:0x15:Completed   2425000 out of 2500000 steps (97%).
15:52:04:WU01:FS00:0x15:Completed   2450000 out of 2500000 steps (98%).
16:04:17:WU01:FS00:0x15:Completed   2475000 out of 2500000 steps (99%).
16:04:17:WU00:FS00:Connecting to assign-GPU.stanford.edu:80
16:04:18:WU00:FS00:News: Welcome to Folding@Home
16:04:18:WU00:FS00:Assigned to work server 171.67.108.142
16:04:18:WU00:FS00:Requesting new work unit for slot 00: RUNNING gpu:0:"GF104 [GeForce GTX 460]" from 171.67.108.142
16:04:18:WU00:FS00:Connecting to 171.67.108.142:8080
16:04:20:WU00:FS00:Downloading 117.37KiB
16:04:20:WU00:FS00:Download complete
16:04:20:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:OK project:8034 run:17 clone:39 gen:9 core:0x15 unit:0x0000000a6953ee2e4f72e08edfc20ea3
16:04:20:WU00:FS00:Downloading project 8034 description
16:04:20:WU00:FS00:Connecting to fah-web.stanford.edu:80
16:04:21:WU00:FS00:Project 8034 description downloaded successfully
16:16:29:WU01:FS00:0x15:Completed   2500000 out of 2500000 steps (100%).
16:16:29:WU01:FS00:0x15:Finished fah_main status=0
16:16:29:WU01:FS00:0x15:Successful run
16:16:29:WU01:FS00:0x15:DynamicWrapper: Finished Work Unit: sleep=10000
16:16:39:WU01:FS00:0x15:Reserved 2194528 bytes for xtc file; Cosm status=0
16:16:39:WU01:FS00:0x15:Allocated 2194528 bytes for xtc file
16:16:39:WU01:FS00:0x15:- Reading up to 2194528 from "01/wudata_01.xtc": Read 2194528
16:16:39:WU01:FS00:0x15:Read 2194528 bytes from xtc file; available packet space=784235936
16:16:39:WU01:FS00:0x15:xtc file hash check passed.
16:16:39:WU01:FS00:0x15:Reserved 12836400 12836400 784235936 bytes for arc file=<01/wudata_01.trr> Cosm status=0
16:16:39:WU01:FS00:0x15:Allocated 12836400 bytes for arc file
16:16:39:WU01:FS00:0x15:- Reading up to 12836400 from "01/wudata_01.trr": Read 12836400
16:16:39:WU01:FS00:0x15:Read 12836400 bytes from arc file; available packet space=771399536
16:16:39:WU01:FS00:0x15:trr file hash check passed.
16:16:39:WU01:FS00:0x15:Allocated 1116 bytes for edr file
16:16:39:WU01:FS00:0x15:Read bedfile
16:16:39:WU01:FS00:0x15:edr file hash check passed.
16:16:39:WU01:FS00:0x15:Allocated 22171 bytes for logfile
16:16:39:WU01:FS00:0x15:Read logfile
16:16:39:WU01:FS00:0x15:GuardedRun: success in DynamicWrapper
16:16:39:WU01:FS00:0x15:GuardedRun: done
16:16:39:WU01:FS00:0x15:Run: GuardedRun completed.
16:16:42:WU01:FS00:0x15:+ Opened results file
16:16:42:WU01:FS00:0x15:- Writing 15054727 bytes of core data to disk...
16:16:50:WU01:FS00:0x15:Done: 15054215 -> 14607320 (compressed to 97.0 percent)
16:16:50:WU01:FS00:0x15:  ... Done.
16:16:50:WU01:FS00:0x15:DeleteFrameFiles: successfully deleted file=01/wudata_01.ckp
16:16:52:WU01:FS00:0x15:Shutting down core 
16:16:52:WU01:FS00:0x15:
16:16:52:WU01:FS00:0x15:Folding@home Core Shutdown: FINISHED_UNIT
16:16:52:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
16:16:53:WU01:FS00:Sending unit results: id:01 state:SEND error:OK project:7640 run:579 clone:0 gen:2 core:0x15 unit:0x000000020a3b1e814f32c8455a7ad6ba
16:16:53:WU00:FS00:Starting
16:16:53:WU01:FS00:Uploading 13.93MiB to 171.64.65.93
16:16:53:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/HTPC/AppData/Roaming/FAHClient/cores/www.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_15.fah/FahCore_15.exe -dir 00 -suffix 01 -version 701 -lifeline 3552 -checkpoint 10 -gpu 0
16:16:53:WU01:FS00:Connecting to 171.64.65.93:8080
16:16:55:WU00:FS00:Started FahCore on PID 4640
16:16:57:WU00:FS00:Core PID:3188
16:16:57:WU00:FS00:FahCore 0x15 started
16:16:57:WU00:FS00:0x15:
16:16:57:WU00:FS00:0x15:*------------------------------*
16:16:57:WU00:FS00:0x15:Folding@Home GPU Core
16:16:57:WU00:FS00:0x15:Version                2.22 (Thu Dec 8 17:08:05 PST 2011)
16:16:57:WU00:FS00:0x15:Build host             SimbiosNvdWin7
16:16:57:WU00:FS00:0x15:Board Type             NVIDIA/CUDA
16:16:57:WU00:FS00:0x15:Core                   15
16:16:57:WU00:FS00:0x15:
16:16:57:WU00:FS00:0x15:Window's signal control handler registered.
16:16:57:WU00:FS00:0x15:Preparing to commence simulation
16:16:57:WU00:FS00:0x15:- Looking at optimizations...
16:16:57:WU00:FS00:0x15:DeleteFrameFiles: successfully deleted file=00/wudata_01.ckp
16:16:57:WU00:FS00:0x15:- Created dyn
16:16:57:WU00:FS00:0x15:- Files status OK
16:16:57:WU00:FS00:0x15:sizeof(CORE_PACKET_HDR) = 512 file=<>
16:16:57:WU00:FS00:0x15:- Expanded 119676 -> 542246 (decompressed 453.0 percent)
16:16:57:WU00:FS00:0x15:Called DecompressByteArray: compressed_data_size=119676 data_size=542246, decompressed_data_size=542246 diff=0
16:16:57:WU00:FS00:0x15:- Digital signature verified
16:16:57:WU00:FS00:0x15:
16:16:57:WU00:FS00:0x15:Project: 8034 (Run 17, Clone 39, Gen 9)
16:16:57:WU00:FS00:0x15:
16:16:57:WU00:FS00:0x15:Assembly optimizations on if available.
16:16:57:WU00:FS00:0x15:Entering M.D.
16:16:59:WU01:FS00:Upload 3.59%
16:16:59:WU00:FS00:0x15:Tpr hash 00/wudata_01.tpr:  2886726237 2969562728 32645902 2898869932 2139251924
16:16:59:WU00:FS00:0x15:GPU device info: vendor=0 device=0 name=<NA> match=0
16:16:59:WU00:FS00:0x15:Working on Protein
16:16:59:WU00:FS00:0x15:Client config unavailable.
16:17:00:WU00:FS00:0x15:Starting GUI Server
16:17:05:WU01:FS00:Upload 6.73%
16:17:11:WU01:FS00:Upload 10.32%
16:17:17:WU01:FS00:Upload 13.91%
16:17:23:WU01:FS00:Upload 17.50%
16:17:29:WU01:FS00:Upload 21.09%
16:17:35:WU01:FS00:Upload 24.67%
16:17:41:WU01:FS00:Upload 27.82%
16:17:47:WU01:FS00:Upload 31.40%
16:17:53:WU01:FS00:Upload 34.99%
16:17:59:WU01:FS00:Upload 38.58%
16:18:02:WU00:FS00:0x15:Setting checkpoint frequency: 250000
16:18:02:WU00:FS00:0x15:Completed         3 out of 25000000 steps (0%).
16:18:05:WU01:FS00:Upload 42.17%
16:18:11:WU01:FS00:Upload 45.31%
16:18:17:WU01:FS00:Upload 48.90%
16:18:23:WU01:FS00:Upload 52.49%
16:18:29:WU01:FS00:Upload 55.63%
16:18:35:WU01:FS00:Upload 59.22%
16:18:41:WU01:FS00:Upload 62.81%
16:18:47:WU01:FS00:Upload 66.40%
16:18:53:WU01:FS00:Upload 69.99%
16:18:59:WU01:FS00:Upload 73.58%
16:19:05:WU01:FS00:Upload 76.72%
16:19:11:WU01:FS00:Upload 80.31%
16:19:17:WU01:FS00:Upload 83.89%
16:19:23:WU01:FS00:Upload 87.48%
16:19:29:WU01:FS00:Upload 91.07%
16:19:35:WU01:FS00:Upload 94.66%
16:19:41:WU01:FS00:Upload 97.80%
16:19:46:WU01:FS00:Upload complete
16:19:46:WU01:FS00:Server responded WORK_ACK (400)
16:19:46:WU01:FS00:Final credit estimate, 7718.00 points
16:19:47:WU01:FS00:Cleaning up
16:21:50:WU00:FS00:0x15:Completed    250000 out of 25000000 steps (1%).
16:25:39:WU00:FS00:0x15:Completed    500000 out of 25000000 steps (2%).
16:26:24:WU02:FS01:0xa4:Completed 165000 out of 1500000 steps  (11%)
16:29:27:WU00:FS00:0x15:Completed    750000 out of 25000000 steps (3%).
16:33:16:WU00:FS00:0x15:Completed   1000000 out of 25000000 steps (4%).
16:37:05:WU00:FS00:0x15:Completed   1250000 out of 25000000 steps (5%).
16:40:53:WU00:FS00:0x15:Completed   1500000 out of 25000000 steps (6%).
16:44:42:WU00:FS00:0x15:Completed   1750000 out of 25000000 steps (7%).
16:48:30:WU00:FS00:0x15:Completed   2000000 out of 25000000 steps (8%).
16:52:19:WU00:FS00:0x15:Completed   2250000 out of 25000000 steps (9%).
16:56:08:WU00:FS00:0x15:Completed   2500000 out of 25000000 steps (10%).
16:59:56:WU00:FS00:0x15:Completed   2750000 out of 25000000 steps (11%).
17:03:45:WU00:FS00:0x15:Completed   3000000 out of 25000000 steps (12%).
17:07:33:WU00:FS00:0x15:Completed   3250000 out of 25000000 steps (13%).
17:11:22:WU00:FS00:0x15:Completed   3500000 out of 25000000 steps (14%).
17:15:11:WU00:FS00:0x15:Completed   3750000 out of 25000000 steps (15%).
17:18:59:WU00:FS00:0x15:Completed   4000000 out of 25000000 steps (16%).
17:22:46:WU02:FS01:0xa4:Completed 180000 out of 1500000 steps  (12%)
17:22:48:WU00:FS00:0x15:Completed   4250000 out of 25000000 steps (17%).
17:26:37:WU00:FS00:0x15:Completed   4500000 out of 25000000 steps (18%).
17:30:25:WU00:FS00:0x15:Completed   4750000 out of 25000000 steps (19%).
17:34:14:WU00:FS00:0x15:Completed   5000000 out of 25000000 steps (20%).
17:38:02:WU00:FS00:0x15:Completed   5250000 out of 25000000 steps (21%).
17:41:51:WU00:FS00:0x15:Completed   5500000 out of 25000000 steps (22%).
17:45:40:WU00:FS00:0x15:Completed   5750000 out of 25000000 steps (23%).
17:49:28:WU00:FS00:0x15:Completed   6000000 out of 25000000 steps (24%).
17:53:17:WU00:FS00:0x15:Completed   6250000 out of 25000000 steps (25%).
17:57:06:WU00:FS00:0x15:Completed   6500000 out of 25000000 steps (26%).
18:00:54:WU00:FS00:0x15:Completed   6750000 out of 25000000 steps (27%).
18:04:43:WU00:FS00:0x15:Completed   7000000 out of 25000000 steps (28%).
18:08:31:WU00:FS00:0x15:Completed   7250000 out of 25000000 steps (29%).
18:12:20:WU00:FS00:0x15:Completed   7500000 out of 25000000 steps (30%).
18:16:18:WU00:FS00:0x15:Completed   7750000 out of 25000000 steps (31%).
18:20:07:WU00:FS00:0x15:Completed   8000000 out of 25000000 steps (32%).
18:21:36:WU02:FS01:0xa4:Completed 195000 out of 1500000 steps  (13%)
18:23:56:WU00:FS00:0x15:Completed   8250000 out of 25000000 steps (33%).
18:27:45:WU00:FS00:0x15:Completed   8500000 out of 25000000 steps (34%).
18:31:33:WU00:FS00:0x15:Completed   8750000 out of 25000000 steps (35%).
18:35:26:WU00:FS00:0x15:Completed   9000000 out of 25000000 steps (36%).
18:39:15:WU00:FS00:0x15:Completed   9250000 out of 25000000 steps (37%).
18:43:06:WU00:FS00:0x15:Completed   9500000 out of 25000000 steps (38%).
18:46:56:WU00:FS00:0x15:Completed   9750000 out of 25000000 steps (39%).
18:50:45:WU00:FS00:0x15:Completed  10000000 out of 25000000 steps (40%).
18:54:34:WU00:FS00:0x15:Completed  10250000 out of 25000000 steps (41%).
18:58:22:WU00:FS00:0x15:Completed  10500000 out of 25000000 steps (42%).
19:02:14:WU00:FS00:0x15:Completed  10750000 out of 25000000 steps (43%).
19:06:04:WU00:FS00:0x15:Completed  11000000 out of 25000000 steps (44%).
19:09:54:WU00:FS00:0x15:Completed  11250000 out of 25000000 steps (45%).
19:13:44:WU00:FS00:0x15:Completed  11500000 out of 25000000 steps (46%).
Ripper36
Posts: 60
Joined: Sun Sep 18, 2011 8:55 am

Re: Gather data: GPU Projects with 20000+ atoms,

Post by Ripper36 »

Ditto for me -

the 803x units are still running at 99% with high PPD and frame rates as before... approx 21000 ppd
the 764x units are running at 84% with low PPD and frame rates identical with previous drivers.... approx 13000 ppd - that must be close to the limit of +- 30% !!!!!!!!!!!!!
803x units frame rates are identical between PCI-E 2 x16 and x8 machines - but 743x frame rates are significantly faster (7.30) on x16 bus width card than on on x8 bus width (8.30)
Last edited by Ripper36 on Fri Apr 13, 2012 7:39 am, edited 1 time in total.
Image
k1wi
Posts: 909
Joined: Tue Sep 22, 2009 10:48 pm

Re: Gather data: GPU Projects with 20000+ atoms,

Post by k1wi »

Ripper36 wrote:803x units frame rates are identical between PCI-E 2 x16 and x8 machines - but 743x frame rates are significantly faster (7.30) on x16 bus width card than on on x8 bus width (8.30)
This is interesting, thank you for experimenting with PCI-e bus width.

From what I read it suggests that PCI-e bandwidth is a factor with the TPF dropping by 1 minute when using a bus width of 16x? The drop is not linear (i.e. doubling bus width does not halve TPF). Can you provide additional information on these results? I think from looking at your previous posts you're running 570's?

I have two questions now - how powerful does a GPU have to be in order to saturate the PCI-e 2 16x connection and how does the speed of the PCI-e bus affect folding (i.e. is latency an issue along with bus/band width). Is it still possible to change PCI-e bus speed independent of the other components or are they all linked now?
7im
Posts: 10179
Joined: Thu Nov 29, 2007 4:30 pm
Hardware configuration: Intel i7-4770K @ 4.5 GHz, 16 GB DDR3-2133 Corsair Vengence (black/red), EVGA GTX 760 @ 1200 MHz, on an Asus Maximus VI Hero MB (black/red), in a blacked out Antec P280 Tower, with a Xigmatek Night Hawk (black) HSF, Seasonic 760w Platinum (black case, sleeves, wires), 4 SilenX 120mm Case fans with silicon fan gaskets and silicon mounts (all black), a 512GB Samsung SSD (black), and a 2TB Black Western Digital HD (silver/black).
Location: Arizona
Contact:

Re: Gather data: GPU Projects with 20000+ atoms,

Post by 7im »

Bus width would appear not to be the limiting factor, but WU size is on the new larger 8xxx WUs. The wu size seems to saturate the bus, not the powerfulness of the gpu.
How to provide enough information to get helpful support
Tell me and I forget. Teach me and I remember. Involve me and I learn.
Ripper36
Posts: 60
Joined: Sun Sep 18, 2011 8:55 am

Re: Gather data: GPU Projects with 20000+ atoms,

Post by Ripper36 »

Yes my stats all come from GTX570OC cards in windows 7 64bit machines with varied motherboards/CPUs

It is not the 803x WUs that are exhibiting the lower GPU utilisation and slower frametimes with slower PCI-E bus, but the 764x WUs.
Here’s a summary of the key parameters of the various PCI Express interfaces:
Base Clock Speed: PCIe 3.0 = 8.0GHz, PCIe 2.0= 5.0GHz, PCIe 1.1= 2.5GHz
Data Rate (per lane & per direction): PCIe 3.0 = 1000MB/s, PCIe 2.0= 500MB/s, PCIe 1.1= 250MB/s
Total Bandwidth (x16 link): PCIe 3.0 = 32GB/s, PCIe 2.0= 16GB/s, PCIe 1.1= 8GB/s
Data Transfer Rate: PCIe 3.0 = 8.0GT/s, PCIe 2.0= 5.0GT/s, PCIe 1.1= 2.5GT/s
http://www.trentontechnology.com/suppor ... s-3-pcie-2
Image
k1wi
Posts: 909
Joined: Tue Sep 22, 2009 10:48 pm

Re: Gather data: GPU Projects with 20000+ atoms,

Post by k1wi »

Interesting - at 21,443 it looks like the >10x increase in atoms over other GPU WUs is saturating the bus on high powered modern GPUs. Crazy to think the WUs are potentially pulling a peak throughput of more than 16GB/s or 5GT/s. Just as well PCIe3 is on the verge of coming out now!

It is apparent, from my understanding, that for the benchmark GPU (GTX460) the GPU does not saturate the bus to the same degree and any saturation for the GTX460 is accounted for in the PPD.

How did the GPU usage differ at x8 and x16?

P.s. by "additional information on these results" I mean the clock speed of your GPU, GPU usage loads, general folding 'environment' etc. :)
Ripper36
Posts: 60
Joined: Sun Sep 18, 2011 8:55 am

Re: Gather data: GPU Projects with 20000+ atoms,

Post by Ripper36 »

Hi Kiwi - am away from base at present but will reply on Monday.

BTW, I owe my participation and progress in folding to your assistance and incentives back last year at Box-Igami team! Thanks - I've come a long way!
Image
k1wi
Posts: 909
Joined: Tue Sep 22, 2009 10:48 pm

Re: Gather data: GPU Projects with 20000+ atoms,

Post by k1wi »

I knew your folding name looked familiar - great to see you're still participating :)

Also thanks for delving into the behaviour of these WUs.
Ripper36
Posts: 60
Joined: Sun Sep 18, 2011 8:55 am

Re: Gather data: GPU Projects with 20000+ atoms,

Post by Ripper36 »

OK. All four GTX570-OCs are using the latest drivers and all four instances are using FAHClient V7.1.52

Tolkein is an i5 2500k 8Gig DDR3 machine with an NVIDIA GTX570OC overclocked to 845/950/1690, running Windows 7 64bit. It hasa PCI-E 2.0 interface operating at x16. The CPU is folding SMP4

Folding 8031 projects it operates at 99% GPU load, tpf 2:25.

Folding 7644 it operates at 88% GPU load, tpf 7:12.

John PC is an i7 2600k 8 Gig DDR3 machine with two NVIDIA GTX570OC cards, SLI disabled, both overclocked to 845/950/1690 running Windows 7 64 bit. It has 2 PCI-E 2.0 slots both operating at x8 The CPU is folding SMP8

Folding 8031 projects both cards operate at 99% GPU load, tpf 2:25. (No difference to Tolkein's x16 bus)

Folding 764x both cards operate at 84% GPU load, tpf for GPU-1 8:05 on 7640, tpf 7:58 for GPU-2 on 7644.

Mediacentre is a Q9450 Core2Quad 4 Gig DDR2 machine with one NVIDIA GTX5700OC card clocked at 780/950/1560 running Windows 7 64 bit. It has PCI-E 1.1 interface operating at x16. The CPU is folding SMP4

Folding 8031 projects it operates at GPU load of 99% tpf 2:39

Folding 7644 projects it operates at GPU load 68% tpf 10:29

Conclusion

There is obviously a degredation of performance on 20000+ atom count projects, associated with PCI-E bus speed. However the relatively small difference (5%) between x16 PCI-E 2.0 and x8 PCI-E 2.0 suggests that there is more to the story.

Whatever the cause, the atom count appears the primary variable - the small atom count 803x projects all have 99% GPU utilisation, not impacted by the PCI-E bandwidth.
Image
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Gather data: GPU Projects with 20000+ atoms,

Post by bruce »

My guess: The "more to the story" depends on how the data is broken up into pieces and especially the relative amount of time needed to move the data and to process the data. I don't know the internals of how this is actually done . . . I'm basing my guesses on standard queuing theory and standard computer techniques.

A block of data takes a certain amount of time to be sent to the GPU. Once there, it takes a different amount of time to be processed. Once processed, it takes another amount of time to be returned to main RAM. Once back, some time is spent processing data with the CPU and data is prepared to be sent back to the GPU. Repeat until done.

Some of these steps can happen concurrently. SOme data of the previous block can be transferred while the GPU is still processing the current block. Apparently with the small proteins, data transfers happen while the GPU is computing, thus making the computational step the only limiting factor. With these big proteins, the GPU finishes the processing step while a data block is still being transferred so the GPU has to wait. Part of the time data transfer will still be overlapped with processing and part of the time it will become the limiting factor with the GPU waiting on data to arrive or on data to be sent. Altering the speed of the bus or the speed of the GPU or the size of the WU may each influence the total time to process the WU, depending on how much of the total time is spent waiting for an adjacent step to complete.

Going back to the small WU case, (almost) all data transfers are overlapped with computing, so the only limiting factor is the number and speed of the shaders and the GPU stays at ~100%. With the current WUs, data transfer is a limiting factor at least part of the time and GPU computations seems to be a limiting factor at other times. Without more detailed information, I don't know how to figure out what the tests you've done tell us about times of overlap compared to times waiting on adjacent steps. The total time will not vary linearly with any one step, however except in the case where all but one step can be overlapped with the others.
Post Reply