GTX 1070 keeps failing

It seems that a lot of GPU problems revolve around specific versions of drivers. Though NVidia has their own support structure, you can often learn from information reported by others who fold.

Moderators: Site Moderators, FAHC Science Team

Post Reply
tstraw48
Posts: 2
Joined: Fri Dec 23, 2016 3:45 am
Hardware configuration: i5-6600K @ 3.5GHz, 16GB Ram, MSI GTX 1070
Location: Toronto, ON

GTX 1070 keeps failing

Post by tstraw48 »

Hi all,

I really want to be able to leave my PC to fold while I'm sleeping/at work but I keep coming home to find the CPU is still chugging along but the GPU (MSI GTX 1070) has failed. Can you please help?

Code: Select all

*********************** Log Started 2016-12-22T23:33:16Z ***********************
23:33:16:******************************** Build ********************************
23:33:16:      Version: 7.4.4
23:33:16:         Date: Mar 4 2014
23:33:16:         Time: 20:26:54
23:33:16:      SVN Rev: 4130
23:33:16:       Branch: fah/trunk/client
23:33:16:     Compiler: Intel(R) C++ MSVC 1500 mode 1200
23:33:16:      Options: /TP /nologo /EHa /Qdiag-disable:4297,4103,1786,279 /Ox -arch:SSE
23:33:16:               /QaxSSE2,SSE3,SSSE3,SSE4.1,SSE4.2 /Qopenmp /Qrestrict /MT /Qmkl
23:33:16:     Platform: win32 XP
23:33:16:         Bits: 32
23:33:16:         Mode: Release
23:33:16:******************************* System ********************************
23:33:16:          CPU: Intel(R) Core(TM) i5-6600K CPU @ 3.50GHz
23:33:16:       CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
23:33:16:         CPUs: 4
23:33:16:       Memory: 15.94GiB
23:33:16:  Free Memory: 13.47GiB
23:33:16:      Threads: WINDOWS_THREADS
23:33:16:   OS Version: 6.2
23:33:16:  Has Battery: false
23:33:16:   On Battery: false
23:33:16:   UTC Offset: -5
23:33:16:          PID: 3104
23:33:16:          CWD: C:/Users/tstrawbridge/AppData/Roaming/FAHClient
23:33:16:           OS: Windows 10 Home
23:33:16:      OS Arch: AMD64
23:33:16:         GPUs: 1
23:33:16:        GPU 0: UNSUPPORTED: NV3 [PCI]
23:33:16:         CUDA: 6.1
23:33:16:  CUDA Driver: 8000
23:33:16:Win32 Service: false
23:33:16:***********************************************************************
23:33:16:<config>
23:33:16:  <!-- Folding Slots -->
23:33:16:</config>
23:33:16:Connecting to assign-GPU.stanford.edu:80
23:33:16:Updated GPUs.txt
23:33:16:Read GPUs.txt
23:33:16:Trying to access database...
23:33:16:Successfully acquired database lock
23:33:16:Enabled folding slot 00: PAUSED cpu:2 (not configured)
23:33:16:Enabled folding slot 01: PAUSED gpu:1:GP104 [GeForce GTX 1070] (not configured)
23:33:20:16:127.0.0.1:New Web connection
23:34:02:Set client configured
23:34:04:WU00:FS00:Connecting to 171.67.108.45:8080
23:34:04:WU01:FS01:Connecting to 171.67.108.45:8080
23:34:05:WU00:FS00:Connecting to 171.67.108.45:8080
23:34:06:WU01:FS01:Connecting to 171.67.108.45:80
23:34:07:WU00:FS00:Assigned to work server 171.67.108.158
23:34:07:WU00:FS00:Requesting new work unit for slot 00: READY cpu:2 from 171.67.108.158
23:34:07:WU00:FS00:Connecting to 171.67.108.158:8080
23:34:07:WU01:FS01:Assigned to work server 140.163.4.245
23:34:07:WU01:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] from 140.163.4.245
23:34:07:WU01:FS01:Connecting to 140.163.4.245:8080
23:34:08:WU01:FS01:Downloading 5.51MiB
23:34:08:WU00:FS00:Downloading 806.40KiB
23:34:08:WU00:FS00:Download complete
23:34:09:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:9039 run:894 clone:0 gen:559 core:0xa4 unit:0x0000026eab436c9e56982744ccda6f1a
23:34:09:WU00:FS00:Downloading core from http://web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah
23:34:09:WU00:FS00:Connecting to web.stanford.edu:80
23:34:09:WU00:FS00:FahCore a4: Downloading 2.89MiB
23:34:09:WU01:FS01:Download complete
23:34:09:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:10495 run:32 clone:42 gen:0 core:0x21 unit:0x000000028ca304f556ba65196cee4457
23:34:09:WU01:FS01:Downloading core from http://web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah
23:34:09:WU01:FS01:Connecting to web.stanford.edu:80
23:34:10:WU01:FS01:FahCore 21: Downloading 3.47MiB
23:34:14:WU00:FS00:FahCore a4: Download complete
23:34:14:WU00:FS00:Valid core signature
23:34:14:WU00:FS00:Unpacked 9.59MiB to cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe
23:34:14:WU00:FS00:Starting
23:34:14:WARNING:WU00:FS00:Changed SMP threads from 2 to 3 this can cause some work units to fail
23:34:14:WU00:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/tstrawbridge/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 00 -suffix 01 -version 704 -lifeline 3104 -checkpoint 15 -np 3
23:34:14:WU00:FS00:Started FahCore on PID 10196
23:34:14:WU00:FS00:Core PID:10220
23:34:14:WU00:FS00:FahCore 0xa4 started
23:34:15:WU00:FS00:0xa4:
23:34:15:WU00:FS00:0xa4:*------------------------------*
23:34:15:WU00:FS00:0xa4:Folding@Home Gromacs GB Core
23:34:15:WU00:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
23:34:15:WU00:FS00:0xa4:
23:34:15:WU00:FS00:0xa4:Preparing to commence simulation
23:34:15:WU00:FS00:0xa4:- Looking at optimizations...
23:34:15:WU00:FS00:0xa4:- Created dyn
23:34:15:WU00:FS00:0xa4:- Files status OK
23:34:15:WU00:FS00:0xa4:- Expanded 825240 -> 1398040 (decompressed 169.4 percent)
23:34:15:WU00:FS00:0xa4:Called DecompressByteArray: compressed_data_size=825240 data_size=1398040, decompressed_data_size=1398040 diff=0
23:34:15:WU00:FS00:0xa4:- Digital signature verified
23:34:15:WU00:FS00:0xa4:
23:34:15:WU00:FS00:0xa4:Project: 9039 (Run 894, Clone 0, Gen 559)
23:34:15:WU00:FS00:0xa4:
23:34:15:WU00:FS00:0xa4:Assembly optimizations on if available.
23:34:15:WU00:FS00:0xa4:Entering M.D.
23:34:15:WU01:FS01:FahCore 21: Download complete
23:34:15:WU01:FS01:Valid core signature
23:34:15:WU01:FS01:Unpacked 11.81MiB to cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe
23:34:16:WU01:FS01:Starting
23:34:16:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/tstrawbridge/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 3104 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
23:34:16:WU01:FS01:Started FahCore on PID 6268
23:34:16:WU01:FS01:Core PID:5736
23:34:16:WU01:FS01:FahCore 0x21 started
00:00:40:WU02:FS01:0x18:Completed 480000 out of 2000000 steps (24%)
00:00:59:WU02:FS01:0x18:Completed 500000 out of 2000000 steps (25%)
00:01:20:WU02:FS01:0x18:Completed 520000 out of 2000000 steps (26%)
00:01:39:WU02:FS01:0x18:Completed 540000 out of 2000000 steps (27%)
00:01:59:WU02:FS01:0x18:Completed 560000 out of 2000000 steps (28%)
00:02:18:WU02:FS01:0x18:Completed 580000 out of 2000000 steps (29%)
00:02:30:WU00:FS00:0xa4:Completed 35000 out of 250000 steps  (14%)
00:02:37:WU02:FS01:0x18:Completed 600000 out of 2000000 steps (30%)
00:02:58:WU02:FS01:0x18:Completed 620000 out of 2000000 steps (31%)
00:03:17:WU02:FS01:0x18:Completed 640000 out of 2000000 steps (32%)
00:03:37:WU02:FS01:0x18:Completed 660000 out of 2000000 steps (33%)
00:03:56:WU02:FS01:0x18:Completed 680000 out of 2000000 steps (34%)
00:04:15:WU02:FS01:0x18:Completed 700000 out of 2000000 steps (35%)
00:04:31:WU00:FS00:0xa4:Completed 37500 out of 250000 steps  (15%)
00:04:37:WU02:FS01:0x18:Completed 720000 out of 2000000 steps (36%)
00:04:56:WU02:FS01:0x18:Completed 740000 out of 2000000 steps (37%)
00:05:15:WU02:FS01:0x18:Completed 760000 out of 2000000 steps (38%)
00:05:34:WU02:FS01:0x18:Completed 780000 out of 2000000 steps (39%)
00:05:53:WU02:FS01:0x18:Completed 800000 out of 2000000 steps (40%)
00:06:15:WU02:FS01:0x18:Completed 820000 out of 2000000 steps (41%)
00:06:30:WU00:FS00:0xa4:Completed 40000 out of 250000 steps  (16%)
00:06:34:WU02:FS01:0x18:Completed 840000 out of 2000000 steps (42%)
00:06:53:WU02:FS01:0x18:Completed 860000 out of 2000000 steps (43%)
00:07:12:WU02:FS01:0x18:Completed 880000 out of 2000000 steps (44%)
00:07:32:WU02:FS01:0x18:Completed 900000 out of 2000000 steps (45%)
00:07:53:WU02:FS01:0x18:Completed 920000 out of 2000000 steps (46%)
00:08:15:WU02:FS01:0x18:Completed 940000 out of 2000000 steps (47%)
00:08:27:WU00:FS00:0xa4:Completed 42500 out of 250000 steps  (17%)
00:08:37:WU02:FS01:0x18:Completed 960000 out of 2000000 steps (48%)
00:08:59:WU02:FS01:0x18:Completed 980000 out of 2000000 steps (49%)
00:09:21:WU02:FS01:0x18:Completed 1000000 out of 2000000 steps (50%)
00:09:46:WU02:FS01:0x18:Completed 1020000 out of 2000000 steps (51%)
00:10:08:WU02:FS01:0x18:Completed 1040000 out of 2000000 steps (52%)
00:10:20:WU00:FS00:0xa4:Completed 45000 out of 250000 steps  (18%)
00:10:30:WU02:FS01:0x18:Completed 1060000 out of 2000000 steps (53%)
00:10:53:WU02:FS01:0x18:Completed 1080000 out of 2000000 steps (54%)
00:11:15:WU02:FS01:0x18:Completed 1100000 out of 2000000 steps (55%)
00:11:39:WU02:FS01:0x18:Completed 1120000 out of 2000000 steps (56%)
00:12:02:WU02:FS01:0x18:Completed 1140000 out of 2000000 steps (57%)
00:12:16:WU00:FS00:0xa4:Completed 47500 out of 250000 steps  (19%)
00:12:24:WU02:FS01:0x18:Completed 1160000 out of 2000000 steps (58%)
00:12:46:WU02:FS01:0x18:Completed 1180000 out of 2000000 steps (59%)
00:13:08:WU02:FS01:0x18:Completed 1200000 out of 2000000 steps (60%)
00:13:33:WU02:FS01:0x18:Completed 1220000 out of 2000000 steps (61%)
00:13:55:WU02:FS01:0x18:Completed 1240000 out of 2000000 steps (62%)
00:14:17:WU02:FS01:0x18:Completed 1260000 out of 2000000 steps (63%)
00:14:17:WU00:FS00:0xa4:Completed 50000 out of 250000 steps  (20%)
00:14:40:WU02:FS01:0x18:Completed 1280000 out of 2000000 steps (64%)
00:15:02:WU02:FS01:0x18:Completed 1300000 out of 2000000 steps (65%)
00:15:26:WU02:FS01:0x18:Completed 1320000 out of 2000000 steps (66%)
00:15:48:WU02:FS01:0x18:Completed 1340000 out of 2000000 steps (67%)
00:16:11:WU02:FS01:0x18:Completed 1360000 out of 2000000 steps (68%)
00:16:11:WU00:FS00:0xa4:Completed 52500 out of 250000 steps  (21%)
00:16:33:WU02:FS01:0x18:Completed 1380000 out of 2000000 steps (69%)
00:16:55:WU02:FS01:0x18:Completed 1400000 out of 2000000 steps (70%)
00:17:19:WU02:FS01:0x18:Completed 1420000 out of 2000000 steps (71%)
00:17:42:WU02:FS01:0x18:Completed 1440000 out of 2000000 steps (72%)
00:18:03:WU00:FS00:0xa4:Completed 55000 out of 250000 steps  (22%)
00:18:04:WU02:FS01:0x18:Completed 1460000 out of 2000000 steps (73%)
00:18:26:WU02:FS01:0x18:Completed 1480000 out of 2000000 steps (74%)
00:18:48:WU02:FS01:0x18:Completed 1500000 out of 2000000 steps (75%)
00:19:13:WU02:FS01:0x18:Completed 1520000 out of 2000000 steps (76%)
00:19:35:WU02:FS01:0x18:Completed 1540000 out of 2000000 steps (77%)
00:19:55:WU00:FS00:0xa4:Completed 57500 out of 250000 steps  (23%)
00:19:57:WU02:FS01:0x18:Completed 1560000 out of 2000000 steps (78%)
00:20:19:WU02:FS01:0x18:Completed 1580000 out of 2000000 steps (79%)
00:20:42:WU02:FS01:0x18:Completed 1600000 out of 2000000 steps (80%)
00:21:06:WU02:FS01:0x18:Completed 1620000 out of 2000000 steps (81%)
00:21:28:WU02:FS01:0x18:Completed 1640000 out of 2000000 steps (82%)
00:21:48:WU00:FS00:0xa4:Completed 60000 out of 250000 steps  (24%)
00:21:50:WU02:FS01:0x18:Completed 1660000 out of 2000000 steps (83%)
00:22:13:WU02:FS01:0x18:Completed 1680000 out of 2000000 steps (84%)
00:22:35:WU02:FS01:0x18:Completed 1700000 out of 2000000 steps (85%)
00:22:59:WU02:FS01:0x18:Completed 1720000 out of 2000000 steps (86%)
00:23:22:WU02:FS01:0x18:Completed 1740000 out of 2000000 steps (87%)
00:23:41:WU00:FS00:0xa4:Completed 62500 out of 250000 steps  (25%)
00:23:44:WU02:FS01:0x18:Completed 1760000 out of 2000000 steps (88%)
00:24:06:WU02:FS01:0x18:Completed 1780000 out of 2000000 steps (89%)
00:24:28:WU02:FS01:0x18:Completed 1800000 out of 2000000 steps (90%)
00:24:53:WU02:FS01:0x18:Completed 1820000 out of 2000000 steps (91%)
00:25:15:WU02:FS01:0x18:Completed 1840000 out of 2000000 steps (92%)
00:25:34:WU00:FS00:0xa4:Completed 65000 out of 250000 steps  (26%)
00:25:37:WU02:FS01:0x18:Completed 1860000 out of 2000000 steps (93%)
00:25:59:WU02:FS01:0x18:Completed 1880000 out of 2000000 steps (94%)
00:26:22:WU02:FS01:0x18:Completed 1900000 out of 2000000 steps (95%)
00:26:46:WU02:FS01:0x18:Completed 1920000 out of 2000000 steps (96%)
00:27:08:WU02:FS01:0x18:Completed 1940000 out of 2000000 steps (97%)
00:27:26:WU00:FS00:0xa4:Completed 67500 out of 250000 steps  (27%)
00:27:31:WU02:FS01:0x18:Completed 1960000 out of 2000000 steps (98%)
00:27:53:WU02:FS01:0x18:Completed 1980000 out of 2000000 steps (99%)
00:28:15:WU02:FS01:0x18:Completed 2000000 out of 2000000 steps (100%)
00:28:16:WU01:FS01:Connecting to 171.67.108.45:80
00:28:16:WU01:FS01:Assigned to work server 171.64.65.92
00:28:16:WU01:FS01:Requesting new work unit for slot 01: RUNNING gpu:1:GP104 [GeForce GTX 1070] from 171.64.65.92
00:28:16:WU01:FS01:Connecting to 171.64.65.92:8080
00:28:17:WU01:FS01:Downloading 2.52MiB
00:28:18:WU02:FS01:0x18:Saving result file logfile_01.txt
00:28:18:WU02:FS01:0x18:Saving result file checkpointState.xml
00:28:18:WU02:FS01:0x18:Saving result file checkpt.crc
00:28:18:WU02:FS01:0x18:Saving result file log.txt
00:28:18:WU02:FS01:0x18:Saving result file positions.xtc
00:28:18:WU02:FS01:0x18:Folding@home Core Shutdown: FINISHED_UNIT
00:28:18:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
00:28:18:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:9659 run:1 clone:26 gen:67 core:0x18 unit:0x00000048ab436c9b56de69ba63d19b24
00:28:18:WU02:FS01:Uploading 1.73MiB to 171.67.108.155
00:28:18:WU02:FS01:Connecting to 171.67.108.155:8080
00:28:21:WU01:FS01:Download complete
00:28:21:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9195 run:0 clone:4 gen:215 core:0x21 unit:0x00000139ab40415c57cb2e9fbe1ddf6d
00:28:21:WU01:FS01:Starting
00:28:21:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/tstrawbridge/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 3104 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
00:28:21:WU01:FS01:Started FahCore on PID 964
00:28:21:WU01:FS01:Core PID:6152
00:28:21:WU01:FS01:FahCore 0x21 started
00:28:21:WU01:FS01:0x21:*********************** Log Started 2016-12-23T00:28:21Z ***********************
00:28:21:WU01:FS01:0x21:Project: 9195 (Run 0, Clone 4, Gen 215)
00:28:21:WU01:FS01:0x21:Unit: 0x00000139ab40415c57cb2e9fbe1ddf6d
00:28:21:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
00:28:21:WU01:FS01:0x21:Machine: 1
00:28:21:WU01:FS01:0x21:Reading tar file core.xml
00:28:21:WU01:FS01:0x21:Reading tar file system.xml
00:28:21:WU01:FS01:0x21:Reading tar file integrator.xml
00:28:21:WU01:FS01:0x21:Reading tar file state.xml
00:28:22:WU01:FS01:0x21:Digital signatures verified
00:28:22:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
00:28:22:WU01:FS01:0x21:Version 0.0.17
00:28:23:WU02:FS01:Upload complete
00:28:23:WU02:FS01:Server responded WORK_ACK (400)
00:28:23:WU02:FS01:Final credit estimate, 12225.00 points
00:28:23:WU02:FS01:Cleaning up
00:28:25:WU01:FS01:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-5)
00:28:25:WU01:FS01:0x21:Saving result file logfile_01.txt
00:28:25:WU01:FS01:0x21:Saving result file log.txt
00:28:25:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
00:28:28:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:28:28:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9195 run:0 clone:4 gen:215 core:0x21 unit:0x00000139ab40415c57cb2e9fbe1ddf6d
00:28:28:WU01:FS01:Uploading 2.39KiB to 171.64.65.92
00:28:28:WU01:FS01:Connecting to 171.64.65.92:8080
00:28:28:WU01:FS01:Upload complete
00:28:28:WU01:FS01:Server responded WORK_ACK (400)
00:28:28:WU01:FS01:Cleaning up
00:28:28:WU02:FS01:Connecting to 171.67.108.45:80
00:28:29:WU02:FS01:Assigned to work server 171.64.65.84
00:28:29:WU02:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] from 171.64.65.84
00:28:29:WU02:FS01:Connecting to 171.64.65.84:8080
00:28:29:WU02:FS01:Downloading 2.52MiB
00:28:33:WU02:FS01:Download complete
00:28:33:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9188 run:1 clone:49 gen:165 core:0x21 unit:0x0000010aab40415457cb2b5ab51e480e
00:28:33:WU02:FS01:Starting
00:28:33:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/tstrawbridge/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 3104 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
00:28:33:WU02:FS01:Started FahCore on PID 2852
00:28:33:WU02:FS01:Core PID:7336
00:28:33:WU02:FS01:FahCore 0x21 started
00:28:34:WU02:FS01:0x21:*********************** Log Started 2016-12-23T00:28:33Z ***********************
00:28:34:WU02:FS01:0x21:Project: 9188 (Run 1, Clone 49, Gen 165)
00:28:34:WU02:FS01:0x21:Unit: 0x0000010aab40415457cb2b5ab51e480e
00:28:34:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
00:28:34:WU02:FS01:0x21:Machine: 1
00:28:34:WU02:FS01:0x21:Reading tar file core.xml
00:28:34:WU02:FS01:0x21:Reading tar file system.xml
00:28:34:WU02:FS01:0x21:Reading tar file integrator.xml
00:28:34:WU02:FS01:0x21:Reading tar file state.xml
00:28:34:WU02:FS01:0x21:Digital signatures verified
00:28:34:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
00:28:34:WU02:FS01:0x21:Version 0.0.17
00:28:39:WU02:FS01:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-5)
00:28:39:WU02:FS01:0x21:Saving result file logfile_01.txt
00:28:39:WU02:FS01:0x21:Saving result file log.txt
00:28:39:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
00:28:41:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:28:41:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9188 run:1 clone:49 gen:165 core:0x21 unit:0x0000010aab40415457cb2b5ab51e480e
00:28:41:WU02:FS01:Uploading 2.41KiB to 171.64.65.84
00:28:41:WU02:FS01:Connecting to 171.64.65.84:8080
00:28:41:WU01:FS01:Connecting to 171.67.108.45:80
00:28:41:WU02:FS01:Upload complete
00:28:41:WU02:FS01:Server responded WORK_ACK (400)
00:28:41:WU02:FS01:Cleaning up
00:28:42:WU01:FS01:Assigned to work server 140.163.4.242
00:28:42:WU01:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] from 140.163.4.242
00:28:42:WU01:FS01:Connecting to 140.163.4.242:8080
00:28:42:WU01:FS01:Downloading 5.32MiB
00:28:45:WU01:FS01:Download complete
00:28:45:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:11406 run:4 clone:45 gen:268 core:0x21 unit:0x000001638ca304f25686b1db75f608d8
00:28:45:WU01:FS01:Starting
00:28:45:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/tstrawbridge/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 3104 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
00:28:45:WU01:FS01:Started FahCore on PID 1104
00:28:45:WU01:FS01:Core PID:1068
00:28:45:WU01:FS01:FahCore 0x21 started
00:28:45:WU01:FS01:0x21:*********************** Log Started 2016-12-23T00:28:45Z ***********************
00:28:45:WU01:FS01:0x21:Project: 11406 (Run 4, Clone 45, Gen 268)
00:28:45:WU01:FS01:0x21:Unit: 0x000001638ca304f25686b1db75f608d8
00:28:45:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
00:28:45:WU01:FS01:0x21:Machine: 1
00:28:45:WU01:FS01:0x21:Reading tar file core.xml
00:28:45:WU01:FS01:0x21:Reading tar file system.xml
00:28:46:WU01:FS01:0x21:Reading tar file integrator.xml
00:28:46:WU01:FS01:0x21:Reading tar file state.xml
00:28:47:WU01:FS01:0x21:Digital signatures verified
00:28:47:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
00:28:47:WU01:FS01:0x21:Version 0.0.17
00:28:53:WU01:FS01:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-5)
00:28:53:WU01:FS01:0x21:Saving result file logfile_01.txt
00:28:53:WU01:FS01:0x21:Saving result file log.txt
00:28:53:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
00:28:55:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:28:55:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:11406 run:4 clone:45 gen:268 core:0x21 unit:0x000001638ca304f25686b1db75f608d8
00:28:55:WU01:FS01:Uploading 2.41KiB to 140.163.4.242
00:28:55:WU01:FS01:Connecting to 140.163.4.242:8080
00:28:56:WU02:FS01:Connecting to 171.67.108.45:80
00:28:56:WU01:FS01:Upload complete
00:28:56:WU01:FS01:Server responded WORK_ACK (400)
00:28:56:WU01:FS01:Cleaning up
00:28:56:WU02:FS01:Assigned to work server 171.67.108.159
00:28:56:WU02:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] from 171.67.108.159
00:28:56:WU02:FS01:Connecting to 171.67.108.159:8080
00:28:57:WU02:FS01:Downloading 22.24MiB
00:29:00:WU02:FS01:Download complete
00:29:00:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:9181 run:21 clone:3 gen:159 core:0x21 unit:0x000000f9ab436c9f57bdce063cff822a
00:29:00:WU02:FS01:Starting
00:29:00:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/tstrawbridge/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 3104 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
00:29:00:WU02:FS01:Started FahCore on PID 3248
00:29:00:WU02:FS01:Core PID:9912
00:29:00:WU02:FS01:FahCore 0x21 started
00:29:01:WU02:FS01:0x21:*********************** Log Started 2016-12-23T00:29:00Z ***********************
00:29:01:WU02:FS01:0x21:Project: 9181 (Run 21, Clone 3, Gen 159)
00:29:01:WU02:FS01:0x21:Unit: 0x000000f9ab436c9f57bdce063cff822a
00:29:01:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
00:29:01:WU02:FS01:0x21:Machine: 1
00:29:01:WU02:FS01:0x21:Reading tar file core.xml
00:29:01:WU02:FS01:0x21:Reading tar file integrator.xml
00:29:01:WU02:FS01:0x21:Reading tar file state.xml
00:29:01:WU02:FS01:0x21:Reading tar file system.xml
00:29:01:WU02:FS01:0x21:Digital signatures verified
00:29:01:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
00:29:01:WU02:FS01:0x21:Version 0.0.17
00:29:06:WU02:FS01:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-5)
00:29:06:WU02:FS01:0x21:Saving result file logfile_01.txt
00:29:06:WU02:FS01:0x21:Saving result file log.txt
00:29:06:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
00:29:09:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:29:09:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:9181 run:21 clone:3 gen:159 core:0x21 unit:0x000000f9ab436c9f57bdce063cff822a
00:29:09:WU02:FS01:Uploading 7.00KiB to 171.67.108.159
00:29:09:WU02:FS01:Connecting to 171.67.108.159:8080
00:29:09:WU02:FS01:Upload complete
00:29:09:WU02:FS01:Server responded WORK_ACK (400)
00:29:09:WU02:FS01:Cleaning up
00:29:09:WU01:FS01:Connecting to 171.67.108.45:80
00:29:10:WU01:FS01:Assigned to work server 171.64.65.92
00:29:10:WU01:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] from 171.64.65.92
00:29:10:WU01:FS01:Connecting to 171.64.65.92:8080
00:29:10:WU01:FS01:Downloading 3.16MiB
00:29:16:WU01:FS01:Download 95.01%
00:29:16:WU01:FS01:Download complete
00:29:16:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9197 run:0 clone:60 gen:120 core:0x21 unit:0x000000bdab40415c57cb3f8dfedca50c
00:29:16:WU01:FS01:Starting
00:29:16:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/tstrawbridge/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 3104 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
00:29:16:WU01:FS01:Started FahCore on PID 10064
00:29:16:WU01:FS01:Core PID:3324
00:29:16:WU01:FS01:FahCore 0x21 started
00:29:16:WU01:FS01:0x21:*********************** Log Started 2016-12-23T00:29:16Z ***********************
00:29:16:WU01:FS01:0x21:Project: 9197 (Run 0, Clone 60, Gen 120)
00:29:16:WU01:FS01:0x21:Unit: 0x000000bdab40415c57cb3f8dfedca50c
00:29:16:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
00:29:16:WU01:FS01:0x21:Machine: 1
00:29:16:WU01:FS01:0x21:Reading tar file core.xml
00:29:16:WU01:FS01:0x21:Reading tar file system.xml
00:29:16:WU01:FS01:0x21:Reading tar file integrator.xml
00:29:16:WU01:FS01:0x21:Reading tar file state.xml
00:29:17:WU01:FS01:0x21:Digital signatures verified
00:29:17:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
00:29:17:WU01:FS01:0x21:Version 0.0.17
00:29:18:WU00:FS00:0xa4:Completed 70000 out of 250000 steps  (28%)
00:29:22:WU01:FS01:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-5)
00:29:22:WU01:FS01:0x21:Saving result file logfile_01.txt
00:29:22:WU01:FS01:0x21:Saving result file log.txt
00:29:22:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
00:29:26:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:29:26:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9197 run:0 clone:60 gen:120 core:0x21 unit:0x000000bdab40415c57cb3f8dfedca50c
00:29:26:WU01:FS01:Uploading 2.40KiB to 171.64.65.92
00:29:26:WU01:FS01:Connecting to 171.64.65.92:8080
00:29:27:WU01:FS01:Upload complete
00:29:27:WU01:FS01:Server responded WORK_ACK (400)
00:29:27:WU01:FS01:Cleaning up
00:29:27:WU02:FS01:Connecting to 171.67.108.45:80
00:29:27:WU02:FS01:Assigned to work server 140.163.4.242
00:29:27:WU02:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] from 140.163.4.242
00:29:27:WU02:FS01:Connecting to 140.163.4.242:8080
00:29:27:WU02:FS01:Downloading 5.31MiB
00:29:31:WU02:FS01:Download complete
00:29:31:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:11406 run:8 clone:13 gen:71 core:0x21 unit:0x000000678ca304f25686b20a4dc655a8
00:29:31:WU02:FS01:Starting
00:29:31:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/tstrawbridge/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 3104 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
00:29:31:WU02:FS01:Started FahCore on PID 5320
00:29:31:WU02:FS01:Core PID:9816
00:29:31:WU02:FS01:FahCore 0x21 started
00:29:32:WU02:FS01:0x21:*********************** Log Started 2016-12-23T00:29:31Z ***********************
00:29:32:WU02:FS01:0x21:Project: 11406 (Run 8, Clone 13, Gen 71)
00:29:32:WU02:FS01:0x21:Unit: 0x000000678ca304f25686b20a4dc655a8
00:29:32:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
00:29:32:WU02:FS01:0x21:Machine: 1
00:29:32:WU02:FS01:0x21:Reading tar file core.xml
00:29:32:WU02:FS01:0x21:Reading tar file system.xml
00:29:32:WU02:FS01:0x21:Reading tar file integrator.xml
00:29:32:WU02:FS01:0x21:Reading tar file state.xml
00:29:33:WU02:FS01:0x21:Digital signatures verified
00:29:33:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
00:29:33:WU02:FS01:0x21:Version 0.0.17
00:29:39:WU02:FS01:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-5)
00:29:39:WU02:FS01:0x21:Saving result file logfile_01.txt
00:29:39:WU02:FS01:0x21:Saving result file log.txt
00:29:39:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
00:29:42:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:29:42:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:11406 run:8 clone:13 gen:71 core:0x21 unit:0x000000678ca304f25686b20a4dc655a8
00:29:42:WU02:FS01:Uploading 2.39KiB to 140.163.4.242
00:29:42:WU02:FS01:Connecting to 140.163.4.242:8080
00:29:42:WU02:FS01:Upload complete
00:29:42:WU02:FS01:Server responded WORK_ACK (400)
00:29:42:WU02:FS01:Cleaning up
00:29:42:WU01:FS01:Connecting to 171.67.108.45:80
00:29:43:WU01:FS01:Assigned to work server 140.163.4.245
00:29:43:WU01:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] from 140.163.4.245
00:29:43:WU01:FS01:Connecting to 140.163.4.245:8080
00:29:43:WU01:FS01:Downloading 5.51MiB
00:29:45:WU01:FS01:Download complete
00:29:46:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:10495 run:32 clone:79 gen:0 core:0x21 unit:0x000000008ca304f556ba6525399c30a5
00:29:46:WU01:FS01:Starting
00:29:46:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/tstrawbridge/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 3104 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
00:29:46:WU01:FS01:Started FahCore on PID 332
00:29:46:WU01:FS01:Core PID:1764
00:29:46:WU01:FS01:FahCore 0x21 started
00:29:46:WU01:FS01:0x21:*********************** Log Started 2016-12-23T00:29:46Z ***********************
00:29:46:WU01:FS01:0x21:Project: 10495 (Run 32, Clone 79, Gen 0)
00:29:46:WU01:FS01:0x21:Unit: 0x000000008ca304f556ba6525399c30a5
00:29:46:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
00:29:46:WU01:FS01:0x21:Machine: 1
00:29:46:WU01:FS01:0x21:Reading tar file core.xml
00:29:46:WU01:FS01:0x21:Reading tar file system.xml
00:29:46:WU01:FS01:0x21:Reading tar file integrator.xml
00:29:46:WU01:FS01:0x21:Reading tar file state.xml
00:29:47:WU01:FS01:0x21:Digital signatures verified
00:29:47:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
00:29:47:WU01:FS01:0x21:Version 0.0.17
00:29:53:WU01:FS01:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-5)
00:29:53:WU01:FS01:0x21:Saving result file logfile_01.txt
00:29:53:WU01:FS01:0x21:Saving result file log.txt
00:29:53:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
00:29:55:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:29:55:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:10495 run:32 clone:79 gen:0 core:0x21 unit:0x000000008ca304f556ba6525399c30a5
00:29:55:WU01:FS01:Uploading 2.35KiB to 140.163.4.245
00:29:55:WU01:FS01:Connecting to 140.163.4.245:8080
00:29:56:WU01:FS01:Upload complete
00:29:56:WU01:FS01:Server responded WORK_ACK (400)
00:29:56:WU01:FS01:Cleaning up
00:29:56:WU02:FS01:Connecting to 171.67.108.45:80
00:29:56:WU02:FS01:Assigned to work server 140.163.4.242
00:29:56:WU02:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] from 140.163.4.242
00:29:56:WU02:FS01:Connecting to 140.163.4.242:8080
00:29:57:WU02:FS01:Downloading 5.31MiB
00:29:59:WU02:FS01:Download complete
00:29:59:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:11406 run:2 clone:40 gen:272 core:0x21 unit:0x000001768ca304f25686b1bcd1d90075
00:29:59:WU02:FS01:Starting
00:29:59:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/tstrawbridge/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 3104 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
00:29:59:WU02:FS01:Started FahCore on PID 8624
00:29:59:WU02:FS01:Core PID:3768
00:29:59:WU02:FS01:FahCore 0x21 started
00:29:59:WU02:FS01:0x21:*********************** Log Started 2016-12-23T00:29:59Z ***********************
00:29:59:WU02:FS01:0x21:Project: 11406 (Run 2, Clone 40, Gen 272)
00:29:59:WU02:FS01:0x21:Unit: 0x000001768ca304f25686b1bcd1d90075
00:29:59:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
00:29:59:WU02:FS01:0x21:Machine: 1
00:29:59:WU02:FS01:0x21:Reading tar file core.xml
00:29:59:WU02:FS01:0x21:Reading tar file system.xml
00:30:00:WU02:FS01:0x21:Reading tar file integrator.xml
00:30:00:WU02:FS01:0x21:Reading tar file state.xml
00:30:01:WU02:FS01:0x21:Digital signatures verified
00:30:01:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
00:30:01:WU02:FS01:0x21:Version 0.0.17
00:30:06:WU02:FS01:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-5)
00:30:06:WU02:FS01:0x21:Saving result file logfile_01.txt
00:30:06:WU02:FS01:0x21:Saving result file log.txt
00:30:06:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
00:30:09:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:30:09:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:11406 run:2 clone:40 gen:272 core:0x21 unit:0x000001768ca304f25686b1bcd1d90075
00:30:09:WU02:FS01:Uploading 2.39KiB to 140.163.4.242
00:30:09:WU02:FS01:Connecting to 140.163.4.242:8080
00:30:09:WU02:FS01:Upload complete
00:30:09:WU02:FS01:Server responded WORK_ACK (400)
00:30:10:WU02:FS01:Cleaning up
00:30:10:WU01:FS01:Connecting to 171.67.108.45:80
00:30:10:WU01:FS01:Assigned to work server 171.64.65.92
00:30:10:WU01:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] from 171.64.65.92
00:30:10:WU01:FS01:Connecting to 171.64.65.92:8080
00:30:11:WU01:FS01:Downloading 2.79MiB
00:30:14:WU01:FS01:Download complete
00:30:14:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9197 run:2 clone:5 gen:125 core:0x21 unit:0x000000c4ab40415c57cb3fcdf61f14fc
00:30:14:WU01:FS01:Starting
00:30:14:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/tstrawbridge/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 3104 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
00:30:14:WU01:FS01:Started FahCore on PID 5052
00:30:14:WU01:FS01:Core PID:9996
00:30:14:WU01:FS01:FahCore 0x21 started
00:30:15:WU01:FS01:0x21:*********************** Log Started 2016-12-23T00:30:14Z ***********************
00:30:15:WU01:FS01:0x21:Project: 9197 (Run 2, Clone 5, Gen 125)
00:30:15:WU01:FS01:0x21:Unit: 0x000000c4ab40415c57cb3fcdf61f14fc
00:30:15:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
00:30:15:WU01:FS01:0x21:Machine: 1
00:30:15:WU01:FS01:0x21:Reading tar file core.xml
00:30:15:WU01:FS01:0x21:Reading tar file system.xml
00:30:15:WU01:FS01:0x21:Reading tar file integrator.xml
00:30:15:WU01:FS01:0x21:Reading tar file state.xml
00:30:15:WU01:FS01:0x21:Digital signatures verified
00:30:15:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
00:30:15:WU01:FS01:0x21:Version 0.0.17
00:30:20:WU01:FS01:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-5)
00:30:20:WU01:FS01:0x21:Saving result file logfile_01.txt
00:30:20:WU01:FS01:0x21:Saving result file log.txt
00:30:20:WU01:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
00:30:22:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:30:22:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:9197 run:2 clone:5 gen:125 core:0x21 unit:0x000000c4ab40415c57cb3fcdf61f14fc
00:30:22:WU01:FS01:Uploading 2.41KiB to 171.64.65.92
00:30:22:WU01:FS01:Connecting to 171.64.65.92:8080
00:30:22:WU01:FS01:Upload complete
00:30:22:WU01:FS01:Server responded WORK_ACK (400)
00:30:22:WU01:FS01:Cleaning up
00:30:22:WU02:FS01:Connecting to 171.67.108.45:80
00:30:23:WU02:FS01:Assigned to work server 140.163.4.242
00:30:23:WU02:FS01:Requesting new work unit for slot 01: READY gpu:1:GP104 [GeForce GTX 1070] from 140.163.4.242
00:30:23:WU02:FS01:Connecting to 140.163.4.242:8080
00:30:23:WU02:FS01:Downloading 4.14MiB
00:30:25:WU02:FS01:Download complete
00:30:25:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:11402 run:5 clone:8 gen:265 core:0x21 unit:0x000001698ca304f255ed4e7c073d485d
00:30:25:WU02:FS01:Starting
00:30:25:WU02:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/tstrawbridge/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 3104 -checkpoint 15 -gpu 0 -gpu-vendor nvidia
00:30:25:WU02:FS01:Started FahCore on PID 9476
00:30:25:WU02:FS01:Core PID:8548
00:30:25:WU02:FS01:FahCore 0x21 started
00:30:26:WU02:FS01:0x21:*********************** Log Started 2016-12-23T00:30:25Z ***********************
00:30:26:WU02:FS01:0x21:Project: 11402 (Run 5, Clone 8, Gen 265)
00:30:26:WU02:FS01:0x21:Unit: 0x000001698ca304f255ed4e7c073d485d
00:30:26:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
00:30:26:WU02:FS01:0x21:Machine: 1
00:30:26:WU02:FS01:0x21:Reading tar file core.xml
00:30:26:WU02:FS01:0x21:Reading tar file system.xml
00:30:26:WU02:FS01:0x21:Reading tar file integrator.xml
00:30:26:WU02:FS01:0x21:Reading tar file state.xml
00:30:27:WU02:FS01:0x21:Digital signatures verified
00:30:27:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
00:30:27:WU02:FS01:0x21:Version 0.0.17
00:30:33:WU02:FS01:0x21:ERROR:exception: Error downloading array interactionCount: clEnqueueReadBuffer (-5)
00:30:33:WU02:FS01:0x21:Saving result file logfile_01.txt
00:30:33:WU02:FS01:0x21:Saving result file log.txt
00:30:33:WU02:FS01:0x21:Folding@home Core Shutdown: BAD_WORK_UNIT
00:30:35:WARNING:WU02:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:30:35:WU02:FS01:Sending unit results: id:02 state:SEND error:FAULTY project:11402 run:5 clone:8 gen:265 core:0x21 unit:0x000001698ca304f255ed4e7c073d485d
00:30:35:WU02:FS01:Uploading 2.38KiB to 140.163.4.242
00:30:35:WU02:FS01:Connecting to 140.163.4.242:8080
00:30:35:WU02:FS01:Upload complete
00:30:35:WU02:FS01:Server responded WORK_ACK (400)
00:30:35:WU02:FS01:Cleaning up
00:31:11:WU00:FS00:0xa4:Completed 72500 out of 250000 steps  (29%)
00:32:57:WU00:FS00:0xa4:Completed 75000 out of 250000 steps  (30%)
00:34:42:WU00:FS00:0xa4:Completed 77500 out of 250000 steps  (31%)
00:36:28:WU00:FS00:0xa4:Completed 80000 out of 250000 steps  (32%)
00:38:14:WU00:FS00:0xa4:Completed 82500 out of 250000 steps  (33%)
00:39:59:WU00:FS00:0xa4:Completed 85000 out of 250000 steps  (34%)
00:41:45:WU00:FS00:0xa4:Completed 87500 out of 250000 steps  (35%)
00:43:31:WU00:FS00:0xa4:Completed 90000 out of 250000 steps  (36%)
00:45:18:WU00:FS00:0xa4:Completed 92500 out of 250000 steps  (37%)
00:47:04:WU00:FS00:0xa4:Completed 95000 out of 250000 steps  (38%)
00:48:50:WU00:FS00:0xa4:Completed 97500 out of 250000 steps  (39%)
00:50:37:WU00:FS00:0xa4:Completed 100000 out of 250000 steps  (40%)
00:52:23:WU00:FS00:0xa4:Completed 102500 out of 250000 steps  (41%)
00:54:09:WU00:FS00:0xa4:Completed 105000 out of 250000 steps  (42%)
00:55:54:WU00:FS00:0xa4:Completed 107500 out of 250000 steps  (43%)
00:57:40:WU00:FS00:0xa4:Completed 110000 out of 250000 steps  (44%)
00:59:25:WU00:FS00:0xa4:Completed 112500 out of 250000 steps  (45%)
01:01:11:WU00:FS00:0xa4:Completed 115000 out of 250000 steps  (46%)
01:02:57:WU00:FS00:0xa4:Completed 117500 out of 250000 steps  (47%)
01:04:42:WU00:FS00:0xa4:Completed 120000 out of 250000 steps  (48%)
01:06:27:WU00:FS00:0xa4:Completed 122500 out of 250000 steps  (49%)
01:08:12:WU00:FS00:0xa4:Completed 125000 out of 250000 steps  (50%)
01:09:58:WU00:FS00:0xa4:Completed 127500 out of 250000 steps  (51%)
01:11:43:WU00:FS00:0xa4:Completed 130000 out of 250000 steps  (52%)
01:13:28:WU00:FS00:0xa4:Completed 132500 out of 250000 steps  (53%)
01:15:13:WU00:FS00:0xa4:Completed 135000 out of 250000 steps  (54%)
01:16:58:WU00:FS00:0xa4:Completed 137500 out of 250000 steps  (55%)
01:18:43:WU00:FS00:0xa4:Completed 140000 out of 250000 steps  (56%)
01:20:29:WU00:FS00:0xa4:Completed 142500 out of 250000 steps  (57%)
01:22:14:WU00:FS00:0xa4:Completed 145000 out of 250000 steps  (58%)
01:23:59:WU00:FS00:0xa4:Completed 147500 out of 250000 steps  (59%)
01:25:44:WU00:FS00:0xa4:Completed 150000 out of 250000 steps  (60%)
01:27:29:WU00:FS00:0xa4:Completed 152500 out of 250000 steps  (61%)
01:29:14:WU00:FS00:0xa4:Completed 155000 out of 250000 steps  (62%)
01:30:59:WU00:FS00:0xa4:Completed 157500 out of 250000 steps  (63%)
01:32:44:WU00:FS00:0xa4:Completed 160000 out of 250000 steps  (64%)
01:34:29:WU00:FS00:0xa4:Completed 162500 out of 250000 steps  (65%)
01:36:14:WU00:FS00:0xa4:Completed 165000 out of 250000 steps  (66%)
01:38:00:WU00:FS00:0xa4:Completed 167500 out of 250000 steps  (67%)
01:39:47:WU00:FS00:0xa4:Completed 170000 out of 250000 steps  (68%)
01:41:34:WU00:FS00:0xa4:Completed 172500 out of 250000 steps  (69%)
01:43:20:WU00:FS00:0xa4:Completed 175000 out of 250000 steps  (70%)
01:45:07:WU00:FS00:0xa4:Completed 177500 out of 250000 steps  (71%)
01:46:54:WU00:FS00:0xa4:Completed 180000 out of 250000 steps  (72%)
01:48:40:WU00:FS00:0xa4:Completed 182500 out of 250000 steps  (73%)
01:50:25:WU00:FS00:0xa4:Completed 185000 out of 250000 steps  (74%)
01:52:10:WU00:FS00:0xa4:Completed 187500 out of 250000 steps  (75%)
01:53:57:WU00:FS00:0xa4:Completed 190000 out of 250000 steps  (76%)
01:55:43:WU00:FS00:0xa4:Completed 192500 out of 250000 steps  (77%)
01:57:28:WU00:FS00:0xa4:Completed 195000 out of 250000 steps  (78%)
01:59:13:WU00:FS00:0xa4:Completed 197500 out of 250000 steps  (79%)
02:00:58:WU00:FS00:0xa4:Completed 200000 out of 250000 steps  (80%)
02:02:43:WU00:FS00:0xa4:Completed 202500 out of 250000 steps  (81%)
02:04:28:WU00:FS00:0xa4:Completed 205000 out of 250000 steps  (82%)
02:06:13:WU00:FS00:0xa4:Completed 207500 out of 250000 steps  (83%)
02:07:59:WU00:FS00:0xa4:Completed 210000 out of 250000 steps  (84%)
02:09:44:WU00:FS00:0xa4:Completed 212500 out of 250000 steps  (85%)
02:11:30:WU00:FS00:0xa4:Completed 215000 out of 250000 steps  (86%)
02:13:15:WU00:FS00:0xa4:Completed 217500 out of 250000 steps  (87%)
02:15:00:WU00:FS00:0xa4:Completed 220000 out of 250000 steps  (88%)
02:16:47:WU00:FS00:0xa4:Completed 222500 out of 250000 steps  (89%)
02:18:33:WU00:FS00:0xa4:Completed 225000 out of 250000 steps  (90%)
02:20:20:WU00:FS00:0xa4:Completed 227500 out of 250000 steps  (91%)
02:22:06:WU00:FS00:0xa4:Completed 230000 out of 250000 steps  (92%)
02:23:53:WU00:FS00:0xa4:Completed 232500 out of 250000 steps  (93%)
02:25:39:WU00:FS00:0xa4:Completed 235000 out of 250000 steps  (94%)
02:27:26:WU00:FS00:0xa4:Completed 237500 out of 250000 steps  (95%)
02:29:12:WU00:FS00:0xa4:Completed 240000 out of 250000 steps  (96%)
02:30:58:WU00:FS00:0xa4:Completed 242500 out of 250000 steps  (97%)
02:32:45:WU00:FS00:0xa4:Completed 245000 out of 250000 steps  (98%)
02:34:31:WU00:FS00:0xa4:Completed 247500 out of 250000 steps  (99%)
02:34:32:WU01:FS00:Connecting to 171.67.108.45:8080
02:34:32:WU01:FS00:Assigned to work server 128.252.203.2
02:34:32:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 128.252.203.2
02:34:32:WU01:FS00:Connecting to 128.252.203.2:8080
02:34:32:ERROR:WU01:FS00:Exception: Server did not assign work unit
02:34:33:WU01:FS00:Connecting to 171.67.108.45:8080
02:34:33:WU01:FS00:Assigned to work server 171.67.108.158
02:34:33:WU01:FS00:Requesting new work unit for slot 00: RUNNING cpu:3 from 171.67.108.158
02:34:33:WU01:FS00:Connecting to 171.67.108.158:8080
02:34:34:WU01:FS00:Downloading 806.24KiB
02:34:35:WU01:FS00:Download complete
02:34:35:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:9031 run:116 clone:1 gen:144 core:0xa4 unit:0x000000b5ab436c9e56983509dcf8243d
02:36:17:WU00:FS00:0xa4:Completed 250000 out of 250000 steps  (100%)
02:36:17:WU00:FS00:0xa4:DynamicWrapper: Finished Work Unit: sleep=10000
02:36:27:WU00:FS00:0xa4:
02:36:27:WU00:FS00:0xa4:Finished Work Unit:
02:36:27:WU00:FS00:0xa4:- Reading up to 811440 from "00/wudata_01.trr": Read 811440
02:36:27:WU00:FS00:0xa4:trr file hash check passed.
02:36:27:WU00:FS00:0xa4:- Reading up to 746200 from "00/wudata_01.xtc": Read 746200
02:36:27:WU00:FS00:0xa4:xtc file hash check passed.
02:36:27:WU00:FS00:0xa4:edr file hash check passed.
02:36:27:WU00:FS00:0xa4:logfile size: 23186
02:36:27:WU00:FS00:0xa4:Leaving Run
02:36:29:WU00:FS00:0xa4:- Writing 1583314 bytes of core data to disk...
02:36:30:WU00:FS00:0xa4:Done: 1582802 -> 1537931 (compressed to 97.1 percent)
02:36:30:WU00:FS00:0xa4:  ... Done.
02:36:30:WU00:FS00:0xa4:- Shutting down core
02:36:30:WU00:FS00:0xa4:
02:36:30:WU00:FS00:0xa4:Folding@home Core Shutdown: FINISHED_UNIT
02:36:30:WU00:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
02:36:30:WU00:FS00:Sending unit results: id:00 state:SEND error:NO_ERROR project:9039 run:894 clone:0 gen:559 core:0xa4 unit:0x0000026eab436c9e56982744ccda6f1a
02:36:30:WU00:FS00:Uploading 1.47MiB to 171.67.108.158
02:36:30:WU00:FS00:Connecting to 171.67.108.158:8080
02:36:30:WU01:FS00:Starting
02:36:30:WU01:FS00:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:/Users/tstrawbridge/AppData/Roaming/FAHClient/cores/web.stanford.edu/~pande/Win32/AMD64/Core_a4.fah/FahCore_a4.exe -dir 01 -suffix 01 -version 704 -lifeline 3104 -checkpoint 15 -np 3
02:36:30:WU01:FS00:Started FahCore on PID 8820
02:36:30:WU01:FS00:Core PID:7888
02:36:30:WU01:FS00:FahCore 0xa4 started
02:36:31:WU01:FS00:0xa4:
02:36:31:WU01:FS00:0xa4:*------------------------------*
02:36:31:WU01:FS00:0xa4:Folding@Home Gromacs GB Core
02:36:31:WU01:FS00:0xa4:Version 2.27 (Dec. 15, 2010)
02:36:31:WU01:FS00:0xa4:
02:36:31:WU01:FS00:0xa4:Preparing to commence simulation
02:36:31:WU01:FS00:0xa4:- Looking at optimizations...
02:36:31:WU01:FS00:0xa4:- Created dyn
02:36:31:WU01:FS00:0xa4:- Files status OK
02:36:31:WU01:FS00:0xa4:- Expanded 825080 -> 1397768 (decompressed 169.4 percent)
02:36:31:WU01:FS00:0xa4:Called DecompressByteArray: compressed_data_size=825080 data_size=1397768, decompressed_data_size=1397768 diff=0
02:36:31:WU01:FS00:0xa4:- Digital signature verified
02:36:31:WU01:FS00:0xa4:
02:36:31:WU01:FS00:0xa4:Project: 9031 (Run 116, Clone 1, Gen 144)
02:36:31:WU01:FS00:0xa4:
02:36:31:WU01:FS00:0xa4:Assembly optimizations on if available.
02:36:31:WU01:FS00:0xa4:Entering M.D.
02:36:32:WU00:FS00:Upload complete
02:36:32:WU00:FS00:Server responded WORK_ACK (400)
02:36:32:WU00:FS00:Final credit estimate, 1452.00 points
02:36:32:WU00:FS00:Cleaning up
02:36:36:WU01:FS00:0xa4:Mapping NT from 3 to 3 
02:36:36:WU01:FS00:0xa4:Completed 0 out of 250000 steps  (0%)
02:38:29:WU01:FS00:0xa4:Completed 2500 out of 250000 steps  (1%)
02:40:24:WU01:FS00:0xa4:Completed 5000 out of 250000 steps  (2%)
02:42:18:WU01:FS00:0xa4:Completed 7500 out of 250000 steps  (3%)
02:44:14:WU01:FS00:0xa4:Completed 10000 out of 250000 steps  (4%)
02:46:09:WU01:FS00:0xa4:Completed 12500 out of 250000 steps  (5%)
02:48:04:WU01:FS00:0xa4:Completed 15000 out of 250000 steps  (6%)
02:50:00:WU01:FS00:0xa4:Completed 17500 out of 250000 steps  (7%)
02:51:55:WU01:FS00:0xa4:Completed 20000 out of 250000 steps  (8%)
02:53:50:WU01:FS00:0xa4:Completed 22500 out of 250000 steps  (9%)
02:55:46:WU01:FS00:0xa4:Completed 25000 out of 250000 steps  (10%)
02:57:42:WU01:FS00:0xa4:Completed 27500 out of 250000 steps  (11%)
02:59:37:WU01:FS00:0xa4:Completed 30000 out of 250000 steps  (12%)
03:01:32:WU01:FS00:0xa4:Completed 32500 out of 250000 steps  (13%)
03:03:27:WU01:FS00:0xa4:Completed 35000 out of 250000 steps  (14%)
03:05:22:WU01:FS00:0xa4:Completed 37500 out of 250000 steps  (15%)
03:07:16:WU01:FS00:0xa4:Completed 40000 out of 250000 steps  (16%)
03:09:12:WU01:FS00:0xa4:Completed 42500 out of 250000 steps  (17%)
03:11:08:WU01:FS00:0xa4:Completed 45000 out of 250000 steps  (18%)
03:13:03:WU01:FS00:0xa4:Completed 47500 out of 250000 steps  (19%)
03:14:58:WU01:FS00:0xa4:Completed 50000 out of 250000 steps  (20%)
03:16:53:WU01:FS00:0xa4:Completed 52500 out of 250000 steps  (21%)
03:18:48:WU01:FS00:0xa4:Completed 55000 out of 250000 steps  (22%)
03:20:43:WU01:FS00:0xa4:Completed 57500 out of 250000 steps  (23%)
03:22:38:WU01:FS00:0xa4:Completed 60000 out of 250000 steps  (24%)
03:24:34:WU01:FS00:0xa4:Completed 62500 out of 250000 steps  (25%)
03:26:29:WU01:FS00:0xa4:Completed 65000 out of 250000 steps  (26%)
03:28:24:WU01:FS00:0xa4:Completed 67500 out of 250000 steps  (27%)
03:29:43:Saving configuration to config.xml
03:29:43:<config>
03:29:43:  <!-- Logging -->
03:29:43:  <verbosity v='5'/>
03:29:43:
03:29:43:  <!-- Network -->
03:29:43:  <proxy v=':8080'/>
03:29:43:
03:29:43:  <!-- Slot Control -->
03:29:43:  <power v='FULL'/>
03:29:43:
03:29:43:  <!-- User Information -->
03:29:43:  <passkey v='********************************'/>
03:29:43:  <team v='231300'/>
03:29:43:  <user v='tstraw48'/>
03:29:43:
03:29:43:  <!-- Folding Slots -->
03:29:43:  <slot id='0' type='CPU'/>
03:29:43:  <slot id='1' type='GPU'/>
03:29:43:</config>
03:30:09:Saving configuration to config.xml
03:30:09:<config>
03:30:09:  <!-- Logging -->
03:30:09:  <verbosity v='5'/>
03:30:09:
03:30:09:  <!-- Network -->
03:30:09:  <proxy v=':8080'/>
03:30:09:
03:30:09:  <!-- Slot Control -->
03:30:09:  <power v='FULL'/>
03:30:09:
03:30:09:  <!-- User Information -->
03:30:09:  <passkey v='********************************'/>
03:30:09:  <team v='231300'/>
03:30:09:  <user v='tstraw48'/>
03:30:09:
03:30:09:  <!-- Folding Slots -->
03:30:09:  <slot id='0' type='CPU'/>
03:30:09:  <slot id='1' type='GPU'/>
03:30:09:</config>
03:30:21:WU01:FS00:0xa4:Completed 70000 out of 250000 steps  (28%)
03:31:25:39:127.0.0.1 GET /api/updates?_=1482449601537&sid=fa35d9509eee0aaa3f96375f5d15d120
03:31:26:40:127.0.0.1 GET /?nocache=0.10071072596700592
03:31:26:41:127.0.0.1 GET /api/updates?_=1482449601538&sid=fa35d9509eee0aaa3f96375f5d15d120
03:31:27:42:127.0.0.1 GET /css/normalize.css
03:31:27:43:127.0.0.1 GET /css/main.css
03:31:27:44:127.0.0.1 GET /images/mail.png
03:31:27:45:127.0.0.1 GET /images/facebook.png
03:31:27:46:127.0.0.1 GET /images/twitter.png
03:31:27:47:127.0.0.1 GET /js/jquery-1.10.2.min.js
03:31:27:48:127.0.0.1 GET /images/report-bug.png
03:31:27:49:127.0.0.1 GET /js/libs/jquery.selectbox-0.2.js
03:31:27:50:127.0.0.1 GET /js/intercom.min.js
03:31:27:51:127.0.0.1 GET /js/main.js
03:31:27:51:127.0.0.1:New Web connection
03:31:27:52:127.0.0.1 GET /images/template/bg.jpg
03:31:28:53:127.0.0.1 GET /images/template/input_radio.png
03:31:28:54:127.0.0.1 GET /images/template/logo_folding_home.png
03:31:28:55:127.0.0.1 GET /images/template/button_bg.png
03:31:28:56:127.0.0.1 GET /api/updates/set?_=1482463887940&sid=64e8b155325a76003911243a041ce20f&update_id=0&update_path=/api/basic&update_rate=1
03:31:28:57:127.0.0.1 GET /api/updates/set?_=1482463887941&sid=64e8b155325a76003911243a041ce20f&update_id=1&update_path=/api/slots&update_rate=1
03:31:28:58:127.0.0.1 GET /images/template/ui-bg-slider.png
03:31:29:59:127.0.0.1 GET /images/template/select-icons.png
03:31:29:60:127.0.0.1 GET /images/template/ui-icon-slider.png
03:31:29:61:127.0.0.1 GET /images/template/ui-progress-bg.png
03:31:29:62:127.0.0.1 GET /api/configured?_=1482463887942&sid=64e8b155325a76003911243a041ce20f
03:31:29:63:127.0.0.1 GET /api/updates?_=1482463887943&sid=64e8b155325a76003911243a041ce20f
03:31:30:63:127.0.0.1 GET /api/updates?_=1482463887947&sid=64e8b155325a76003911243a041ce20f
03:31:31:64:127.0.0.1 GET /api/updates?_=1482463887948&sid=64e8b155325a76003911243a041ce20f
03:31:33:63:127.0.0.1 GET /api/updates?_=1482463887949&sid=64e8b155325a76003911243a041ce20f
03:31:35:64:127.0.0.1 GET /api/updates?_=1482463887950&sid=64e8b155325a76003911243a041ce20f
03:32:02:Started thread 33 on PID 3104
03:32:21:WU01:FS00:0xa4:Completed 72500 out of 250000 steps  (29%)
03:33:41:FS00:Shutting core down
03:33:44:Clean exit
[size=50][/size]
Image
Top
Joe_H
Site Admin
Posts: 7990
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: Mac Studio M1 Max 32 GB smp6
Mac Hack i7-7700K 48 GB smp4
Location: W. MA

Re: GTX 1070 keeps failing

Post by Joe_H »

Welcome to the folding support forum.

From the error message in your log, your system is using one of the version 375 or 376 drivers that nvidia released that broke an OpenCL call used by Core_21. There is a blog post about this and another topic here warning against use of those versions. You can either revert to the last version known to work, 373.06, or download a hot fix version just released by nVidia that includes a workaround for the issue. A topic on the hot fix version is located here - viewtopic.php?f=80&t=29497.
Image
Top
tstraw48
Posts: 2
Joined: Fri Dec 23, 2016 3:45 am
Hardware configuration: i5-6600K @ 3.5GHz, 16GB Ram, MSI GTX 1070
Location: Toronto, ON

Re: GTX 1070 keeps failing

Post by tstraw48 »

Joe_H wrote:Welcome to the folding support forum.

From the error message in your log, your system is using one of the version 375 or 376 drivers that nvidia released that broke an OpenCL call used by Core_21. There is a blog post about this and another topic here warning against use of those versions. You can either revert to the last version known to work, 373.06, or download a hot fix version just released by nVidia that includes a workaround for the issue. A topic on the hot fix version is located here - viewtopic.php?f=80&t=29497.
Thanks for the quick reply and suggestions. I changed to the hotfix driver last night and the GPU has yet to fail. I'll keep an eye on it.
Image
Top
Post Reply

Return to “Problems with NVidia drivers”