Project 18202 - all wu fail to upload
Posted: Sun May 30, 2021 4:09 pm
I have had a few wu from project 18202. They all come from Work Server 128.252.203.11. The all have the Collect Server listed as 0.0.0.0.
Each of them tries uploading to the collection server, and fails due to receiving 0 bytes back when 512 is needed.
As they take around 8 hours to complete, with an estimated 200K points each, having them all fail to upload is a big problem. I lose 8 hours worth of electric and 200K points for each of them, and the science is not recorded. Any ideas if there is something I can do to fix this? I'm folding on a GTX 1060, hosted on an i7-6700K based PC.
Each of them tries uploading to the collection server, and fails due to receiving 0 bytes back when 512 is needed.
Code: Select all
00:48:49:WU00:FS01:Started FahCore on PID 7628
00:48:49:WU00:FS01:Core PID:11344
00:48:49:WU00:FS01:FahCore 0x22 started
00:48:50:WU00:FS01:0x22:*********************** Log Started 2021-05-30T00:48:50Z ***********************
00:48:50:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
00:48:50:WU00:FS01:0x22: Core: Core22
00:48:50:WU00:FS01:0x22: Type: 0x22
00:48:50:WU00:FS01:0x22: Version: 0.0.13
00:48:50:WU00:FS01:0x22: Author: Joseph Coffland <[email protected]>
00:48:50:WU00:FS01:0x22: Copyright: 2020 foldingathome.org
00:48:50:WU00:FS01:0x22: Homepage: https://foldingathome.org/
00:48:50:WU00:FS01:0x22: Date: Sep 19 2020
00:48:50:WU00:FS01:0x22: Time: 02:35:58
00:48:50:WU00:FS01:0x22: Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
00:48:50:WU00:FS01:0x22: Branch: core22-0.0.13
00:48:50:WU00:FS01:0x22: Compiler: Visual C++ 2015
00:48:50:WU00:FS01:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
00:48:50:WU00:FS01:0x22: -DOPENMM_GIT_HASH="\"189320d0\""
00:48:50:WU00:FS01:0x22: Platform: win32 10
00:48:50:WU00:FS01:0x22: Bits: 64
00:48:50:WU00:FS01:0x22: Mode: Release
00:48:50:WU00:FS01:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
00:48:50:WU00:FS01:0x22: <[email protected]>
00:48:50:WU00:FS01:0x22: Args: -dir 00 -suffix 01 -version 706 -lifeline 7628 -checkpoint 15
00:48:50:WU00:FS01:0x22: -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
00:48:50:WU00:FS01:0x22: nvidia -gpu 0 -gpu-usage 100
00:48:50:WU00:FS01:0x22:************************************ libFAH ************************************
00:48:50:WU00:FS01:0x22: Date: Sep 7 2020
00:48:50:WU00:FS01:0x22: Time: 19:09:56
00:48:50:WU00:FS01:0x22: Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
00:48:50:WU00:FS01:0x22: Branch: HEAD
00:48:50:WU00:FS01:0x22: Compiler: Visual C++ 2015
00:48:50:WU00:FS01:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
00:48:50:WU00:FS01:0x22: Platform: win32 10
00:48:50:WU00:FS01:0x22: Bits: 64
00:48:50:WU00:FS01:0x22: Mode: Release
00:48:50:WU00:FS01:0x22:************************************ CBang *************************************
00:48:50:WU00:FS01:0x22: Date: Sep 7 2020
00:48:50:WU00:FS01:0x22: Time: 19:08:30
00:48:50:WU00:FS01:0x22: Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
00:48:50:WU00:FS01:0x22: Branch: HEAD
00:48:50:WU00:FS01:0x22: Compiler: Visual C++ 2015
00:48:50:WU00:FS01:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
00:48:50:WU00:FS01:0x22: Platform: win32 10
00:48:50:WU00:FS01:0x22: Bits: 64
00:48:50:WU00:FS01:0x22: Mode: Release
00:48:50:WU00:FS01:0x22:************************************ System ************************************
00:48:50:WU00:FS01:0x22: CPU: Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz
00:48:50:WU00:FS01:0x22: CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
00:48:50:WU00:FS01:0x22: CPUs: 8
00:48:50:WU00:FS01:0x22: Memory: 15.94GiB
00:48:50:WU00:FS01:0x22:Free Memory: 8.00GiB
00:48:50:WU00:FS01:0x22: Threads: WINDOWS_THREADS
00:48:50:WU00:FS01:0x22: OS Version: 6.2
00:48:50:WU00:FS01:0x22:Has Battery: false
00:48:50:WU00:FS01:0x22: On Battery: false
00:48:50:WU00:FS01:0x22: UTC Offset: 1
00:48:50:WU00:FS01:0x22: PID: 11344
00:48:50:WU00:FS01:0x22: CWD: C:\ProgramData\FAHClient\work
00:48:50:WU00:FS01:0x22:************************************ OpenMM ************************************
00:48:50:WU00:FS01:0x22: Revision: 189320d0
00:48:50:WU00:FS01:0x22:********************************************************************************
00:48:50:WU00:FS01:0x22:Project: 16465 (Run 0, Clone 1426, Gen 113)
00:48:50:WU00:FS01:0x22:Unit: 0x00000000000000000000000000000000
00:48:50:WU00:FS01:0x22:Reading tar file core.xml
00:48:50:WU00:FS01:0x22:Reading tar file integrator.xml.bz2
00:48:50:WU00:FS01:0x22:Reading tar file state.xml.bz2
00:48:50:WU00:FS01:0x22:Reading tar file system.xml.bz2
00:48:50:WU00:FS01:0x22:Digital signatures verified
00:48:50:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
00:48:50:WU00:FS01:0x22:Version 0.0.13
00:48:50:WU00:FS01:0x22: Checkpoint write interval: 125000 steps (5%) [20 total]
00:48:50:WU00:FS01:0x22: JSON viewer frame write interval: 25000 steps (1%) [100 total]
00:48:50:WU00:FS01:0x22: XTC frame write interval: 62500 steps (2.5%) [40 total]
00:48:50:WU00:FS01:0x22: Global context and integrator variables write interval: disabled
00:48:50:WU00:FS01:0x22:There are 4 platforms available.
00:48:50:WU00:FS01:0x22:Platform 0: Reference
00:48:50:WU00:FS01:0x22:Platform 1: CPU
00:48:50:WU00:FS01:0x22:Platform 2: OpenCL
00:48:50:WU00:FS01:0x22: opencl-device 0 specified
00:48:50:WU00:FS01:0x22:Platform 3: CUDA
00:48:50:WU00:FS01:0x22: cuda-device 0 specified
00:48:52:WU00:FS01:0x22:Attempting to create CUDA context:
00:48:52:WU00:FS01:0x22: Configuring platform CUDA
00:48:53:WU00:FS01:0x22: Using CUDA and gpu 0
00:48:53:WU00:FS01:0x22:Completed 0 out of 2500000 steps (0%)
00:48:53:WU00:FS01:0x22:Checkpoint completed at step 0
00:49:04:WU03:FS01:Upload complete
00:49:04:WU03:FS01:Server responded WORK_ACK (400)
00:49:04:WU03:FS01:Final credit estimate, 137051.00 points
00:49:04:WU03:FS01:Cleaning up
00:50:14:WU00:FS01:0x22:Completed 25000 out of 2500000 steps (1%)
00:51:33:WU00:FS01:0x22:Completed 50000 out of 2500000 steps (2%)
00:52:53:WU00:FS01:0x22:Completed 75000 out of 2500000 steps (3%)
00:54:13:WU00:FS01:0x22:Completed 100000 out of 2500000 steps (4%)
00:55:33:WU00:FS01:0x22:Completed 125000 out of 2500000 steps (5%)
00:55:33:WU00:FS01:0x22:Checkpoint completed at step 125000
00:56:53:WU00:FS01:0x22:Completed 150000 out of 2500000 steps (6%)
00:58:12:WU00:FS01:0x22:Completed 175000 out of 2500000 steps (7%)
00:59:31:WU00:FS01:0x22:Completed 200000 out of 2500000 steps (8%)
01:00:50:WU00:FS01:0x22:Completed 225000 out of 2500000 steps (9%)
01:02:10:WU00:FS01:0x22:Completed 250000 out of 2500000 steps (10%)
01:02:10:WU00:FS01:0x22:Checkpoint completed at step 250000
01:03:37:WU00:FS01:0x22:Completed 275000 out of 2500000 steps (11%)
01:04:57:WU00:FS01:0x22:Completed 300000 out of 2500000 steps (12%)
01:06:17:WU00:FS01:0x22:Completed 325000 out of 2500000 steps (13%)
01:07:36:WU00:FS01:0x22:Completed 350000 out of 2500000 steps (14%)
01:08:55:WU00:FS01:0x22:Completed 375000 out of 2500000 steps (15%)
01:08:55:WU00:FS01:0x22:Checkpoint completed at step 375000
01:10:14:WU00:FS01:0x22:Completed 400000 out of 2500000 steps (16%)
01:11:33:WU00:FS01:0x22:Completed 425000 out of 2500000 steps (17%)
01:12:52:WU00:FS01:0x22:Completed 450000 out of 2500000 steps (18%)
01:14:11:WU00:FS01:0x22:Completed 475000 out of 2500000 steps (19%)
01:15:30:WU00:FS01:0x22:Completed 500000 out of 2500000 steps (20%)
01:15:30:WU00:FS01:0x22:Checkpoint completed at step 500000
01:16:50:WU00:FS01:0x22:Completed 525000 out of 2500000 steps (21%)
01:18:10:WU00:FS01:0x22:Completed 550000 out of 2500000 steps (22%)
01:19:31:WU00:FS01:0x22:Completed 575000 out of 2500000 steps (23%)
01:20:50:WU00:FS01:0x22:Completed 600000 out of 2500000 steps (24%)
01:22:09:WU00:FS01:0x22:Completed 625000 out of 2500000 steps (25%)
01:22:09:WU00:FS01:0x22:Checkpoint completed at step 625000
01:23:28:WU00:FS01:0x22:Completed 650000 out of 2500000 steps (26%)
01:24:47:WU00:FS01:0x22:Completed 675000 out of 2500000 steps (27%)
01:26:07:WU00:FS01:0x22:Completed 700000 out of 2500000 steps (28%)
01:27:26:WU00:FS01:0x22:Completed 725000 out of 2500000 steps (29%)
01:28:47:WU00:FS01:0x22:Completed 750000 out of 2500000 steps (30%)
01:28:47:WU00:FS01:0x22:Checkpoint completed at step 750000
01:30:08:WU00:FS01:0x22:Completed 775000 out of 2500000 steps (31%)
01:31:29:WU00:FS01:0x22:Completed 800000 out of 2500000 steps (32%)
01:32:49:WU00:FS01:0x22:Completed 825000 out of 2500000 steps (33%)
01:32:52:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:372 clone:1 gen:0 core:0x22 unit:0x00000001000000000000471a00000174
01:32:52:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
01:32:52:WU01:FS01:Connecting to 128.252.203.11:8080
01:32:52:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:18202 run:4271 clone:3 gen:0 core:0x22 unit:0x00000003000000000000471a000010af
01:32:52:WU02:FS01:Uploading 27.50MiB to 128.252.203.11
01:32:52:WU02:FS01:Connecting to 128.252.203.11:8080
01:32:58:WU02:FS01:Upload 34.09%
01:33:04:WU02:FS01:Upload 58.18%
01:33:10:WU02:FS01:Upload 82.26%
01:33:22:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
01:33:44:WARNING:WU02:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
01:34:13:WU00:FS01:0x22:Completed 850000 out of 2500000 steps (34%)
01:35:39:WU00:FS01:0x22:Completed 875000 out of 2500000 steps (35%)
01:35:40:WU00:FS01:0x22:Checkpoint completed at step 875000
01:37:01:WU00:FS01:0x22:Completed 900000 out of 2500000 steps (36%)
01:38:21:WU00:FS01:0x22:Completed 925000 out of 2500000 steps (37%)
01:39:43:WU00:FS01:0x22:Completed 950000 out of 2500000 steps (38%)
01:41:02:WU00:FS01:0x22:Completed 975000 out of 2500000 steps (39%)
01:42:20:WU00:FS01:0x22:Completed 1000000 out of 2500000 steps (40%)
01:42:20:WU00:FS01:0x22:Checkpoint completed at step 1000000
01:43:39:WU00:FS01:0x22:Completed 1025000 out of 2500000 steps (41%)
01:44:58:WU00:FS01:0x22:Completed 1050000 out of 2500000 steps (42%)
01:46:17:WU00:FS01:0x22:Completed 1075000 out of 2500000 steps (43%)
01:47:36:WU00:FS01:0x22:Completed 1100000 out of 2500000 steps (44%)
01:48:54:WU00:FS01:0x22:Completed 1125000 out of 2500000 steps (45%)
01:48:54:WU00:FS01:0x22:Checkpoint completed at step 1125000
01:50:13:WU00:FS01:0x22:Completed 1150000 out of 2500000 steps (46%)
01:51:32:WU00:FS01:0x22:Completed 1175000 out of 2500000 steps (47%)
01:52:51:WU00:FS01:0x22:Completed 1200000 out of 2500000 steps (48%)
01:54:10:WU00:FS01:0x22:Completed 1225000 out of 2500000 steps (49%)
01:55:28:WU00:FS01:0x22:Completed 1250000 out of 2500000 steps (50%)
01:55:28:WU00:FS01:0x22:Checkpoint completed at step 1250000
01:56:47:WU00:FS01:0x22:Completed 1275000 out of 2500000 steps (51%)
01:58:06:WU00:FS01:0x22:Completed 1300000 out of 2500000 steps (52%)
01:59:24:WU00:FS01:0x22:Completed 1325000 out of 2500000 steps (53%)
02:00:43:WU00:FS01:0x22:Completed 1350000 out of 2500000 steps (54%)
02:02:02:WU00:FS01:0x22:Completed 1375000 out of 2500000 steps (55%)
02:02:02:WU00:FS01:0x22:Checkpoint completed at step 1375000
02:03:21:WU00:FS01:0x22:Completed 1400000 out of 2500000 steps (56%)
02:04:40:WU00:FS01:0x22:Completed 1425000 out of 2500000 steps (57%)
02:05:58:WU00:FS01:0x22:Completed 1450000 out of 2500000 steps (58%)
02:07:17:WU00:FS01:0x22:Completed 1475000 out of 2500000 steps (59%)
02:08:36:WU00:FS01:0x22:Completed 1500000 out of 2500000 steps (60%)
02:08:36:WU00:FS01:0x22:Checkpoint completed at step 1500000
02:09:54:WU00:FS01:0x22:Completed 1525000 out of 2500000 steps (61%)
02:11:18:WU00:FS01:0x22:Completed 1550000 out of 2500000 steps (62%)
02:12:45:WU00:FS01:0x22:Completed 1575000 out of 2500000 steps (63%)
02:14:12:WU00:FS01:0x22:Completed 1600000 out of 2500000 steps (64%)
02:15:39:WU00:FS01:0x22:Completed 1625000 out of 2500000 steps (65%)
02:15:39:WU00:FS01:0x22:Checkpoint completed at step 1625000
02:17:06:WU00:FS01:0x22:Completed 1650000 out of 2500000 steps (66%)
02:18:33:WU00:FS01:0x22:Completed 1675000 out of 2500000 steps (67%)
02:20:00:WU00:FS01:0x22:Completed 1700000 out of 2500000 steps (68%)
02:21:27:WU00:FS01:0x22:Completed 1725000 out of 2500000 steps (69%)
02:22:54:WU00:FS01:0x22:Completed 1750000 out of 2500000 steps (70%)
02:22:55:WU00:FS01:0x22:Checkpoint completed at step 1750000
02:24:21:WU00:FS01:0x22:Completed 1775000 out of 2500000 steps (71%)
02:25:48:WU00:FS01:0x22:Completed 1800000 out of 2500000 steps (72%)
02:27:15:WU00:FS01:0x22:Completed 1825000 out of 2500000 steps (73%)
02:28:42:WU00:FS01:0x22:Completed 1850000 out of 2500000 steps (74%)
02:30:09:WU00:FS01:0x22:Completed 1875000 out of 2500000 steps (75%)
02:30:10:WU00:FS01:0x22:Checkpoint completed at step 1875000
02:31:37:WU00:FS01:0x22:Completed 1900000 out of 2500000 steps (76%)
02:32:52:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:372 clone:1 gen:0 core:0x22 unit:0x00000001000000000000471a00000174
02:32:52:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
02:32:52:WU01:FS01:Connecting to 128.252.203.11:8080
02:32:53:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:18202 run:4271 clone:3 gen:0 core:0x22 unit:0x00000003000000000000471a000010af
02:32:53:WU02:FS01:Uploading 27.50MiB to 128.252.203.11
02:32:53:WU02:FS01:Connecting to 128.252.203.11:8080
02:32:59:WU02:FS01:Upload 35.00%
02:33:04:WU00:FS01:0x22:Completed 1925000 out of 2500000 steps (77%)
02:33:05:WU02:FS01:Upload 59.08%
02:33:11:WU02:FS01:Upload 83.17%
02:33:22:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
02:33:45:WARNING:WU02:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
02:34:31:WU00:FS01:0x22:Completed 1950000 out of 2500000 steps (78%)
02:35:58:WU00:FS01:0x22:Completed 1975000 out of 2500000 steps (79%)
02:37:25:WU00:FS01:0x22:Completed 2000000 out of 2500000 steps (80%)
02:37:25:WU00:FS01:0x22:Checkpoint completed at step 2000000
02:38:52:WU00:FS01:0x22:Completed 2025000 out of 2500000 steps (81%)
02:40:29:WU00:FS01:0x22:Completed 2050000 out of 2500000 steps (82%)
02:41:48:WU00:FS01:0x22:Completed 2075000 out of 2500000 steps (83%)
02:43:08:WU00:FS01:0x22:Completed 2100000 out of 2500000 steps (84%)
02:46:02:WU00:FS01:0x22:Completed 2125000 out of 2500000 steps (85%)
02:46:04:WU00:FS01:0x22:Checkpoint completed at step 2125000
02:47:42:WU00:FS01:0x22:Completed 2150000 out of 2500000 steps (86%)
02:49:03:WU00:FS01:0x22:Completed 2175000 out of 2500000 steps (87%)
02:50:24:WU00:FS01:0x22:Completed 2200000 out of 2500000 steps (88%)
02:51:46:WU00:FS01:0x22:Completed 2225000 out of 2500000 steps (89%)
02:53:09:WU00:FS01:0x22:Completed 2250000 out of 2500000 steps (90%)
02:53:09:WU00:FS01:0x22:Checkpoint completed at step 2250000
02:54:34:WU00:FS01:0x22:Completed 2275000 out of 2500000 steps (91%)
02:56:00:WU00:FS01:0x22:Completed 2300000 out of 2500000 steps (92%)
02:57:23:WU00:FS01:0x22:Completed 2325000 out of 2500000 steps (93%)
02:58:46:WU00:FS01:0x22:Completed 2350000 out of 2500000 steps (94%)
03:00:10:WU00:FS01:0x22:Completed 2375000 out of 2500000 steps (95%)
03:00:10:WU00:FS01:0x22:Checkpoint completed at step 2375000
03:01:32:WU00:FS01:0x22:Completed 2400000 out of 2500000 steps (96%)
03:02:54:WU00:FS01:0x22:Completed 2425000 out of 2500000 steps (97%)
03:04:26:WU00:FS01:0x22:Completed 2450000 out of 2500000 steps (98%)
03:05:49:WU00:FS01:0x22:Completed 2475000 out of 2500000 steps (99%)
03:05:50:WU03:FS01:Connecting to assign1.foldingathome.org:80
03:05:50:WU03:FS01:Assigned to work server 207.53.233.146
03:05:50:WU03:FS01:Requesting new work unit for slot 01: gpu:1:0 GP106 [GeForce GTX 1060 3GB] 3935 from 207.53.233.146
03:05:50:WU03:FS01:Connecting to 207.53.233.146:8080
03:05:51:WU03:FS01:Downloading 6.10MiB
03:05:53:WU03:FS01:Download complete
03:05:53:WU03:FS01:Received Unit: id:03 state:DOWNLOAD error:NO_ERROR project:17804 run:43 clone:25 gen:48 core:0x22 unit:0x00000019000000300000458c0000002b
03:07:10:WU00:FS01:0x22:Completed 2500000 out of 2500000 steps (100%)
03:07:10:WU00:FS01:0x22:Average performance: 51.4286 ns/day
03:07:10:WU00:FS01:0x22:Checkpoint completed at step 2500000
03:07:11:WU00:FS01:0x22:Saving result file ..\logfile_01.txt
03:07:11:WU00:FS01:0x22:Saving result file checkpointIntegrator.xml.bz2
03:07:11:WU00:FS01:0x22:Saving result file checkpointState.xml.bz2
03:07:11:WU00:FS01:0x22:Saving result file positions.xtc
03:07:11:WU00:FS01:0x22:Saving result file science.log
03:07:11:WU00:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
03:07:12:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
03:07:12:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:16465 run:0 clone:1426 gen:113 core:0x22 unit:0x00000592000000710000405100000000
03:07:12:WU00:FS01:Uploading 4.26MiB to 140.163.4.210
03:07:12:WU00:FS01:Connecting to 140.163.4.210:8080
03:07:12:WU03:FS01:Starting
03:07:12:WU03:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 03 -suffix 01 -version 706 -lifeline 10600 -checkpoint 15 -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor nvidia -gpu 0 -gpu-usage 100
03:07:12:WU03:FS01:Started FahCore on PID 8444
03:07:13:WU03:FS01:Core PID:12484
03:07:13:WU03:FS01:FahCore 0x22 started
03:07:13:WU03:FS01:0x22:*********************** Log Started 2021-05-30T03:07:13Z ***********************
03:07:13:WU03:FS01:0x22:*************************** Core22 Folding@home Core ***************************
03:07:13:WU03:FS01:0x22: Core: Core22
03:07:13:WU03:FS01:0x22: Type: 0x22
03:07:13:WU03:FS01:0x22: Version: 0.0.13
03:07:13:WU03:FS01:0x22: Author: Joseph Coffland <[email protected]>
03:07:13:WU03:FS01:0x22: Copyright: 2020 foldingathome.org
03:07:13:WU03:FS01:0x22: Homepage: https://foldingathome.org/
03:07:13:WU03:FS01:0x22: Date: Sep 19 2020
03:07:13:WU03:FS01:0x22: Time: 02:35:58
03:07:13:WU03:FS01:0x22: Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
03:07:13:WU03:FS01:0x22: Branch: core22-0.0.13
03:07:13:WU03:FS01:0x22: Compiler: Visual C++ 2015
03:07:13:WU03:FS01:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
03:07:13:WU03:FS01:0x22: -DOPENMM_GIT_HASH="\"189320d0\""
03:07:13:WU03:FS01:0x22: Platform: win32 10
03:07:13:WU03:FS01:0x22: Bits: 64
03:07:13:WU03:FS01:0x22: Mode: Release
03:07:13:WU03:FS01:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
03:07:13:WU03:FS01:0x22: <[email protected]>
03:07:13:WU03:FS01:0x22: Args: -dir 03 -suffix 01 -version 706 -lifeline 8444 -checkpoint 15
03:07:13:WU03:FS01:0x22: -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
03:07:13:WU03:FS01:0x22: nvidia -gpu 0 -gpu-usage 100
03:07:13:WU03:FS01:0x22:************************************ libFAH ************************************
03:07:13:WU03:FS01:0x22: Date: Sep 7 2020
03:07:13:WU03:FS01:0x22: Time: 19:09:56
03:07:13:WU03:FS01:0x22: Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
03:07:13:WU03:FS01:0x22: Branch: HEAD
03:07:13:WU03:FS01:0x22: Compiler: Visual C++ 2015
03:07:13:WU03:FS01:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
03:07:13:WU03:FS01:0x22: Platform: win32 10
03:07:13:WU03:FS01:0x22: Bits: 64
03:07:13:WU03:FS01:0x22: Mode: Release
03:07:13:WU03:FS01:0x22:************************************ CBang *************************************
03:07:13:WU03:FS01:0x22: Date: Sep 7 2020
03:07:13:WU03:FS01:0x22: Time: 19:08:30
03:07:13:WU03:FS01:0x22: Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
03:07:13:WU03:FS01:0x22: Branch: HEAD
03:07:13:WU03:FS01:0x22: Compiler: Visual C++ 2015
03:07:13:WU03:FS01:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
03:07:13:WU03:FS01:0x22: Platform: win32 10
03:07:13:WU03:FS01:0x22: Bits: 64
03:07:13:WU03:FS01:0x22: Mode: Release
03:07:13:WU03:FS01:0x22:************************************ System ************************************
03:07:13:WU03:FS01:0x22: CPU: Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz
03:07:13:WU03:FS01:0x22: CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
03:07:13:WU03:FS01:0x22: CPUs: 8
03:07:13:WU03:FS01:0x22: Memory: 15.94GiB
03:07:13:WU03:FS01:0x22:Free Memory: 8.75GiB
03:07:13:WU03:FS01:0x22: Threads: WINDOWS_THREADS
03:07:13:WU03:FS01:0x22: OS Version: 6.2
03:07:13:WU03:FS01:0x22:Has Battery: false
03:07:13:WU03:FS01:0x22: On Battery: false
03:07:13:WU03:FS01:0x22: UTC Offset: 1
03:07:13:WU03:FS01:0x22: PID: 12484
03:07:13:WU03:FS01:0x22: CWD: C:\ProgramData\FAHClient\work
03:07:13:WU03:FS01:0x22:************************************ OpenMM ************************************
03:07:13:WU03:FS01:0x22: Revision: 189320d0
03:07:13:WU03:FS01:0x22:********************************************************************************
03:07:13:WU03:FS01:0x22:Project: 17804 (Run 43, Clone 25, Gen 48)
03:07:13:WU03:FS01:0x22:Unit: 0x00000000000000000000000000000000
03:07:13:WU03:FS01:0x22:Reading tar file core.xml
03:07:13:WU03:FS01:0x22:Reading tar file integrator.xml.bz2
03:07:13:WU03:FS01:0x22:Reading tar file state.xml.bz2
03:07:13:WU03:FS01:0x22:Reading tar file system.xml.bz2
03:07:13:WU03:FS01:0x22:Digital signatures verified
03:07:13:WU03:FS01:0x22:Folding@home GPU Core22 Folding@home Core
03:07:13:WU03:FS01:0x22:Version 0.0.13
03:07:13:WU03:FS01:0x22: Checkpoint write interval: 125000 steps (5%) [20 total]
03:07:13:WU03:FS01:0x22: JSON viewer frame write interval: 25000 steps (1%) [100 total]
03:07:13:WU03:FS01:0x22: XTC frame write interval: 25000 steps (1%) [100 total]
03:07:13:WU03:FS01:0x22: Global context and integrator variables write interval: disabled
03:07:13:WU03:FS01:0x22:There are 4 platforms available.
03:07:13:WU03:FS01:0x22:Platform 0: Reference
03:07:13:WU03:FS01:0x22:Platform 1: CPU
03:07:13:WU03:FS01:0x22:Platform 2: OpenCL
03:07:13:WU03:FS01:0x22: opencl-device 0 specified
03:07:13:WU03:FS01:0x22:Platform 3: CUDA
03:07:13:WU03:FS01:0x22: cuda-device 0 specified
03:07:17:WU03:FS01:0x22:Attempting to create CUDA context:
03:07:17:WU03:FS01:0x22: Configuring platform CUDA
03:07:18:WU03:FS01:0x22: Using CUDA and gpu 0
03:07:18:WU03:FS01:0x22:Completed 0 out of 2500000 steps (0%)
03:07:18:WU03:FS01:0x22:Checkpoint completed at step 0
03:07:18:WU00:FS01:Upload complete
03:07:18:WU00:FS01:Server responded WORK_ACK (400)
03:07:18:WU00:FS01:Final credit estimate, 61699.00 points
03:07:18:WU00:FS01:Cleaning up
03:10:18:WU03:FS01:0x22:Completed 25000 out of 2500000 steps (1%)
03:13:14:WU03:FS01:0x22:Completed 50000 out of 2500000 steps (2%)
03:16:09:WU03:FS01:0x22:Completed 75000 out of 2500000 steps (3%)
03:19:03:WU03:FS01:0x22:Completed 100000 out of 2500000 steps (4%)
03:21:57:WU03:FS01:0x22:Completed 125000 out of 2500000 steps (5%)
03:21:57:WU03:FS01:0x22:Checkpoint completed at step 125000
03:25:09:WU03:FS01:0x22:Completed 150000 out of 2500000 steps (6%)
03:28:15:WU03:FS01:0x22:Completed 175000 out of 2500000 steps (7%)
******************************* Date: 2021-05-30 *******************************
03:31:24:WU03:FS01:0x22:Completed 200000 out of 2500000 steps (8%)
03:32:52:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:372 clone:1 gen:0 core:0x22 unit:0x00000001000000000000471a00000174
03:32:52:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
03:32:52:WU01:FS01:Connecting to 128.252.203.11:8080
03:32:53:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:18202 run:4271 clone:3 gen:0 core:0x22 unit:0x00000003000000000000471a000010af
03:32:53:WU02:FS01:Uploading 27.50MiB to 128.252.203.11
03:32:53:WU02:FS01:Connecting to 128.252.203.11:8080
03:32:59:WU02:FS01:Upload 39.31%
03:33:05:WU02:FS01:Upload 63.17%
03:33:11:WU02:FS01:Upload 87.26%
03:33:22:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
03:33:44:WARNING:WU02:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
03:34:32:WU03:FS01:0x22:Completed 225000 out of 2500000 steps (9%)
03:37:39:WU03:FS01:0x22:Completed 250000 out of 2500000 steps (10%)
03:37:40:WU03:FS01:0x22:Checkpoint completed at step 250000
03:40:39:WU03:FS01:0x22:Completed 275000 out of 2500000 steps (11%)
03:43:33:WU03:FS01:0x22:Completed 300000 out of 2500000 steps (12%)
03:46:38:WU03:FS01:0x22:Completed 325000 out of 2500000 steps (13%)
03:49:34:WU03:FS01:0x22:Completed 350000 out of 2500000 steps (14%)
03:52:28:WU03:FS01:0x22:Completed 375000 out of 2500000 steps (15%)
03:52:28:WU03:FS01:0x22:Checkpoint completed at step 375000
03:55:29:WU03:FS01:0x22:Completed 400000 out of 2500000 steps (16%)
03:58:29:WU03:FS01:0x22:Completed 425000 out of 2500000 steps (17%)
04:01:23:WU03:FS01:0x22:Completed 450000 out of 2500000 steps (18%)
04:04:18:WU03:FS01:0x22:Completed 475000 out of 2500000 steps (19%)
04:07:11:WU03:FS01:0x22:Completed 500000 out of 2500000 steps (20%)
04:07:12:WU03:FS01:0x22:Checkpoint completed at step 500000
04:10:15:WU03:FS01:0x22:Completed 525000 out of 2500000 steps (21%)
04:13:24:WU03:FS01:0x22:Completed 550000 out of 2500000 steps (22%)
04:16:34:WU03:FS01:0x22:Completed 575000 out of 2500000 steps (23%)
04:19:28:WU03:FS01:0x22:Completed 600000 out of 2500000 steps (24%)
04:22:31:WU03:FS01:0x22:Completed 625000 out of 2500000 steps (25%)
04:22:31:WU03:FS01:0x22:Checkpoint completed at step 625000
04:25:42:WU03:FS01:0x22:Completed 650000 out of 2500000 steps (26%)
04:28:51:WU03:FS01:0x22:Completed 675000 out of 2500000 steps (27%)
04:31:55:WU03:FS01:0x22:Completed 700000 out of 2500000 steps (28%)
04:32:52:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:372 clone:1 gen:0 core:0x22 unit:0x00000001000000000000471a00000174
04:32:52:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
04:32:52:WU01:FS01:Connecting to 128.252.203.11:8080
04:32:53:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:18202 run:4271 clone:3 gen:0 core:0x22 unit:0x00000003000000000000471a000010af
04:32:53:WU02:FS01:Uploading 27.50MiB to 128.252.203.11
04:32:53:WU02:FS01:Connecting to 128.252.203.11:8080
04:32:59:WU02:FS01:Upload 39.09%
04:33:05:WU02:FS01:Upload 63.17%
04:33:11:WU02:FS01:Upload 87.49%
04:33:23:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
04:33:44:WARNING:WU02:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
04:35:06:WU03:FS01:0x22:Completed 725000 out of 2500000 steps (29%)
04:38:15:WU03:FS01:0x22:Completed 750000 out of 2500000 steps (30%)
04:38:16:WU03:FS01:0x22:Checkpoint completed at step 750000
04:41:23:WU03:FS01:0x22:Completed 775000 out of 2500000 steps (31%)
04:44:19:WU03:FS01:0x22:Completed 800000 out of 2500000 steps (32%)
04:47:15:WU03:FS01:0x22:Completed 825000 out of 2500000 steps (33%)
04:50:09:WU03:FS01:0x22:Completed 850000 out of 2500000 steps (34%)
04:53:03:WU03:FS01:0x22:Completed 875000 out of 2500000 steps (35%)
04:53:04:WU03:FS01:0x22:Checkpoint completed at step 875000
04:55:59:WU03:FS01:0x22:Completed 900000 out of 2500000 steps (36%)
04:58:52:WU03:FS01:0x22:Completed 925000 out of 2500000 steps (37%)
05:01:46:WU03:FS01:0x22:Completed 950000 out of 2500000 steps (38%)
05:04:39:WU03:FS01:0x22:Completed 975000 out of 2500000 steps (39%)
05:07:32:WU03:FS01:0x22:Completed 1000000 out of 2500000 steps (40%)
05:07:32:WU03:FS01:0x22:Checkpoint completed at step 1000000
05:10:26:WU03:FS01:0x22:Completed 1025000 out of 2500000 steps (41%)
05:13:20:WU03:FS01:0x22:Completed 1050000 out of 2500000 steps (42%)
05:16:14:WU03:FS01:0x22:Completed 1075000 out of 2500000 steps (43%)
05:19:07:WU03:FS01:0x22:Completed 1100000 out of 2500000 steps (44%)
05:22:10:WU03:FS01:0x22:Completed 1125000 out of 2500000 steps (45%)
05:22:11:WU03:FS01:0x22:Checkpoint completed at step 1125000
05:25:18:WU03:FS01:0x22:Completed 1150000 out of 2500000 steps (46%)
05:28:14:WU03:FS01:0x22:Completed 1175000 out of 2500000 steps (47%)
05:31:10:WU03:FS01:0x22:Completed 1200000 out of 2500000 steps (48%)
05:32:52:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:372 clone:1 gen:0 core:0x22 unit:0x00000001000000000000471a00000174
05:32:52:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
05:32:52:WU01:FS01:Connecting to 128.252.203.11:8080
05:32:53:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:18202 run:4271 clone:3 gen:0 core:0x22 unit:0x00000003000000000000471a000010af
05:32:53:WU02:FS01:Uploading 27.50MiB to 128.252.203.11
05:32:53:WU02:FS01:Connecting to 128.252.203.11:8080
05:32:59:WU02:FS01:Upload 34.54%
05:33:05:WU02:FS01:Upload 57.49%
05:33:11:WU02:FS01:Upload 81.35%
05:33:23:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
05:33:45:WARNING:WU02:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
05:34:08:WU03:FS01:0x22:Completed 1225000 out of 2500000 steps (49%)
05:37:02:WU03:FS01:0x22:Completed 1250000 out of 2500000 steps (50%)
05:37:03:WU03:FS01:0x22:Checkpoint completed at step 1250000
05:39:59:WU03:FS01:0x22:Completed 1275000 out of 2500000 steps (51%)
05:42:54:WU03:FS01:0x22:Completed 1300000 out of 2500000 steps (52%)
05:45:50:WU03:FS01:0x22:Completed 1325000 out of 2500000 steps (53%)
05:48:45:WU03:FS01:0x22:Completed 1350000 out of 2500000 steps (54%)
05:51:39:WU03:FS01:0x22:Completed 1375000 out of 2500000 steps (55%)
05:51:39:WU03:FS01:0x22:Checkpoint completed at step 1375000
05:54:33:WU03:FS01:0x22:Completed 1400000 out of 2500000 steps (56%)
05:57:27:WU03:FS01:0x22:Completed 1425000 out of 2500000 steps (57%)
06:00:28:WU03:FS01:0x22:Completed 1450000 out of 2500000 steps (58%)
06:03:42:WU03:FS01:0x22:Completed 1475000 out of 2500000 steps (59%)
06:06:57:WU03:FS01:0x22:Completed 1500000 out of 2500000 steps (60%)
06:06:58:WU03:FS01:0x22:Checkpoint completed at step 1500000
06:10:12:WU03:FS01:0x22:Completed 1525000 out of 2500000 steps (61%)
06:13:27:WU03:FS01:0x22:Completed 1550000 out of 2500000 steps (62%)
06:16:43:WU03:FS01:0x22:Completed 1575000 out of 2500000 steps (63%)
06:19:56:WU03:FS01:0x22:Completed 1600000 out of 2500000 steps (64%)
06:23:11:WU03:FS01:0x22:Completed 1625000 out of 2500000 steps (65%)
06:23:11:WU03:FS01:0x22:Checkpoint completed at step 1625000
06:26:25:WU03:FS01:0x22:Completed 1650000 out of 2500000 steps (66%)
06:29:38:WU03:FS01:0x22:Completed 1675000 out of 2500000 steps (67%)
06:32:52:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:372 clone:1 gen:0 core:0x22 unit:0x00000001000000000000471a00000174
06:32:52:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
06:32:52:WU01:FS01:Connecting to 128.252.203.11:8080
06:32:53:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:18202 run:4271 clone:3 gen:0 core:0x22 unit:0x00000003000000000000471a000010af
06:32:53:WU02:FS01:Uploading 27.50MiB to 128.252.203.11
06:32:53:WU02:FS01:Connecting to 128.252.203.11:8080
06:32:54:WU03:FS01:0x22:Completed 1700000 out of 2500000 steps (68%)
06:32:59:WU02:FS01:Upload 33.63%
06:33:05:WU02:FS01:Upload 56.81%
06:33:11:WU02:FS01:Upload 80.90%
06:33:23:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
06:33:45:WU02:FS01:Upload complete
06:33:45:WU02:FS01:Server responded WORK_ACK (400)
06:33:45:WU02:FS01:Final credit estimate, 135389.00 points
06:33:45:WU02:FS01:Cleaning up
06:36:11:WU03:FS01:0x22:Completed 1725000 out of 2500000 steps (69%)
06:39:25:WU03:FS01:0x22:Completed 1750000 out of 2500000 steps (70%)
06:39:26:WU03:FS01:0x22:Checkpoint completed at step 1750000
06:42:42:WU03:FS01:0x22:Completed 1775000 out of 2500000 steps (71%)
06:45:58:WU03:FS01:0x22:Completed 1800000 out of 2500000 steps (72%)
06:49:13:WU03:FS01:0x22:Completed 1825000 out of 2500000 steps (73%)
06:52:30:WU03:FS01:0x22:Completed 1850000 out of 2500000 steps (74%)
06:55:46:WU03:FS01:0x22:Completed 1875000 out of 2500000 steps (75%)
06:55:47:WU03:FS01:0x22:Checkpoint completed at step 1875000
06:59:04:WU03:FS01:0x22:Completed 1900000 out of 2500000 steps (76%)
07:02:18:WU03:FS01:0x22:Completed 1925000 out of 2500000 steps (77%)
07:05:34:WU03:FS01:0x22:Completed 1950000 out of 2500000 steps (78%)
07:08:48:WU03:FS01:0x22:Completed 1975000 out of 2500000 steps (79%)
07:12:05:WU03:FS01:0x22:Completed 2000000 out of 2500000 steps (80%)
07:12:05:WU03:FS01:0x22:Checkpoint completed at step 2000000
07:15:21:WU03:FS01:0x22:Completed 2025000 out of 2500000 steps (81%)
07:18:38:WU03:FS01:0x22:Completed 2050000 out of 2500000 steps (82%)
07:21:53:WU03:FS01:0x22:Completed 2075000 out of 2500000 steps (83%)
07:25:10:WU03:FS01:0x22:Completed 2100000 out of 2500000 steps (84%)
07:28:25:WU03:FS01:0x22:Completed 2125000 out of 2500000 steps (85%)
07:28:25:WU03:FS01:0x22:Checkpoint completed at step 2125000
07:31:42:WU03:FS01:0x22:Completed 2150000 out of 2500000 steps (86%)
07:32:53:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:372 clone:1 gen:0 core:0x22 unit:0x00000001000000000000471a00000174
07:32:53:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
07:32:53:WU01:FS01:Connecting to 128.252.203.11:8080
07:33:23:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
07:34:58:WU03:FS01:0x22:Completed 2175000 out of 2500000 steps (87%)
07:38:14:WU03:FS01:0x22:Completed 2200000 out of 2500000 steps (88%)
07:41:33:WU03:FS01:0x22:Completed 2225000 out of 2500000 steps (89%)
07:44:49:WU03:FS01:0x22:Completed 2250000 out of 2500000 steps (90%)
07:44:49:WU03:FS01:0x22:Checkpoint completed at step 2250000
07:48:05:WU03:FS01:0x22:Completed 2275000 out of 2500000 steps (91%)
07:51:20:WU03:FS01:0x22:Completed 2300000 out of 2500000 steps (92%)
07:54:35:WU03:FS01:0x22:Completed 2325000 out of 2500000 steps (93%)
07:57:53:WU03:FS01:0x22:Completed 2350000 out of 2500000 steps (94%)
08:01:09:WU03:FS01:0x22:Completed 2375000 out of 2500000 steps (95%)
08:01:10:WU03:FS01:0x22:Checkpoint completed at step 2375000
08:04:25:WU03:FS01:0x22:Completed 2400000 out of 2500000 steps (96%)
08:07:41:WU03:FS01:0x22:Completed 2425000 out of 2500000 steps (97%)
08:10:59:WU03:FS01:0x22:Completed 2450000 out of 2500000 steps (98%)
08:14:16:WU03:FS01:0x22:Completed 2475000 out of 2500000 steps (99%)
08:14:16:WU00:FS01:Connecting to assign1.foldingathome.org:80
08:14:16:WU00:FS01:Assigned to work server 128.252.203.11
08:14:16:WU00:FS01:Requesting new work unit for slot 01: gpu:1:0 GP106 [GeForce GTX 1060 3GB] 3935 from 128.252.203.11
08:14:16:WU00:FS01:Connecting to 128.252.203.11:8080
08:14:28:WU00:FS01:Downloading 26.55MiB
08:14:34:WU00:FS01:Download 4.24%
08:14:40:WU00:FS01:Download 7.06%
08:14:46:WU00:FS01:Download 8.71%
08:14:52:WU00:FS01:Download 11.53%
08:14:58:WU00:FS01:Download 13.18%
08:15:04:WU00:FS01:Download 15.06%
08:15:10:WU00:FS01:Download 16.95%
08:15:16:WU00:FS01:Download 19.54%
08:15:22:WU00:FS01:Download 21.89%
08:15:28:WU00:FS01:Download 24.01%
08:15:34:WU00:FS01:Download 26.83%
08:15:40:WU00:FS01:Download 30.13%
08:15:46:WU00:FS01:Download 32.72%
08:15:52:WU00:FS01:Download 35.31%
08:15:58:WU00:FS01:Download 37.66%
08:16:04:WU00:FS01:Download 39.78%
08:16:10:WU00:FS01:Download 42.13%
08:16:16:WU00:FS01:Download 44.49%
08:16:22:WU00:FS01:Download 47.31%
08:16:28:WU00:FS01:Download 49.66%
08:16:34:WU00:FS01:Download 51.31%
08:16:40:WU00:FS01:Download 52.96%
08:16:46:WU00:FS01:Download 54.14%
08:16:52:WU00:FS01:Download 55.78%
08:16:58:WU00:FS01:Download 58.37%
08:17:04:WU00:FS01:Download 61.43%
08:17:10:WU00:FS01:Download 63.79%
08:17:17:WU00:FS01:Download 66.14%
08:17:23:WU00:FS01:Download 68.73%
08:17:29:WU00:FS01:Download 70.85%
08:17:34:WU03:FS01:0x22:Completed 2500000 out of 2500000 steps (100%)
08:17:34:WU03:FS01:0x22:Average performance: 8.78049 ns/day
08:17:35:WU03:FS01:0x22:Checkpoint completed at step 2500000
08:17:35:WU00:FS01:Download 72.97%
08:17:39:WU03:FS01:0x22:Saving result file ..\logfile_01.txt
08:17:39:WU03:FS01:0x22:Saving result file checkpointIntegrator.xml.bz2
08:17:39:WU03:FS01:0x22:Saving result file checkpointState.xml.bz2
08:17:39:WU03:FS01:0x22:Saving result file positions.xtc
08:17:39:WU03:FS01:0x22:Saving result file science.log
08:17:39:WU03:FS01:0x22:Folding@home Core Shutdown: FINISHED_UNIT
08:17:40:WU03:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
08:17:40:WU03:FS01:Sending unit results: id:03 state:SEND error:NO_ERROR project:17804 run:43 clone:25 gen:48 core:0x22 unit:0x00000019000000300000458c0000002b
08:17:40:WU03:FS01:Uploading 8.41MiB to 207.53.233.146
08:17:40:WU03:FS01:Connecting to 207.53.233.146:8080
08:17:41:WU00:FS01:Download 75.32%
08:17:47:WU00:FS01:Download 78.14%
08:17:53:WU00:FS01:Download 80.97%
08:17:54:WU03:FS01:Upload complete
08:17:54:WU03:FS01:Server responded WORK_ACK (400)
08:17:54:WU03:FS01:Final credit estimate, 104446.00 points
08:17:54:WU03:FS01:Cleaning up
08:17:59:WU00:FS01:Download 83.09%
08:18:05:WU00:FS01:Download 85.44%
08:18:11:WU00:FS01:Download 87.56%
08:18:17:WU00:FS01:Download 89.68%
08:18:23:WU00:FS01:Download 91.32%
08:18:29:WU00:FS01:Download 93.68%
08:18:35:WU00:FS01:Download 95.56%
08:18:41:WU00:FS01:Download 97.68%
08:18:47:WU00:FS01:Download 99.80%
08:18:47:WU00:FS01:Download complete
08:18:47:WU00:FS01:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:18202 run:14178 clone:1 gen:1 core:0x22 unit:0x00000001000000010000471a00003762
08:18:47:WU00:FS01:Starting
08:18:47:WU00:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 10600 -checkpoint 15 -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor nvidia -gpu 0 -gpu-usage 100
08:18:48:WU00:FS01:Started FahCore on PID 7200
08:18:48:WU00:FS01:Core PID:2740
08:18:48:WU00:FS01:FahCore 0x22 started
08:18:48:WU00:FS01:0x22:*********************** Log Started 2021-05-30T08:18:48Z ***********************
08:18:48:WU00:FS01:0x22:*************************** Core22 Folding@home Core ***************************
08:18:48:WU00:FS01:0x22: Core: Core22
08:18:48:WU00:FS01:0x22: Type: 0x22
08:18:48:WU00:FS01:0x22: Version: 0.0.13
08:18:48:WU00:FS01:0x22: Author: Joseph Coffland <[email protected]>
08:18:48:WU00:FS01:0x22: Copyright: 2020 foldingathome.org
08:18:48:WU00:FS01:0x22: Homepage: https://foldingathome.org/
08:18:48:WU00:FS01:0x22: Date: Sep 19 2020
08:18:48:WU00:FS01:0x22: Time: 02:35:58
08:18:48:WU00:FS01:0x22: Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
08:18:48:WU00:FS01:0x22: Branch: core22-0.0.13
08:18:48:WU00:FS01:0x22: Compiler: Visual C++ 2015
08:18:48:WU00:FS01:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
08:18:48:WU00:FS01:0x22: -DOPENMM_GIT_HASH="\"189320d0\""
08:18:48:WU00:FS01:0x22: Platform: win32 10
08:18:48:WU00:FS01:0x22: Bits: 64
08:18:48:WU00:FS01:0x22: Mode: Release
08:18:48:WU00:FS01:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
08:18:48:WU00:FS01:0x22: <[email protected]>
08:18:48:WU00:FS01:0x22: Args: -dir 00 -suffix 01 -version 706 -lifeline 7200 -checkpoint 15
08:18:48:WU00:FS01:0x22: -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
08:18:48:WU00:FS01:0x22: nvidia -gpu 0 -gpu-usage 100
08:18:48:WU00:FS01:0x22:************************************ libFAH ************************************
08:18:48:WU00:FS01:0x22: Date: Sep 7 2020
08:18:48:WU00:FS01:0x22: Time: 19:09:56
08:18:48:WU00:FS01:0x22: Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
08:18:48:WU00:FS01:0x22: Branch: HEAD
08:18:48:WU00:FS01:0x22: Compiler: Visual C++ 2015
08:18:48:WU00:FS01:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
08:18:48:WU00:FS01:0x22: Platform: win32 10
08:18:48:WU00:FS01:0x22: Bits: 64
08:18:48:WU00:FS01:0x22: Mode: Release
08:18:48:WU00:FS01:0x22:************************************ CBang *************************************
08:18:48:WU00:FS01:0x22: Date: Sep 7 2020
08:18:48:WU00:FS01:0x22: Time: 19:08:30
08:18:48:WU00:FS01:0x22: Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
08:18:48:WU00:FS01:0x22: Branch: HEAD
08:18:48:WU00:FS01:0x22: Compiler: Visual C++ 2015
08:18:48:WU00:FS01:0x22: Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
08:18:48:WU00:FS01:0x22: Platform: win32 10
08:18:48:WU00:FS01:0x22: Bits: 64
08:18:48:WU00:FS01:0x22: Mode: Release
08:18:48:WU00:FS01:0x22:************************************ System ************************************
08:18:48:WU00:FS01:0x22: CPU: Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz
08:18:48:WU00:FS01:0x22: CPU ID: GenuineIntel Family 6 Model 94 Stepping 3
08:18:48:WU00:FS01:0x22: CPUs: 8
08:18:48:WU00:FS01:0x22: Memory: 15.94GiB
08:18:48:WU00:FS01:0x22:Free Memory: 8.30GiB
08:18:48:WU00:FS01:0x22: Threads: WINDOWS_THREADS
08:18:48:WU00:FS01:0x22: OS Version: 6.2
08:18:48:WU00:FS01:0x22:Has Battery: false
08:18:48:WU00:FS01:0x22: On Battery: false
08:18:48:WU00:FS01:0x22: UTC Offset: 1
08:18:48:WU00:FS01:0x22: PID: 2740
08:18:48:WU00:FS01:0x22: CWD: C:\ProgramData\FAHClient\work
08:18:48:WU00:FS01:0x22:************************************ OpenMM ************************************
08:18:48:WU00:FS01:0x22: Revision: 189320d0
08:18:48:WU00:FS01:0x22:********************************************************************************
08:18:48:WU00:FS01:0x22:Project: 18202 (Run 14178, Clone 1, Gen 1)
08:18:48:WU00:FS01:0x22:Unit: 0x00000000000000000000000000000000
08:18:48:WU00:FS01:0x22:Reading tar file core.xml
08:18:48:WU00:FS01:0x22:Reading tar file integrator.xml
08:18:48:WU00:FS01:0x22:Reading tar file state.xml
08:18:49:WU00:FS01:0x22:Reading tar file system.xml
08:18:49:WU00:FS01:0x22:Digital signatures verified
08:18:49:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
08:18:49:WU00:FS01:0x22:Version 0.0.13
08:18:49:WU00:FS01:0x22: Checkpoint write interval: 25000 steps (2%) [50 total]
08:18:49:WU00:FS01:0x22: JSON viewer frame write interval: 12500 steps (1%) [100 total]
08:18:49:WU00:FS01:0x22: XTC frame write interval: 20000 steps (1.6%) [62 total]
08:18:49:WU00:FS01:0x22: Global context and integrator variables write interval: disabled
08:18:49:WU00:FS01:0x22:There are 4 platforms available.
08:18:49:WU00:FS01:0x22:Platform 0: Reference
08:18:49:WU00:FS01:0x22:Platform 1: CPU
08:18:49:WU00:FS01:0x22:Platform 2: OpenCL
08:18:49:WU00:FS01:0x22: opencl-device 0 specified
08:18:49:WU00:FS01:0x22:Platform 3: CUDA
08:18:49:WU00:FS01:0x22: cuda-device 0 specified
08:19:00:WU00:FS01:0x22:Attempting to create CUDA context:
08:19:00:WU00:FS01:0x22: Configuring platform CUDA
08:19:06:WU00:FS01:0x22: Using CUDA and gpu 0
08:19:06:WU00:FS01:0x22:Completed 0 out of 1250000 steps (0%)
08:19:07:WU00:FS01:0x22:Checkpoint completed at step 0
08:24:17:WU00:FS01:0x22:Completed 12500 out of 1250000 steps (1%)
08:29:26:WU00:FS01:0x22:Completed 25000 out of 1250000 steps (2%)
08:29:28:WU00:FS01:0x22:Checkpoint completed at step 25000
08:32:53:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:372 clone:1 gen:0 core:0x22 unit:0x00000001000000000000471a00000174
08:32:53:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
08:32:53:WU01:FS01:Connecting to 128.252.203.11:8080
08:33:23:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
08:34:40:WU00:FS01:0x22:Completed 37500 out of 1250000 steps (3%)
08:39:51:WU00:FS01:0x22:Completed 50000 out of 1250000 steps (4%)
08:39:53:WU00:FS01:0x22:Checkpoint completed at step 50000
08:45:04:WU00:FS01:0x22:Completed 62500 out of 1250000 steps (5%)
08:50:15:WU00:FS01:0x22:Completed 75000 out of 1250000 steps (6%)
08:50:17:WU00:FS01:0x22:Checkpoint completed at step 75000
08:55:27:WU00:FS01:0x22:Completed 87500 out of 1250000 steps (7%)
09:00:39:WU00:FS01:0x22:Completed 100000 out of 1250000 steps (8%)
09:00:41:WU00:FS01:0x22:Checkpoint completed at step 100000
09:05:54:WU00:FS01:0x22:Completed 112500 out of 1250000 steps (9%)
09:11:05:WU00:FS01:0x22:Completed 125000 out of 1250000 steps (10%)
09:11:06:WU00:FS01:0x22:Checkpoint completed at step 125000
09:16:18:WU00:FS01:0x22:Completed 137500 out of 1250000 steps (11%)
09:21:30:WU00:FS01:0x22:Completed 150000 out of 1250000 steps (12%)
09:21:32:WU00:FS01:0x22:Checkpoint completed at step 150000
09:26:44:WU00:FS01:0x22:Completed 162500 out of 1250000 steps (13%)
******************************* Date: 2021-05-30 *******************************
09:31:55:WU00:FS01:0x22:Completed 175000 out of 1250000 steps (14%)
09:31:56:WU00:FS01:0x22:Checkpoint completed at step 175000
09:32:53:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:372 clone:1 gen:0 core:0x22 unit:0x00000001000000000000471a00000174
09:32:53:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
09:32:53:WU01:FS01:Connecting to 128.252.203.11:8080
09:33:23:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
09:37:09:WU00:FS01:0x22:Completed 187500 out of 1250000 steps (15%)
09:42:20:WU00:FS01:0x22:Completed 200000 out of 1250000 steps (16%)
09:42:21:WU00:FS01:0x22:Checkpoint completed at step 200000
09:47:35:WU00:FS01:0x22:Completed 212500 out of 1250000 steps (17%)
09:52:48:WU00:FS01:0x22:Completed 225000 out of 1250000 steps (18%)
09:52:49:WU00:FS01:0x22:Checkpoint completed at step 225000
09:58:01:WU00:FS01:0x22:Completed 237500 out of 1250000 steps (19%)
10:03:12:WU00:FS01:0x22:Completed 250000 out of 1250000 steps (20%)
10:03:14:WU00:FS01:0x22:Checkpoint completed at step 250000
10:08:27:WU00:FS01:0x22:Completed 262500 out of 1250000 steps (21%)
10:13:39:WU00:FS01:0x22:Completed 275000 out of 1250000 steps (22%)
10:13:41:WU00:FS01:0x22:Checkpoint completed at step 275000
10:18:55:WU00:FS01:0x22:Completed 287500 out of 1250000 steps (23%)
10:24:06:WU00:FS01:0x22:Completed 300000 out of 1250000 steps (24%)
10:24:08:WU00:FS01:0x22:Checkpoint completed at step 300000
10:29:22:WU00:FS01:0x22:Completed 312500 out of 1250000 steps (25%)
10:32:53:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:372 clone:1 gen:0 core:0x22 unit:0x00000001000000000000471a00000174
10:32:53:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
10:32:53:WU01:FS01:Connecting to 128.252.203.11:8080
10:33:23:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
10:34:35:WU00:FS01:0x22:Completed 325000 out of 1250000 steps (26%)
10:34:37:WU00:FS01:0x22:Checkpoint completed at step 325000
10:39:49:WU00:FS01:0x22:Completed 337500 out of 1250000 steps (27%)
10:45:06:WU00:FS01:0x22:Completed 350000 out of 1250000 steps (28%)
10:45:08:WU00:FS01:0x22:Checkpoint completed at step 350000
10:50:20:WU00:FS01:0x22:Completed 362500 out of 1250000 steps (29%)
10:55:33:WU00:FS01:0x22:Completed 375000 out of 1250000 steps (30%)
10:55:35:WU00:FS01:0x22:Checkpoint completed at step 375000
11:00:48:WU00:FS01:0x22:Completed 387500 out of 1250000 steps (31%)
11:06:00:WU00:FS01:0x22:Completed 400000 out of 1250000 steps (32%)
11:06:02:WU00:FS01:0x22:Checkpoint completed at step 400000
11:11:17:WU00:FS01:0x22:Completed 412500 out of 1250000 steps (33%)
11:16:31:WU00:FS01:0x22:Completed 425000 out of 1250000 steps (34%)
11:16:33:WU00:FS01:0x22:Checkpoint completed at step 425000
11:21:46:WU00:FS01:0x22:Completed 437500 out of 1250000 steps (35%)
11:26:57:WU00:FS01:0x22:Completed 450000 out of 1250000 steps (36%)
11:26:59:WU00:FS01:0x22:Checkpoint completed at step 450000
11:32:12:WU00:FS01:0x22:Completed 462500 out of 1250000 steps (37%)
11:32:53:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:372 clone:1 gen:0 core:0x22 unit:0x00000001000000000000471a00000174
11:32:53:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
11:32:53:WU01:FS01:Connecting to 128.252.203.11:8080
11:33:23:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
11:37:24:WU00:FS01:0x22:Completed 475000 out of 1250000 steps (38%)
11:37:26:WU00:FS01:0x22:Checkpoint completed at step 475000
11:42:38:WU00:FS01:0x22:Completed 487500 out of 1250000 steps (39%)
11:47:56:WU00:FS01:0x22:Completed 500000 out of 1250000 steps (40%)
11:47:58:WU00:FS01:0x22:Checkpoint completed at step 500000
11:53:15:WU00:FS01:0x22:Completed 512500 out of 1250000 steps (41%)
11:58:26:WU00:FS01:0x22:Completed 525000 out of 1250000 steps (42%)
11:58:27:WU00:FS01:0x22:Checkpoint completed at step 525000
12:03:40:WU00:FS01:0x22:Completed 537500 out of 1250000 steps (43%)
12:08:55:WU00:FS01:0x22:Completed 550000 out of 1250000 steps (44%)
12:08:57:WU00:FS01:0x22:Checkpoint completed at step 550000
12:14:13:WU00:FS01:0x22:Completed 562500 out of 1250000 steps (45%)
12:19:34:WU00:FS01:0x22:Completed 575000 out of 1250000 steps (46%)
12:19:36:WU00:FS01:0x22:Checkpoint completed at step 575000
12:24:49:WU00:FS01:0x22:Completed 587500 out of 1250000 steps (47%)
12:30:01:WU00:FS01:0x22:Completed 600000 out of 1250000 steps (48%)
12:30:03:WU00:FS01:0x22:Checkpoint completed at step 600000
12:32:53:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:372 clone:1 gen:0 core:0x22 unit:0x00000001000000000000471a00000174
12:32:53:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
12:32:53:WU01:FS01:Connecting to 128.252.203.11:8080
12:33:23:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
12:35:18:WU00:FS01:0x22:Completed 612500 out of 1250000 steps (49%)
12:40:31:WU00:FS01:0x22:Completed 625000 out of 1250000 steps (50%)
12:40:33:WU00:FS01:0x22:Checkpoint completed at step 625000
12:45:50:WU00:FS01:0x22:Completed 637500 out of 1250000 steps (51%)
12:51:06:WU00:FS01:0x22:Completed 650000 out of 1250000 steps (52%)
12:51:08:WU00:FS01:0x22:Checkpoint completed at step 650000
12:56:21:WU00:FS01:0x22:Completed 662500 out of 1250000 steps (53%)
13:01:35:WU00:FS01:0x22:Completed 675000 out of 1250000 steps (54%)
13:01:37:WU00:FS01:0x22:Checkpoint completed at step 675000
13:06:52:WU00:FS01:0x22:Completed 687500 out of 1250000 steps (55%)
13:12:05:WU00:FS01:0x22:Completed 700000 out of 1250000 steps (56%)
13:12:07:WU00:FS01:0x22:Checkpoint completed at step 700000
13:17:21:WU00:FS01:0x22:Completed 712500 out of 1250000 steps (57%)
13:22:37:WU00:FS01:0x22:Completed 725000 out of 1250000 steps (58%)
13:22:39:WU00:FS01:0x22:Checkpoint completed at step 725000
13:27:50:WU00:FS01:0x22:Completed 737500 out of 1250000 steps (59%)
13:32:53:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:372 clone:1 gen:0 core:0x22 unit:0x00000001000000000000471a00000174
13:32:53:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
13:32:53:WU01:FS01:Connecting to 128.252.203.11:8080
13:33:01:WU00:FS01:0x22:Completed 750000 out of 1250000 steps (60%)
13:33:03:WU00:FS01:0x22:Checkpoint completed at step 750000
13:33:24:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
13:38:16:WU00:FS01:0x22:Completed 762500 out of 1250000 steps (61%)
13:43:30:WU00:FS01:0x22:Completed 775000 out of 1250000 steps (62%)
13:43:32:WU00:FS01:0x22:Checkpoint completed at step 775000
13:48:46:WU00:FS01:0x22:Completed 787500 out of 1250000 steps (63%)
13:54:01:WU00:FS01:0x22:Completed 800000 out of 1250000 steps (64%)
13:54:03:WU00:FS01:0x22:Checkpoint completed at step 800000
13:59:17:WU00:FS01:0x22:Completed 812500 out of 1250000 steps (65%)
14:04:22:WU00:FS01:0x22:Completed 825000 out of 1250000 steps (66%)
14:04:24:WU00:FS01:0x22:Checkpoint completed at step 825000
14:09:44:WU00:FS01:0x22:Completed 837500 out of 1250000 steps (67%)
14:14:57:WU00:FS01:0x22:Completed 850000 out of 1250000 steps (68%)
14:14:59:WU00:FS01:0x22:Checkpoint completed at step 850000
14:20:19:WU00:FS01:0x22:Completed 862500 out of 1250000 steps (69%)
14:25:20:WU00:FS01:0x22:Completed 875000 out of 1250000 steps (70%)
14:25:22:WU00:FS01:0x22:Checkpoint completed at step 875000
14:30:08:WU00:FS01:0x22:Completed 887500 out of 1250000 steps (71%)
14:32:53:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:372 clone:1 gen:0 core:0x22 unit:0x00000001000000000000471a00000174
14:32:53:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
14:32:53:WU01:FS01:Connecting to 128.252.203.11:8080
14:33:24:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
14:34:52:WU00:FS01:0x22:Completed 900000 out of 1250000 steps (72%)
14:34:53:WU00:FS01:0x22:Checkpoint completed at step 900000
14:39:35:WU00:FS01:0x22:Completed 912500 out of 1250000 steps (73%)
14:44:21:WU00:FS01:0x22:Completed 925000 out of 1250000 steps (74%)
14:44:23:WU00:FS01:0x22:Checkpoint completed at step 925000
14:49:11:WU00:FS01:0x22:Completed 937500 out of 1250000 steps (75%)
14:54:02:WU00:FS01:0x22:Completed 950000 out of 1250000 steps (76%)
14:54:04:WU00:FS01:0x22:Checkpoint completed at step 950000
14:58:49:WU00:FS01:0x22:Completed 962500 out of 1250000 steps (77%)
15:03:37:WU00:FS01:0x22:Completed 975000 out of 1250000 steps (78%)
15:03:39:WU00:FS01:0x22:Checkpoint completed at step 975000
15:08:32:WU00:FS01:0x22:Completed 987500 out of 1250000 steps (79%)
15:13:17:WU00:FS01:0x22:Completed 1000000 out of 1250000 steps (80%)
15:13:19:WU00:FS01:0x22:Checkpoint completed at step 1000000
15:18:16:WU00:FS01:0x22:Completed 1012500 out of 1250000 steps (81%)
15:23:50:WU00:FS01:0x22:Completed 1025000 out of 1250000 steps (82%)
15:23:52:WU00:FS01:0x22:Checkpoint completed at step 1025000
15:28:51:WU00:FS01:0x22:Completed 1037500 out of 1250000 steps (83%)
******************************* Date: 2021-05-30 *******************************
15:32:53:WU01:FS01:Sending unit results: id:01 state:SEND error:NO_ERROR project:18202 run:372 clone:1 gen:0 core:0x22 unit:0x00000001000000000000471a00000174
15:32:53:WU01:FS01:Uploading 27.50MiB to 128.252.203.11
15:32:53:WU01:FS01:Connecting to 128.252.203.11:8080
15:33:24:WARNING:WU01:FS01:Exception: Failed to send results to work server: 10002: Received short response, expected 512 bytes, got 0
15:34:03:WU00:FS01:0x22:Completed 1050000 out of 1250000 steps (84%)
15:34:05:WU00:FS01:0x22:Checkpoint completed at step 1050000
15:38:47:WU00:FS01:0x22:Completed 1062500 out of 1250000 steps (85%)
15:43:38:WU00:FS01:0x22:Completed 1075000 out of 1250000 steps (86%)
15:43:40:WU00:FS01:0x22:Checkpoint completed at step 1075000
15:49:00:WU00:FS01:0x22:Completed 1087500 out of 1250000 steps (87%)
15:54:11:WU00:FS01:0x22:Completed 1100000 out of 1250000 steps (88%)
15:54:13:WU00:FS01:0x22:Checkpoint completed at step 1100000
15:59:13:WU00:FS01:0x22:Completed 1112500 out of 1250000 steps (89%)
16:04:09:WU00:FS01:0x22:Completed 1125000 out of 1250000 steps (90%)
16:04:11:WU00:FS01:0x22:Checkpoint completed at step 1125000
16:09:03:WU00:FS01:0x22:Completed 1137500 out of 1250000 steps (91%)