129.32.209.207 not accepting my WUs (18432, 18431)

Moderators: Site Moderators, FAHC Science Team

Post Reply
belloq
Posts: 42
Joined: Thu Sep 24, 2020 12:58 pm

129.32.209.207 not accepting my WUs (18432, 18431)

Post by belloq »

I've had multiple WUs try to upload to 129.32.209.207 and they've been unable to connect/upload. Not sure where the problem is happening. The two snippets below are from a day or two apart.

Code: Select all

00:25:14:WU02:FS02:0x22:Completed 425000 out of 1250000 steps (34%)
00:25:17:WU02:FS02:0x22:Checkpoint completed at step 425000
00:31:44:WU02:FS02:0x22:Completed 437500 out of 1250000 steps (35%)
00:38:10:WU02:FS02:0x22:Completed 450000 out of 1250000 steps (36%)
00:38:13:WU02:FS02:0x22:Checkpoint completed at step 450000
00:44:37:WU02:FS02:0x22:Completed 462500 out of 1250000 steps (37%)
00:44:55:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:18431 run:55 clone:9 gen:26 core:0x22 unit:0x000000090000001a000047ff00000037
00:44:55:WU00:FS02:Uploading 14.31MiB to 129.32.209.202
00:44:55:WU00:FS02:Connecting to 129.32.209.202:8080
00:45:25:WU00:FS02:Upload 0.87%
00:45:25:WARNING:WU00:FS02:Exception: Failed to send results to work server: Transfer failed
00:45:25:WU00:FS02:Trying to send results to collection server
00:45:25:WU00:FS02:Uploading 14.31MiB to 129.32.209.207
00:45:25:WU00:FS02:Connecting to 129.32.209.207:8080
00:45:46:WU00:FS02:Upload 0.87%
00:45:46:ERROR:WU00:FS02:Exception: Transfer failed
00:51:03:WU02:FS02:0x22:Completed 475000 out of 1250000 steps (38%)
00:51:06:WU02:FS02:0x22:Checkpoint completed at step 475000
00:57:30:WU02:FS02:0x22:Completed 487500 out of 1250000 steps (39%)
01:03:55:WU02:FS02:0x22:Completed 500000 out of 1250000 steps (40%)
01:03:58:WU02:FS02:0x22:Checkpoint completed at step 500000
01:10:22:WU02:FS02:0x22:Completed 512500 out of 1250000 steps (41%)
01:16:46:WU02:FS02:0x22:Completed 525000 out of 1250000 steps (42%)
01:16:49:WU02:FS02:0x22:Checkpoint completed at step 525000

Code: Select all

05:50:14:WU00:FS02:Assigned to work server 129.32.209.202
05:50:14:WU00:FS02:Requesting new work unit for slot 02: gpu:1:0 TU117GLM [Quadro T2000 Mobile / Max-Q] from 129.32.209.202
05:50:14:WU00:FS02:Connecting to 129.32.209.202:8080
05:50:14:WU00:FS02:Downloading 27.81MiB
05:50:20:WU00:FS02:Download 18.20%
05:50:26:WU00:FS02:Download 41.35%
05:50:32:WU00:FS02:Download 64.95%
05:50:38:WU00:FS02:Download 91.02%
05:50:40:WU00:FS02:Download complete
05:50:40:WU00:FS02:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:18432 run:25 clone:10 gen:81 core:0x22 unit:0x0000000a000000510000480000000019
05:53:28:WU02:FS02:0x22:Completed 5000000 out of 5000000 steps (100%)
05:53:28:WU02:FS02:0x22:Average performance: 8.70968 ns/day
05:53:28:WU02:FS02:0x22:Checkpoint completed at step 5000000
05:53:31:WU02:FS02:0x22:Saving result file ..\logfile_01.txt
05:53:31:WU02:FS02:0x22:Saving result file checkpointIntegrator.xml.bz2
05:53:31:WU02:FS02:0x22:Saving result file checkpointState.xml.bz2
05:53:31:WU02:FS02:0x22:Saving result file positions.xtc
05:53:31:WU02:FS02:0x22:Saving result file science.log
05:53:31:WU02:FS02:0x22:Folding@home Core Shutdown: FINISHED_UNIT
05:53:31:WU02:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
05:53:31:WU02:FS02:Sending unit results: id:02 state:SEND error:NO_ERROR project:17806 run:31 clone:81 gen:443 core:0x22 unit:0x00000051000001bb0000458e0000001f
05:53:31:WU02:FS02:Uploading 4.88MiB to 207.53.233.146
05:53:31:WU02:FS02:Connecting to 207.53.233.146:8080
05:53:32:WU00:FS02:Starting
05:53:32:WU00:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.18/Core_22.fah/FahCore_22.exe -dir 00 -suffix 01 -version 706 -lifeline 1804 -checkpoint 10 -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor nvidia -gpu 0 -gpu-usage 100
05:53:32:WU00:FS02:Started FahCore on PID 31944
05:53:33:WU00:FS02:Core PID:59056
05:53:33:WU00:FS02:FahCore 0x22 started
05:53:34:WU00:FS02:0x22:*********************** Log Started 2021-12-10T05:53:33Z ***********************
05:53:34:WU00:FS02:0x22:*************************** Core22 Folding@home Core ***************************
05:53:34:WU00:FS02:0x22:       Core: Core22
05:53:34:WU00:FS02:0x22:       Type: 0x22
05:53:34:WU00:FS02:0x22:    Version: 0.0.18
05:53:34:WU00:FS02:0x22:     Author: Joseph Coffland <[email protected]>
05:53:34:WU00:FS02:0x22:  Copyright: 2020 foldingathome.org
05:53:34:WU00:FS02:0x22:   Homepage: https://foldingathome.org/
05:53:34:WU00:FS02:0x22:       Date: Sep 28 2021
05:53:34:WU00:FS02:0x22:       Time: 05:55:05
05:53:34:WU00:FS02:0x22:   Revision: cfe3d7d990e8f456e371f8ce63b5fcc6daab2103
05:53:34:WU00:FS02:0x22:     Branch: HEAD
05:53:34:WU00:FS02:0x22:   Compiler: Visual C++
05:53:34:WU00:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
05:53:34:WU00:FS02:0x22:             -DOPENMM_VERSION="\"7.6.0\""
05:53:34:WU00:FS02:0x22:   Platform: win32 10
05:53:34:WU00:FS02:0x22:       Bits: 64
05:53:34:WU00:FS02:0x22:       Mode: Release
05:53:34:WU00:FS02:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
05:53:34:WU00:FS02:0x22:             <[email protected]>
05:53:34:WU00:FS02:0x22:       Args: -dir 00 -suffix 01 -version 706 -lifeline 31944 -checkpoint 10
05:53:34:WU00:FS02:0x22:             -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
05:53:34:WU00:FS02:0x22:             nvidia -gpu 0 -gpu-usage 100
05:53:34:WU00:FS02:0x22:************************************ libFAH ************************************
05:53:34:WU00:FS02:0x22:       Date: Sep 28 2021
05:53:34:WU00:FS02:0x22:       Time: 05:53:43
05:53:34:WU00:FS02:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
05:53:34:WU00:FS02:0x22:     Branch: HEAD
05:53:34:WU00:FS02:0x22:   Compiler: Visual C++
05:53:34:WU00:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
05:53:34:WU00:FS02:0x22:   Platform: win32 10
05:53:34:WU00:FS02:0x22:       Bits: 64
05:53:34:WU00:FS02:0x22:       Mode: Release
05:53:34:WU00:FS02:0x22:************************************ CBang *************************************
05:53:34:WU00:FS02:0x22:       Date: Sep 28 2021
05:53:34:WU00:FS02:0x22:       Time: 05:52:38
05:53:34:WU00:FS02:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
05:53:34:WU00:FS02:0x22:     Branch: HEAD
05:53:34:WU00:FS02:0x22:   Compiler: Visual C++
05:53:34:WU00:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
05:53:34:WU00:FS02:0x22:   Platform: win32 10
05:53:34:WU00:FS02:0x22:       Bits: 64
05:53:34:WU00:FS02:0x22:       Mode: Release
05:53:34:WU00:FS02:0x22:************************************ System ************************************
05:53:34:WU00:FS02:0x22:        CPU: Intel(R) Xeon(R) E-2276M CPU @ 2.80GHz
05:53:34:WU00:FS02:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
05:53:34:WU00:FS02:0x22:       CPUs: 12
05:53:34:WU00:FS02:0x22:     Memory: 31.71GiB
05:53:34:WU00:FS02:0x22:Free Memory: 14.74GiB
05:53:34:WU00:FS02:0x22:    Threads: WINDOWS_THREADS
05:53:34:WU00:FS02:0x22: OS Version: 6.2
05:53:34:WU00:FS02:0x22:Has Battery: true
05:53:34:WU00:FS02:0x22: On Battery: false
05:53:34:WU00:FS02:0x22: UTC Offset: -8
05:53:34:WU00:FS02:0x22:        PID: 59056
05:53:34:WU00:FS02:0x22:        CWD: C:\ProgramData\FAHClient\work
05:53:34:WU00:FS02:0x22:************************************ OpenMM ************************************
05:53:34:WU00:FS02:0x22:    Version: 7.6.0
05:53:34:WU00:FS02:0x22:********************************************************************************
05:53:34:WU00:FS02:0x22:Project: 18432 (Run 25, Clone 10, Gen 81)
05:53:34:WU00:FS02:0x22:Unit: 0x00000000000000000000000000000000
05:53:34:WU00:FS02:0x22:Reading tar file core.xml
05:53:34:WU00:FS02:0x22:Reading tar file integrator.xml
05:53:34:WU00:FS02:0x22:Reading tar file state.xml
05:53:34:WU00:FS02:0x22:Reading tar file system.xml
05:53:34:WU00:FS02:0x22:Digital signatures verified
05:53:34:WU00:FS02:0x22:Folding@home GPU Core22 Folding@home Core
05:53:34:WU00:FS02:0x22:Version 0.0.18
05:53:35:WU00:FS02:0x22:  Checkpoint write interval: 100000 steps (2%) [50 total]
05:53:35:WU00:FS02:0x22:  JSON viewer frame write interval: 50000 steps (1%) [100 total]
05:53:35:WU00:FS02:0x22:  XTC frame write interval: 250000 steps (5%) [20 total]
05:53:35:WU00:FS02:0x22:  Global context and integrator variables write interval: disabled
05:53:35:WU00:FS02:0x22:There are 4 platforms available.
05:53:35:WU00:FS02:0x22:Platform 0: Reference
05:53:35:WU00:FS02:0x22:Platform 1: CPU
05:53:35:WU00:FS02:0x22:Platform 2: OpenCL
05:53:35:WU00:FS02:0x22:  opencl-device 0 specified
05:53:35:WU00:FS02:0x22:Platform 3: CUDA
05:53:35:WU00:FS02:0x22:  cuda-device 0 specified
05:53:37:WU02:FS02:Upload 28.18%
05:53:43:WU02:FS02:Upload 65.33%
05:53:46:WU00:FS02:0x22:Attempting to create CUDA context:
05:53:46:WU00:FS02:0x22:  Configuring platform CUDA
05:53:49:WU02:FS02:Upload complete
05:53:49:WU02:FS02:Server responded WORK_ACK (400)
05:53:49:WU02:FS02:Final credit estimate, 42964.00 points
05:53:49:WU02:FS02:Cleaning up
05:53:51:WU00:FS02:0x22:  Using CUDA and gpu 0
05:53:51:WU00:FS02:0x22:Completed 0 out of 5000000 steps (0%)
05:53:52:WU00:FS02:0x22:Checkpoint completed at step 0
05:58:25:WU00:FS02:0x22:Completed 50000 out of 5000000 steps (1%)
06:02:59:WU00:FS02:0x22:Completed 100000 out of 5000000 steps (2%)
06:03:00:WU00:FS02:0x22:Checkpoint completed at step 100000
06:07:33:WU00:FS02:0x22:Completed 150000 out of 5000000 steps (3%)
06:12:16:WU00:FS02:0x22:Completed 200000 out of 5000000 steps (4%)
06:12:17:WU00:FS02:0x22:Checkpoint completed at step 200000
06:16:50:WU00:FS02:0x22:Completed 250000 out of 5000000 steps (5%)
06:21:24:WU00:FS02:0x22:Completed 300000 out of 5000000 steps (6%)
06:21:25:WU00:FS02:0x22:Checkpoint completed at step 300000
06:26:02:WU00:FS02:0x22:Completed 350000 out of 5000000 steps (7%)
06:30:34:WU00:FS02:0x22:Completed 400000 out of 5000000 steps (8%)
06:30:35:WU00:FS02:0x22:Checkpoint completed at step 400000
06:35:09:WU00:FS02:0x22:Completed 450000 out of 5000000 steps (9%)
06:39:46:WU00:FS02:0x22:Completed 500000 out of 5000000 steps (10%)
06:39:47:WU00:FS02:0x22:Checkpoint completed at step 500000
06:44:20:WU00:FS02:0x22:Completed 550000 out of 5000000 steps (11%)
06:48:57:WU00:FS02:0x22:Completed 600000 out of 5000000 steps (12%)
06:48:57:WU00:FS02:0x22:Checkpoint completed at step 600000
06:53:31:WU00:FS02:0x22:Completed 650000 out of 5000000 steps (13%)
06:58:06:WU00:FS02:0x22:Completed 700000 out of 5000000 steps (14%)
06:58:07:WU00:FS02:0x22:Checkpoint completed at step 700000
07:02:47:WU00:FS02:0x22:Completed 750000 out of 5000000 steps (15%)
07:07:21:WU00:FS02:0x22:Completed 800000 out of 5000000 steps (16%)
07:07:22:WU00:FS02:0x22:Checkpoint completed at step 800000
07:11:57:WU00:FS02:0x22:Completed 850000 out of 5000000 steps (17%)
07:16:32:WU00:FS02:0x22:Completed 900000 out of 5000000 steps (18%)
07:16:32:WU00:FS02:0x22:Checkpoint completed at step 900000
07:21:06:WU00:FS02:0x22:Completed 950000 out of 5000000 steps (19%)
07:25:40:WU00:FS02:0x22:Completed 1000000 out of 5000000 steps (20%)
07:25:41:WU00:FS02:0x22:Checkpoint completed at step 1000000
07:30:18:WU00:FS02:0x22:Completed 1050000 out of 5000000 steps (21%)
07:34:52:WU00:FS02:0x22:Completed 1100000 out of 5000000 steps (22%)
07:34:53:WU00:FS02:0x22:Checkpoint completed at step 1100000
07:39:28:WU00:FS02:0x22:Completed 1150000 out of 5000000 steps (23%)
07:44:05:WU00:FS02:0x22:Completed 1200000 out of 5000000 steps (24%)
07:44:06:WU00:FS02:0x22:Checkpoint completed at step 1200000
07:48:50:WU00:FS02:0x22:Completed 1250000 out of 5000000 steps (25%)
07:53:24:WU00:FS02:0x22:Completed 1300000 out of 5000000 steps (26%)
07:53:25:WU00:FS02:0x22:Checkpoint completed at step 1300000
07:58:07:WU00:FS02:0x22:Completed 1350000 out of 5000000 steps (27%)
08:03:07:WU00:FS02:0x22:Completed 1400000 out of 5000000 steps (28%)
08:03:08:WU00:FS02:0x22:Checkpoint completed at step 1400000
08:08:11:WU00:FS02:0x22:Completed 1450000 out of 5000000 steps (29%)
08:13:04:WU00:FS02:0x22:Completed 1500000 out of 5000000 steps (30%)
08:13:05:WU00:FS02:0x22:Checkpoint completed at step 1500000
08:17:51:WU00:FS02:0x22:Completed 1550000 out of 5000000 steps (31%)
08:22:57:WU00:FS02:0x22:Completed 1600000 out of 5000000 steps (32%)
08:22:58:WU00:FS02:0x22:Checkpoint completed at step 1600000
08:27:39:WU00:FS02:0x22:Completed 1650000 out of 5000000 steps (33%)
08:32:15:WU00:FS02:0x22:Completed 1700000 out of 5000000 steps (34%)
08:32:15:WU00:FS02:0x22:Checkpoint completed at step 1700000
08:36:46:WU00:FS02:0x22:Completed 1750000 out of 5000000 steps (35%)
08:41:22:WU00:FS02:0x22:Completed 1800000 out of 5000000 steps (36%)
08:41:23:WU00:FS02:0x22:Checkpoint completed at step 1800000
08:46:04:WU00:FS02:0x22:Completed 1850000 out of 5000000 steps (37%)
08:50:34:WU00:FS02:0x22:Completed 1900000 out of 5000000 steps (38%)
08:50:35:WU00:FS02:0x22:Checkpoint completed at step 1900000
08:55:11:WU00:FS02:0x22:Completed 1950000 out of 5000000 steps (39%)
08:59:41:WU00:FS02:0x22:Completed 2000000 out of 5000000 steps (40%)
08:59:42:WU00:FS02:0x22:Checkpoint completed at step 2000000
09:04:16:WU00:FS02:0x22:Completed 2050000 out of 5000000 steps (41%)
09:08:52:WU00:FS02:0x22:Completed 2100000 out of 5000000 steps (42%)
09:08:53:WU00:FS02:0x22:Checkpoint completed at step 2100000
09:13:23:WU00:FS02:0x22:Completed 2150000 out of 5000000 steps (43%)
09:17:59:WU00:FS02:0x22:Completed 2200000 out of 5000000 steps (44%)
09:17:59:WU00:FS02:0x22:Checkpoint completed at step 2200000
09:22:32:WU00:FS02:0x22:Completed 2250000 out of 5000000 steps (45%)
09:27:05:WU00:FS02:0x22:Completed 2300000 out of 5000000 steps (46%)
09:27:05:WU00:FS02:0x22:Checkpoint completed at step 2300000
09:31:38:WU00:FS02:0x22:Completed 2350000 out of 5000000 steps (47%)
09:36:09:WU00:FS02:0x22:Completed 2400000 out of 5000000 steps (48%)
09:36:10:WU00:FS02:0x22:Checkpoint completed at step 2400000
09:40:45:WU00:FS02:0x22:Completed 2450000 out of 5000000 steps (49%)
09:45:22:WU00:FS02:0x22:Completed 2500000 out of 5000000 steps (50%)
09:45:22:WU00:FS02:0x22:Checkpoint completed at step 2500000
09:49:52:WU00:FS02:0x22:Completed 2550000 out of 5000000 steps (51%)
09:54:29:WU00:FS02:0x22:Completed 2600000 out of 5000000 steps (52%)
09:54:29:WU00:FS02:0x22:Checkpoint completed at step 2600000
09:59:01:WU00:FS02:0x22:Completed 2650000 out of 5000000 steps (53%)
10:03:30:WU00:FS02:0x22:Completed 2700000 out of 5000000 steps (54%)
10:03:31:WU00:FS02:0x22:Checkpoint completed at step 2700000
10:08:01:WU00:FS02:0x22:Completed 2750000 out of 5000000 steps (55%)
10:12:31:WU00:FS02:0x22:Completed 2800000 out of 5000000 steps (56%)
10:12:32:WU00:FS02:0x22:Checkpoint completed at step 2800000
10:17:05:WU00:FS02:0x22:Completed 2850000 out of 5000000 steps (57%)
10:21:37:WU00:FS02:0x22:Completed 2900000 out of 5000000 steps (58%)
10:21:37:WU00:FS02:0x22:Checkpoint completed at step 2900000
10:26:09:WU00:FS02:0x22:Completed 2950000 out of 5000000 steps (59%)
10:30:39:WU00:FS02:0x22:Completed 3000000 out of 5000000 steps (60%)
10:30:40:WU00:FS02:0x22:Checkpoint completed at step 3000000
10:35:11:WU00:FS02:0x22:Completed 3050000 out of 5000000 steps (61%)
10:39:43:WU00:FS02:0x22:Completed 3100000 out of 5000000 steps (62%)
10:39:44:WU00:FS02:0x22:Checkpoint completed at step 3100000
10:44:29:WU00:FS02:0x22:Completed 3150000 out of 5000000 steps (63%)
10:48:57:WU00:FS02:0x22:Completed 3200000 out of 5000000 steps (64%)
10:48:58:WU00:FS02:0x22:Checkpoint completed at step 3200000
10:53:41:WU00:FS02:0x22:Completed 3250000 out of 5000000 steps (65%)
10:58:12:WU00:FS02:0x22:Completed 3300000 out of 5000000 steps (66%)
10:58:13:WU00:FS02:0x22:Checkpoint completed at step 3300000
11:02:41:WU00:FS02:0x22:Completed 3350000 out of 5000000 steps (67%)
11:07:11:WU00:FS02:0x22:Completed 3400000 out of 5000000 steps (68%)
11:07:11:WU00:FS02:0x22:Checkpoint completed at step 3400000
11:11:38:WU00:FS02:0x22:Completed 3450000 out of 5000000 steps (69%)
11:16:09:WU00:FS02:0x22:Completed 3500000 out of 5000000 steps (70%)
11:16:09:WU00:FS02:0x22:Checkpoint completed at step 3500000
11:20:40:WU00:FS02:0x22:Completed 3550000 out of 5000000 steps (71%)
11:25:09:WU00:FS02:0x22:Completed 3600000 out of 5000000 steps (72%)
11:25:09:WU00:FS02:0x22:Checkpoint completed at step 3600000
11:29:38:WU00:FS02:0x22:Completed 3650000 out of 5000000 steps (73%)
11:34:07:WU00:FS02:0x22:Completed 3700000 out of 5000000 steps (74%)
11:34:08:WU00:FS02:0x22:Checkpoint completed at step 3700000
11:38:35:WU00:FS02:0x22:Completed 3750000 out of 5000000 steps (75%)
11:43:04:WU00:FS02:0x22:Completed 3800000 out of 5000000 steps (76%)
11:43:05:WU00:FS02:0x22:Checkpoint completed at step 3800000
******************************* Date: 2021-12-10 *******************************
11:47:36:WU00:FS02:0x22:Completed 3850000 out of 5000000 steps (77%)
11:52:07:WU00:FS02:0x22:Completed 3900000 out of 5000000 steps (78%)
11:52:08:WU00:FS02:0x22:Checkpoint completed at step 3900000
11:56:39:WU00:FS02:0x22:Completed 3950000 out of 5000000 steps (79%)
12:01:08:WU00:FS02:0x22:Completed 4000000 out of 5000000 steps (80%)
12:01:09:WU00:FS02:0x22:Checkpoint completed at step 4000000
12:05:41:WU00:FS02:0x22:Completed 4050000 out of 5000000 steps (81%)
12:10:10:WU00:FS02:0x22:Completed 4100000 out of 5000000 steps (82%)
12:10:11:WU00:FS02:0x22:Checkpoint completed at step 4100000
12:14:40:WU00:FS02:0x22:Completed 4150000 out of 5000000 steps (83%)
12:19:09:WU00:FS02:0x22:Completed 4200000 out of 5000000 steps (84%)
12:19:10:WU00:FS02:0x22:Checkpoint completed at step 4200000
12:23:51:WU00:FS02:0x22:Completed 4250000 out of 5000000 steps (85%)
12:28:20:WU00:FS02:0x22:Completed 4300000 out of 5000000 steps (86%)
12:28:20:WU00:FS02:0x22:Checkpoint completed at step 4300000
12:32:54:WU00:FS02:0x22:Completed 4350000 out of 5000000 steps (87%)
12:37:25:WU00:FS02:0x22:Completed 4400000 out of 5000000 steps (88%)
12:37:26:WU00:FS02:0x22:Checkpoint completed at step 4400000
12:41:58:WU00:FS02:0x22:Completed 4450000 out of 5000000 steps (89%)
12:46:31:WU00:FS02:0x22:Completed 4500000 out of 5000000 steps (90%)
12:46:32:WU00:FS02:0x22:Checkpoint completed at step 4500000
12:51:04:WU00:FS02:0x22:Completed 4550000 out of 5000000 steps (91%)
12:56:19:WU00:FS02:0x22:Completed 4600000 out of 5000000 steps (92%)
12:56:20:WU00:FS02:0x22:Checkpoint completed at step 4600000
13:01:24:WU00:FS02:0x22:Completed 4650000 out of 5000000 steps (93%)
13:06:14:WU00:FS02:0x22:Completed 4700000 out of 5000000 steps (94%)
13:06:15:WU00:FS02:0x22:Checkpoint completed at step 4700000
13:10:54:WU00:FS02:0x22:Completed 4750000 out of 5000000 steps (95%)
13:15:54:WU00:FS02:0x22:Completed 4800000 out of 5000000 steps (96%)
13:15:54:WU00:FS02:0x22:Checkpoint completed at step 4800000
13:20:51:WU00:FS02:0x22:Completed 4850000 out of 5000000 steps (97%)
13:25:36:WU00:FS02:0x22:Completed 4900000 out of 5000000 steps (98%)
13:25:37:WU00:FS02:0x22:Checkpoint completed at step 4900000
13:30:21:WU00:FS02:0x22:Completed 4950000 out of 5000000 steps (99%)
13:30:22:WU02:FS02:Connecting to assign1.foldingathome.org:80
13:30:22:WU02:FS02:Assigned to work server 140.163.4.210
13:30:23:WU02:FS02:Requesting new work unit for slot 02: gpu:1:0 TU117GLM [Quadro T2000 Mobile / Max-Q] from 140.163.4.210
13:30:23:WU02:FS02:Connecting to 140.163.4.210:8080
13:30:23:WU02:FS02:Downloading 5.28MiB
13:30:28:WU02:FS02:Download complete
13:30:29:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:16488 run:0 clone:281 gen:87 core:0x22 unit:0x00000119000000570000406800000000
13:35:07:WU00:FS02:0x22:Completed 5000000 out of 5000000 steps (100%)
13:35:07:WU00:FS02:0x22:Average performance: 75.7895 ns/day
13:35:07:WU00:FS02:0x22:Checkpoint completed at step 5000000
13:35:09:WU00:FS02:0x22:Saving result file ..\logfile_01.txt
13:35:09:WU00:FS02:0x22:Saving result file checkpointIntegrator.xml
13:35:09:WU00:FS02:0x22:Saving result file checkpointState.xml
13:35:12:WU00:FS02:0x22:Saving result file positions.xtc
13:35:12:WU00:FS02:0x22:Saving result file science.log
13:35:12:WU00:FS02:0x22:Folding@home Core Shutdown: FINISHED_UNIT
13:35:13:WU00:FS02:FahCore returned: FINISHED_UNIT (100 = 0x64)
13:35:13:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:18432 run:25 clone:10 gen:81 core:0x22 unit:0x0000000a000000510000480000000019
13:35:13:WU00:FS02:Uploading 14.34MiB to 129.32.209.202
13:35:13:WU00:FS02:Connecting to 129.32.209.202:8080
13:35:13:WU02:FS02:Starting
13:35:13:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\ProgramData\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe -dir 02 -suffix 01 -version 706 -lifeline 1804 -checkpoint 10 -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor nvidia -gpu 0 -gpu-usage 100
13:35:14:WU02:FS02:Started FahCore on PID 47140
13:35:15:WU02:FS02:Core PID:58980
13:35:15:WU02:FS02:FahCore 0x22 started
13:35:16:WU02:FS02:0x22:*********************** Log Started 2021-12-10T13:35:15Z ***********************
13:35:16:WU02:FS02:0x22:*************************** Core22 Folding@home Core ***************************
13:35:16:WU02:FS02:0x22:       Core: Core22
13:35:16:WU02:FS02:0x22:       Type: 0x22
13:35:16:WU02:FS02:0x22:    Version: 0.0.13
13:35:16:WU02:FS02:0x22:     Author: Joseph Coffland <[email protected]>
13:35:16:WU02:FS02:0x22:  Copyright: 2020 foldingathome.org
13:35:16:WU02:FS02:0x22:   Homepage: https://foldingathome.org/
13:35:16:WU02:FS02:0x22:       Date: Sep 19 2020
13:35:16:WU02:FS02:0x22:       Time: 02:35:58
13:35:16:WU02:FS02:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
13:35:16:WU02:FS02:0x22:     Branch: core22-0.0.13
13:35:16:WU02:FS02:0x22:   Compiler: Visual C++ 2015
13:35:16:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
13:35:16:WU02:FS02:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
13:35:16:WU02:FS02:0x22:   Platform: win32 10
13:35:16:WU02:FS02:0x22:       Bits: 64
13:35:16:WU02:FS02:0x22:       Mode: Release
13:35:16:WU02:FS02:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
13:35:16:WU02:FS02:0x22:             <[email protected]>
13:35:16:WU02:FS02:0x22:       Args: -dir 02 -suffix 01 -version 706 -lifeline 47140 -checkpoint 10
13:35:16:WU02:FS02:0x22:             -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
13:35:16:WU02:FS02:0x22:             nvidia -gpu 0 -gpu-usage 100
13:35:16:WU02:FS02:0x22:************************************ libFAH ************************************
13:35:16:WU02:FS02:0x22:       Date: Sep 7 2020
13:35:16:WU02:FS02:0x22:       Time: 19:09:56
13:35:16:WU02:FS02:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
13:35:16:WU02:FS02:0x22:     Branch: HEAD
13:35:16:WU02:FS02:0x22:   Compiler: Visual C++ 2015
13:35:16:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
13:35:16:WU02:FS02:0x22:   Platform: win32 10
13:35:16:WU02:FS02:0x22:       Bits: 64
13:35:16:WU02:FS02:0x22:       Mode: Release
13:35:16:WU02:FS02:0x22:************************************ CBang *************************************
13:35:16:WU02:FS02:0x22:       Date: Sep 7 2020
13:35:16:WU02:FS02:0x22:       Time: 19:08:30
13:35:16:WU02:FS02:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
13:35:16:WU02:FS02:0x22:     Branch: HEAD
13:35:16:WU02:FS02:0x22:   Compiler: Visual C++ 2015
13:35:16:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
13:35:16:WU02:FS02:0x22:   Platform: win32 10
13:35:16:WU02:FS02:0x22:       Bits: 64
13:35:16:WU02:FS02:0x22:       Mode: Release
13:35:16:WU02:FS02:0x22:************************************ System ************************************
13:35:16:WU02:FS02:0x22:        CPU: Intel(R) Xeon(R) E-2276M CPU @ 2.80GHz
13:35:16:WU02:FS02:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 13
13:35:16:WU02:FS02:0x22:       CPUs: 12
13:35:16:WU02:FS02:0x22:     Memory: 31.71GiB
13:35:16:WU02:FS02:0x22:Free Memory: 15.82GiB
13:35:16:WU02:FS02:0x22:    Threads: WINDOWS_THREADS
13:35:16:WU02:FS02:0x22: OS Version: 6.2
13:35:16:WU02:FS02:0x22:Has Battery: true
13:35:16:WU02:FS02:0x22: On Battery: false
13:35:16:WU02:FS02:0x22: UTC Offset: -8
13:35:16:WU02:FS02:0x22:        PID: 58980
13:35:16:WU02:FS02:0x22:        CWD: C:\ProgramData\FAHClient\work
13:35:16:WU02:FS02:0x22:************************************ OpenMM ************************************
13:35:16:WU02:FS02:0x22:   Revision: 189320d0
13:35:16:WU02:FS02:0x22:********************************************************************************
13:35:16:WU02:FS02:0x22:Project: 16488 (Run 0, Clone 281, Gen 87)
13:35:16:WU02:FS02:0x22:Unit: 0x00000000000000000000000000000000
13:35:16:WU02:FS02:0x22:Reading tar file core.xml
13:35:16:WU02:FS02:0x22:Reading tar file integrator.xml.bz2
13:35:16:WU02:FS02:0x22:Reading tar file state.xml.bz2
13:35:16:WU02:FS02:0x22:Reading tar file system.xml.bz2
13:35:16:WU02:FS02:0x22:Digital signatures verified
13:35:17:WU02:FS02:0x22:Folding@home GPU Core22 Folding@home Core
13:35:17:WU02:FS02:0x22:Version 0.0.13
13:35:18:WU02:FS02:0x22:  Checkpoint write interval: 125000 steps (5%) [20 total]
13:35:18:WU02:FS02:0x22:  JSON viewer frame write interval: 25000 steps (1%) [100 total]
13:35:18:WU02:FS02:0x22:  XTC frame write interval: 250000 steps (10%) [10 total]
13:35:18:WU02:FS02:0x22:  Global context and integrator variables write interval: disabled
13:35:18:WU02:FS02:0x22:There are 4 platforms available.
13:35:18:WU02:FS02:0x22:Platform 0: Reference
13:35:18:WU02:FS02:0x22:Platform 1: CPU
13:35:18:WU02:FS02:0x22:Platform 2: OpenCL
13:35:18:WU02:FS02:0x22:  opencl-device 0 specified
13:35:18:WU02:FS02:0x22:Platform 3: CUDA
13:35:18:WU02:FS02:0x22:  cuda-device 0 specified
13:35:25:WU02:FS02:0x22:Attempting to create CUDA context:
13:35:25:WU02:FS02:0x22:  Configuring platform CUDA
13:35:34:WU00:FS02:Upload 0.87%
13:35:34:WARNING:WU00:FS02:Exception: Failed to send results to work server: Transfer failed
13:35:34:WU00:FS02:Trying to send results to collection server
13:35:34:WU00:FS02:Uploading 14.34MiB to 129.32.209.207
13:35:34:WU00:FS02:Connecting to 129.32.209.207:8080
13:35:36:WU02:FS02:0x22:  Using CUDA and gpu 0
13:35:36:WU02:FS02:0x22:Completed 0 out of 2500000 steps (0%)
13:35:36:WU02:FS02:0x22:Checkpoint completed at step 0
13:35:57:WU00:FS02:Upload 0.87%
13:35:57:ERROR:WU00:FS02:Exception: Transfer failed
13:35:58:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:18432 run:25 clone:10 gen:81 core:0x22 unit:0x0000000a000000510000480000000019
13:35:58:WU00:FS02:Uploading 14.34MiB to 129.32.209.202
13:35:58:WU00:FS02:Connecting to 129.32.209.202:8080
13:36:19:WU00:FS02:Upload 0.87%
13:36:19:WARNING:WU00:FS02:Exception: Failed to send results to work server: Transfer failed
13:36:19:WU00:FS02:Trying to send results to collection server
13:36:19:WU00:FS02:Uploading 14.34MiB to 129.32.209.207
13:36:19:WU00:FS02:Connecting to 129.32.209.207:8080
13:36:42:WU00:FS02:Upload 0.87%
13:36:42:ERROR:WU00:FS02:Exception: Transfer failed
13:36:58:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:18432 run:25 clone:10 gen:81 core:0x22 unit:0x0000000a000000510000480000000019
13:36:58:WU00:FS02:Uploading 14.34MiB to 129.32.209.202
13:36:58:WU00:FS02:Connecting to 129.32.209.202:8080
13:37:22:WU00:FS02:Upload 0.87%
13:37:22:WARNING:WU00:FS02:Exception: Failed to send results to work server: Transfer failed
13:37:22:WU00:FS02:Trying to send results to collection server
13:37:22:WU00:FS02:Uploading 14.34MiB to 129.32.209.207
13:37:22:WU00:FS02:Connecting to 129.32.209.207:8080
13:37:52:WU00:FS02:Upload 0.87%
13:37:53:ERROR:WU00:FS02:Exception: Transfer failed
13:38:03:WU02:FS02:0x22:Completed 25000 out of 2500000 steps (1%)
13:38:35:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:18432 run:25 clone:10 gen:81 core:0x22 unit:0x0000000a000000510000480000000019
13:38:35:WU00:FS02:Uploading 14.34MiB to 129.32.209.202
13:38:35:WU00:FS02:Connecting to 129.32.209.202:8080
13:39:05:WU00:FS02:Upload 0.87%
13:39:06:WARNING:WU00:FS02:Exception: Failed to send results to work server: Transfer failed
13:39:06:WU00:FS02:Trying to send results to collection server
13:39:06:WU00:FS02:Uploading 14.34MiB to 129.32.209.207
13:39:06:WU00:FS02:Connecting to 129.32.209.207:8080
13:39:27:WU00:FS02:Upload 0.87%
13:39:27:ERROR:WU00:FS02:Exception: Transfer failed
13:40:31:WU02:FS02:0x22:Completed 50000 out of 2500000 steps (2%)
13:41:12:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:18432 run:25 clone:10 gen:81 core:0x22 unit:0x0000000a000000510000480000000019
13:41:12:WU00:FS02:Uploading 14.34MiB to 129.32.209.202
13:41:12:WU00:FS02:Connecting to 129.32.209.202:8080
13:41:43:WU00:FS02:Upload 0.87%
13:41:43:WARNING:WU00:FS02:Exception: Failed to send results to work server: Transfer failed
13:41:43:WU00:FS02:Trying to send results to collection server
13:41:43:WU00:FS02:Uploading 14.34MiB to 129.32.209.207
13:41:43:WU00:FS02:Connecting to 129.32.209.207:8080
13:42:04:WU00:FS02:Upload 0.87%
13:42:04:ERROR:WU00:FS02:Exception: Transfer failed
13:43:01:WU02:FS02:0x22:Completed 75000 out of 2500000 steps (3%)
13:45:27:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:18432 run:25 clone:10 gen:81 core:0x22 unit:0x0000000a000000510000480000000019
13:45:27:WU00:FS02:Uploading 14.34MiB to 129.32.209.202
13:45:27:WU00:FS02:Connecting to 129.32.209.202:8080
13:45:28:WU02:FS02:0x22:Completed 100000 out of 2500000 steps (4%)
13:45:50:WU00:FS02:Upload 0.87%
13:45:50:WARNING:WU00:FS02:Exception: Failed to send results to work server: Transfer failed
13:45:50:WU00:FS02:Trying to send results to collection server
13:45:50:WU00:FS02:Uploading 14.34MiB to 129.32.209.207
13:45:50:WU00:FS02:Connecting to 129.32.209.207:8080
13:46:21:WU00:FS02:Upload 0.87%
13:46:21:ERROR:WU00:FS02:Exception: Transfer failed
13:47:55:WU02:FS02:0x22:Completed 125000 out of 2500000 steps (5%)
13:47:56:WU02:FS02:0x22:Checkpoint completed at step 125000
13:50:24:WU02:FS02:0x22:Completed 150000 out of 2500000 steps (6%)
13:52:18:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:18432 run:25 clone:10 gen:81 core:0x22 unit:0x0000000a000000510000480000000019
13:52:18:WU00:FS02:Uploading 14.34MiB to 129.32.209.202
13:52:18:WU00:FS02:Connecting to 129.32.209.202:8080
13:52:44:WU00:FS02:Upload 0.87%
13:52:44:WARNING:WU00:FS02:Exception: Failed to send results to work server: Transfer failed
13:52:44:WU00:FS02:Trying to send results to collection server
13:52:44:WU00:FS02:Uploading 14.34MiB to 129.32.209.207
13:52:44:WU00:FS02:Connecting to 129.32.209.207:8080
13:52:51:WU02:FS02:0x22:Completed 175000 out of 2500000 steps (7%)
13:53:11:WU00:FS02:Upload 0.87%
13:53:11:ERROR:WU00:FS02:Exception: Transfer failed
13:55:16:WU02:FS02:0x22:Completed 200000 out of 2500000 steps (8%)
13:57:44:WU02:FS02:0x22:Completed 225000 out of 2500000 steps (9%)
14:00:15:WU02:FS02:0x22:Completed 250000 out of 2500000 steps (10%)
14:00:16:WU02:FS02:0x22:Checkpoint completed at step 250000
14:02:46:WU02:FS02:0x22:Completed 275000 out of 2500000 steps (11%)
14:03:24:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:18432 run:25 clone:10 gen:81 core:0x22 unit:0x0000000a000000510000480000000019
14:03:24:WU00:FS02:Uploading 14.34MiB to 129.32.209.202
14:03:24:WU00:FS02:Connecting to 129.32.209.202:8080
14:03:54:WU00:FS02:Upload 0.87%
14:03:54:WARNING:WU00:FS02:Exception: Failed to send results to work server: Transfer failed
14:03:54:WU00:FS02:Trying to send results to collection server
14:03:54:WU00:FS02:Uploading 14.34MiB to 129.32.209.207
14:03:54:WU00:FS02:Connecting to 129.32.209.207:8080
14:04:25:WU00:FS02:Upload 0.87%
14:04:25:ERROR:WU00:FS02:Exception: Transfer failed
14:05:33:WU02:FS02:0x22:Completed 300000 out of 2500000 steps (12%)
14:08:30:WU02:FS02:0x22:Completed 325000 out of 2500000 steps (13%)
14:11:07:WU02:FS02:0x22:Completed 350000 out of 2500000 steps (14%)
14:13:32:WU02:FS02:0x22:Completed 375000 out of 2500000 steps (15%)
14:13:33:WU02:FS02:0x22:Checkpoint completed at step 375000
14:16:10:WU02:FS02:0x22:Completed 400000 out of 2500000 steps (16%)
14:18:37:WU02:FS02:0x22:Completed 425000 out of 2500000 steps (17%)
14:21:02:WU02:FS02:0x22:Completed 450000 out of 2500000 steps (18%)
14:21:21:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:18432 run:25 clone:10 gen:81 core:0x22 unit:0x0000000a000000510000480000000019
14:21:21:WU00:FS02:Uploading 14.34MiB to 129.32.209.202
14:21:21:WU00:FS02:Connecting to 129.32.209.202:8080
14:21:41:WU00:FS02:Upload 0.87%
14:21:42:WARNING:WU00:FS02:Exception: Failed to send results to work server: Transfer failed
14:21:42:WU00:FS02:Trying to send results to collection server
14:21:42:WU00:FS02:Uploading 14.34MiB to 129.32.209.207
14:21:42:WU00:FS02:Connecting to 129.32.209.207:8080
14:22:02:WU00:FS02:Upload 0.87%
14:22:02:ERROR:WU00:FS02:Exception: Transfer failed
14:23:28:WU02:FS02:0x22:Completed 475000 out of 2500000 steps (19%)
14:25:54:WU02:FS02:0x22:Completed 500000 out of 2500000 steps (20%)
14:25:55:WU02:FS02:0x22:Checkpoint completed at step 500000
14:28:21:WU02:FS02:0x22:Completed 525000 out of 2500000 steps (21%)
14:30:46:WU02:FS02:0x22:Completed 550000 out of 2500000 steps (22%)
14:33:13:WU02:FS02:0x22:Completed 575000 out of 2500000 steps (23%)
14:35:37:WU02:FS02:0x22:Completed 600000 out of 2500000 steps (24%)
14:38:05:WU02:FS02:0x22:Completed 625000 out of 2500000 steps (25%)
14:38:07:WU02:FS02:0x22:Checkpoint completed at step 625000
14:40:33:WU02:FS02:0x22:Completed 650000 out of 2500000 steps (26%)
14:42:57:WU02:FS02:0x22:Completed 675000 out of 2500000 steps (27%)
14:45:22:WU02:FS02:0x22:Completed 700000 out of 2500000 steps (28%)
14:47:47:WU02:FS02:0x22:Completed 725000 out of 2500000 steps (29%)
14:50:12:WU02:FS02:0x22:Completed 750000 out of 2500000 steps (30%)
14:50:12:WU02:FS02:0x22:Checkpoint completed at step 750000
14:50:23:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:18432 run:25 clone:10 gen:81 core:0x22 unit:0x0000000a000000510000480000000019
14:50:23:WU00:FS02:Uploading 14.34MiB to 129.32.209.202
14:50:23:WU00:FS02:Connecting to 129.32.209.202:8080
14:50:43:WU00:FS02:Upload 0.87%
14:50:43:WARNING:WU00:FS02:Exception: Failed to send results to work server: Transfer failed
14:50:43:WU00:FS02:Trying to send results to collection server
14:50:43:WU00:FS02:Uploading 14.34MiB to 129.32.209.207
14:50:43:WU00:FS02:Connecting to 129.32.209.207:8080
14:51:07:WU00:FS02:Upload 0.87%
14:51:07:ERROR:WU00:FS02:Exception: Transfer failed
14:52:37:WU02:FS02:0x22:Completed 775000 out of 2500000 steps (31%)
14:55:02:WU02:FS02:0x22:Completed 800000 out of 2500000 steps (32%)
14:57:27:WU02:FS02:0x22:Completed 825000 out of 2500000 steps (33%)
14:59:51:WU02:FS02:0x22:Completed 850000 out of 2500000 steps (34%)
15:02:15:WU02:FS02:0x22:Completed 875000 out of 2500000 steps (35%)
15:02:16:WU02:FS02:0x22:Checkpoint completed at step 875000
15:04:40:WU02:FS02:0x22:Completed 900000 out of 2500000 steps (36%)
15:07:04:WU02:FS02:0x22:Completed 925000 out of 2500000 steps (37%)
15:09:29:WU02:FS02:0x22:Completed 950000 out of 2500000 steps (38%)
15:11:53:WU02:FS02:0x22:Completed 975000 out of 2500000 steps (39%)
15:14:17:WU02:FS02:0x22:Completed 1000000 out of 2500000 steps (40%)
15:14:18:WU02:FS02:0x22:Checkpoint completed at step 1000000
15:16:46:WU02:FS02:0x22:Completed 1025000 out of 2500000 steps (41%)
15:19:17:WU02:FS02:0x22:Completed 1050000 out of 2500000 steps (42%)
15:21:46:WU02:FS02:0x22:Completed 1075000 out of 2500000 steps (43%)
15:24:12:WU02:FS02:0x22:Completed 1100000 out of 2500000 steps (44%)
15:27:01:WU02:FS02:0x22:Completed 1125000 out of 2500000 steps (45%)
15:27:04:WU02:FS02:0x22:Checkpoint completed at step 1125000
15:29:30:WU02:FS02:0x22:Completed 1150000 out of 2500000 steps (46%)
15:31:54:WU02:FS02:0x22:Completed 1175000 out of 2500000 steps (47%)
15:34:23:WU02:FS02:0x22:Completed 1200000 out of 2500000 steps (48%)
15:36:56:WU02:FS02:0x22:Completed 1225000 out of 2500000 steps (49%)
15:37:22:WU00:FS02:Sending unit results: id:00 state:SEND error:NO_ERROR project:18432 run:25 clone:10 gen:81 core:0x22 unit:0x0000000a000000510000480000000019
15:37:22:WU00:FS02:Uploading 14.34MiB to 129.32.209.202
15:37:22:WU00:FS02:Connecting to 129.32.209.202:8080
15:37:43:WU00:FS02:Upload 0.87%
15:37:43:WARNING:WU00:FS02:Exception: Failed to send results to work server: Transfer failed
15:37:43:WU00:FS02:Trying to send results to collection server
15:37:43:WU00:FS02:Uploading 14.34MiB to 129.32.209.207
15:37:43:WU00:FS02:Connecting to 129.32.209.207:8080
15:38:13:WU00:FS02:Upload 0.87%
15:38:13:ERROR:WU00:FS02:Exception: Transfer failed
15:39:23:WU02:FS02:0x22:Completed 1250000 out of 2500000 steps (50%)
15:39:24:WU02:FS02:0x22:Checkpoint completed at step 1250000
I thought perhaps that the WUs were going stale and so the server wasn't accepting them, but this last one shows that it completed the WU without pause, downloaded the next WU, finished the first WU, but still is getting no connection to upload.
Last edited by belloq on Sat Dec 11, 2021 6:08 am, edited 1 time in total.
Top
Neil-B
Posts: 1996
Joined: Sun Mar 22, 2020 5:52 pm
Hardware configuration: 1: 2x Xeon [email protected], 512GB DDR4 LRDIMM, SSD Raid, Win10 Ent 20H2, Quadro K420 1GB, FAH 7.6.21
2: Xeon [email protected], 32GB DDR4, NVME, Win10 Pro 20H2, Quadro M1000M 2GB, FAH 7.6.21 (actually have two of these)
3: [email protected], 12GB DDR3, SSD, Win10 Pro 20H2, GTX 750Ti 2GB, GTX 1080Ti 11GB, FAH 7.6.21
Location: UK

Re: 129.32.209.207 not accepting my WUs (18432, 18432)

Post by Neil-B »

In both cases the client is attempting to upload firstly to the WS (129.32.209.202) and failing and then to the CS (129.32.209.207) and also failing ... both servers are showing as having a fair bit of storage available so unlikely to be an issue due to that ... with up[loads failing to two servers it doesn't feel like a server issue as such ... it is possible there may be some form of network issue/loading issue at the server end - or there may be some issue with comms being interfered with at your end (AV, Firewall, etc.) or even somewhere between (isp, etc.).

I'll throw a heads up to the server administrators ... If you are the only folder experiencing this issue at the moment (and we can see if others report the same problem - you could be just the first) it might indicate the issue is more likely at your end - but this isn't always the case (just worth checking).

Are all this issues you are seeing (in this and other post) from the same bit of kit? ... are any wus getting uploaded (for this or other projects)? or are just some getting stalled?
2x Xeon E5-2697v3, 512GB DDR4 LRDIMM, SSD Raid, W10-Ent, Quadro K420
Xeon E3-1505Mv5, 32GB DDR4, NVME, W10-Pro, Quadro M1000M
i7-960, 12GB DDR3, SSD, W10-Pro, GTX1080Ti
i9-10850K, 64GB DDR4, NVME, W11-Pro, RTX3070
(Green/Bold = Active)
Top
belloq
Posts: 42
Joined: Thu Sep 24, 2020 12:58 pm

Re: 129.32.209.207 not accepting my WUs (18432, 18431)

Post by belloq »

Neil-B wrote:...it is possible there may be some form of network issue/loading issue at the server end - or there may be some issue with comms being interfered with at your end (AV, Firewall, etc.) or even somewhere between (isp, etc.).
...
Are all this issues you are seeing (in this and other post) from the same bit of kit? ... are any wus getting uploaded (for this or other projects)? or are just some getting stalled?
Thanks for the reply! Well, yeah, anything is possible. But I've got no other noticeable network issues right now. I've got 5 systems in my home and they are all actively folding, though I haven't checked all of the upload queues. The system with those two projects is my only GPU system, and it just finished and uploaded project:18201 run:35620 clone:0 gen:27 core:0x22 unit:0x000000000000001b0000471900008b24 to 128.252.203.11 with no issue. The 18432 WU is still trying to upload periodically to the same 202 and 207 servers.

My client did eventually dump the 18431 WU due to being past deadline.
project:18431 run:55 clone:9 gen:26 core:0x22 unit:0x000000090000001a000047ff00000037
Downloaded 12/3
Completed 12/3
Dumped on 12/5
Top
Post Reply

Return to “Issues with a specific server”