Slow WU downloads & failed transfer [140.163.4.231]

[lknl]

I've recently started folding on my new GPU, and I notice that the GPU slot takes a long time to finish downloading new WU, about 1 or 2 hours for 16MB. Sometimes it fails while downloading half-way, with the following error:

ERROR:WU02:FS01:Exception: Transfer failed

Is this a normal behaviour?

Code: Select all

19:29:48:WU02:FS01:Download 34.42%
19:30:00:WU02:FS01:Download 34.80%
19:30:13:WU02:FS01:Download 35.18%
19:30:26:WU02:FS01:Download 35.56%
19:30:39:WU02:FS01:Download 35.94%
19:30:52:WU02:FS01:Download 36.32%
19:31:05:WU02:FS01:Download 36.69%
19:31:18:WU02:FS01:Download 37.07%
19:31:30:WU02:FS01:Download 37.45%
19:31:43:WU02:FS01:Download 37.83%
19:31:56:WU02:FS01:Download 38.21%
19:32:09:WU02:FS01:Download 38.58%
19:32:22:WU02:FS01:Download 38.96%
19:32:34:WU02:FS01:Download 39.34%
19:32:47:WU02:FS01:Download 39.72%
19:33:00:WU02:FS01:Download 40.10%
19:33:13:WU02:FS01:Download 40.48%
19:33:26:WU02:FS01:Download 40.85%
19:33:39:WU02:FS01:Download 41.23%
19:33:52:WU02:FS01:Download 41.61%
19:34:04:WU02:FS01:Download 41.99%
19:34:17:WU02:FS01:Download 42.37%
19:34:30:WU02:FS01:Download 42.75%
19:34:43:WU02:FS01:Download 43.12%
19:34:56:WU02:FS01:Download 43.50%
19:35:09:WU02:FS01:Download 43.88%
19:35:21:WU02:FS01:Download 44.26%
19:35:34:WU02:FS01:Download 44.64%
19:35:47:WU02:FS01:Download 45.02%
19:36:00:WU02:FS01:Download 45.39%
19:36:13:WU02:FS01:Download 45.77%
19:36:26:WU02:FS01:Download 46.15%
19:36:38:WU02:FS01:Download 46.53%
19:36:51:WU02:FS01:Download 46.91%
19:37:04:WU02:FS01:Download 47.29%
19:37:17:WU02:FS01:Download 47.66%
19:37:30:WU02:FS01:Download 48.04%
19:37:43:WU02:FS01:Download 48.42%
19:37:55:WU02:FS01:Download 48.80%
19:38:08:WU02:FS01:Download 49.18%
19:38:21:WU02:FS01:Download 49.56%
19:38:34:WU02:FS01:Download 49.93%
19:38:47:WU02:FS01:Download 50.31%
19:38:59:WU02:FS01:Download 50.69%
19:39:12:WU02:FS01:Download 51.07%
19:39:25:WU02:FS01:Download 51.45%
19:39:38:WU02:FS01:Download 51.82%
19:39:51:WU02:FS01:Download 52.20%
19:40:04:WU02:FS01:Download 52.58%
19:40:16:WU02:FS01:Download 52.96%
19:40:29:WU02:FS01:Download 53.34%
19:40:42:WU02:FS01:Download 53.72%
19:40:55:WU02:FS01:Download 54.09%
19:41:08:WU02:FS01:Download 54.47%
19:41:20:WU02:FS01:Download 54.85%
19:41:33:WU02:FS01:Download 55.23%
19:41:46:WU02:FS01:Download 55.61%
19:41:59:WU02:FS01:Download 55.99%
19:42:12:WU02:FS01:Download 56.36%
19:42:24:WU02:FS01:Download 56.74%
19:42:37:WU02:FS01:Download 57.12%
19:42:50:WU02:FS01:Download 57.50%
19:43:03:WU02:FS01:Download 57.88%
19:43:16:WU02:FS01:Download 58.26%
19:43:28:WU02:FS01:Download 58.63%
19:43:41:WU02:FS01:Download 59.01%
19:43:54:WU02:FS01:Download 59.39%
19:44:07:WU02:FS01:Download 59.77%
19:44:20:WU02:FS01:Download 60.15%
19:44:33:WU02:FS01:Download 60.53%
19:44:45:WU02:FS01:Download 60.90%
19:44:58:WU02:FS01:Download 61.28%
19:45:11:WU02:FS01:Download 61.66%
19:45:24:WU02:FS01:Download 62.04%
19:45:37:WU02:FS01:Download 62.42%
19:45:50:WU02:FS01:Download 62.80%
19:46:03:WU02:FS01:Download 63.17%
19:46:15:WU02:FS01:Download 63.55%
19:46:28:WU02:FS01:Download 63.93%
19:46:41:WU02:FS01:Download 64.31%
19:46:54:WU02:FS01:Download 64.69%
19:47:07:WU02:FS01:Download 65.06%
19:47:19:WU02:FS01:Download 65.44%
19:47:32:WU02:FS01:Download 65.82%
19:47:45:WU02:FS01:Download 66.20%
19:47:58:WU02:FS01:Download 66.58%
19:48:11:WU02:FS01:Download 66.96%
19:48:24:WU02:FS01:Download 67.33%
19:48:37:WU02:FS01:Download 67.71%
19:48:49:WU02:FS01:Download 68.09%
19:49:02:WU02:FS01:Download 68.47%
19:49:15:WU02:FS01:Download 68.85%
19:49:28:WU02:FS01:Download 69.23%
19:49:41:WU02:FS01:Download 69.60%
19:49:54:WU02:FS01:Download 69.98%
19:50:06:WU02:FS01:Download 70.36%
19:50:19:WU02:FS01:Download 70.74%
19:50:32:WU02:FS01:Download 71.12%
19:50:45:WU02:FS01:Download 71.50%
19:50:58:WU02:FS01:Download 71.87%
19:51:11:WU02:FS01:Download 72.25%
19:51:23:WU02:FS01:Download 72.63%
19:51:36:WU02:FS01:Download 73.01%
19:51:49:WU02:FS01:Download 73.39%
19:52:02:WU02:FS01:Download 73.77%
19:52:15:WU02:FS01:Download 74.14%
19:52:28:WU02:FS01:Download 74.52%
19:52:40:WU02:FS01:Download 74.90%
19:52:53:WU02:FS01:Download 75.28%
19:53:06:WU02:FS01:Download 75.66%
19:53:19:WU02:FS01:Download 76.04%
19:53:32:WU02:FS01:Download 76.41%
19:53:45:WU02:FS01:Download 76.79%
19:53:57:WU02:FS01:Download 77.17%
19:54:10:WU02:FS01:Download 77.55%
19:54:23:WU02:FS01:Download 77.93%
19:54:36:WU02:FS01:Download 78.30%
19:54:49:WU02:FS01:Download 78.68%
19:55:01:WU02:FS01:Download 79.06%
19:55:14:WU02:FS01:Download 79.44%
19:55:27:WU02:FS01:Download 79.82%
19:55:40:WU02:FS01:Download 80.20%
19:55:53:WU02:FS01:Download 80.57%
19:56:06:WU02:FS01:Download 80.95%
19:56:19:WU02:FS01:Download 81.33%
19:56:31:WU02:FS01:Download 81.71%
19:56:44:WU02:FS01:Download 82.09%
19:56:57:WU02:FS01:Download 82.47%
19:57:10:WU02:FS01:Download 82.84%
19:57:23:WU02:FS01:Download 83.22%
19:57:36:WU02:FS01:Download 83.60%
19:57:48:WU02:FS01:Download 83.98%
19:58:01:WU02:FS01:Download 84.36%
19:58:14:WU02:FS01:Download 84.74%
19:58:27:WU02:FS01:Download 85.11%
19:58:40:WU02:FS01:Download 85.49%
19:58:53:WU02:FS01:Download 85.87%
19:59:05:WU02:FS01:Download 86.25%
19:59:18:WU02:FS01:Download 86.63%
19:59:31:WU02:FS01:Download 87.01%
19:59:44:WU02:FS01:Download 87.38%
19:59:57:WU02:FS01:Download 87.76%
20:00:10:WU02:FS01:Download 88.14%
20:00:22:WU02:FS01:Download 88.52%
20:00:35:WU02:FS01:Download 88.90%
20:00:48:WU02:FS01:Download 89.28%
20:01:01:WU02:FS01:Download 89.65%
20:01:14:WU02:FS01:Download 90.03%
20:01:26:WU02:FS01:Download 90.41%
20:01:39:WU02:FS01:Download 90.79%
20:01:52:WU02:FS01:Download 91.17%
20:02:05:WU02:FS01:Download 91.54%
20:02:18:WU02:FS01:Download 91.92%
20:02:31:WU02:FS01:Download 92.30%
20:02:44:WU02:FS01:Download 92.68%
20:02:56:WU02:FS01:Download 93.06%
20:03:09:WU02:FS01:Download 93.44%
20:03:22:WU02:FS01:Download 93.81%
20:03:35:WU02:FS01:Download 94.19%
20:03:48:WU02:FS01:Download 94.57%
20:04:01:WU02:FS01:Download 94.95%
20:04:13:WU02:FS01:Download 95.33%
20:04:26:WU02:FS01:Download 95.71%
20:04:39:WU02:FS01:Download 96.08%
20:04:52:WU02:FS01:Download 96.46%
20:05:05:WU02:FS01:Download 96.84%
20:05:18:WU02:FS01:Download 97.22%
20:05:31:WU02:FS01:Download 97.60%
20:05:44:WU02:FS01:Download 97.98%
20:05:56:WU02:FS01:Download 98.35%
20:06:09:WU02:FS01:Download 98.73%
20:06:22:WU02:FS01:Download 99.11%
20:06:35:WU02:FS01:Download 99.49%
20:06:48:WU02:FS01:Download 99.87%
20:06:52:WU02:FS01:Download complete
20:06:52:WU02:FS01:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:11713 run:22 clone:74 gen:161 core:0x21 unit:0x000000c88ca304e75a5a522c450b23cc
20:06:52:WU02:FS01:Starting
20:06:52:WU02:FS01:Running FahCore: E:\FAHClient/FAHCoreWrapper.exe E:\FAH\cores/cores.foldingathome.org/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 02 -suffix 01 -version 704 -lifeline 5500 -checkpoint 30 -gpu-vendor nvidia -opencl-platform 1 -opencl-device 0 -cuda-device 0 -gpu 0
20:06:52:WU02:FS01:Started FahCore on PID 8472
20:06:52:WU02:FS01:Core PID:5068
20:06:52:WU02:FS01:FahCore 0x21 started
20:06:52:WU02:FS01:0x21:*********************** Log Started 2018-06-20T20:06:52Z ***********************
20:06:52:WU02:FS01:0x21:Project: 11713 (Run 22, Clone 74, Gen 161)
20:06:52:WU02:FS01:0x21:Unit: 0x000000c88ca304e75a5a522c450b23cc
20:06:52:WU02:FS01:0x21:CPU: 0x00000000000000000000000000000000
20:06:52:WU02:FS01:0x21:Machine: 1
20:06:52:WU02:FS01:0x21:Reading tar file core.xml
20:06:52:WU02:FS01:0x21:Reading tar file integrator.xml
20:06:52:WU02:FS01:0x21:Reading tar file state.xml
20:07:05:WU02:FS01:0x21:Reading tar file system.xml
20:07:19:WU02:FS01:0x21:Digital signatures verified
20:07:19:WU02:FS01:0x21:Folding@home GPU Core21 Folding@home Core
20:07:19:WU02:FS01:0x21:Version 0.0.18
20:07:24:WU02:FS01:0x21:Completed 0 out of 7500000 steps (0%)
20:07:24:WU02:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
20:09:04:WU02:FS01:0x21:Completed 75000 out of 7500000 steps (1%)
20:10:45:WU02:FS01:0x21:Completed 150000 out of 7500000 steps (2%)
20:12:25:WU02:FS01:0x21:Completed 225000 out of 7500000 steps (3%)
20:14:21:WU02:FS01:0x21:Completed 300000 out of 7500000 steps (4%)
20:16:01:WU02:FS01:0x21:Completed 375000 out of 7500000 steps (5%)
20:17:42:WU02:FS01:0x21:Completed 450000 out of 7500000 steps (6%)
20:19:36:WU02:FS01:0x21:Completed 525000 out of 7500000 steps (7%)
20:21:17:WU02:FS01:0x21:Completed 600000 out of 7500000 steps (8%)
20:22:58:WU02:FS01:0x21:Completed 675000 out of 7500000 steps (9%)
20:24:38:WU02:FS01:0x21:Completed 750000 out of 7500000 steps (10%)
20:26:33:WU02:FS01:0x21:Completed 825000 out of 7500000 steps (11%)
20:28:14:WU02:FS01:0x21:Completed 900000 out of 7500000 steps (12%)
20:29:55:WU02:FS01:0x21:Completed 975000 out of 7500000 steps (13%)
20:31:49:WU02:FS01:0x21:Completed 1050000 out of 7500000 steps (14%)
20:33:30:WU02:FS01:0x21:Completed 1125000 out of 7500000 steps (15%)
20:35:10:WU02:FS01:0x21:Completed 1200000 out of 7500000 steps (16%)
20:37:06:WU02:FS01:0x21:Completed 1275000 out of 7500000 steps (17%)
20:38:46:WU02:FS01:0x21:Completed 1350000 out of 7500000 steps (18%)
20:40:27:WU02:FS01:0x21:Completed 1425000 out of 7500000 steps (19%)
20:42:07:WU02:FS01:0x21:Completed 1500000 out of 7500000 steps (20%)
20:44:02:WU02:FS01:0x21:Completed 1575000 out of 7500000 steps (21%)
20:45:43:WU02:FS01:0x21:Completed 1650000 out of 7500000 steps (22%)
20:47:24:WU02:FS01:0x21:Completed 1725000 out of 7500000 steps (23%)
20:49:19:WU02:FS01:0x21:Completed 1800000 out of 7500000 steps (24%)
20:50:59:WU02:FS01:0x21:Completed 1875000 out of 7500000 steps (25%)
20:52:40:WU02:FS01:0x21:Completed 1950000 out of 7500000 steps (26%)
20:54:35:WU02:FS01:0x21:Completed 2025000 out of 7500000 steps (27%)
20:56:16:WU02:FS01:0x21:Completed 2100000 out of 7500000 steps (28%)
20:57:57:WU02:FS01:0x21:Completed 2175000 out of 7500000 steps (29%)
20:59:38:WU02:FS01:0x21:Completed 2250000 out of 7500000 steps (30%)
21:01:33:WU02:FS01:0x21:Completed 2325000 out of 7500000 steps (31%)
21:03:14:WU02:FS01:0x21:Completed 2400000 out of 7500000 steps (32%)
21:04:55:WU02:FS01:0x21:Completed 2475000 out of 7500000 steps (33%)
21:06:50:WU02:FS01:0x21:Completed 2550000 out of 7500000 steps (34%)
21:08:31:WU02:FS01:0x21:Completed 2625000 out of 7500000 steps (35%)
21:10:11:WU02:FS01:0x21:Completed 2700000 out of 7500000 steps (36%)
21:12:11:WU02:FS01:0x21:Completed 2775000 out of 7500000 steps (37%)
21:13:50:WU02:FS01:0x21:Completed 2850000 out of 7500000 steps (38%)
21:15:29:WU02:FS01:0x21:Completed 2925000 out of 7500000 steps (39%)
21:17:08:WU02:FS01:0x21:Completed 3000000 out of 7500000 steps (40%)
21:19:01:WU02:FS01:0x21:Completed 3075000 out of 7500000 steps (41%)
21:20:40:WU02:FS01:0x21:Completed 3150000 out of 7500000 steps (42%)
21:22:18:WU02:FS01:0x21:Completed 3225000 out of 7500000 steps (43%)
21:24:11:WU02:FS01:0x21:Completed 3300000 out of 7500000 steps (44%)
21:25:51:WU02:FS01:0x21:Completed 3375000 out of 7500000 steps (45%)
21:27:30:WU02:FS01:0x21:Completed 3450000 out of 7500000 steps (46%)
21:29:23:WU02:FS01:0x21:Completed 3525000 out of 7500000 steps (47%)
21:31:02:WU02:FS01:0x21:Completed 3600000 out of 7500000 steps (48%)
21:32:41:WU02:FS01:0x21:Completed 3675000 out of 7500000 steps (49%)
21:34:20:WU02:FS01:0x21:Completed 3750000 out of 7500000 steps (50%)
21:36:13:WU02:FS01:0x21:Completed 3825000 out of 7500000 steps (51%)
21:37:52:WU02:FS01:0x21:Completed 3900000 out of 7500000 steps (52%)
21:39:31:WU02:FS01:0x21:Completed 3975000 out of 7500000 steps (53%)
21:41:26:WU02:FS01:0x21:Completed 4050000 out of 7500000 steps (54%)
21:43:05:WU02:FS01:0x21:Completed 4125000 out of 7500000 steps (55%)
21:44:44:WU02:FS01:0x21:Completed 4200000 out of 7500000 steps (56%)
21:46:39:WU02:FS01:0x21:Completed 4275000 out of 7500000 steps (57%)
21:48:18:WU02:FS01:0x21:Completed 4350000 out of 7500000 steps (58%)
21:49:57:WU02:FS01:0x21:Completed 4425000 out of 7500000 steps (59%)
21:51:36:WU02:FS01:0x21:Completed 4500000 out of 7500000 steps (60%)
21:53:31:WU02:FS01:0x21:Completed 4575000 out of 7500000 steps (61%)
21:55:10:WU02:FS01:0x21:Completed 4650000 out of 7500000 steps (62%)
21:56:49:WU02:FS01:0x21:Completed 4725000 out of 7500000 steps (63%)
21:58:44:WU02:FS01:0x21:Completed 4800000 out of 7500000 steps (64%)
22:00:24:WU02:FS01:0x21:Completed 4875000 out of 7500000 steps (65%)
22:02:02:WU02:FS01:0x21:Completed 4950000 out of 7500000 steps (66%)
22:03:57:WU02:FS01:0x21:Completed 5025000 out of 7500000 steps (67%)
22:05:36:WU02:FS01:0x21:Completed 5100000 out of 7500000 steps (68%)
22:07:16:WU02:FS01:0x21:Completed 5175000 out of 7500000 steps (69%)
22:08:55:WU02:FS01:0x21:Completed 5250000 out of 7500000 steps (70%)
22:10:50:WU02:FS01:0x21:Completed 5325000 out of 7500000 steps (71%)
22:12:31:WU02:FS01:0x21:Completed 5400000 out of 7500000 steps (72%)
22:14:12:WU02:FS01:0x21:Completed 5475000 out of 7500000 steps (73%)
22:16:08:WU02:FS01:0x21:Completed 5550000 out of 7500000 steps (74%)
22:17:49:WU02:FS01:0x21:Completed 5625000 out of 7500000 steps (75%)
22:19:30:WU02:FS01:0x21:Completed 5700000 out of 7500000 steps (76%)
22:21:26:WU02:FS01:0x21:Completed 5775000 out of 7500000 steps (77%)
22:23:07:WU02:FS01:0x21:Completed 5850000 out of 7500000 steps (78%)
22:24:48:WU02:FS01:0x21:Completed 5925000 out of 7500000 steps (79%)
22:26:28:WU02:FS01:0x21:Completed 6000000 out of 7500000 steps (80%)
22:28:24:WU02:FS01:0x21:Completed 6075000 out of 7500000 steps (81%)
22:30:03:WU02:FS01:0x21:Completed 6150000 out of 7500000 steps (82%)
22:31:42:WU02:FS01:0x21:Completed 6225000 out of 7500000 steps (83%)
22:33:38:WU02:FS01:0x21:Completed 6300000 out of 7500000 steps (84%)
22:35:17:WU02:FS01:0x21:Completed 6375000 out of 7500000 steps (85%)
22:36:57:WU02:FS01:0x21:Completed 6450000 out of 7500000 steps (86%)
22:38:52:WU02:FS01:0x21:Completed 6525000 out of 7500000 steps (87%)
22:40:32:WU02:FS01:0x21:Completed 6600000 out of 7500000 steps (88%)
22:42:11:WU02:FS01:0x21:Completed 6675000 out of 7500000 steps (89%)
22:43:50:WU02:FS01:0x21:Completed 6750000 out of 7500000 steps (90%)
22:43:51:WU01:FS01:Connecting to 65.254.110.245:80
22:43:52:WU01:FS01:Assigned to work server 140.163.4.231
22:43:52:WU01:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GP102 [GeForce GTX 1080 Ti] 11380 from 140.163.4.231
22:43:52:WU01:FS01:Connecting to 140.163.4.231:8080
22:44:03:WU01:FS01:Downloading 16.53MiB
22:45:45:WU02:FS01:0x21:Completed 6825000 out of 7500000 steps (91%)
22:46:50:WU01:FS01:Download 0.38%
22:47:25:WU02:FS01:0x21:Completed 6900000 out of 7500000 steps (92%)
22:49:04:WU02:FS01:0x21:Completed 6975000 out of 7500000 steps (93%)
22:49:39:WU01:FS01:Download 0.76%
22:51:00:WU02:FS01:0x21:Completed 7050000 out of 7500000 steps (94%)
22:52:26:WU01:FS01:Download 1.13%
22:52:39:WU02:FS01:0x21:Completed 7125000 out of 7500000 steps (95%)
22:54:19:WU02:FS01:0x21:Completed 7200000 out of 7500000 steps (96%)
22:55:14:WU01:FS01:Download 1.51%
22:56:14:WU02:FS01:0x21:Completed 7275000 out of 7500000 steps (97%)
22:57:54:WU02:FS01:0x21:Completed 7350000 out of 7500000 steps (98%)
22:58:03:WU01:FS01:Download 1.89%
22:59:33:WU02:FS01:0x21:Completed 7425000 out of 7500000 steps (99%)
23:00:52:WU01:FS01:Download 2.27%
23:01:13:WU02:FS01:0x21:Completed 7500000 out of 7500000 steps (100%)
23:01:29:WU02:FS01:0x21:Saving result file logfile_01.txt
23:01:29:WU02:FS01:0x21:Saving result file checkpointState.xml
23:01:29:WU02:FS01:0x21:Saving result file checkpt.crc
23:01:29:WU02:FS01:0x21:Saving result file log.txt
23:01:29:WU02:FS01:0x21:Saving result file positions.xtc
23:01:30:WU02:FS01:0x21:Folding@home Core Shutdown: FINISHED_UNIT
23:01:30:WU02:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
23:01:30:WU02:FS01:Sending unit results: id:02 state:SEND error:NO_ERROR project:11713 run:22 clone:74 gen:161 core:0x21 unit:0x000000c88ca304e75a5a522c450b23cc
23:01:30:WU02:FS01:Uploading 11.78MiB to 140.163.4.231
23:01:30:WU02:FS01:Connecting to 140.163.4.231:8080
23:02:35:WU02:FS01:Upload complete
23:02:35:WU02:FS01:Server responded WORK_ACK (400)
23:02:35:WU02:FS01:Final credit estimate, 108872.00 points
23:02:35:WU02:FS01:Cleaning up
23:03:33:WU01:FS01:Download 2.65%
23:04:25:WU01:FS01:Download 3.02%
23:05:14:WU01:FS01:Download 3.40%
23:06:02:WU01:FS01:Download 3.78%
23:06:51:WU01:FS01:Download 4.16%
23:07:40:WU01:FS01:Download 4.54%
23:08:28:WU01:FS01:Download 4.92%
23:09:17:WU01:FS01:Download 5.29%
23:10:06:WU01:FS01:Download 5.67%
23:10:54:WU01:FS01:Download 6.05%
23:11:43:WU01:FS01:Download 6.43%
23:12:31:WU01:FS01:Download 6.81%
23:13:20:WU01:FS01:Download 7.18%
23:14:09:WU01:FS01:Download 7.56%
23:14:57:WU01:FS01:Download 7.94%
23:15:46:WU01:FS01:Download 8.32%
23:16:35:WU01:FS01:Download 8.70%
23:17:23:WU01:FS01:Download 9.07%
23:18:12:WU01:FS01:Download 9.45%
23:19:01:WU01:FS01:Download 9.83%
23:19:49:WU01:FS01:Download 10.21%
23:20:38:WU01:FS01:Download 10.59%
23:21:27:WU01:FS01:Download 10.97%
23:22:15:WU01:FS01:Download 11.34%
23:23:04:WU01:FS01:Download 11.72%
23:23:53:WU01:FS01:Download 12.10%
23:24:41:WU01:FS01:Download 12.48%
23:25:30:WU01:FS01:Download 12.86%
23:26:19:WU01:FS01:Download 13.23%
23:27:07:WU01:FS01:Download 13.61%
23:27:56:WU01:FS01:Download 13.99%
23:28:45:WU01:FS01:Download 14.37%
23:29:33:WU01:FS01:Download 14.75%
23:30:22:WU01:FS01:Download 15.12%
23:31:11:WU01:FS01:Download 15.50%
23:32:00:WU01:FS01:Download 15.88%
23:32:48:WU01:FS01:Download 16.26%
23:33:37:WU01:FS01:Download 16.64%
23:34:26:WU01:FS01:Download 17.01%
23:35:15:WU01:FS01:Download 17.39%
23:36:03:WU01:FS01:Download 17.77%
23:36:52:WU01:FS01:Download 18.15%
23:37:41:WU01:FS01:Download 18.53%
23:38:29:WU01:FS01:Download 18.91%
23:39:18:WU01:FS01:Download 19.28%
23:40:07:WU01:FS01:Download 19.66%
23:40:55:WU01:FS01:Download 20.04%
23:41:44:WU01:FS01:Download 20.42%
23:42:33:WU01:FS01:Download 20.80%
23:43:21:WU01:FS01:Download 21.17%
23:44:10:WU01:FS01:Download 21.55%
23:44:59:WU01:FS01:Download 21.93%
23:45:47:WU01:FS01:Download 22.31%
23:46:36:WU01:FS01:Download 22.69%
23:47:25:WU01:FS01:Download 23.06%
23:48:13:WU01:FS01:Download 23.44%
23:49:02:WU01:FS01:Download 23.82%
23:49:51:WU01:FS01:Download 24.20%
23:50:39:WU01:FS01:Download 24.58%
23:51:28:WU01:FS01:Download 24.95%
23:52:16:WU01:FS01:Download 25.33%
23:53:05:WU01:FS01:Download 25.71%
23:53:54:WU01:FS01:Download 26.09%
23:54:42:WU01:FS01:Download 26.47%
23:55:31:WU01:FS01:Download 26.85%
23:56:20:WU01:FS01:Download 27.22%
23:57:08:WU01:FS01:Download 27.60%
23:57:57:WU01:FS01:Download 27.98%
23:58:45:WU01:FS01:Download 28.36%
23:59:56:WU01:FS01:Download 28.74%
00:00:44:WU01:FS01:Download 29.11%
00:01:33:WU01:FS01:Download 29.49%
00:02:22:WU01:FS01:Download 29.87%
00:03:10:WU01:FS01:Download 30.25%
00:03:59:WU01:FS01:Download 30.63%
00:04:48:WU01:FS01:Download 31.00%
00:05:36:WU01:FS01:Download 31.38%
00:06:25:WU01:FS01:Download 31.76%
00:07:13:WU01:FS01:Download 32.14%
00:08:02:WU01:FS01:Download 32.52%
00:08:51:WU01:FS01:Download 32.90%
00:09:39:WU01:FS01:Download 33.27%
00:10:28:WU01:FS01:Download 33.65%
00:11:16:WU01:FS01:Download 34.03%
00:12:05:WU01:FS01:Download 34.41%
00:12:54:WU01:FS01:Download 34.79%
00:13:42:WU01:FS01:Download 35.16%
00:14:31:WU01:FS01:Download 35.54%
00:15:19:WU01:FS01:Download 35.92%
00:16:08:WU01:FS01:Download 36.30%
00:16:57:WU01:FS01:Download 36.68%
00:17:45:WU01:FS01:Download 37.05%
00:18:34:WU01:FS01:Download 37.43%
00:19:22:WU01:FS01:Download 37.81%
00:20:11:WU01:FS01:Download 38.19%
00:21:00:WU01:FS01:Download 38.57%
00:21:48:WU01:FS01:Download 38.94%
00:22:37:WU01:FS01:Download 39.32%
00:23:25:WU01:FS01:Download 39.70%
00:24:14:WU01:FS01:Download 40.08%
00:25:03:WU01:FS01:Download 40.46%
00:25:51:WU01:FS01:Download 40.84%
00:26:40:WU01:FS01:Download 41.21%
00:27:58:WU01:FS01:Download 41.59%
00:30:46:WU01:FS01:Download 41.97%
00:33:07:WU01:FS01:Download 42.35%
00:33:56:WU01:FS01:Download 42.73%
00:34:45:WU01:FS01:Download 43.10%
00:35:33:WU01:FS01:Download 43.48%
00:36:22:WU01:FS01:Download 43.86%
00:37:11:WU01:FS01:Download 44.24%
00:37:59:WU01:FS01:Download 44.62%
00:38:48:WU01:FS01:Download 44.99%
00:39:36:WU01:FS01:Download 45.37%
00:40:25:WU01:FS01:Download 45.75%
00:41:13:WU01:FS01:Download 46.13%
00:42:02:WU01:FS01:Download 46.51%
00:42:51:WU01:FS01:Download 46.89%
00:43:39:WU01:FS01:Download 47.26%
00:44:28:WU01:FS01:Download 47.64%
00:45:17:WU01:FS01:Download 48.02%
00:46:05:WU01:FS01:Download 48.40%
00:46:54:WU01:FS01:Download 48.78%
00:47:43:WU01:FS01:Download 49.15%
00:48:32:WU01:FS01:Download 49.53%
00:49:21:WU01:FS01:Download 49.91%
00:50:09:WU01:FS01:Download 50.29%
00:50:58:WU01:FS01:Download 50.67%
00:51:46:WU01:FS01:Download 51.04%
00:52:35:WU01:FS01:Download 51.42%
00:53:24:WU01:FS01:Download 51.80%
00:54:12:WU01:FS01:Download 52.18%
00:55:01:WU01:FS01:Download 52.56%
00:55:49:WU01:FS01:Download 52.93%
00:56:38:WU01:FS01:Download 53.31%
00:57:27:WU01:FS01:Download 53.69%
00:58:15:WU01:FS01:Download 54.07%
00:59:04:WU01:FS01:Download 54.45%
00:59:52:WU01:FS01:Download 54.83%
01:00:41:WU01:FS01:Download 55.20%
01:01:30:WU01:FS01:Download 55.58%
01:02:18:WU01:FS01:Download 55.96%
01:03:07:WU01:FS01:Download 56.34%
01:03:55:WU01:FS01:Download 56.72%
01:04:44:WU01:FS01:Download 57.09%
01:06:18:WU01:FS01:Download 57.47%
01:08:55:WU01:FS01:Download 57.85%
01:11:45:WU01:FS01:Download 58.23%
01:13:20:WU01:FS01:Download 58.61%
01:14:09:WU01:FS01:Download 58.98%
01:14:57:WU01:FS01:Download 59.36%
01:15:46:WU01:FS01:Download 59.74%
01:16:35:WU01:FS01:Download 60.12%
01:17:29:WU01:FS01:Download 60.50%
01:19:50:WU01:FS01:Download 60.87%
01:22:11:WU01:FS01:Download 61.25%
01:24:32:WU01:FS01:Download 61.63%
01:26:54:WU01:FS01:Download 62.01%
01:29:26:WU01:FS01:Download 62.39%
01:30:15:WU01:FS01:Download 62.77%
01:31:03:WU01:FS01:Download 63.14%
01:31:52:WU01:FS01:Download 63.52%
01:32:40:WU01:FS01:Download 63.90%
01:33:29:WU01:FS01:Download 64.28%
01:34:18:WU01:FS01:Download 64.66%
01:35:06:WU01:FS01:Download 65.03%
01:35:55:WU01:FS01:Download 65.41%
01:36:44:WU01:FS01:Download 65.79%
01:37:32:WU01:FS01:Download 66.17%
01:38:21:WU01:FS01:Download 66.55%
01:39:10:WU01:FS01:Download 66.92%
01:39:58:WU01:FS01:Download 67.30%
01:40:01:ERROR:WU01:FS01:Exception: Transfer failed
01:40:01:WU01:FS01:Connecting to 65.254.110.245:80
01:40:02:WU01:FS01:Assigned to work server 140.163.4.231
01:40:02:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP102 [GeForce GTX 1080 Ti] 11380 from 140.163.4.231
01:40:02:WU01:FS01:Connecting to 140.163.4.231:8080
01:40:06:WU01:FS01:Downloading 16.51MiB
01:40:55:WU01:FS01:Download 0.38%

Edit: solved. Singapore's firewall slows down the connection to FAH servers.
My workaround is to try some US proxies. Some proxies greatly improve the WU download speed, some do not. Currently I'm using 167.99.193.171:80, when it's offline I will have to try my luck with others.

[bruce]

No, it's not normal. I'd call it very unusual.

I'll contact mskcc.org.

[lknl]

Sorry, somehow the current log file doesn't show machine info & client info, I've attached the older log file.
Thanks for the insight. Actually the GPU slot is still unable to get new WU up till now, hopefully the server migration will be completed soon.

Code: Select all

*********************** Log Started 2018-06-19T22:11:25Z ***********************
22:11:25:************************* Folding@home Client *************************
22:11:25:        Website: http://folding.stanford.edu/
22:11:25:      Copyright: (c) 2009-2016 Stanford University
22:11:25:         Author: Joseph Coffland <[email protected]>
22:11:25:           Args: 
22:11:25:         Config: E:\\FAH\\config.xml
22:11:25:******************************** Build ********************************
22:11:25:        Version: 7.4.16
22:11:25:           Date: Jan 6 2017
22:11:25:           Time: 00:25:14
22:11:25:     Repository: Git
22:11:25:       Revision: a9e9e27dc2ee6ff01398c439677bc27f6cb74032
22:11:25:         Branch: master
22:11:25:       Compiler: Visual C++ 2008
22:11:25:        Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox -arch:SSE /MT
22:11:25:       Platform: win32 10
22:11:25:           Bits: 32
22:11:25:           Mode: Release
22:11:25:******************************* System ********************************
22:11:25:            CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
22:11:25:         CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
22:11:25:           CPUs: 12
22:11:25:         Memory: 30.93GiB
22:11:25:    Free Memory: 21.86GiB
22:11:25:        Threads: WINDOWS_THREADS
22:11:25:     OS Version: 6.2
22:11:25:    Has Battery: false
22:11:25:     On Battery: false
22:11:25:     UTC Offset: 8
22:11:25:            PID: 5500
22:11:25:            CWD: E:\\FAH
22:11:25:             OS: Windows 10 Enterprise
22:11:25:        OS Arch: AMD64
22:11:25:           GPUs: 1
22:11:25:          GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:7 GP102 [GeForce GTX 1080 Ti] 11380
22:11:25:  CUDA Device 0: Platform:0 Device:0 Bus:1 Slot:0 Compute:6.1 Driver:9.2
22:11:25:OpenCL Device 0: Platform:0 Device:0 Bus:NA Slot:NA Compute:2.1 Driver:24.20
22:11:25:OpenCL Device 2: Platform:1 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:398.11
22:11:25:  Win32 Service: false
22:11:25:***********************************************************************
22:11:25:<config>
22:11:25:  <!-- Folding Core -->
22:11:25:  <checkpoint v='30'/>
22:11:25:
22:11:25:  <!-- Network -->
22:11:25:  <proxy v=':8080'/>
22:11:25:
22:11:25:  <!-- Slot Control -->
22:11:25:  <power v='FULL'/>
22:11:25:
22:11:25:  <!-- User Information -->
22:11:25:  <passkey v='********************************'/>
22:11:25:  <team v='edited'/>
22:11:25:  <user v='edited'/>
22:11:25:
22:11:25:  <!-- Folding Slots -->
22:11:25:  <slot id='0' type='CPU'/>
22:11:25:  <slot id='1' type='GPU'/>
22:11:25:</config>
22:11:25:Trying to access database...
22:11:25:Successfully acquired database lock
22:11:25:Enabled folding slot 00: READY cpu:11
22:11:25:Enabled folding slot 01: READY gpu:0:GP102 [GeForce GTX 1080 Ti] 11380
22:11:25:ERROR:Exception: Failed to register systray icon: Unspecified error
22:11:25:WU01:FS01:Starting
22:11:25:WU01:FS01:Running FahCore: E:\\FAHClient/FAHCoreWrapper.exe E:\\FAH\\cores/cores.foldingathome.org/Win32/AMD64/NVIDIA/Fermi/Core_21.fah/FahCore_21.exe -dir 01 -suffix 01 -version 704 -lifeline 5500 -checkpoint 30 -gpu-vendor nvidia -opencl-platform 1 -opencl-device 0 -cuda-device 0 -gpu 0
22:11:25:WU01:FS01:Started FahCore on PID 9048
22:11:26:WU01:FS01:Core PID:9072
22:11:26:WU01:FS01:FahCore 0x21 started
22:11:26:WU00:FS00:Connecting to 65.254.110.245:8080
22:11:26:WU01:FS01:0x21:*********************** Log Started 2018-06-19T22:11:26Z ***********************
22:11:26:WU01:FS01:0x21:Project: 11713 (Run 18, Clone 314, Gen 64)
22:11:26:WU01:FS01:0x21:Unit: 0x000000588ca304e75adf7ab62d480d1f
22:11:26:WU01:FS01:0x21:CPU: 0x00000000000000000000000000000000
22:11:26:WU01:FS01:0x21:Machine: 1
22:11:26:WU01:FS01:0x21:Digital signatures verified
22:11:26:WU01:FS01:0x21:Folding@home GPU Core21 Folding@home Core
22:11:26:WU01:FS01:0x21:Version 0.0.18
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WU01:FS01:0x21:  Found a checkpoint file
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:27:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:11:28:WU00:FS00:Assigned to work server 128.252.203.2
22:11:28:WU00:FS00:Requesting new work unit for slot 00: READY cpu:11 from 128.252.203.2
22:11:28:WU00:FS00:Connecting to 128.252.203.2:8080
22:11:30:WU00:FS00:Downloading 4.57MiB
22:11:31:WU01:FS01:0x21:Completed 4750000 out of 7500000 steps (63%)
22:11:31:WU01:FS01:0x21:Temperature control disabled. Requirements: single Nvidia GPU, tmax must be < 110 and twait >= 900
22:11:42:WU00:FS00:Download 1.37%
22:11:55:WU00:FS00:Download 2.73%
22:12:07:WU00:FS00:Download 4.10%
22:12:20:WU00:FS00:Download 5.47%
22:12:32:WU00:FS00:Download 6.84%
22:12:37:WU01:FS01:0x21:Completed 4800000 out of 7500000 steps (64%)
22:12:45:WU00:FS00:Download 8.20%
22:12:58:WU00:FS00:Download 9.57%
22:13:10:WU00:FS00:Download 10.94%
22:13:23:WU00:FS00:Download 12.31%
22:13:35:WU00:FS00:Download 13.67%
22:13:48:WU00:FS00:Download 15.04%
22:14:01:WU00:FS00:Download 16.41%
22:14:13:WU00:FS00:Download 17.77%
22:14:16:WU01:FS01:0x21:Completed 4875000 out of 7500000 steps (65%)
22:14:26:WU00:FS00:Download 19.14%
22:14:39:WU00:FS00:Download 20.51%
22:14:51:WU00:FS00:Download 21.88%
22:15:04:WU00:FS00:Download 23.24%
22:15:16:WU00:FS00:Download 24.61%
22:15:29:WU00:FS00:Download 25.98%
22:15:42:WU00:FS00:Download 27.34%
22:15:54:WU00:FS00:Download 28.71%
22:15:55:WU01:FS01:0x21:Completed 4950000 out of 7500000 steps (66%)
22:16:07:WU00:FS00:Download 30.08%
22:16:20:WU00:FS00:Download 31.45%
22:16:32:WU00:FS00:Download 32.81%
22:16:45:WU00:FS00:Download 34.18%
22:16:57:WU00:FS00:Download 35.55%
22:17:10:WU00:FS00:Download 36.92%
22:17:23:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:17:23:WU00:FS00:Download 38.28%
22:17:35:WU00:FS00:Download 39.65%
22:17:48:WU00:FS00:Download 41.02%
22:17:50:WU01:FS01:0x21:Completed 5025000 out of 7500000 steps (67%)
22:18:01:WU00:FS00:Download 42.38%
22:18:13:WU00:FS00:Download 43.75%
22:18:26:WU00:FS00:Download 45.12%
22:18:38:WU00:FS00:Download 46.49%
22:18:51:WU00:FS00:Download 47.85%
22:19:04:WU00:FS00:Download 49.22%
22:19:16:WU00:FS00:Download 50.59%
22:19:28:WU01:FS01:0x21:Completed 5100000 out of 7500000 steps (68%)
22:19:29:WU00:FS00:Download 51.95%
22:19:42:WU00:FS00:Download 53.32%
22:19:54:WU00:FS00:Download 54.69%
22:20:07:WU00:FS00:Download 56.06%
22:20:19:WU00:FS00:Download 57.42%
22:20:32:WU00:FS00:Download 58.79%
22:20:45:WU00:FS00:Download 60.16%
22:20:57:WU00:FS00:Download 61.53%
22:21:07:WU01:FS01:0x21:Completed 5175000 out of 7500000 steps (69%)
22:21:10:WU00:FS00:Download 62.89%
22:21:23:WU00:FS00:Download 64.26%
22:21:35:WU00:FS00:Download 65.63%
22:21:48:WU00:FS00:Download 66.99%
22:22:00:WU00:FS00:Download 68.36%
22:22:13:WU00:FS00:Download 69.73%
22:22:26:WU00:FS00:Download 71.10%
22:22:38:WU00:FS00:Download 72.46%
22:22:46:WU01:FS01:0x21:Completed 5250000 out of 7500000 steps (70%)
22:22:51:WU00:FS00:Download 73.83%
22:23:04:WU00:FS00:Download 75.20%
22:23:09:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:23:16:WU00:FS00:Download 76.56%
22:23:29:WU00:FS00:Download 77.93%
22:23:41:WU00:FS00:Download 79.30%
22:23:54:WU00:FS00:Download 80.67%
22:24:07:WU00:FS00:Download 82.03%
22:24:19:WU00:FS00:Download 83.40%
22:24:32:WU00:FS00:Download 84.77%
22:24:41:WU01:FS01:0x21:Completed 5325000 out of 7500000 steps (71%)
22:24:44:WU00:FS00:Download 86.14%
22:24:57:WU00:FS00:Download 87.50%
22:25:10:WU00:FS00:Download 88.87%
22:25:22:WU00:FS00:Download 90.24%
22:25:35:WU00:FS00:Download 91.60%
22:25:48:WU00:FS00:Download 92.97%
22:26:00:WU00:FS00:Download 94.34%
22:26:13:WU00:FS00:Download 95.71%
22:26:19:WU01:FS01:0x21:Completed 5400000 out of 7500000 steps (72%)
22:26:25:WU00:FS00:Download 97.07%
22:26:38:WU00:FS00:Download 98.44%
22:26:51:WU00:FS00:Download 99.81%
22:26:52:WU00:FS00:Download complete
22:26:52:WU00:FS00:Received Unit: id:00 state:DOWNLOAD error:NO_ERROR project:13812 run:0 clone:1721 gen:63 core:0xa7 unit:0x0000004d80fccb025ac12c3e19f04807
22:26:52:WU00:FS00:Starting
22:26:52:WARNING:WU00:FS00:AS lowered CPUs from 11 to 10
22:26:52:WU00:FS00:Running FahCore: E:\\FAHClient/FAHCoreWrapper.exe E:\\FAH\\cores/cores.foldingathome.org/Win32/AMD64/AVX/Core_a7.fah/FahCore_a7.exe -dir 00 -suffix 01 -version 704 -lifeline 5500 -checkpoint 30 -np 10
22:26:52:WU00:FS00:Started FahCore on PID 6840
22:26:52:WU00:FS00:Core PID:8612
22:26:52:WU00:FS00:FahCore 0xa7 started
22:26:53:WU00:FS00:0xa7:*********************** Log Started 2018-06-19T22:26:52Z ***********************
22:26:53:WU00:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
22:26:53:WU00:FS00:0xa7:       Type: 0xa7
22:26:53:WU00:FS00:0xa7:       Core: Gromacs
22:26:53:WU00:FS00:0xa7:    Website: http://folding.stanford.edu/
22:26:53:WU00:FS00:0xa7:  Copyright: (c) 2009-2016 Stanford University
22:26:53:WU00:FS00:0xa7:     Author: Joseph Coffland <[email protected]>
22:26:53:WU00:FS00:0xa7:       Args: -dir 00 -suffix 01 -version 704 -lifeline 6840 -checkpoint 30 -np
22:26:53:WU00:FS00:0xa7:             10
22:26:53:WU00:FS00:0xa7:     Config: <none>
22:26:53:WU00:FS00:0xa7:************************************ Build *************************************
22:26:53:WU00:FS00:0xa7:    Version: 0.0.16
22:26:53:WU00:FS00:0xa7:       Date: Oct 31 2017
22:26:53:WU00:FS00:0xa7:       Time: 14:04:33
22:26:53:WU00:FS00:0xa7: Repository: Git
22:26:53:WU00:FS00:0xa7:   Revision: 2f0a8a3d0b0698be48154fe99a0216f289060932
22:26:53:WU00:FS00:0xa7:     Branch: master
22:26:53:WU00:FS00:0xa7:   Compiler: Visual C++ 2008
22:26:53:WU00:FS00:0xa7:    Options: /TP /nologo /EHa /wd4297 /wd4103 /Ox /MT
22:26:53:WU00:FS00:0xa7:   Platform: win32 10
22:26:53:WU00:FS00:0xa7:       Bits: 64
22:26:53:WU00:FS00:0xa7:       Mode: Release
22:26:53:WU00:FS00:0xa7:       SIMD: avx_256
22:26:53:WU00:FS00:0xa7:************************************ System ************************************
22:26:53:WU00:FS00:0xa7:        CPU: Unknown
22:26:53:WU00:FS00:0xa7:     CPU ID: 
22:26:53:WU00:FS00:0xa7:       CPUs: 12
22:26:53:WU00:FS00:0xa7:     Memory: 30.93GiB
22:26:53:WU00:FS00:0xa7:Free Memory: 29.07GiB
22:26:53:WU00:FS00:0xa7:    Threads: WINDOWS_THREADS
22:26:53:WU00:FS00:0xa7: OS Version: 6.2
22:26:53:WU00:FS00:0xa7:Has Battery: false
22:26:53:WU00:FS00:0xa7: On Battery: false
22:26:53:WU00:FS00:0xa7: UTC Offset: 8
22:26:53:WU00:FS00:0xa7:        PID: 8612
22:26:53:WU00:FS00:0xa7:        CWD: E:\\FAH\\work
22:26:53:WU00:FS00:0xa7:         OS: Windows 10 Pro
22:26:53:WU00:FS00:0xa7:    OS Arch: AMD64
22:26:53:WU00:FS00:0xa7:********************************************************************************
22:26:53:WU00:FS00:0xa7:Project: 13812 (Run 0, Clone 1721, Gen 63)
22:26:53:WU00:FS00:0xa7:Unit: 0x0000004d80fccb025ac12c3e19f04807
22:26:53:WU00:FS00:0xa7:Reading tar file core.xml
22:26:53:WU00:FS00:0xa7:Reading tar file frame63.tpr
22:26:59:WU00:FS00:0xa7:Digital signatures verified
22:27:00:WU00:FS00:0xa7:Calling: mdrun -s frame63.tpr -o frame63.trr -x frame63.xtc -cpt 30 -nt 10
22:27:00:WU00:FS00:0xa7:Steps: first=15750000 total=250000
22:27:04:WU00:FS00:0xa7:Completed 1 out of 250000 steps (0%)
22:28:00:WU01:FS01:0x21:Completed 5475000 out of 7500000 steps (73%)
22:28:41:WU00:FS00:0xa7:Completed 2500 out of 250000 steps (1%)
22:28:55:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:29:56:WU01:FS01:0x21:Completed 5550000 out of 7500000 steps (74%)
22:30:17:WU00:FS00:0xa7:Completed 5000 out of 250000 steps (2%)
22:31:37:WU01:FS01:0x21:Completed 5625000 out of 7500000 steps (75%)
22:31:53:WU00:FS00:0xa7:Completed 7500 out of 250000 steps (3%)
22:33:19:WU01:FS01:0x21:Completed 5700000 out of 7500000 steps (76%)
22:33:28:WU00:FS00:0xa7:Completed 10000 out of 250000 steps (4%)
22:34:47:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:35:05:WU00:FS00:0xa7:Completed 12500 out of 250000 steps (5%)
22:35:14:WU01:FS01:0x21:Completed 5775000 out of 7500000 steps (77%)
22:36:40:WU00:FS00:0xa7:Completed 15000 out of 250000 steps (6%)
22:36:55:WU01:FS01:0x21:Completed 5850000 out of 7500000 steps (78%)
22:38:16:WU00:FS00:0xa7:Completed 17500 out of 250000 steps (7%)
22:38:37:WU01:FS01:0x21:Completed 5925000 out of 7500000 steps (79%)
22:39:52:WU00:FS00:0xa7:Completed 20000 out of 250000 steps (8%)
22:40:18:WU01:FS01:0x21:Completed 6000000 out of 7500000 steps (80%)
22:40:39:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:41:28:WU00:FS00:0xa7:Completed 22500 out of 250000 steps (9%)
22:42:13:WU01:FS01:0x21:Completed 6075000 out of 7500000 steps (81%)
22:43:03:WU00:FS00:0xa7:Completed 25000 out of 250000 steps (10%)
22:43:55:WU01:FS01:0x21:Completed 6150000 out of 7500000 steps (82%)
22:44:39:WU00:FS00:0xa7:Completed 27500 out of 250000 steps (11%)
22:45:36:WU01:FS01:0x21:Completed 6225000 out of 7500000 steps (83%)
22:46:15:WU00:FS00:0xa7:Completed 30000 out of 250000 steps (12%)
22:46:31:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:47:32:WU01:FS01:0x21:Completed 6300000 out of 7500000 steps (84%)
22:47:52:WU00:FS00:0xa7:Completed 32500 out of 250000 steps (13%)
22:49:14:WU01:FS01:0x21:Completed 6375000 out of 7500000 steps (85%)
22:49:27:WU00:FS00:0xa7:Completed 35000 out of 250000 steps (14%)
22:50:55:WU01:FS01:0x21:Completed 6450000 out of 7500000 steps (86%)
22:51:03:WU00:FS00:0xa7:Completed 37500 out of 250000 steps (15%)
22:52:23:WARNING:FS01:Size of positions 2586 does not match topology 2585
22:52:39:WU00:FS00:0xa7:Completed 40000 out of 250000 steps (16%)
22:52:51:WU01:FS01:0x21:Completed 6525000 out of 7500000 steps (87%)
22:54:15:WU00:FS00:0xa7:Completed 42500 out of 250000 steps (17%)

[bruce]

The current log file ALWAYS shows the machine info & client info ... but if you're looking at it in the FAHClient "log" tab you have to refresh it as the top is generally truncated. Anyway, this is fine. It doesn't show anything unexpected.

[lknl]

I got it, thanks for taking a look.

[OntosChalmer]

Code: Select all

22:58:17:WU01:FS01:Connecting to 65.254.110.245:8080
22:58:18:WU01:FS01:Assigned to work server 140.163.4.231
22:58:18:WU01:FS01:Requesting new work unit for slot 01: RUNNING gpu:0:GP104 [GeForce GTX 1070] 6463 from 140.163.4.231
22:58:18:WU01:FS01:Connecting to 140.163.4.231:8080
23:00:34:WU00:FS01:0x21:Completed 7500000 out of 7500000 steps (100%)
23:00:35:WU00:FS01:0x21:Saving result file logfile_01.txt
23:00:35:WU00:FS01:0x21:Saving result file checkpointState.xml
23:00:35:WU00:FS01:0x21:Saving result file checkpt.crc
23:00:35:WU00:FS01:0x21:Saving result file log.txt
23:00:35:WU00:FS01:0x21:Saving result file positions.xtc
23:00:35:WU00:FS01:0x21:Folding@home Core Shutdown: FINISHED_UNIT
23:00:36:WU00:FS01:FahCore returned: FINISHED_UNIT (100 = 0x64)
23:00:36:WU00:FS01:Sending unit results: id:00 state:SEND error:NO_ERROR project:11713 run:3 clone:181 gen:118 core:0x21 unit:0x000000a08ca304e75adf72edf9c3edb3
23:00:36:WU00:FS01:Uploading 11.78MiB to 140.163.4.231
23:00:36:WU00:FS01:Connecting to 140.163.4.231:8080
23:01:51:WU00:FS01:Upload complete
23:01:51:WU00:FS01:Server responded WORK_ACK (400)
23:01:51:WU00:FS01:Final credit estimate, 97254.00 points
23:01:52:WU00:FS01:Cleaning up
23:04:28:WU01:FS01:Downloading 16.52MiB
23:04:39:WU01:FS01:Download 12.48%
00:21:42:WU01:FS01:Download 56.73%
******************************* Date: 2018-06-22 *******************************
00:22:22:WU01:FS01:Download 57.11%
00:58:24:WU01:FS01:Download 77.54%
00:59:04:WU01:FS01:Download 77.92%
00:59:38:WU01:FS01:Download 77.92%
00:59:38:ERROR:WU01:FS01:Exception: Transfer failed
00:59:39:WU01:FS01:Connecting to 65.254.110.245:8080
00:59:39:WU01:FS01:Assigned to work server 140.163.4.231
00:59:39:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 140.163.4.231
00:59:39:WU01:FS01:Connecting to 140.163.4.231:8080

(Many Download % messages cut for brevity)

My GPU generally spends a lot of time idle in FAH due to poor download speeds, and download issues. It almost happens more often than it does not. Unsure on causes.

1. My ISP uses a proxy by default. I do not have a static IP. Unsure if this will cause any issues.
2. I have a fibre connection to my home. The network usage on the FAHClient.exe is shown as 0.1 Mbps when downloading, but may be less than that or around there.
3. The tracert to 140.163.4.221 is as below:

Code: Select all

Tracing route to plfah1-1.mskcc.org [140.163.4.231]
over a maximum of 30 hops:

  1    <1 ms    <1 ms    <1 ms  192.168.1.254
  2     3 ms     2 ms     2 ms  bb119-74-45-254.singnet.com.sg [119.74.45.254]
  3     4 ms     2 ms     2 ms  202.166.123.134
  4     2 ms     2 ms     2 ms  202.166.123.133
  5     2 ms     3 ms     2 ms  ae8-0.tp-cr03.singnet.com.sg [202.166.122.50]
  6     2 ms     2 ms     5 ms  ae4-0.tp-er03.singnet.com.sg [202.166.123.70]
  7     3 ms     2 ms     3 ms  203.208.191.197
  8   204 ms   199 ms   199 ms  203.208.172.210
  9   198 ms   197 ms   197 ms  palo-b1-link.telia.net [80.239.134.85]
 10     *        *      291 ms  nyk-bb3-link.telia.net [62.115.114.4]
 11   248 ms   248 ms   248 ms  nyk-b3-link.telia.net [62.115.140.223]
 12   280 ms   274 ms   272 ms  windstream-ic-310403-nyk-b3.c.telia.net [213.248.95.22]
 13   242 ms   244 ms   243 ms  be1.agr03.nwrk01-nj.us.windstream.net [40.128.248.11]
 14   243 ms   248 ms   242 ms  xe0-0-0-0.pe07.nwrk01-nj.us.windstream.net [40.128.249.132]
 15   252 ms   250 ms   250 ms  74.8.57.6
 16     *        *        *     Request timed out.
 17     *        *        *     Request timed out.
 18     *        *        *     Request timed out.
 19     *        *        *     Request timed out.
 20     *        *        *     Request timed out.
 21     *        *        *     Request timed out.
 22     *        *        *     Request timed out.
 23     *        *        *     Request timed out.
 24     *        *        *     Request timed out.
 25     *        *        *     Request timed out.
 26     *        *        *     Request timed out.
 27     *        *        *     Request timed out.
 28     *        *        *     Request timed out.
 29     *        *        *     Request timed out.
 30     *        *        *     Request timed out.

Download speeds and issues are one of the few issues I've had with FAH. I do like how BOINC downloads their equivalent of work-units ahead of time, so there's less time spend idle. If FAHC could do that, it'd be lovely.

[Joe_H]

The folding client already starts the download in advance, by default at 99% of completion of the current WU as shown in your log file. That can be set as early os 90%. But the issue of poor connectivity from your location to the server will still remain. Not certain how to improve that, you may need to contact your ISP to see if you can improve that.

[bruce]

I'm seeing essentially the same problem after a tracert from here gets to hop 15 (although i get to that point somewhat faster)

14 88 ms 88 ms 88 ms xe1-0-0-0.pe07.nwrk01-nj.us.windstream.net [40.128.249.134]
15 85 ms 86 ms 93 ms 74.8.57.6
16 * * * Request timed out.
17 * * * Request timed out.

I'll contact somebody at mskcc.org and have them contact THEIR ISp and see if something can be done about it from their end.

FAH doesn't care whether you have a fixed or dynamic IP address.

[OntosChalmer]

The folding client already starts the download in advance, by default at 99% of completion of the current WU as shown in your log file. That can be set as early os 90%. But the issue of poor connectivity from your location to the server will still remain. Not certain how to improve that, you may need to contact your ISP to see if you can improve that.

How do I change the % when I start downloading the new WU? I don't see the option to do so in the client?

[bruce]

Open FAHControl and click on Configure + Expert + Add (at the bottom of "Extra client options")
In the popup, enter
(Name) next-unit-percentage
(Value) 90
and proceed to save that setting. That will set it for all of your slots.

Since that server only has WUs for GPUs and you may have one or more slots for CPUs, you may choose to set it selectively. Click on Configure + Slots + (choose a slot) The same setting can be added in "extra slot options" to make the setting apply only to selected slots.

[rafwiewiora]

We're investigating folks - thanks for reports!

[JohnChodera]

Thanks for the heads-up, everybody!

I've restarted the work servers. Please advise if the slow transfers continue!

We're checking in with our Networking folks too. Will let you know what we find.

~ The Chodera Lab

[Aurum]

I'm getting this a lot today:

Code: Select all

01:29:59:ERROR:WU02:FS00:Exception: Could not get IP address for assign1.foldingathome.org: Temporary failure in name resolution
01:30:19:ERROR:WU02:FS00:Exception: Could not get IP address for assign2.foldingathome.org: Temporary failure in name resolution
01:30:19:WARNING:WU02:FS00:Exception: Failed to find any IP addresses for assignment servers
01:30:19:ERROR:WU02:FS00:Exception: Could not get an assignment
01:31:36:ERROR:WU02:FS00:Exception: Could not get IP address for assign1.foldingathome.org: Temporary failure in name resolution
01:31:56:ERROR:WU02:FS00:Exception: Could not get IP address for assign2.foldingathome.org: Temporary failure in name resolution
01:31:56:WARNING:WU02:FS00:Exception: Failed to find any IP addresses for assignment servers
01:31:56:ERROR:WU02:FS00:Exception: Could not get an assignment
01:32:20:WU01:FS01:0x21:Completed 4125000 out of 7500000 steps (55%)
01:34:13:ERROR:WU02:FS00:Exception: Could not get IP address for assign1.foldingathome.org: Temporary failure in name resolution
01:34:33:ERROR:WU02:FS00:Exception: Could not get IP address for assign2.foldingathome.org: Temporary failure in name resolution
01:34:33:WARNING:WU02:FS00:Exception: Failed to find any IP addresses for assignment servers
01:34:33:ERROR:WU02:FS00:Exception: Could not get an assignment

[Aurum]

And this:

Code: Select all

01:30:49:ERROR:WU03:FS03:Exception: Could not get IP address for assign3.stanford.edu: Temporary failure in name resolution
01:31:09:ERROR:WU03:FS03:Exception: Could not get IP address for assign4.stanford.edu: Temporary failure in name resolution
01:31:09:WARNING:WU03:FS03:Exception: Failed to find any IP addresses for assignment servers
01:31:09:ERROR:WU03:FS03:Exception: Could not get an assignment
01:31:46:WU01:FS01:0x21:Completed 3450000 out of 7500000 steps (46%)
01:31:49:ERROR:WU03:FS03:Exception: Could not get IP address for assign3.stanford.edu: Temporary failure in name resolution
01:32:00:WU00:FS00:0x21:Completed 3225000 out of 7500000 steps (43%)
01:32:09:ERROR:WU03:FS03:Exception: Could not get IP address for assign4.stanford.edu: Temporary failure in name resolution
01:32:09:WARNING:WU03:FS03:Exception: Failed to find any IP addresses for assignment servers
01:32:09:ERROR:WU03:FS03:Exception: Could not get an assignment
01:32:28:WU02:FS02:0x21:Completed 3375000 out of 7500000 steps (45%)
01:33:26:ERROR:WU03:FS03:Exception: Could not get IP address for assign3.stanford.edu: Temporary failure in name resolution
01:33:46:ERROR:WU03:FS03:Exception: Could not get IP address for assign4.stanford.edu: Temporary failure in name resolution
01:33:46:WARNING:WU03:FS03:Exception: Failed to find any IP addresses for assignment servers
01:33:46:ERROR:WU03:FS03:Exception: Could not get an assignment
01:33:46:WARNING:FS00:Size of positions 2825 does not match topology 2775
01:33:58:WU01:FS01:0x21:Completed 3525000 out of 7500000 steps (47%)
01:34:46:WU02:FS02:0x21:Completed 3450000 out of 7500000 steps (46%)
01:35:20:WU00:FS00:0x21:Completed 3300000 out of 7500000 steps (44%)
01:36:03:ERROR:WU03:FS03:Exception: Could not get IP address for assign3.stanford.edu: Temporary failure in name resolution
01:36:10:WU01:FS01:0x21:Completed 3600000 out of 7500000 steps (48%)
01:36:23:ERROR:WU03:FS03:Exception: Could not get IP address for assign4.stanford.edu: Temporary failure in name resolution
01:36:23:WARNING:WU03:FS03:Exception: Failed to find any IP addresses for assignment servers
01:36:23:ERROR:WU03:FS03:Exception: Could not get an assignment
01:37:05:WU02:FS02:0x21:Completed 3525000 out of 7500000 steps (47%)

[OntosChalmer]

Code: Select all

22:15:40:WU01:FS01:Connecting to 65.254.110.245:8080
22:15:41:WU01:FS01:Assigned to work server 140.163.4.231
22:15:41:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 140.163.4.231
22:15:41:WU01:FS01:Connecting to 140.163.4.231:8080
22:34:42:WU01:FS01:Downloading 16.51MiB
22:35:19:WU01:FS01:Download 12.49%
00:24:57:WU01:FS01:Download 84.42%
00:24:59:ERROR:WU01:FS01:Exception: Transfer failed
02:47:56:FS01:Unpaused
02:47:56:WU01:FS01:Connecting to 65.254.110.245:8080
02:47:58:WU01:FS01:Assigned to work server 140.163.4.231
02:47:58:WU01:FS01:Requesting new work unit for slot 01: READY gpu:0:GP104 [GeForce GTX 1070] 6463 from 140.163.4.231
02:47:58:WU01:FS01:Connecting to 140.163.4.231:8080

Speeds are still slow and prone to transfer failed issues from the same domain.