Folding Forum

Posted: **Wed Dec 12, 2007 8:15 am**

Here is the problem :

[03:13:37] Unit 8 finished with 83 percent of time to deadline remaining.
[03:13:37] Updated performance fraction: 0.825096
[03:13:37] Sending work to server

[03:13:37] + Attempting to send results
[03:13:37] - Reading file work/wuresults_08.dat from core
[03:13:37] (Read 14576340 bytes from disk)
[03:13:37] Connecting to http://171.64.65.63:8080/
[03:15:52] Posted data.
[03:15:53] Initial: 0000; - Uploaded at ~104 kB/s
[03:15:53] - Averaged speed for that direction ~103 kB/s
[03:15:53] + Results successfully sent
[03:15:53] Thank you for your contribution to Folding@Home.
[03:15:53] + Number of Units Completed: 57

[03:19:58] - Warning: Could not delete all work unit files (8): Core returned invalid code
[03:19:58] Trying to send all finished work units
[03:19:58] + No unsent completed units remaining.
[03:19:58] - Preparing to get new work unit...
[03:19:58] + Attempting to get work packet
[03:19:58] - Will indicate memory of 2014 MB
[03:19:58] - Connecting to assignment server
[03:19:58] Connecting to http://assign.stanford.edu:8080/
[03:19:58] Posted data.
[03:19:58] Initial: 40AB; - Successful: assigned to (171.64.65.63).
[03:19:58] + News From Folding@Home: Welcome to Folding@Home
[03:19:59] Loaded queue successfully.
[03:19:59] Connecting to http://171.64.65.63:8080/
[03:20:00] Posted data.
[03:20:00] Initial: 0000; - Receiving payload (expected size: 284062)
[03:20:01] - Downloaded at ~277 kB/s
[03:20:01] - Averaged speed for that direction ~169 kB/s
[03:20:01] + Received work.
[03:20:01] Trying to send all finished work units
[03:20:01] + No unsent completed units remaining.
[03:20:01] + Closed connections
[03:20:01]
[03:20:01] + Processing work unit
[03:20:01] Core required: FahCore_a1.exe
[03:20:01] Core found.
[03:20:01] Working on Unit 09 [December 10 03:20:01]
[03:20:01] + Working ...
[03:20:01] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 09 -checkpoint 15 -verbose -lifeline 9952 -version 600'

[03:20:01]
[03:20:01] *------------------------------*
[03:20:01] Folding@Home Gromacs SMP Core
[03:20:01] Version 1.74 (November 27, 2006)
[03:20:01]
[03:20:01] Preparing to commence simulation
[03:20:01] - Ensuring status. Please wait.
[03:20:01] Created dyn
[03:20:01] - Files status OK
[03:20:01] - Expanded 283550 -> 1506689 (decompressed 531.3 percent)
[03:20:01] - Starting from initial work packet
[03:20:01]
[03:20:01] Project: 3050 (Run 1, Clone 33, Gen 20)
[03:20:01]
[03:20:01] Assembly optimizations on if available.
[03:20:01] Entering M.D.
[03:20:18] ial work packet
[03:20:18]
[03:20:18] Project: 3050 (Run 1, Clone 33, Gen 20)
[03:20:18]
[03:20:18] Entering M.D.
[03:20:18] one 33, Gen 20)
[03:20:18]
[03:20:18] Entering M.D.
[03:20:25] 676 p3050_SMP-emsv-03
[03:20:25] Writing loWriting loExtra SSE boost OK.
[03:20:25] Writing local files
[03:20:25] Completed 0 out of 10000000 steps (0 percent)
[03:27:10] Writing local files
[03:27:10] Completed 100000 out of 10000000 steps (1 percent)
[03:33:56] Writing local files
[03:33:56] Completed 200000 out of 10000000 steps (2 percent)
[03:40:37] Writing local files
[03:40:37] Completed 300000 out of 10000000 steps (3 percent)
[03:47:19] Writing local files
[03:47:19] Completed 400000 out of 10000000 steps (4 percent)
[03:54:00] Writing local files
[03:54:00] Completed 500000 out of 10000000 steps (5 percent)
[04:00:48] Writing local files
[04:00:48] Completed 600000 out of 10000000 steps (6 percent)
[04:07:30] Writing local files
[04:07:30] Completed 700000 out of 10000000 steps (7 percent)
[04:14:09] Writing local files
[04:14:10] Completed 800000 out of 10000000 steps (8 percent)
[04:20:56] Writing local files
[04:20:56] Completed 900000 out of 10000000 steps (9 percent)
[04:27:39] Writing local files
[04:27:39] Completed 1000000 out of 10000000 steps (10 percent)
[04:34:22] Writing local files
[04:34:22] Completed 1100000 out of 10000000 steps (11 percent)
[04:41:03] Writing local files
[04:41:03] Completed 1200000 out of 10000000 steps (12 percent)
[04:47:46] Writing local files
[04:47:46] Completed 1300000 out of 10000000 steps (13 percent)
[04:54:29] Writing local files
[04:54:30] Completed 1400000 out of 10000000 steps (14 percent)
[05:01:10] Writing local files
[05:01:10] Completed 1500000 out of 10000000 steps (15 percent)
[05:07:50] Writing local files
[05:07:50] Completed 1600000 out of 10000000 steps (16 percent)
[05:14:28] Writing local files
[05:14:28] Completed 1700000 out of 10000000 steps (17 percent)
[05:21:08] Writing local files
[05:21:08] Completed 1800000 out of 10000000 steps (18 percent)
[05:24:22] - Autosending finished units...
[05:24:22] Trying to send all finished work units
[05:24:22] + No unsent completed units remaining.
[05:24:22] - Autosend completed
[05:27:53] Writing local files
[05:27:53] Completed 1900000 out of 10000000 steps (19 percent)
[05:34:41] Writing local files
[05:34:41] Completed 2000000 out of 10000000 steps (20 percent)
[05:41:25] Writing local files
[05:41:25] Completed 2100000 out of 10000000 steps (21 percent)
[05:48:04] Writing local files
[05:48:04] Completed 2200000 out of 10000000 steps (22 percent)
[05:54:47] Writing local files
[05:54:47] Completed 2300000 out of 10000000 steps (23 percent)
[06:01:28] Writing local files
[06:01:28] Completed 2400000 out of 10000000 steps (24 percent)
[06:08:11] Writing local files
[06:08:11] Completed 2500000 out of 10000000 steps (25 percent)
[06:14:56] Writing local files
[06:14:56] Completed 2600000 out of 10000000 steps (26 percent)
[06:21:38] Writing local files
[06:21:38] Completed 2700000 out of 10000000 steps (27 percent)
[06:28:19] Writing local files
[06:28:19] Completed 2800000 out of 10000000 steps (28 percent)
[06:35:01] Writing local files
[06:35:01] Completed 2900000 out of 10000000 steps (29 percent)
[06:41:45] Writing local files
[06:41:45] Completed 3000000 out of 10000000 steps (30 percent)
[06:48:29] Writing local files
[06:48:29] Completed 3100000 out of 10000000 steps (31 percent)
[06:55:15] Writing local files
[06:55:15] Completed 3200000 out of 10000000 steps (32 percent)
[07:02:05] Writing local files
[07:02:05] Completed 3300000 out of 10000000 steps (33 percent)
[07:08:55] Writing local files
[07:08:55] Completed 3400000 out of 10000000 steps (34 percent)
[07:15:42] Writing local files
[07:15:42] Completed 3500000 out of 10000000 steps (35 percent)
[07:22:27] Writing local files
[07:22:27] Completed 3600000 out of 10000000 steps (36 percent)
[07:29:14] Writing local files
[07:29:15] Completed 3700000 out of 10000000 steps (37 percent)
[07:35:54] Writing local files
[07:35:54] Completed 3800000 out of 10000000 steps (38 percent)
[07:42:40] Writing local files
[07:42:40] Completed 3900000 out of 10000000 steps (39 percent)
[07:49:23] Writing local files
[07:49:23] Completed 4000000 out of 10000000 steps (40 percent)
[07:56:04] Writing local files
[07:56:04] Completed 4100000 out of 10000000 steps (41 percent)
[08:02:45] Writing local files
[08:02:45] Completed 4200000 out of 10000000 steps (42 percent)
[08:09:31] Writing local files
[08:09:31] Completed 4300000 out of 10000000 steps (43 percent)
[08:16:17] Writing local files
[08:16:17] Completed 4400000 out of 10000000 steps (44 percent)
[08:23:04] Writing local files
[08:23:04] Completed 4500000 out of 10000000 steps (45 percent)
[08:29:48] Writing local files
[08:29:48] Completed 4600000 out of 10000000 steps (46 percent)
[08:36:33] Writing local files
[08:36:33] Completed 4700000 out of 10000000 steps (47 percent)
[08:43:14] Writing local files
[08:43:14] Completed 4800000 out of 10000000 steps (48 percent)
[08:49:54] Writing local files
[08:49:54] Completed 4900000 out of 10000000 steps (49 percent)
[08:56:39] Writing local files
[08:56:39] Completed 5000000 out of 10000000 steps (50 percent)
[09:03:19] Writing local files
[09:03:19] Completed 5100000 out of 10000000 steps (51 percent)
[09:10:03] Writing local files
[09:10:03] Completed 5200000 out of 10000000 steps (52 percent)
[09:16:46] Writing local files
[09:16:46] Completed 5300000 out of 10000000 steps (53 percent)
[09:23:30] Writing local files
[09:23:30] Completed 5400000 out of 10000000 steps (54 percent)
[09:30:16] Writing local files
[09:30:16] Completed 5500000 out of 10000000 steps (55 percent)
[09:36:57] Writing local files
[09:36:57] Completed 5600000 out of 10000000 steps (56 percent)
[09:43:36] Writing local files
[09:43:36] Completed 5700000 out of 10000000 steps (57 percent)
[09:50:18] Writing local files
[09:50:18] Completed 5800000 out of 10000000 steps (58 percent)
[09:57:01] Writing local files
[09:57:01] Completed 5900000 out of 10000000 steps (59 percent)
[10:03:44] Writing local files
[10:03:44] Completed 6000000 out of 10000000 steps (60 percent)
[10:10:28] Writing local files
[10:10:28] Completed 6100000 out of 10000000 steps (61 percent)
[10:17:10] Writing local files
[10:17:10] Completed 6200000 out of 10000000 steps (62 percent)
[10:23:57] Writing local files
[10:23:57] Completed 6300000 out of 10000000 steps (63 percent)
[10:30:41] Writing local files
[10:30:41] Completed 6400000 out of 10000000 steps (64 percent)
[10:37:23] Writing local files
[10:37:23] Completed 6500000 out of 10000000 steps (65 percent)
[10:44:05] Writing local files
[10:44:05] Completed 6600000 out of 10000000 steps (66 percent)
[10:50:52] Writing local files
[10:50:52] Completed 6700000 out of 10000000 steps (67 percent)
[10:57:34] Writing local files
[10:57:35] Completed 6800000 out of 10000000 steps (68 percent)
[11:04:17] Writing local files
[11:04:17] Completed 6900000 out of 10000000 steps (69 percent)
[11:11:02] Writing local files
[11:11:02] Completed 7000000 out of 10000000 steps (70 percent)
[11:17:48] Writing local files
[11:17:48] Completed 7100000 out of 10000000 steps (71 percent)
[11:24:22] - Autosending finished units...
[11:24:22] Trying to send all finished work units
[11:24:22] + No unsent completed units remaining.
[11:24:22] - Autosend completed
[11:24:32] Writing local files
[11:24:32] Completed 7200000 out of 10000000 steps (72 percent)
[11:31:14] Writing local files
[11:31:14] Completed 7300000 out of 10000000 steps (73 percent)
[11:37:58] Writing local files
[11:37:58] Completed 7400000 out of 10000000 steps (74 percent)
[11:44:40] Writing local files
[11:44:40] Completed 7500000 out of 10000000 steps (75 percent)
[11:51:22] Writing local files
[11:51:22] Completed 7600000 out of 10000000 steps (76 percent)
[11:58:05] Writing local files
[11:58:05] Completed 7700000 out of 10000000 steps (77 percent)
[12:04:49] Writing local files
[12:04:49] Completed 7800000 out of 10000000 steps (78 percent)
[12:11:36] Writing local files
[12:11:36] Completed 7900000 out of 10000000 steps (79 percent)
[12:18:21] Writing local files
[12:18:21] Completed 8000000 out of 10000000 steps (80 percent)
[12:25:07] Writing local files
[12:25:07] Completed 8100000 out of 10000000 steps (81 percent)
[12:31:51] Writing local files
[12:31:51] Completed 8200000 out of 10000000 steps (82 percent)
[12:38:36] Writing local files
[12:38:36] Completed 8300000 out of 10000000 steps (83 percent)
[12:45:19] Writing local files
[12:45:19] Completed 8400000 out of 10000000 steps (84 percent)
[12:52:05] Writing local files
[12:52:05] Completed 8500000 out of 10000000 steps (85 percent)
[12:58:49] Writing local files
[12:58:49] Completed 8600000 out of 10000000 steps (86 percent)
[13:05:33] Writing local files
[13:05:34] Completed 8700000 out of 10000000 steps (87 percent)
[13:12:18] Writing local files
[13:12:18] Completed 8800000 out of 10000000 steps (88 percent)
[13:19:04] Writing local files
[13:19:04] Completed 8900000 out of 10000000 steps (89 percent)
[13:25:46] Writing local files
[13:25:46] Completed 9000000 out of 10000000 steps (90 percent)
[13:32:29] Writing local files
[13:32:29] Completed 9100000 out of 10000000 steps (91 percent)
[13:39:11] Writing local files
[13:39:11] Completed 9200000 out of 10000000 steps (92 percent)
[13:45:54] Writing local files
[13:45:54] Completed 9300000 out of 10000000 steps (93 percent)
[13:52:43] Writing local files
[13:52:43] Completed 9400000 out of 10000000 steps (94 percent)
[13:57:19] Warning: long 1-4 interactions
[13:57:23] CoreStatus = 0 (0)
[13:57:23] Client-core communications error: ERROR 0x0
[13:57:23] Deleting current work unit & continuing...
[14:01:45] - Warning: Could not delete all work unit files (9): Core returned invalid code
[14:01:45] Trying to send all finished work units
[14:01:45] + No unsent completed units remaining.
[14:01:45] - Preparing to get new work unit...
[14:01:45] + Attempting to get work packet
[14:01:45] - Will indicate memory of 2014 MB
[14:01:45] - Connecting to assignment server
[14:01:45] Connecting to http://assign.stanford.edu:8080/
[14:01:46] Posted data.
[14:01:46] Initial: 40AB; - Successful: assigned to (171.64.65.63).
[14:01:46] + News From Folding@Home: Welcome to Folding@Home
[14:01:46] Loaded queue successfully.
[14:01:46] Connecting to http://171.64.65.63:8080/
[14:01:47] Posted data.
[14:01:47] Initial: 0000; - Receiving payload (expected size: 284062)
[14:01:49] - Downloaded at ~138 kB/s
[14:01:49] - Averaged speed for that direction ~163 kB/s
[14:01:49] + Received work.
[14:01:49] + Closed connections
[14:01:54]
[14:01:54] + Processing work unit
[14:01:54] Core required: FahCore_a1.exe
[14:01:54] Core found.
[14:01:54] Working on Unit 00 [December 10 14:01:54]
[14:01:54] + Working ...
[14:01:54] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 00 -checkpoint 15 -verbose -lifeline 9952 -version 600'

[14:01:54]
[14:01:54] *------------------------------*
[14:01:54] Folding@Home Gromacs SMP Core
[14:01:54] Version 1.74 (November 27, 2006)
[14:01:54]
[14:01:54] Preparing to commence simulation
[14:01:54] - Ensuring status. Please wait.
[14:02:11] - Looking at optimizations...
[14:02:11] - Working with standard loops on this execution.
[14:02:11] - Previous termination of core w- Expanded 283550 -> 1506689 (d- Expanded 283550 -> 150668- Starting from initial work pa- Sta
[14:02:11] Project: 3050 (Run 1, Clone 33, Gen 20)
[14:02:11]
[14:02:11] Entering M.D.
[14:02:11] one 33, Gen 20)
[14:02:11]
[14:02:11] Entering M.D.
[14:02:11] one 33, Gen 20)
[14:02:11]
[14:02:11] Entering M.D.
[14:02:17] boost OK.
[14:02:17] SMP-emsv-03
[14:02:17] Writing local files
[14:02:17] Extra SSE boost OK.
[14:02:17] boost OK.
[14:02:17] cal files
[14:02:17] Completed 0 out of 10000000 steps (0 percent)
[14:08:57] Writing local files
[14:08:57] Completed 100000 out of 10000000 steps (1 percent)
[14:15:42] Writing local files
[14:15:42] Completed 200000 out of 10000000 steps (2 percent)
[14:22:25] Writing local files
[14:22:25] Completed 300000 out of 10000000 steps (3 percent)
[14:29:05] Writing local files
[14:29:05] Completed 400000 out of 10000000 steps (4 percent)
[14:35:48] Writing local files
[14:35:48] Completed 500000 out of 10000000 steps (5 percent)
[14:42:31] Writing local files
[14:42:31] Completed 600000 out of 10000000 steps (6 percent)
[14:49:15] Writing local files
[14:49:15] Completed 700000 out of 10000000 steps (7 percent)
[14:55:55] Writing local files
[14:55:55] Completed 800000 out of 10000000 steps (8 percent)
[15:02:34] Writing local files
[15:02:34] Completed 900000 out of 10000000 steps (9 percent)
[15:09:15] Writing local files
[15:09:15] Completed 1000000 out of 10000000 steps (10 percent)
[15:16:02] Writing local files
[15:16:02] Completed 1100000 out of 10000000 steps (11 percent)
[15:22:45] Writing local files
[15:22:45] Completed 1200000 out of 10000000 steps (12 percent)
[15:29:26] Writing local files
[15:29:26] Completed 1300000 out of 10000000 steps (13 percent)
[15:36:05] Writing local files
[15:36:05] Completed 1400000 out of 10000000 steps (14 percent)
[15:42:45] Writing local files
[15:42:45] Completed 1500000 out of 10000000 steps (15 percent)
[15:49:26] Writing local files
[15:49:26] Completed 1600000 out of 10000000 steps (16 percent)
[15:56:06] Writing local files
[15:56:06] Completed 1700000 out of 10000000 steps (17 percent)
[16:02:52] Writing local files
[16:02:52] Completed 1800000 out of 10000000 steps (18 percent)
[16:09:39] Writing local files
[16:09:39] Completed 1900000 out of 10000000 steps (19 percent)
[16:16:24] Writing local files
[16:16:24] Completed 2000000 out of 10000000 steps (20 percent)
[16:23:08] Writing local files
[16:23:08] Completed 2100000 out of 10000000 steps (21 percent)
[16:29:46] Writing local files
[16:29:46] Completed 2200000 out of 10000000 steps (22 percent)
[16:36:29] Writing local files
[16:36:29] Completed 2300000 out of 10000000 steps (23 percent)
[16:43:11] Writing local files
[16:43:11] Completed 2400000 out of 10000000 steps (24 percent)
[16:49:58] Writing local files
[16:49:58] Completed 2500000 out of 10000000 steps (25 percent)
[16:56:41] Writing local files
[16:56:41] Completed 2600000 out of 10000000 steps (26 percent)
[17:03:21] Writing local files
[17:03:21] Completed 2700000 out of 10000000 steps (27 percent)
[17:10:01] Writing local files
[17:10:01] Completed 2800000 out of 10000000 steps (28 percent)
[17:16:42] Writing local files
[17:16:42] Completed 2900000 out of 10000000 steps (29 percent)
[17:23:23] Writing local files
[17:23:23] Completed 3000000 out of 10000000 steps (30 percent)
[17:24:22] - Autosending finished units...
[17:24:22] Trying to send all finished work units
[17:24:22] + No unsent completed units remaining.
[17:24:22] - Autosend completed
[17:30:05] Writing local files
[17:30:05] Completed 3100000 out of 10000000 steps (31 percent)
[17:36:49] Writing local files
[17:36:49] Completed 3200000 out of 10000000 steps (32 percent)
[17:44:55] Writing local files
[17:44:55] Completed 3300000 out of 10000000 steps (33 percent)
[17:52:40] Writing local files
[17:52:40] Completed 3400000 out of 10000000 steps (34 percent)
[18:00:15] Writing local files
[18:00:15] Completed 3500000 out of 10000000 steps (35 percent)
[18:07:52] Writing local files
[18:07:52] Completed 3600000 out of 10000000 steps (36 percent)
[18:15:30] Writing local files
[18:15:30] Completed 3700000 out of 10000000 steps (37 percent)
[18:23:09] Writing local files
[18:23:09] Completed 3800000 out of 10000000 steps (38 percent)
[18:30:47] Writing local files
[18:30:47] Completed 3900000 out of 10000000 steps (39 percent)
[18:38:27] Writing local files
[18:38:27] Completed 4000000 out of 10000000 steps (40 percent)
[18:46:01] Writing local files
[18:46:01] Completed 4100000 out of 10000000 steps (41 percent)
[18:53:36] Writing local files
[18:53:36] Completed 4200000 out of 10000000 steps (42 percent)
[19:01:09] Writing local files
[19:01:09] Completed 4300000 out of 10000000 steps (43 percent)
[19:08:38] Writing local files
[19:08:38] Completed 4400000 out of 10000000 steps (44 percent)
[19:16:26] Writing local files
[19:16:26] Completed 4500000 out of 10000000 steps (45 percent)
[19:23:54] Writing local files
[19:23:54] Completed 4600000 out of 10000000 steps (46 percent)
[19:31:42] Writing local files
[19:31:42] Completed 4700000 out of 10000000 steps (47 percent)
[19:39:13] Writing local files
[19:39:13] Completed 4800000 out of 10000000 steps (48 percent)
[19:46:48] Writing local files
[19:46:48] Completed 4900000 out of 10000000 steps (49 percent)
[19:54:39] Writing local files
[19:54:39] Completed 5000000 out of 10000000 steps (50 percent)
[20:02:29] Writing local files
[20:02:29] Completed 5100000 out of 10000000 steps (51 percent)
[20:10:17] Writing local files
[20:10:17] Completed 5200000 out of 10000000 steps (52 percent)
[20:18:01] Writing local files
[20:18:01] Completed 5300000 out of 10000000 steps (53 percent)
[20:25:42] Writing local files
[20:25:42] Completed 5400000 out of 10000000 steps (54 percent)
[20:33:34] Writing local files
[20:33:34] Completed 5500000 out of 10000000 steps (55 percent)
[20:41:13] Writing local files
[20:41:13] Completed 5600000 out of 10000000 steps (56 percent)
[20:49:05] Writing local files
[20:49:05] Completed 5700000 out of 10000000 steps (57 percent)
[20:56:51] Writing local files
[20:56:51] Completed 5800000 out of 10000000 steps (58 percent)
[21:04:27] Writing local files
[21:04:27] Completed 5900000 out of 10000000 steps (59 percent)
[21:12:16] Writing local files
[21:12:16] Completed 6000000 out of 10000000 steps (60 percent)
[21:20:03] Writing local files
[21:20:03] Completed 6100000 out of 10000000 steps (61 percent)
[21:27:47] Writing local files
[21:27:47] Completed 6200000 out of 10000000 steps (62 percent)
[21:35:34] Writing local files
[21:35:34] Completed 6300000 out of 10000000 steps (63 percent)
[21:43:15] Writing local files
[21:43:15] Completed 6400000 out of 10000000 steps (64 percent)
[21:51:02] Writing local files
[21:51:02] Completed 6500000 out of 10000000 steps (65 percent)
[21:58:56] Writing local files
[21:58:56] Completed 6600000 out of 10000000 steps (66 percent)
[22:08:29] Writing local files
[22:08:29] Completed 6700000 out of 10000000 steps (67 percent)
[22:17:36] Writing local files
[22:17:36] Completed 6800000 out of 10000000 steps (68 percent)
[22:26:23] Writing local files
[22:26:23] Completed 6900000 out of 10000000 steps (69 percent)
[22:33:54] Writing local files
[22:33:54] Completed 7000000 out of 10000000 steps (70 percent)
[22:40:38] Writing local files
[22:40:38] Completed 7100000 out of 10000000 steps (71 percent)
[22:47:21] Writing local files
[22:47:21] Completed 7200000 out of 10000000 steps (72 percent)
[22:54:03] Writing local files
[22:54:03] Completed 7300000 out of 10000000 steps (73 percent)
[23:00:43] Writing local files
[23:00:43] Completed 7400000 out of 10000000 steps (74 percent)
[23:07:28] Writing local files
[23:07:28] Completed 7500000 out of 10000000 steps (75 percent)
[23:14:06] Writing local files
[23:14:06] Completed 7600000 out of 10000000 steps (76 percent)
[23:20:41] Writing local files
[23:20:41] Completed 7700000 out of 10000000 steps (77 percent)
[23:24:22] - Autosending finished units...
[23:24:22] Trying to send all finished work units
[23:24:22] + No unsent completed units remaining.
[23:24:22] - Autosend completed
[23:27:22] Writing local files
[23:27:22] Completed 7800000 out of 10000000 steps (78 percent)
[23:34:06] Writing local files
[23:34:06] Completed 7900000 out of 10000000 steps (79 percent)
[23:40:49] Writing local files
[23:40:49] Completed 8000000 out of 10000000 steps (80 percent)
[23:47:36] Writing local files
[23:47:36] Completed 8100000 out of 10000000 steps (81 percent)
[23:54:23] Writing local files
[23:54:23] Completed 8200000 out of 10000000 steps (82 percent)
[00:01:06] Writing local files
[00:01:06] Completed 8300000 out of 10000000 steps (83 percent)
[00:07:45] Writing local files
[00:07:45] Completed 8400000 out of 10000000 steps (84 percent)
[00:14:27] Writing local files
[00:14:27] Completed 8500000 out of 10000000 steps (85 percent)
[00:21:11] Writing local files
[00:21:11] Completed 8600000 out of 10000000 steps (86 percent)
[00:27:53] Writing local files
[00:27:53] Completed 8700000 out of 10000000 steps (87 percent)
[00:34:40] Writing local files
[00:34:40] Completed 8800000 out of 10000000 steps (88 percent)
[00:41:25] Writing local files
[00:41:25] Completed 8900000 out of 10000000 steps (89 percent)
[00:48:09] Writing local files
[00:48:09] Completed 9000000 out of 10000000 steps (90 percent)
[00:54:55] Writing local files
[00:54:55] Completed 9100000 out of 10000000 steps (91 percent)
[01:01:40] Writing local files
[01:01:40] Completed 9200000 out of 10000000 steps (92 percent)
[01:08:28] Writing local files
[01:08:28] Completed 9300000 out of 10000000 steps (93 percent)
[01:15:10] Writing local files
[01:15:10] Completed 9400000 out of 10000000 steps (94 percent)
[01:19:49] Warning: long 1-4 interactions
[01:19:53] CoreStatus = 0 (0)
[01:19:53] Client-core communications error: ERROR 0x0
[01:19:53] Deleting current work unit & continuing...
[01:24:16] - Warning: Could not delete all work unit files (0): Core returned invalid code
[01:24:16] Trying to send all finished work units
[01:24:16] + No unsent completed units remaining.
[01:24:16] - Preparing to get new work unit...
[01:24:16] + Attempting to get work packet
[01:24:16] - Will indicate memory of 2014 MB
[01:24:16] - Connecting to assignment server
[01:24:16] Connecting to http://assign.stanford.edu:8080/
[01:24:16] Posted data.
[01:24:16] Initial: 40AB; - Successful: assigned to (171.64.65.63).
[01:24:16] + News From Folding@Home: Welcome to Folding@Home
[01:24:16] Loaded queue successfully.
[01:24:16] Connecting to http://171.64.65.63:8080/
[01:24:17] Posted data.
[01:24:19] Initial: 0000; - Receiving payload (expected size: 284062)
[01:24:30] - Downloaded at ~25 kB/s
[01:24:30] - Averaged speed for that direction ~135 kB/s
[01:24:30] + Received work.
[01:24:30] + Closed connections
[01:24:35]
[01:24:35] + Processing work unit
[01:24:35] Core required: FahCore_a1.exe
[01:24:35] Core found.
[01:24:35] Working on Unit 01 [December 11 01:24:35]
[01:24:35] + Working ...
[01:24:35] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 01 -checkpoint 15 -verbose -lifeline 9952 -version 600'

[01:24:35]
[01:24:35] *------------------------------*
[01:24:35] Folding@Home Gromacs SMP Core
[01:24:35] Version 1.74 (November 27, 2006)
[01:24:35]
[01:24:35] Preparing to commence simulation
[01:24:35] - Ensuring status. Please wait.
[01:24:52] - Looking at optimizations...
[01:24:52] - Working with standard loops on this execution.
[01:24:52] - Previous termination of core w- Expanded 283550 -> 1506689 (d- Expanded 283550 -> 150668- St- Expanded 283550 -> 150668- Sta
[01:24:52] Project: 3050 (Run 1, Clone 33, Gen 20)
[01:24:52]
[01:24:52] Entering M.D.
[01:24:52] one 33
[01:24:52] Project: 3Entering M.D.
[01:24:52] one 33, Gen 20)
[01:24:52]
[01:24:52] Entering M.D.
[01:24:59] boost OK.
[01:24:59] SMP-emsv-03
[01:24:59] Writing local files
[01:24:59] Extra SSE Eoost OK.
[01:24:59] Writing local files
[01:24:59] Completed 0 out of 10000000 steps (0 percent)
[01:31:40] Writing local files
[01:31:40] Completed 100000 out of 10000000 steps (1 percent)
[01:38:23] Writing local files
[01:38:23] Completed 200000 out of 10000000 steps (2 percent)
[01:45:06] Writing local files
[01:45:06] Completed 300000 out of 10000000 steps (3 percent)
[01:51:51] Writing local files
[01:51:51] Completed 400000 out of 10000000 steps (4 percent)
[01:58:30] Writing local files
[01:58:30] Completed 500000 out of 10000000 steps (5 percent)
[02:05:11] Writing local files
[02:05:11] Completed 600000 out of 10000000 steps (6 percent)
[02:11:51] Writing local files
[02:11:51] Completed 700000 out of 10000000 steps (7 percent)
[02:18:30] Writing local files
[02:18:30] Completed 800000 out of 10000000 steps (8 percent)
[02:25:12] Writing local files
[02:25:12] Completed 900000 out of 10000000 steps (9 percent)
[02:31:49] Writing local files
[02:31:49] Completed 1000000 out of 10000000 steps (10 percent)
[02:38:34] Writing local files
[02:38:34] Completed 1100000 out of 10000000 steps (11 percent)
[02:45:23] Writing local files
[02:45:23] Completed 1200000 out of 10000000 steps (12 percent)
[02:51:59] Writing local files
[02:52:00] Completed 1300000 out of 10000000 steps (13 percent)
[02:58:42] Writing local files
[02:58:42] Completed 1400000 out of 10000000 steps (14 percent)
[03:05:26] Writing local files
[03:05:26] Completed 1500000 out of 10000000 steps (15 percent)
[03:12:08] Writing local files
[03:12:08] Completed 1600000 out of 10000000 steps (16 percent)
[03:18:52] Writing local files
[03:18:52] Completed 1700000 out of 10000000 steps (17 percent)
[03:25:34] Writing local files
[03:25:34] Completed 1800000 out of 10000000 steps (18 percent)
[03:32:15] Writing local files
[03:32:15] Completed 1900000 out of 10000000 steps (19 percent)
[03:38:54] Writing local files
[03:38:54] Completed 2000000 out of 10000000 steps (20 percent)
[03:45:36] Writing local files
[03:45:36] Completed 2100000 out of 10000000 steps (21 percent)
[03:52:13] Writing local files
[03:52:13] Completed 2200000 out of 10000000 steps (22 percent)
[03:58:58] Writing local files
[03:58:58] Completed 2300000 out of 10000000 steps (23 percent)
[04:05:42] Writing local files
[04:05:42] Completed 2400000 out of 10000000 steps (24 percent)
[04:12:25] Writing local files
[04:12:25] Completed 2500000 out of 10000000 steps (25 percent)
[04:19:14] Writing local files
[04:19:14] Completed 2600000 out of 10000000 steps (26 percent)
[04:25:57] Writing local files
[04:25:57] Completed 2700000 out of 10000000 steps (27 percent)
[04:32:38] Writing local files
[04:32:38] Completed 2800000 out of 10000000 steps (28 percent)
[04:39:24] Writing local files
[04:39:24] Completed 2900000 out of 10000000 steps (29 percent)
[04:46:06] Writing local files
[04:46:06] Completed 3000000 out of 10000000 steps (30 percent)
[04:52:50] Writing local files
[04:52:50] Completed 3100000 out of 10000000 steps (31 percent)
[04:59:34] Writing local files
[04:59:34] Completed 3200000 out of 10000000 steps (32 percent)
[05:06:23] Writing local files
[05:06:23] Completed 3300000 out of 10000000 steps (33 percent)
[05:13:07] Writing local files
[05:13:07] Completed 3400000 out of 10000000 steps (34 percent)
[05:19:55] Writing local files
[05:19:55] Completed 3500000 out of 10000000 steps (35 percent)
[05:24:22] - Autosending finished units...
[05:24:22] Trying to send all finished work units
[05:24:22] + No unsent completed units remaining.
[05:24:22] - Autosend completed
[05:26:41] Writing local files
[05:26:41] Completed 3600000 out of 10000000 steps (36 percent)
[05:33:28] Writing local files
[05:33:28] Completed 3700000 out of 10000000 steps (37 percent)
[05:40:12] Writing local files
[05:40:12] Completed 3800000 out of 10000000 steps (38 percent)
[05:46:57] Writing local files
[05:46:57] Completed 3900000 out of 10000000 steps (39 percent)
[05:53:40] Writing local files
[05:53:40] Completed 4000000 out of 10000000 steps (40 percent)
[06:00:22] Writing local files
[06:00:22] Completed 4100000 out of 10000000 steps (41 percent)
[06:07:04] Writing local files
[06:07:04] Completed 4200000 out of 10000000 steps (42 percent)
[06:13:47] Writing local files
[06:13:47] Completed 4300000 out of 10000000 steps (43 percent)
[06:20:36] Writing local files
[06:20:36] Completed 4400000 out of 10000000 steps (44 percent)
[06:27:23] Writing local files
[06:27:23] Completed 4500000 out of 10000000 steps (45 percent)
[06:34:09] Writing local files
[06:34:09] Completed 4600000 out of 10000000 steps (46 percent)
[06:40:55] Writing local files
[06:40:55] Completed 4700000 out of 10000000 steps (47 percent)
[06:47:37] Writing local files
[06:47:37] Completed 4800000 out of 10000000 steps (48 percent)
[06:54:24] Writing local files
[06:54:24] Completed 4900000 out of 10000000 steps (49 percent)
[07:01:10] Writing local files
[07:01:10] Completed 5000000 out of 10000000 steps (50 percent)
[07:07:51] Writing local files
[07:07:51] Completed 5100000 out of 10000000 steps (51 percent)
[07:14:34] Writing local files
[07:14:34] Completed 5200000 out of 10000000 steps (52 percent)
[07:21:16] Writing local files
[07:21:16] Completed 5300000 out of 10000000 steps (53 percent)
[07:27:57] Writing local files
[07:27:57] Completed 5400000 out of 10000000 steps (54 percent)
[07:34:37] Writing local files
[07:34:37] Completed 5500000 out of 10000000 steps (55 percent)
[07:41:15] Writing local files
[07:41:15] Completed 5600000 out of 10000000 steps (56 percent)
[07:48:00] Writing local files
[07:48:00] Completed 5700000 out of 10000000 steps (57 percent)
[07:54:43] Writing local files
[07:54:43] Completed 5800000 out of 10000000 steps (58 percent)
[08:01:22] Writing local files
[08:01:22] Completed 5900000 out of 10000000 steps (59 percent)
[08:08:05] Writing local files
[08:08:05] Completed 6000000 out of 10000000 steps (60 percent)
[08:14:49] Writing local files
[08:14:49] Completed 6100000 out of 10000000 steps (61 percent)
[08:21:31] Writing local files
[08:21:31] Completed 6200000 out of 10000000 steps (62 percent)
[08:28:13] Writing local files
[08:28:13] Completed 6300000 out of 10000000 steps (63 percent)
[08:34:54] Writing local files
[08:34:54] Completed 6400000 out of 10000000 steps (64 percent)
[08:41:35] Writing local files
[08:41:35] Completed 6500000 out of 10000000 steps (65 percent)
[08:48:20] Writing local files
[08:48:20] Completed 6600000 out of 10000000 steps (66 percent)
[08:55:05] Writing local files
[08:55:05] Completed 6700000 out of 10000000 steps (67 percent)
[09:01:50] Writing local files
[09:01:50] Completed 6800000 out of 10000000 steps (68 percent)
[09:08:36] Writing local files
[09:08:36] Completed 6900000 out of 10000000 steps (69 percent)
[09:15:20] Writing local files
[09:15:20] Completed 7000000 out of 10000000 steps (70 percent)
[09:22:05] Writing local files
[09:22:05] Completed 7100000 out of 10000000 steps (71 percent)
[09:28:49] Writing local files
[09:28:49] Completed 7200000 out of 10000000 steps (72 percent)
[09:35:34] Writing local files
[09:35:34] Completed 7300000 out of 10000000 steps (73 percent)
[09:42:18] Writing local files
[09:42:18] Completed 7400000 out of 10000000 steps (74 percent)
[09:49:02] Writing local files
[09:49:02] Completed 7500000 out of 10000000 steps (75 percent)
[09:55:44] Writing local files
[09:55:44] Completed 7600000 out of 10000000 steps (76 percent)
[10:02:22] Writing local files
[10:02:22] Completed 7700000 out of 10000000 steps (77 percent)
[10:09:02] Writing local files
[10:09:02] Completed 7800000 out of 10000000 steps (78 percent)
[10:15:45] Writing local files
[10:15:45] Completed 7900000 out of 10000000 steps (79 percent)
[10:22:33] Writing local files
[10:22:33] Completed 8000000 out of 10000000 steps (80 percent)
[10:29:22] Writing local files
[10:29:22] Completed 8100000 out of 10000000 steps (81 percent)
[10:36:06] Writing local files
[10:36:06] Completed 8200000 out of 10000000 steps (82 percent)
[10:42:49] Writing local files
[10:42:49] Completed 8300000 out of 10000000 steps (83 percent)
[10:49:36] Writing local files
[10:49:36] Completed 8400000 out of 10000000 steps (84 percent)
[10:56:22] Writing local files
[10:56:22] Completed 8500000 out of 10000000 steps (85 percent)
[11:03:07] Writing local files
[11:03:07] Completed 8600000 out of 10000000 steps (86 percent)
[11:09:53] Writing local files
[11:09:53] Completed 8700000 out of 10000000 steps (87 percent)
[11:16:37] Writing local files
[11:16:37] Completed 8800000 out of 10000000 steps (88 percent)
[11:23:23] Writing local files
[11:23:23] Completed 8900000 out of 10000000 steps (89 percent)
[11:24:22] - Autosending finished units...
[11:24:22] Trying to send all finished work units
[11:24:22] + No unsent completed units remaining.
[11:24:22] - Autosend completed
[11:30:05] Writing local files
[11:30:05] Completed 9000000 out of 10000000 steps (90 percent)
[11:36:48] Writing local files
[11:36:48] Completed 9100000 out of 10000000 steps (91 percent)
[11:43:30] Writing local files
[11:43:30] Completed 9200000 out of 10000000 steps (92 percent)
[11:50:20] Writing local files
[11:50:20] Completed 9300000 out of 10000000 steps (93 percent)
[11:57:10] Writing local files
[11:57:10] Completed 9400000 out of 10000000 steps (94 percent)
[12:01:48] Warning: long 1-4 interactions
[12:01:52] CoreStatus = 0 (0)
[12:01:52] Client-core communications error: ERROR 0x0
[12:01:52] - Attempting to download new core...
[12:01:52] + Downloading new core: FahCore_a1.exe
[12:01:52] Downloading core (/~pande/Linux/x86//Core_a1.fah from http://www.stanford.edu)
[12:01:54] Initial: AFDE; + 10240 bytes downloaded
[12:01:54] Initial: B54E; + 20480 bytes downloaded
[12:01:54] Initial: D6C2; + 30720 bytes downloaded
[12:01:54] Initial: 9F08; + 40960 bytes downloaded
[12:01:54] Initial: C6C3; + 51200 bytes downloaded
[12:01:54] Initial: EBA8; + 61440 bytes downloaded
[12:01:55] Initial: 3141; + 71680 bytes downloaded
[12:01:55] Initial: D218; + 81920 bytes downloaded
[12:01:55] Initial: F7AC; + 92160 bytes downloaded
[12:01:55] Initial: 820B; + 102400 bytes downloaded
[12:01:55] Initial: 1B1E; + 112640 bytes downloaded
[12:01:55] Initial: C249; + 122880 bytes downloaded
[12:01:56] Initial: 5EBD; + 133120 bytes downloaded
[12:01:57] Initial: CD6C; + 143360 bytes downloaded
[12:01:57] Initial: 221C; + 153600 bytes downloaded
[12:01:57] Initial: DB18; + 163840 bytes downloaded
[12:01:57] Initial: 237E; + 174080 bytes downloaded
[12:01:57] Initial: AEEC; + 184320 bytes downloaded
[12:01:57] Initial: 4C66; + 194560 bytes downloaded
[12:01:57] Initial: AE1E; + 204800 bytes downloaded
[12:01:57] Initial: A37E; + 215040 bytes downloaded
[12:01:57] Initial: 8193; + 225280 bytes downloaded
[12:01:57] Initial: 9F05; + 235520 bytes downloaded
[12:01:57] Initial: AAA5; + 245760 bytes downloaded
[12:01:57] Initial: 6400; + 256000 bytes downloaded
[12:01:57] Initial: 6E3D; + 266240 bytes downloaded
[12:01:58] Initial: EA6B; + 276480 bytes downloaded
[12:01:58] Initial: 820A; + 286720 bytes downloaded
[12:01:58] Initial: DE6D; + 296960 bytes downloaded
[12:01:58] Initial: B97B; + 307200 bytes downloaded
[12:01:58] Initial: 9D5D; + 317440 bytes downloaded
[12:01:58] Initial: 91D7; + 327680 bytes downloaded
[12:01:58] Initial: BB3B; + 337920 bytes downloaded
[12:01:58] Initial: 611B; + 348160 bytes downloaded
[12:01:59] Initial: B290; + 358400 bytes downloaded
[12:01:59] Initial: B0AA; + 368640 bytes downloaded
[12:01:59] Initial: 6A85; + 378880 bytes downloaded
[12:01:59] Initial: BF10; + 389120 bytes downloaded
[12:02:00] Initial: A818; + 399360 bytes downloaded
[12:02:00] Initial: 90E1; + 409600 bytes downloaded
[12:02:00] Initial: 2869; + 419840 bytes downloaded
[12:02:00] Initial: CAFE; + 430080 bytes downloaded
[12:02:01] Initial: 414B; + 440320 bytes downloaded
[12:02:01] Initial: 9B7A; + 450560 bytes downloaded
[12:02:01] Initial: 33AA; + 460800 bytes downloaded
[12:02:01] Initial: B1D5; + 471040 bytes downloaded
[12:02:01] Initial: 0206; + 481280 bytes downloaded
[12:02:02] Initial: 11F4; + 491520 bytes downloaded
[12:02:02] Initial: 31B5; + 501760 bytes downloaded
[12:02:02] Initial: 46B2; + 512000 bytes downloaded
[12:02:03] Initial: 3113; + 522240 bytes downloaded
[12:02:03] Initial: 525A; + 532480 bytes downloaded
[12:02:04] Initial: 66F9; + 542720 bytes downloaded
[12:02:04] Initial: 9672; + 552960 bytes downloaded
[12:02:05] Initial: 9058; + 563200 bytes downloaded
[12:02:05] Initial: 49ED; + 573440 bytes downloaded
[12:02:06] Initial: 515D; + 583680 bytes downloaded
[12:02:06] Initial: CAC0; + 593920 bytes downloaded
[12:02:07] Initial: 0B15; + 604160 bytes downloaded
[12:02:07] Initial: 5A89; + 614400 bytes downloaded
[12:02:08] Initial: 0F31; + 624640 bytes downloaded
[12:02:08] Initial: 2BC3; + 634880 bytes downloaded
[12:02:08] Initial: 3C06; + 645120 bytes downloaded
[12:02:08] Initial: 89C7; + 655360 bytes downloaded
[12:02:09] Initial: 6C54; + 665600 bytes downloaded
[12:02:09] Initial: 8D4D; + 675840 bytes downloaded
[12:02:09] Initial: EA59; + 686080 bytes downloaded
[12:02:09] Initial: C563; + 696320 bytes downloaded
[12:02:09] Initial: 8D45; + 706560 bytes downloaded
[12:02:10] Initial: 9BD0; + 716800 bytes downloaded
[12:02:10] Initial: 130C; + 727040 bytes downloaded
[12:02:10] Initial: CDA1; + 737280 bytes downloaded
[12:02:10] Initial: 7681; + 747520 bytes downloaded
[12:02:10] Initial: 1110; + 757760 bytes downloaded
[12:02:10] Initial: EE35; + 768000 bytes downloaded
[12:02:11] Initial: E5E1; + 778240 bytes downloaded
[12:02:11] Initial: 4B97; + 788480 bytes downloaded
[12:02:11] Initial: 4D75; + 798720 bytes downloaded
[12:02:11] Initial: E268; + 808960 bytes downloaded
[12:02:11] Initial: FAC6; + 819200 bytes downloaded
[12:02:11] Initial: A625; + 829440 bytes downloaded
[12:02:11] Initial: A12A; + 839680 bytes downloaded
[12:02:11] Initial: 83A3; + 849920 bytes downloaded
[12:02:11] Initial: 3BEA; + 860160 bytes downloaded
[12:02:12] Initial: 5298; + 870400 bytes downloaded
[12:02:12] Initial: 4811; + 880640 bytes downloaded
[12:02:12] Initial: EB07; + 890880 bytes downloaded
[12:02:12] Initial: 83FC; + 901120 bytes downloaded
[12:02:12] Initial: FA4E; + 911360 bytes downloaded
[12:02:12] Initial: 2945; + 921600 bytes downloaded
[12:02:12] Initial: 6BC9; + 931840 bytes downloaded
[12:02:12] Initial: E495; + 942080 bytes downloaded
[12:02:12] Initial: 1050; + 952320 bytes downloaded
[12:02:12] Initial: 2070; + 962560 bytes downloaded
[12:02:12] Initial: 1083; + 972800 bytes downloaded
[12:02:12] Initial: 96E5; + 983040 bytes downloaded
[12:02:13] Initial: 3EEE; + 993280 bytes downloaded
[12:02:13] Initial: 84AC; + 1003520 bytes downloaded
[12:02:13] Initial: 3B6B; + 1013760 bytes downloaded
[12:02:13] Initial: 3030; + 1024000 bytes downloaded
[12:02:13] Initial: 4B95; + 1034240 bytes downloaded
[12:02:14] Initial: D9BC; + 1044480 bytes downloaded
[12:02:14] Initial: C5B8; + 1054720 bytes downloaded
[12:02:14] Initial: A5EF; + 1064960 bytes downloaded
[12:02:14] Initial: 28DC; + 1075200 bytes downloaded
[12:02:14] Initial: 0943; + 1085440 bytes downloaded
[12:02:14] Initial: 338A; + 1095680 bytes downloaded
[12:02:14] Initial: ADFC; + 1105920 bytes downloaded
[12:02:15] Initial: ED39; + 1116160 bytes downloaded
[12:02:15] Initial: D284; + 1126400 bytes downloaded
[12:02:15] Initial: 0057; + 1136640 bytes downloaded
[12:02:15] Initial: 3E65; + 1146880 bytes downloaded
[12:02:15] Initial: FCB5; + 1157120 bytes downloaded
[12:02:16] Initial: A7D8; + 1167360 bytes downloaded
[12:02:16] Initial: A564; + 1177600 bytes downloaded
[12:02:16] Initial: 7654; + 1187840 bytes downloaded
[12:02:16] Initial: 0848; + 1198080 bytes downloaded
[12:02:16] Initial: 471E; + 1208320 bytes downloaded
[12:02:17] Initial: A7F3; + 1218560 bytes downloaded
[12:02:17] Initial: FA59; + 1228800 bytes downloaded
[12:02:17] Initial: FBF2; + 1239040 bytes downloaded
[12:02:17] Initial: F54E; + 1249280 bytes downloaded
[12:02:17] Initial: 3023; + 1259520 bytes downloaded
[12:02:18] Initial: AB37; + 1269760 bytes downloaded
[12:02:18] Initial: 0896; + 1280000 bytes downloaded
[12:02:18] Initial: 756D; + 1290240 bytes downloaded
[12:02:18] Initial: C1E7; + 1300480 bytes downloaded
[12:02:18] Initial: 9AAC; + 1310720 bytes downloaded
[12:02:19] Initial: E5AF; + 1320960 bytes downloaded
[12:02:19] Initial: BBE3; + 1331200 bytes downloaded
[12:02:19] Initial: 3596; + 1341440 bytes downloaded
[12:02:20] Initial: 924C; + 1351680 bytes downloaded
[12:02:20] Initial: 30B7; + 1361920 bytes downloaded
[12:02:20] Initial: AEB7; + 1372160 bytes downloaded
[12:02:20] Initial: 7D25; + 1382400 bytes downloaded
[12:02:20] Initial: 0FEB; + 1392640 bytes downloaded
[12:02:21] Initial: 3131; + 1402880 bytes downloaded
[12:02:21] Initial: 755F; + 1413120 bytes downloaded
[12:02:21] Initial: 4800; + 1423360 bytes downloaded
[12:02:22] Initial: 1282; + 1433600 bytes downloaded
[12:02:22] Initial: B2A3; + 1443840 bytes downloaded
[12:02:22] Initial: 21E9; + 1454080 bytes downloaded
[12:02:22] Initial: 789E; + 1464320 bytes downloaded
[12:02:22] Initial: 8542; + 1474560 bytes downloaded
[12:02:23] Initial: 3A56; + 1484800 bytes downloaded
[12:02:23] Initial: D4FE; + 1490945 bytes downloaded
[12:02:23] Verifying core Core_a1.fah...
[12:02:23] Signature is VALID
[12:02:23]
[12:02:23] Trying to unzip core FahCore_a1.exe
[12:02:23] Decompressed FahCore_a1.exe (3625104 bytes) successfully
[12:02:23] + Core successfully engaged
[12:02:23] Deleting current work unit & continuing...
[12:06:45] - Warning: Could not delete all work unit files (1): Core returned invalid code
[12:06:45] Trying to send all finished work units
[12:06:45] + No unsent completed units remaining.
[12:06:45] - Preparing to get new work unit...
[12:06:45] + Attempting to get work packet
[12:06:45] - Will indicate memory of 2014 MB
[12:06:45] - Connecting to assignment server
[12:06:45] Connecting to http://assign.stanford.edu:8080/
[12:06:45] Posted data.
[12:06:45] Initial: 40AB; - Successful: assigned to (171.64.65.63).
[12:06:45] + News From Folding@Home: Welcome to Folding@Home
[12:06:46] Loaded queue successfully.
[12:06:46] Connecting to http://171.64.65.63:8080/
[12:06:47] Posted data.
[12:06:47] Initial: 0000; - Receiving payload (expected size: 284062)
[12:06:48] - Downloaded at ~277 kB/s
[12:06:48] - Averaged speed for that direction ~163 kB/s
[12:06:48] + Received work.
[12:06:48] + Closed connections
[12:06:53]
[12:06:53] + Processing work unit
[12:06:53] Core required: FahCore_a1.exe
[12:06:53] Core found.
[12:06:53] Working on Unit 02 [December 11 12:06:53]
[12:06:53] + Working ...
[12:06:53] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 02 -checkpoint 15 -verbose -lifeline 9952 -version 600'

[12:06:53]
[12:06:53] *------------------------------*
[12:06:53] Folding@Home Gromacs SMP Core
[12:06:53] Version 1.74 (November 27, 2006)
[12:06:53]
[12:06:53] Preparing to commence simulation
[12:06:53] - Ensuring status. Please wait.
[12:07:11] - Looking at optimizations...
[12:07:11] - Working with standard loops on this execution.
[12:07:11] - Previous termination of core w- Expanded 283550 -> 1506689 (d- Expanded 283550 -> 150668- St- Expanded 283550 -> 1506689 (de
[12:07:11] Project: 3050 (Run 1, Clone 33
[12:07:11] Project: 3Entering M.D.
[12:07:11] one 33, roject: 3Entering M.D.
[12:07:11] one 33, Gen 20)
[12:07:11]
[12:07:11] Entering M.D.
[12:07:17] ocal files
[12:07:17] Extra SSE boost OK.
[12:07:17] Writing local files
[12:07:17] Completed 0 out of 10000000 steps (0 percent)
[12:14:00] Writing local files
[12:14:00] Completed 100000 out of 10000000 steps (1 percent)
[12:20:43] Writing local files
[12:20:43] Completed 200000 out of 10000000 steps (2 percent)
[12:27:28] Writing local files
[12:27:28] Completed 300000 out of 10000000 steps (3 percent)
[12:34:16] Writing local files
[12:34:17] Completed 400000 out of 10000000 steps (4 percent)
[12:40:59] Writing local files
[12:40:59] Completed 500000 out of 10000000 steps (5 percent)
[12:47:41] Writing local files
[12:47:41] Completed 600000 out of 10000000 steps (6 percent)
[12:54:24] Writing local files
[12:54:24] Completed 700000 out of 10000000 steps (7 percent)
[13:01:07] Writing local files
[13:01:07] Completed 800000 out of 10000000 steps (8 percent)
[13:07:50] Writing local files
[13:07:50] Completed 900000 out of 10000000 steps (9 percent)
[13:14:31] Writing local files
[13:14:31] Completed 1000000 out of 10000000 steps (10 percent)
[13:21:14] Writing local files
[13:21:14] Completed 1100000 out of 10000000 steps (11 percent)
[13:27:57] Writing local files
[13:27:57] Completed 1200000 out of 10000000 steps (12 percent)
[13:34:40] Writing local files
[13:34:40] Completed 1300000 out of 10000000 steps (13 percent)
[13:41:22] Writing local files
[13:41:22] Completed 1400000 out of 10000000 steps (14 percent)
[13:48:05] Writing local files
[13:48:05] Completed 1500000 out of 10000000 steps (15 percent)
[13:54:44] Writing local files
[13:54:44] Completed 1600000 out of 10000000 steps (16 percent)
[14:01:26] Writing local files
[14:01:26] Completed 1700000 out of 10000000 steps (17 percent)
[14:08:09] Writing local files
[14:08:09] Completed 1800000 out of 10000000 steps (18 percent)
[14:14:58] Writing local files
[14:14:58] Completed 1900000 out of 10000000 steps (19 percent)
[14:21:42] Writing local files
[14:21:42] Completed 2000000 out of 10000000 steps (20 percent)
[14:28:31] Writing local files
[14:28:31] Completed 2100000 out of 10000000 steps (21 percent)
[14:35:12] Writing local files
[14:35:12] Completed 2200000 out of 10000000 steps (22 percent)
[14:41:55] Writing local files
[14:41:55] Completed 2300000 out of 10000000 steps (23 percent)
[14:48:37] Writing local files
[14:48:37] Completed 2400000 out of 10000000 steps (24 percent)
[14:55:21] Writing local files
[14:55:21] Completed 2500000 out of 10000000 steps (25 percent)
[15:02:04] Writing local files
[15:02:04] Completed 2600000 out of 10000000 steps (26 percent)
[15:08:44] Writing local files
[15:08:44] Completed 2700000 out of 10000000 steps (27 percent)
[15:15:26] Writing local files
[15:15:26] Completed 2800000 out of 10000000 steps (28 percent)
[15:22:11] Writing local files
[15:22:11] Completed 2900000 out of 10000000 steps (29 percent)
[15:28:56] Writing local files
[15:28:56] Completed 3000000 out of 10000000 steps (30 percent)
[15:35:41] Writing local files
[15:35:41] Completed 3100000 out of 10000000 steps (31 percent)
[15:42:24] Writing local files
[15:42:24] Completed 3200000 out of 10000000 steps (32 percent)
[15:49:19] Writing local files
[15:49:19] Completed 3300000 out of 10000000 steps (33 percent)
[15:56:05] Writing local files
[15:56:05] Completed 3400000 out of 10000000 steps (34 percent)
[16:02:47] Writing local files
[16:02:47] Completed 3500000 out of 10000000 steps (35 percent)
[16:09:36] Writing local files
[16:09:36] Completed 3600000 out of 10000000 steps (36 percent)
[16:16:22] Writing local files
[16:16:22] Completed 3700000 out of 10000000 steps (37 percent)
[16:23:09] Writing local files
[16:23:09] Completed 3800000 out of 10000000 steps (38 percent)
[16:29:53] Writing local files
[16:29:53] Completed 3900000 out of 10000000 steps (39 percent)
[16:36:34] Writing local files
[16:36:34] Completed 4000000 out of 10000000 steps (40 percent)
[16:43:17] Writing local files
[16:43:17] Completed 4100000 out of 10000000 steps (41 percent)
[16:50:03] Writing local files
[16:50:03] Completed 4200000 out of 10000000 steps (42 percent)
[16:56:49] Writing local files
[16:56:49] Completed 4300000 out of 10000000 steps (43 percent)
[17:03:32] Writing local files
[17:03:32] Completed 4400000 out of 10000000 steps (44 percent)
[17:10:18] Writing local files
[17:10:18] Completed 4500000 out of 10000000 steps (45 percent)
[17:16:57] Writing local files
[17:16:57] Completed 4600000 out of 10000000 steps (46 percent)
[17:23:44] Writing local files
[17:23:44] Completed 4700000 out of 10000000 steps (47 percent)
[17:24:22] - Autosending finished units...
[17:24:22] Trying to send all finished work units
[17:24:22] + No unsent completed units remaining.
[17:24:22] - Autosend completed
[17:30:31] Writing local files
[17:30:31] Completed 4800000 out of 10000000 steps (48 percent)
[17:37:14] Writing local files
[17:37:14] Completed 4900000 out of 10000000 steps (49 percent)
[17:43:58] Writing local files
[17:43:58] Completed 5000000 out of 10000000 steps (50 percent)
[17:50:38] Writing local files
[17:50:38] Completed 5100000 out of 10000000 steps (51 percent)
[17:57:18] Writing local files
[17:57:18] Completed 5200000 out of 10000000 steps (52 percent)
[18:04:03] Writing local files
[18:04:03] Completed 5300000 out of 10000000 steps (53 percent)
[18:10:43] Writing local files
[18:10:43] Completed 5400000 out of 10000000 steps (54 percent)
[18:18:02] Writing local files
[18:18:02] Completed 5500000 out of 10000000 steps (55 percent)
[18:25:25] Writing local files
[18:25:25] Completed 5600000 out of 10000000 steps (56 percent)
[18:32:37] Writing local files
[18:32:37] Completed 5700000 out of 10000000 steps (57 percent)
[18:39:24] Writing local files
[18:39:24] Completed 5800000 out of 10000000 steps (58 percent)
[18:47:00] Writing local files
[18:47:00] Completed 5900000 out of 10000000 steps (59 percent)
[18:54:39] Writing local files
[18:54:39] Completed 6000000 out of 10000000 steps (60 percent)
[19:02:18] Writing local files
[19:02:18] Completed 6100000 out of 10000000 steps (61 percent)
[19:10:00] Writing local files
[19:10:00] Completed 6200000 out of 10000000 steps (62 percent)
[19:17:36] Writing local files
[19:17:36] Completed 6300000 out of 10000000 steps (63 percent)
[19:25:09] Writing local files
[19:25:09] Completed 6400000 out of 10000000 steps (64 percent)
[19:32:48] Writing local files
[19:32:48] Completed 6500000 out of 10000000 steps (65 percent)
[19:40:36] Writing local files
[19:40:36] Completed 6600000 out of 10000000 steps (66 percent)
[19:48:17] Writing local files
[19:48:17] Completed 6700000 out of 10000000 steps (67 percent)
[19:55:51] Writing local files
[19:55:51] Completed 6800000 out of 10000000 steps (68 percent)
[20:03:40] Writing local files
[20:03:40] Completed 6900000 out of 10000000 steps (69 percent)
[20:11:23] Writing local files
[20:11:23] Completed 7000000 out of 10000000 steps (70 percent)
[20:19:07] Writing local files
[20:19:07] Completed 7100000 out of 10000000 steps (71 percent)
[20:26:50] Writing local files
[20:26:50] Completed 7200000 out of 10000000 steps (72 percent)
[20:34:26] Writing local files
[20:34:26] Completed 7300000 out of 10000000 steps (73 percent)
[20:42:10] Writing local files
[20:42:10] Completed 7400000 out of 10000000 steps (74 percent)
[20:49:59] Writing local files
[20:49:59] Completed 7500000 out of 10000000 steps (75 percent)
[20:57:47] Writing local files
[20:57:47] Completed 7600000 out of 10000000 steps (76 percent)
[21:05:25] Writing local files
[21:05:25] Completed 7700000 out of 10000000 steps (77 percent)
[21:13:08] Writing local files
[21:13:08] Completed 7800000 out of 10000000 steps (78 percent)
[21:20:53] Writing local files
[21:20:53] Completed 7900000 out of 10000000 steps (79 percent)
[21:28:40] Writing local files
[21:28:40] Completed 8000000 out of 10000000 steps (80 percent)
[21:36:21] Writing local files
[21:36:21] Completed 8100000 out of 10000000 steps (81 percent)
[21:43:59] Writing local files
[21:43:59] Completed 8200000 out of 10000000 steps (82 percent)
[21:51:45] Writing local files
[21:51:45] Completed 8300000 out of 10000000 steps (83 percent)
[21:59:29] Writing local files
[21:59:29] Completed 8400000 out of 10000000 steps (84 percent)
[22:07:21] Writing local files
[22:07:21] Completed 8500000 out of 10000000 steps (85 percent)
[22:15:04] Writing local files
[22:15:04] Completed 8600000 out of 10000000 steps (86 percent)
[22:22:41] Writing local files
[22:22:41] Completed 8700000 out of 10000000 steps (87 percent)
[22:30:29] Writing local files
[22:30:29] Completed 8800000 out of 10000000 steps (88 percent)
[22:38:53] Writing local files
[22:38:53] Completed 8900000 out of 10000000 steps (89 percent)
[22:46:03] Writing local files
[22:46:03] Completed 9000000 out of 10000000 steps (90 percent)
[22:52:51] Writing local files
[22:52:51] Completed 9100000 out of 10000000 steps (91 percent)
[22:59:39] Writing local files
[22:59:39] Completed 9200000 out of 10000000 steps (92 percent)
[23:06:31] Writing local files
[23:06:31] Completed 9300000 out of 10000000 steps (93 percent)
[23:13:20] Writing local files
[23:13:20] Completed 9400000 out of 10000000 steps (94 percent)
[23:18:01] Warning: long 1-4 interactions
[23:18:05] CoreStatus = 0 (0)
[23:18:05] Client-core communications error: ERROR 0x0
[23:18:05] Deleting current work unit & continuing...
[23:22:27] - Warning: Could not delete all work unit files (2): Core returned invalid code
[23:22:27] Trying to send all finished work units
[23:22:27] + No unsent completed units remaining.
[23:22:27] - Preparing to get new work unit...
[23:22:27] + Attempting to get work packet
[23:22:27] - Will indicate memory of 2014 MB
[23:22:27] - Connecting to assignment server
[23:22:27] Connecting to http://assign.stanford.edu:8080/
[23:22:28] Posted data.
[23:22:28] Initial: 40AB; - Successful: assigned to (171.64.65.63).
[23:22:28] + News From Folding@Home: Welcome to Folding@Home
[23:22:28] Loaded queue successfully.
[23:22:28] Connecting to http://171.64.65.63:8080/
[23:22:29] Posted data.
[23:22:29] Initial: 0000; - Receiving payload (expected size: 284062)
[23:22:36] - Downloaded at ~39 kB/s
[23:22:36] - Averaged speed for that direction ~139 kB/s
[23:22:36] + Received work.
[23:22:36] + Closed connections
[23:22:41]
[23:22:41] + Processing work unit
[23:22:41] Core required: FahCore_a1.exe
[23:22:41] Core found.
[23:22:41] Working on Unit 03 [December 11 23:22:41]
[23:22:41] + Working ...
[23:22:41] - Calling './mpiexec -np 4 -host 127.0.0.1 ./FahCore_a1.exe -dir work/ -suffix 03 -checkpoint 15 -verbose -lifeline 9952 -version 600'

[23:22:41]
[23:22:41] *------------------------------*
[23:22:41] Folding@Home Gromacs SMP Core
[23:22:41] Version 1.74 (November 27, 2006)
[23:22:41]
[23:22:41] Preparing to commence simulation
[23:22:41] - Ensuring status. Please wait.
[23:22:59] - Looking at optimizations...
[23:22:59] - Working with standard loops on this execution.
[23:22:59] - Previous termination of core w- Expanded 283550 -> 1506689 (d- Expanded 283550 -> 150668- Starting from initial work pa- Sta
[23:22:59] Project: 3050 (Run 1, Clone 33, Gen 20)
[23:22:59]
[23:22:59] Entering M.D.
[23:22:59] one 33, Gen 20)
[23:22:59]
[23:22:59] Entering M.D.
[23:22:59] one 33, Gen 20)
[23:22:59]
[23:22:59] Entering M.D.
[23:23:05] boost OK.
[23:23:05] 6Extra SSE boost OK.
[23:23:05] Writing local files
[23:23:05] Completed 0 out of 10000000 steps (0 percent)
[23:24:22] - Autosending finished units...
[23:24:22] Trying to send all finished work units
[23:24:22] + No unsent completed units remaining.
[23:24:22] - Autosend completed
[23:29:51] Writing local files
[23:29:51] Completed 100000 out of 10000000 steps (1 percent)
[23:36:38] Writing local files

Will it loop forever ? Will I delete the WU ?

Posted: **Wed Dec 12, 2007 9:33 am**

Stop the client and back up the WU data and send it to Pande Group or to me and I'll pass it along.

As it is "reliably" failing at the same point then we may have a perfect specimen to pinpoint the 0x0 error cause.

After that just delete this WU and you'll get a new one.

Posted: **Wed Dec 12, 2007 11:06 am**

It might be a good candidate to use the qfix trick

Posted: **Wed Dec 12, 2007 12:48 pm**

Too late, I've deleted the WU but I got exactly the same WU.

I will see if it crash at 94 percent...

Posted: **Wed Dec 12, 2007 1:00 pm**

And it will end at the same point

Next time, think about using qfix : if you can tell the server about the error, it won't sent the WU to you again

Posted: **Wed Dec 12, 2007 2:40 pm**

_ikki_ wrote:Too late, I've deleted the WU but I got exactly the same WU.

I will see if it crash at 94 percent...

Take a WU backup just a bit before it will reach 94% and send it to me as well.

Posted: **Wed Dec 12, 2007 5:42 pm**

well my client was stopped all the day and I've just started it from 1 percent.

I will tar the work and queue.dat tomorrow and send it to you.

I see there is a lot of similar problèms since today.
Are they linked to a specific server delivering bad WUs ?

No results sent to stanford since 3 days

(((

Posted: **Thu Dec 13, 2007 8:19 am**

It has not crashed and I continue on a Project: 3050 (Run 1, Clone 33, Gen 21)

Posted: **Thu Dec 13, 2007 12:24 pm**

The next time I will be ready

Code: Select all

#!/bin/bash
# /home/ikki/fah/backup.sh
# script to backup FAH files

suffix=$(date +%s)
cd /home/ikki/fah && tar cvzf "fah-$suffix.tgz" inst1/ >/dev/null

Code: Select all

#cron task
0 * * * * /home/ikki/fah/backup.sh

Posted: **Thu Dec 13, 2007 5:40 pm**

_ikki_ wrote:It has not crashed and I continue on a Project: 3050 (Run 1, Clone 33, Gen 21)

It's actually a different WU.

First one was
Project: 3050 (Run 1, Clone 33, Gen 20)

Edit:
Maybe I read that wrong... You did complete Project: 3050 (Run 1, Clone 33, Gen 20) successfully on the last attempt?

Posted: **Thu Dec 13, 2007 7:14 pm**

Edit:
Maybe I read that wrong... You did complete Project: 3050 (Run 1, Clone 33, Gen 20) successfully on the last attempt?

Yes I completed the xxx gen 20 before getting a xxx gen 21

Posted: **Thu Dec 13, 2007 8:07 pm**

_ikki_ wrote:I see there is a lot of similar problèms since today.
Are they linked to a specific server delivering bad WUs ?

No.

There are always a certain number of WUs that are "bad" and they're not associated with any single server. The problem here is not that you received a bad WU, but that the client (which is still in beta) doesn't handle the error properly and it is reassigned to you. The 5.0x client sends back an error report after the first error and then you get a different assignment.

That's what "Ivoshiee" meant when he said we may have a perfect specimen to pinpoint the 0x0 error cause. If we do, then the beta code can be corrected.

Posted: **Fri Dec 14, 2007 8:10 am**

ok, so actually the WU I got (3050 / 1-33-20) is not a "very bad" WU because I succeed to complete one -> Did there a case where no one succeed to return results for a WU that crashed every time ?

Sorry to not have furnished you the data but the next time, I will do it and report the bad WU thanks to the backup script

I did not mentionned my config : core2Quad Q6600 @3.15GHz under Ubuntu Linux 7.10, V6 SMP with passkey and 60 WU returned since 2 months