Project: 2665 (Run 3, Clone 493, Gen 79)

Moderators: Site Moderators, FAHC Science Team

Post Reply
coo-coo
Posts: 8
Joined: Sun Apr 20, 2008 5:35 pm

Project: 2665 (Run 3, Clone 493, Gen 79)

Post by coo-coo »

Project: 2665 (Run 3, Clone 493, Gen 79)

Croaked at 53% on 3 consecutive runs on one of my boxes.

Code: Select all

[12:15:06] Project: 2665 (Run 3, Clone 493, Gen 79)
[12:15:06] 
[12:15:06] Assembly optimizations on if available.
[12:15:06] Entering M.D.
[12:15:27]  percent)
[12:15:28] cket
[12:15:28] 
[12:15:28] Project: 2665 (Run 3, Clone 493, Gen 79)
[12:15:28] 
[12:15:28] 65 (Run 3, Clone 493, Gen 79)
[12:15:28] 
[12:15:29] Entering M.D.
[12:15:35] Rejecting checkpoint
[12:15:36] 
[12:15:36] Writing local files
[12:15:36] 
[12:15:36] Writing local files
[12:15:42] Extra SSE boost OK.
[12:15:42] Writing local files
[12:15:42] Completed 0 out of 250000 steps  (0 percent)
[12:28:27] Writing local files
[12:28:27] Completed 2500 out of 250000 steps  (1 percent)
[12:41:11] Writing local files
[12:41:11] Completed 5000 out of 250000 steps  (2 percent)
[12:53:51] Writing local files
[12:53:51] Completed 7500 out of 250000 steps  (3 percent)
[13:06:31] Writing local files
[13:06:31] Completed 10000 out of 250000 steps  (4 percent)
[13:19:14] Writing local files
[13:19:14] Completed 12500 out of 250000 steps  (5 percent)
[13:31:55] Writing local files
[13:31:55] Completed 15000 out of 250000 steps  (6 percent)
[13:44:35] Writing local files
[13:44:35] Completed 17500 out of 250000 steps  (7 percent)
[13:57:21] Writing local files
[13:57:21] Completed 20000 out of 250000 steps  (8 percent)
[14:10:02] Writing local files
[14:10:02] Completed 22500 out of 250000 steps  (9 percent)
[14:22:41] Writing local files
[14:22:41] Completed 25000 out of 250000 steps  (10 percent)
[14:35:23] Writing local files
[14:35:23] Completed 27500 out of 250000 steps  (11 percent)
[14:48:04] Writing local files
[14:48:04] Completed 30000 out of 250000 steps  (12 percent)
[15:00:45] Writing local files
[15:00:46] Completed 32500 out of 250000 steps  (13 percent)
[15:13:26] Writing local files
[15:13:26] Completed 35000 out of 250000 steps  (14 percent)
[15:26:07] Writing local files
[15:26:07] Completed 37500 out of 250000 steps  (15 percent)
[15:38:49] Writing local files
[15:38:49] Completed 40000 out of 250000 steps  (16 percent)
[15:51:35] Writing local files
[15:51:35] Completed 42500 out of 250000 steps  (17 percent)
[16:04:20] Writing local files
[16:04:21] Completed 45000 out of 250000 steps  (18 percent)
[16:17:09] Writing local files
[16:17:09] Completed 47500 out of 250000 steps  (19 percent)
[16:29:57] Writing local files
[16:29:57] Completed 50000 out of 250000 steps  (20 percent)
[16:42:46] Writing local files
[16:42:46] Completed 52500 out of 250000 steps  (21 percent)
[16:55:34] Writing local files
[16:55:34] Completed 55000 out of 250000 steps  (22 percent)
[17:08:22] Writing local files
[17:08:22] Completed 57500 out of 250000 steps  (23 percent)
[17:21:11] Writing local files
[17:21:11] Completed 60000 out of 250000 steps  (24 percent)
[17:33:59] Writing local files
[17:33:59] Completed 62500 out of 250000 steps  (25 percent)
[17:46:48] Writing local files
[17:46:48] Completed 65000 out of 250000 steps  (26 percent)
[17:59:36] Writing local files
[17:59:36] Completed 67500 out of 250000 steps  (27 percent)
[18:12:23] Writing local files
[18:12:23] Completed 70000 out of 250000 steps  (28 percent)
[18:25:10] Writing local files
[18:25:10] Completed 72500 out of 250000 steps  (29 percent)
[18:37:58] Writing local files
[18:37:58] Completed 75000 out of 250000 steps  (30 percent)
[18:50:44] Writing local files
[18:50:44] Completed 77500 out of 250000 steps  (31 percent)
[19:03:30] Writing local files
[19:03:30] Completed 80000 out of 250000 steps  (32 percent)
[19:16:10] Writing local files
[19:16:11] Completed 82500 out of 250000 steps  (33 percent)
[19:28:51] Writing local files
[19:28:51] Completed 85000 out of 250000 steps  (34 percent)
[19:41:32] Writing local files
[19:41:32] Completed 87500 out of 250000 steps  (35 percent)
[19:54:13] Writing local files
[19:54:14] Completed 90000 out of 250000 steps  (36 percent)
[20:06:54] Writing local files
[20:06:54] Completed 92500 out of 250000 steps  (37 percent)
[20:19:36] Writing local files
[20:19:36] Completed 95000 out of 250000 steps  (38 percent)
[20:32:19] Writing local files
[20:32:19] Completed 97500 out of 250000 steps  (39 percent)
[20:45:03] Writing local files
[20:45:03] Completed 100000 out of 250000 steps  (40 percent)
[20:57:48] Writing local files
[20:57:48] Completed 102500 out of 250000 steps  (41 percent)
[21:10:33] Writing local files
[21:10:33] Completed 105000 out of 250000 steps  (42 percent)
[21:23:21] Writing local files
[21:23:21] Completed 107500 out of 250000 steps  (43 percent)
[21:36:06] Writing local files
[21:36:06] Completed 110000 out of 250000 steps  (44 percent)
[21:48:49] Writing local files
[21:48:49] Completed 112500 out of 250000 steps  (45 percent)
[22:01:31] Writing local files
[22:01:32] Completed 115000 out of 250000 steps  (46 percent)
[22:14:11] Writing local files
[22:14:12] Completed 117500 out of 250000 steps  (47 percent)
[22:26:53] Writing local files
[22:26:53] Completed 120000 out of 250000 steps  (48 percent)
[22:39:34] Writing local files
[22:39:35] Completed 122500 out of 250000 steps  (49 percent)
[22:52:15] Writing local files
[22:52:16] Completed 125000 out of 250000 steps  (50 percent)
[23:04:56] Writing local files
[23:04:56] Completed 127500 out of 250000 steps  (51 percent)
[23:17:37] Writing local files
[23:17:38] Completed 130000 out of 250000 steps  (52 percent)
[23:30:18] Writing local files
[23:30:18] Completed 132500 out of 250000 steps  (53 percent)
[23:42:59] Writing local files
[23:42:59] Completed 135000 out of 250000 steps  (54 percent)
[23:55:03] Warning:  long 1-4 interactions
[23:55:03] Gromacs cannot continue further.
[23:55:03] Going to send back what have done.
[23:55:03] logfile size: 110005
[23:55:03] - Writing 110541 bytes of core data to disk...
[23:55:03]   ... Done.
[23:55:03] - Failed to delete work/wudata_01.sas
[23:55:03] - Failed to delete work/wudata_01.goe
[23:55:03] Warning:  check for stray files
[23:55:03] 
[23:55:03] Folding@home Core Shutdown: EARLY_UNIT_END
[23:55:03] 
[23:55:03] Folding@home Core Shutdown: EARLY_UNIT_END
[23:55:07] CoreStatus = 7B (123)
[23:55:07] Client-core communications error: ERROR 0x7b
[23:55:07] This is a sign of more serious problems, shutting down.

Folding@Home Client Shutdown at user request.

Folding@Home Client Shutdown.
Then today, the same WU was sent to another one of my rigs and failed again at the same point.

Code: Select all

[02:18:41] Project: 2665 (Run 3, Clone 493, Gen 79)
[02:18:41] 
[02:18:43] Entering M.D.
[02:18:50] Rejecting checkpoint
[02:18:51] Protein: HGG in water
[02:18:51] Writing local files
[02:18:58] Extra SSE boost OK.
[02:18:59] Writing local files
[02:18:59] Completed 0 out of 250000 steps  (0 percent)
[02:34:00] Timered checkpoint triggered.
[02:38:28] Writing local files
[02:38:28] Completed 2500 out of 250000 steps  (1 percent)
[02:53:28] Timered checkpoint triggered.
[02:57:56] Writing local files
[02:57:56] Completed 5000 out of 250000 steps  (2 percent)
[03:12:57] Timered checkpoint triggered.
[03:17:25] Writing local files
[03:17:25] Completed 7500 out of 250000 steps  (3 percent)
[03:32:26] Timered checkpoint triggered.
[03:36:54] Writing local files
[03:36:54] Completed 10000 out of 250000 steps  (4 percent)
[03:51:55] Timered checkpoint triggered.
[03:56:25] Writing local files
[03:56:25] Completed 12500 out of 250000 steps  (5 percent)
[04:11:26] Timered checkpoint triggered.
[04:15:55] Writing local files
[04:15:55] Completed 15000 out of 250000 steps  (6 percent)
[04:30:56] Timered checkpoint triggered.
[04:35:24] Writing local files
[04:35:25] Completed 17500 out of 250000 steps  (7 percent)
[04:50:25] Timered checkpoint triggered.
[04:54:54] Writing local files
[04:54:54] Completed 20000 out of 250000 steps  (8 percent)
[05:09:55] Timered checkpoint triggered.
[05:14:23] Writing local files
[05:14:23] Completed 22500 out of 250000 steps  (9 percent)
[05:29:24] Timered checkpoint triggered.
[05:33:52] Writing local files
[05:33:53] Completed 25000 out of 250000 steps  (10 percent)
[05:48:53] Timered checkpoint triggered.
[05:53:23] Writing local files
[05:53:23] Completed 27500 out of 250000 steps  (11 percent)
[06:08:24] Timered checkpoint triggered.
[06:12:53] Writing local files
[06:12:53] Completed 30000 out of 250000 steps  (12 percent)
[06:27:55] Timered checkpoint triggered.
[06:32:21] Writing local files
[06:32:21] Completed 32500 out of 250000 steps  (13 percent)
[06:47:22] Timered checkpoint triggered.
[06:51:51] Writing local files
[06:51:51] Completed 35000 out of 250000 steps  (14 percent)
[07:06:52] Timered checkpoint triggered.
[07:11:25] Writing local files
[07:11:25] Completed 37500 out of 250000 steps  (15 percent)
[07:26:26] Timered checkpoint triggered.
[07:29:43] Writing local files
[07:29:43] Completed 40000 out of 250000 steps  (16 percent)
[07:44:44] Timered checkpoint triggered.
[07:48:01] Writing local files
[07:48:01] Completed 42500 out of 250000 steps  (17 percent)
[07:59:00] - Autosending finished units... [January 13 07:59:00 UTC]
[07:59:00] Trying to send all finished work units
[07:59:00] + No unsent completed units remaining.
[07:59:00] - Autosend completed
[08:03:03] Timered checkpoint triggered.
[08:06:21] Writing local files
[08:06:21] Completed 45000 out of 250000 steps  (18 percent)
[08:21:21] Timered checkpoint triggered.
[08:24:40] Writing local files
[08:24:40] Completed 47500 out of 250000 steps  (19 percent)
[08:39:41] Timered checkpoint triggered.
[08:43:00] Writing local files
[08:43:00] Completed 50000 out of 250000 steps  (20 percent)
[08:58:00] Timered checkpoint triggered.
[09:01:18] Writing local files
[09:01:18] Completed 52500 out of 250000 steps  (21 percent)
[09:16:19] Timered checkpoint triggered.
[09:19:36] Writing local files
[09:19:36] Completed 55000 out of 250000 steps  (22 percent)
[09:34:37] Timered checkpoint triggered.
[09:37:54] Writing local files
[09:37:55] Completed 57500 out of 250000 steps  (23 percent)
[09:52:56] Timered checkpoint triggered.
[09:56:13] Writing local files
[09:56:13] Completed 60000 out of 250000 steps  (24 percent)
[10:11:14] Timered checkpoint triggered.
[10:14:32] Writing local files
[10:14:32] Completed 62500 out of 250000 steps  (25 percent)
[10:29:33] Timered checkpoint triggered.
[10:32:49] Writing local files
[10:32:50] Completed 65000 out of 250000 steps  (26 percent)
[10:47:49] Timered checkpoint triggered.
[10:51:08] Writing local files
[10:51:08] Completed 67500 out of 250000 steps  (27 percent)
[11:06:08] Timered checkpoint triggered.
[11:09:27] Writing local files
[11:09:27] Completed 70000 out of 250000 steps  (28 percent)
[11:24:27] Timered checkpoint triggered.
[11:27:42] Writing local files
[11:27:42] Completed 72500 out of 250000 steps  (29 percent)
[11:42:42] Timered checkpoint triggered.
[11:45:59] Writing local files
[11:45:59] Completed 75000 out of 250000 steps  (30 percent)
[12:00:59] Timered checkpoint triggered.
[12:04:15] Writing local files
[12:04:16] Completed 77500 out of 250000 steps  (31 percent)
[12:19:15] Timered checkpoint triggered.
[12:22:31] Writing local files
[12:22:31] Completed 80000 out of 250000 steps  (32 percent)
[12:37:32] Timered checkpoint triggered.
[12:40:36] Writing local files
[12:40:36] Completed 82500 out of 250000 steps  (33 percent)
[12:55:36] Timered checkpoint triggered.
[12:58:54] Writing local files
[12:58:54] Completed 85000 out of 250000 steps  (34 percent)
[13:13:54] Timered checkpoint triggered.
[13:17:14] Writing local files
[13:17:14] Completed 87500 out of 250000 steps  (35 percent)
[13:32:14] Timered checkpoint triggered.
[13:35:32] Writing local files
[13:35:32] Completed 90000 out of 250000 steps  (36 percent)
[13:50:32] Timered checkpoint triggered.
[13:53:50] Writing local files
[13:53:50] Completed 92500 out of 250000 steps  (37 percent)
[13:59:00] - Autosending finished units... [January 13 13:59:00 UTC]
[13:59:00] Trying to send all finished work units
[13:59:00] + No unsent completed units remaining.
[13:59:00] - Autosend completed
[14:08:50] Timered checkpoint triggered.
[14:12:10] Writing local files
[14:12:10] Completed 95000 out of 250000 steps  (38 percent)
[14:27:09] Timered checkpoint triggered.
[14:30:26] Writing local files
[14:30:27] Completed 97500 out of 250000 steps  (39 percent)
[14:45:26] Timered checkpoint triggered.
[14:48:44] Writing local files
[14:48:44] Completed 100000 out of 250000 steps  (40 percent)
[15:03:45] Timered checkpoint triggered.
[15:07:01] Writing local files
[15:07:01] Completed 102500 out of 250000 steps  (41 percent)
[15:22:02] Timered checkpoint triggered.
[15:25:19] Writing local files
[15:25:19] Completed 105000 out of 250000 steps  (42 percent)
[15:40:20] Timered checkpoint triggered.
[15:43:37] Writing local files
[15:43:37] Completed 107500 out of 250000 steps  (43 percent)
[15:58:38] Timered checkpoint triggered.
[16:01:56] Writing local files
[16:01:56] Completed 110000 out of 250000 steps  (44 percent)
[16:16:57] Timered checkpoint triggered.
[16:20:16] Writing local files
[16:20:17] Completed 112500 out of 250000 steps  (45 percent)
[16:35:16] Timered checkpoint triggered.
[16:38:37] Writing local files
[16:38:38] Completed 115000 out of 250000 steps  (46 percent)
[16:53:38] Timered checkpoint triggered.
[16:56:56] Writing local files
[16:56:56] Completed 117500 out of 250000 steps  (47 percent)
[17:11:57] Timered checkpoint triggered.
[17:15:17] Writing local files
[17:15:18] Completed 120000 out of 250000 steps  (48 percent)
[17:30:18] Timered checkpoint triggered.
[17:33:38] Writing local files
[17:33:38] Completed 122500 out of 250000 steps  (49 percent)
[17:48:37] Timered checkpoint triggered.
[17:51:54] Writing local files
[17:51:55] Completed 125000 out of 250000 steps  (50 percent)
[18:06:54] Timered checkpoint triggered.
[18:10:12] Writing local files
[18:10:13] Completed 127500 out of 250000 steps  (51 percent)
[18:25:13] Timered checkpoint triggered.
[18:28:30] Writing local files
[18:28:30] Completed 130000 out of 250000 steps  (52 percent)
[18:43:31] Timered checkpoint triggered.
[18:46:46] Writing local files
[18:46:46] Completed 132500 out of 250000 steps  (53 percent)
[19:01:47] Timered checkpoint triggered.
[19:05:03] Writing local files
[19:05:03] Completed 135000 out of 250000 steps  (54 percent)
[19:20:04] Timered checkpoint triggered.
[19:22:23] Warning:  long 1-4 interactions
[19:22:23] Gromacs cannot continue further.
[19:22:23] Going to send back what have done.
[19:22:23] logfile size: 0
[19:22:23] Warning: Core could not open logfile.
[19:22:23] - Writing 536 bytes of core data to disk...
[19:22:23]   ... Done.
[19:22:23] - Failed to delete work/wudata_08.sas
[19:22:23] - Failed to delete work/wudata_08.goe
[19:22:23] Warning:  check for stray files
[19:24:23] 
[19:24:23] Folding@home Core Shutdown: EARLY_UNIT_END
[19:24:23] 
[19:24:23] Folding@home Core Shutdown: EARLY_UNIT_END
[19:24:27] CoreStatus = 7B (123)
[19:24:27] Client-core communications error: ERROR 0x7b
[19:24:27] This is a sign of more serious problems, shutting down.
[19:59:00] - Autosending finished units... [January 13 19:59:00 UTC]
[19:59:00] Trying to send all finished work units
[19:59:00] + No unsent completed units remaining.
[19:59:00] - Autosend completed
Looks like a bad project unit.
Please kill this thing.... and do it now. :evil:
Thank you for listening.
toTOW
Site Moderator
Posts: 6395
Joined: Sun Dec 02, 2007 10:38 am
Location: Bordeaux, France
Contact:

Re: Project: 2665 (Run 3, Clone 493, Gen 79)

Post by toTOW »

There are two reports in the DB, both are EUEs ...

By the way, you should consider upgrading your client to 6.23 to avoid getting the "This is a sign of more serious problems, shutting down." message and report automatically your own partial results.
Image

Folding@Home beta tester since 2002. Folding Forum moderator since July 2008.
Tobit
Posts: 342
Joined: Thu Apr 17, 2008 2:35 pm
Location: Manchester, NH USA

Re: Project: 2665 (Run 3, Clone 493, Gen 79)

Post by Tobit »

6.23 can be found here
Post Reply