Sample logs below:
Code: Select all
08:50:35:I1:WU15:Completed 2475000 out of 2500000 steps (99%)
08:51:29:I1:WU15:Completed 2500000 out of 2500000 steps (100%)
08:51:29:I1:WU15:Saving result file ../logfile_01.txt
08:51:29:I1:WU15:Saving result file frame657.gro
08:51:29:I1:WU15:Saving result file frame657.xtc
08:51:29:I1:WU15:Saving result file md.log
08:51:29:I1:WU15:Saving result file science.log
08:51:29:I1:WU15:Saving result file state.cpt
08:51:29:I1:WU15:Folding@home Core Shutdown: FINISHED_UNIT
08:51:30:I1:WU15:Core returned FINISHED_UNIT (100)
08:51:30:I1:WU15:Uploading WU results
08:51:30:I3:Connecting to vav22.fah.temple.edu:443
08:51:30:I1:OUT45:> POST https://vav22.fah.temple.edu/api/results HTTP/1.1
08:51:32:I1:WU15:UPLOAD 1% 103.55KiB of 6.98MiB
08:51:33:I1:WU15:UPLOAD 16% 1.12MiB of 6.98MiB
08:51:34:I1:WU15:UPLOAD 91% 6.38MiB of 6.98MiB
08:51:41:I1:OUT45:< HTTP/1.1 200 HTTP_OK
08:51:41:I1:WU15:Credited
08:52:41:E :OUT44:Failed response: EOF
08:52:41:I1:WU20:Retry #1 in 2 secs
08:52:43:I1:WU20:Downloading WU
08:52:43:I3:Connecting to highland2.seas.upenn.edu:443
08:52:44:I1:OUT46:> POST https://highland2.seas.upenn.edu/api/assign HTTP/1.1
08:53:30:I1:WU20:DOWNLOAD 100% 55B of 55B
08:53:30:I1:OUT46:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
08:53:30:E :OUT46:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"Can't dereference NULL pointer!"}}
08:53:32:I1:Default:Added new work unit: cpus:32 gpus:gpu:01:00:00,gpu:02:00:00
08:53:32:I1:WU21:Requesting WU assignment for user enroscado team 1747
08:53:32:I3:Connecting to assign2.foldingathome.org:443
08:53:33:I1:OUT47:> POST https://assign2.foldingathome.org/api/assign HTTP/1.1
08:53:34:I1:OUT47:< HTTP/1.1 200 HTTP_OK
08:53:34:I1:WU21:Received WU assignment BC3e5GOTnyEblV0KX6HOuAKGZJh-0xJsCOUJz6qcrxQ
08:53:34:I1:WU21:Downloading WU
08:53:35:I3:Connecting to highland4.seas.upenn.edu:443
08:53:35:I1:OUT48:> POST https://highland4.seas.upenn.edu/api/assign HTTP/1.1
08:55:36:I1:WU21:DOWNLOAD 1% 310.17KiB of 31.24MiB
08:57:15:E :OUT48:Failed response: EOF
08:57:15:I1:WU21:Retry #1 in 2 secs
08:57:17:I1:WU21:Downloading WU
08:57:17:I3:Connecting to highland4.seas.upenn.edu:443
08:57:18:I1:OUT49:> POST https://highland4.seas.upenn.edu/api/assign HTTP/1.1
08:57:23:I1:WU21:DOWNLOAD 100% 55B of 55B
08:57:23:I1:OUT49:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
08:57:23:E :OUT49:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"Can't dereference NULL pointer!"}}
08:57:27:I1:Default:Added new work unit: cpus:32 gpus:gpu:01:00:00,gpu:02:00:00
08:57:27:I1:WU22:Requesting WU assignment for user enroscado team 1747
08:57:27:I3:Connecting to assign3.foldingathome.org:443
08:57:27:I1:OUT50:> POST https://assign3.foldingathome.org/api/assign HTTP/1.1
08:57:29:I1:OUT50:< HTTP/1.1 200 HTTP_OK
08:57:29:I1:WU22:Received WU assignment BzShVCIrlpfziqyC47nvms9P-Dstl_GRA7Qn77LuCw0
08:57:29:I1:WU22:Downloading WU
08:57:29:I3:Connecting to highland4.seas.upenn.edu:443
08:57:29:I1:OUT51:> POST https://highland4.seas.upenn.edu/api/assign HTTP/1.1
08:59:50:I1:WU22:DOWNLOAD 1% 318.12KiB of 31.22MiB
09:00:53:E :OUT51:Failed response: EOF
09:00:53:I1:WU22:Retry #1 in 2 secs
09:00:55:I1:WU22:Downloading WU
09:00:55:I3:Connecting to highland4.seas.upenn.edu:443
09:00:57:I1:OUT52:> POST https://highland4.seas.upenn.edu/api/assign HTTP/1.1
09:00:59:I1:WU22:DOWNLOAD 100% 55B of 55B
09:00:59:I1:OUT52:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
09:00:59:E :OUT52:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"Can't dereference NULL pointer!"}}
09:01:07:I1:Default:Added new work unit: cpus:32 gpus:gpu:01:00:00,gpu:02:00:00
09:01:07:I1:WU23:Requesting WU assignment for user enroscado team 1747
09:01:07:I3:Connecting to assign4.foldingathome.org:443
09:01:07:I1:OUT53:> POST https://assign4.foldingathome.org/api/assign HTTP/1.1
09:01:09:I1:OUT53:< HTTP/1.1 200 HTTP_OK
09:01:09:I1:WU23:Received WU assignment xHvVCCCLYmrmlTro1XsYh26pe9fUlYX_Ax6z4U9kLu4
09:01:09:I1:WU23:Downloading WU
09:01:09:I3:Connecting to highland4.seas.upenn.edu:443
09:01:09:I1:OUT54:> POST https://highland4.seas.upenn.edu/api/assign HTTP/1.1
09:03:09:I1:WU23:DOWNLOAD 1% 278.36KiB of 27.83MiB
09:05:25:I1:WU23:DOWNLOAD 2% 556.72KiB of 27.83MiB
09:08:08:E :OUT54:Failed response: EOF
09:08:08:I1:WU23:Retry #1 in 2 secs
09:08:10:I1:WU23:Downloading WU
09:08:10:I3:Connecting to highland4.seas.upenn.edu:443
09:08:10:I1:OUT55:> POST https://highland4.seas.upenn.edu/api/assign HTTP/1.1
09:08:13:I1:WU23:DOWNLOAD 100% 55B of 55B
09:08:13:I1:OUT55:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
09:08:13:E :OUT55:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"Can't dereference NULL pointer!"}}
09:08:29:I1:Default:Added new work unit: cpus:32 gpus:gpu:01:00:00,gpu:02:00:00
09:08:29:I1:WU24:Requesting WU assignment for user enroscado team 1747
09:08:29:I3:Connecting to assign5.foldingathome.org:443
09:08:30:I1:OUT56:> POST https://assign5.foldingathome.org/api/assign HTTP/1.1
09:08:31:I1:OUT56:< HTTP/1.1 200 HTTP_OK
09:08:31:I1:WU24:Received WU assignment FiCzwA5yNdIV_wpVqd4XUGNhNaw1yCJv0SF7Kx2cUxU
09:08:31:I1:WU24:Downloading WU
09:08:31:I3:Connecting to highland2.seas.upenn.edu:443
09:08:31:I1:OUT57:> POST https://highland2.seas.upenn.edu/api/assign HTTP/1.1
09:10:32:I1:WU24:DOWNLOAD 1% 310.17KiB of 31.23MiB
09:12:14:I1:WU24:DOWNLOAD 2% 628.30KiB of 31.23MiB
09:14:25:E :OUT57:Failed response: EOF
09:14:25:I1:WU24:Retry #1 in 2 secs
09:14:27:I1:WU24:Downloading WU
09:14:27:I3:Connecting to highland2.seas.upenn.edu:443
09:14:28:I1:OUT58:> POST https://highland2.seas.upenn.edu/api/assign HTTP/1.1
09:14:37:I1:WU24:DOWNLOAD 100% 55B of 55B
09:14:37:I1:OUT58:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
09:14:37:E :OUT58:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"Can't dereference NULL pointer!"}}
09:15:09:I1:Default:Added new work unit: cpus:32 gpus:gpu:01:00:00,gpu:02:00:00
09:15:09:I1:WU25:Requesting WU assignment for user enroscado team 1747
09:15:09:I3:Connecting to assign6.foldingathome.org:443
09:15:09:I1:OUT59:> POST https://assign6.foldingathome.org/api/assign HTTP/1.1
09:15:11:I1:OUT59:< HTTP/1.1 200 HTTP_OK
09:15:11:I1:WU25:Received WU assignment r4xwXeYI0bkwQih7rXYIZd31YwEg3su52vyCywhS2og
09:15:11:I1:WU25:Downloading WU
09:15:11:I3:Connecting to highland2.seas.upenn.edu:443
09:15:12:I1:OUT60:> POST https://highland2.seas.upenn.edu/api/assign HTTP/1.1
09:16:54:I1:WU25:DOWNLOAD 1% 310.17KiB of 31.23MiB
09:19:29:I1:WU25:DOWNLOAD 2% 628.30KiB of 31.23MiB
09:21:31:I1:WU25:DOWNLOAD 3% 946.42KiB of 31.23MiB
09:23:43:I1:WU25:DOWNLOAD 4% 1.23MiB of 31.23MiB
09:25:09:E :OUT60:Failed response: EOF
09:25:09:I1:WU25:Retry #1 in 2 secs
09:25:11:I1:WU25:Downloading WU
09:25:11:I3:Connecting to highland2.seas.upenn.edu:443
09:25:11:I1:OUT61:> POST https://highland2.seas.upenn.edu/api/assign HTTP/1.1
09:25:14:I1:WU25:DOWNLOAD 100% 55B of 55B
09:25:14:I1:OUT61:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
09:25:14:E :OUT61:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"Can't dereference NULL pointer!"}}
09:26:18:I1:Default:Added new work unit: cpus:32 gpus:gpu:01:00:00,gpu:02:00:00
09:26:18:I1:WU26:Requesting WU assignment for user enroscado team 1747
09:26:18:I3:Connecting to assign1.foldingathome.org:443
09:26:18:I1:OUT62:> POST https://assign1.foldingathome.org/api/assign HTTP/1.1
09:26:20:I1:OUT62:< HTTP/1.1 200 HTTP_OK
09:26:20:I1:WU26:Received WU assignment 05L5AkB-e2GvWLkaosKIrsJuEQ2y598FGt8YUlTWs1g
09:26:20:I1:WU26:Downloading WU
09:26:20:I3:Connecting to highland2.seas.upenn.edu:443
09:26:31:I1:OUT63:> POST https://highland2.seas.upenn.edu/api/assign HTTP/1.1
09:30:09:I1:WU26:DOWNLOAD 1% 318.12KiB of 31.23MiB
09:33:12:I1:WU26:DOWNLOAD 2% 636.25KiB of 31.23MiB
09:36:29:I1:WU26:DOWNLOAD 3% 946.42KiB of 31.23MiB
09:39:03:I1:WU26:DOWNLOAD 4% 1.23MiB of 31.23MiB
09:40:54:E :OUT63:Failed response: EOF
09:40:54:I1:WU26:Retry #1 in 2 secs
09:40:56:I1:WU26:Downloading WU
09:40:56:I3:Connecting to highland2.seas.upenn.edu:443
09:40:56:I1:OUT64:> POST https://highland2.seas.upenn.edu/api/assign HTTP/1.1
09:41:06:I1:WU26:DOWNLOAD 100% 55B of 55B
09:41:06:I1:OUT64:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
09:41:06:E :OUT64:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"Can't dereference NULL pointer!"}}
09:43:14:I1:Default:Added new work unit: cpus:32 gpus:gpu:01:00:00,gpu:02:00:00
09:43:14:I1:WU27:Requesting WU assignment for user enroscado team 1747
09:43:15:I3:Connecting to assign2.foldingathome.org:443
09:43:15:I1:OUT65:> POST https://assign2.foldingathome.org/api/assign HTTP/1.1
09:43:16:I1:OUT65:< HTTP/1.1 200 HTTP_OK
09:43:16:I1:WU27:Received WU assignment 4ezAwDu3_B52GMXanuOKmi_0ydK2rmmZK6AXlSeGgo8
09:43:16:I1:WU27:Downloading WU
09:43:16:I3:Connecting to highland3.seas.upenn.edu:443
09:43:16:I1:OUT66:> POST https://highland3.seas.upenn.edu/api/assign HTTP/1.1
09:45:28:I1:WU27:DOWNLOAD 1% 310.17KiB of 31.23MiB
09:47:27:I1:WU27:DOWNLOAD 2% 628.30KiB of 31.23MiB
09:49:35:E :OUT66:Failed response: EOF
09:49:35:I1:WU27:Retry #1 in 2 secs
09:49:37:I1:WU27:Downloading WU
09:49:37:I3:Connecting to highland3.seas.upenn.edu:443
09:49:37:I1:OUT68:> POST https://highland3.seas.upenn.edu/api/assign HTTP/1.1
09:49:39:I1:WU27:DOWNLOAD 100% 55B of 55B
09:49:39:I1:OUT68:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
09:49:39:E :OUT68:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"Can't dereference NULL pointer!"}}
09:53:55:I1:Default:Added new work unit: cpus:32 gpus:gpu:01:00:00,gpu:02:00:00
09:53:55:I1:WU28:Requesting WU assignment for user enroscado team 1747
09:53:55:I3:Connecting to assign3.foldingathome.org:443
09:53:56:I1:OUT69:> POST https://assign3.foldingathome.org/api/assign HTTP/1.1
09:53:57:I1:OUT69:< HTTP/1.1 200 HTTP_OK
09:53:57:I1:WU28:Received WU assignment PSZLWhXVq_Gw2IAmw107AWVEDdwTucDoN5MhGrIPwxk
09:53:57:I1:WU28:Downloading WU
09:53:57:I3:Connecting to highland3.seas.upenn.edu:443
09:53:59:I1:OUT70:> POST https://highland3.seas.upenn.edu/api/assign HTTP/1.1
09:56:07:E :OUT70:Failed response: EOF
09:56:07:I1:WU28:Retry #1 in 2 secs
09:56:09:I1:WU28:Downloading WU
09:56:09:I3:Connecting to highland3.seas.upenn.edu:443
09:56:10:I1:OUT71:> POST https://highland3.seas.upenn.edu/api/assign HTTP/1.1
09:56:14:I1:WU28:DOWNLOAD 100% 55B of 55B
09:56:14:I1:OUT71:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
09:56:14:E :OUT71:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"Can't dereference NULL pointer!"}}
10:04:46:I1:Default:Added new work unit: cpus:32 gpus:gpu:01:00:00,gpu:02:00:00
10:04:46:I1:WU29:Requesting WU assignment for user enroscado team 1747
10:04:46:I3:Connecting to assign4.foldingathome.org:443
10:04:47:I1:OUT72:> POST https://assign4.foldingathome.org/api/assign HTTP/1.1
10:04:48:I1:OUT72:< HTTP/1.1 200 HTTP_OK
10:04:48:I1:WU29:Received WU assignment e2nWkCbWuxP2VejJo69Zi0D4pV42zasWxLb6IzEo7HA
10:04:48:I1:WU29:Downloading WU
10:04:48:I3:Connecting to highland2.seas.upenn.edu:443
10:04:48:I1:OUT73:> POST https://highland2.seas.upenn.edu/api/assign HTTP/1.1
10:06:38:I1:WU29:DOWNLOAD 1% 310.17KiB of 31.23MiB
10:07:56:I1:WU29:DOWNLOAD 2% 628.30KiB of 31.23MiB
10:09:15:E :OUT73:Failed response: EOF
10:09:15:I1:WU29:Retry #1 in 2 secs
10:09:17:I1:WU29:Downloading WU
10:09:17:I3:Connecting to highland2.seas.upenn.edu:443
10:09:17:I1:OUT74:> POST https://highland2.seas.upenn.edu/api/assign HTTP/1.1
10:09:21:I1:WU29:DOWNLOAD 100% 55B of 55B
10:09:21:I1:OUT74:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
10:09:21:E :OUT74:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"Can't dereference NULL pointer!"}}
10:26:25:I1:Default:Added new work unit: cpus:32 gpus:gpu:01:00:00,gpu:02:00:00
10:26:25:I1:WU30:Requesting WU assignment for user enroscado team 1747
10:26:25:I3:Connecting to assign5.foldingathome.org:443
10:26:26:I1:OUT75:> POST https://assign5.foldingathome.org/api/assign HTTP/1.1
10:26:27:I1:OUT75:< HTTP/1.1 200 HTTP_OK
10:26:27:I1:WU30:Received WU assignment xRtMQSzuD1TM0ZwcY4YL_MwvaKve2IbeU8cpU7DgPwE
10:26:27:I1:WU30:Downloading WU
10:26:27:I3:Connecting to highland2.seas.upenn.edu:443
10:26:28:I1:OUT76:> POST https://highland2.seas.upenn.edu/api/assign HTTP/1.1
10:28:13:I1:WU30:DOWNLOAD 1% 318.12KiB of 31.23MiB
10:29:36:I1:WU30:DOWNLOAD 2% 628.30KiB of 31.23MiB
10:32:07:I1:WU30:DOWNLOAD 3% 946.42KiB of 31.23MiB
10:33:53:I1:WU30:DOWNLOAD 4% 1.23MiB of 31.23MiB
10:35:54:I1:WU30:DOWNLOAD 5% 1.55MiB of 31.23MiB
10:38:09:I1:WU30:DOWNLOAD 6% 1.86MiB of 31.23MiB
10:39:40:I1:WU30:DOWNLOAD 7% 2.17MiB of 31.23MiB
10:41:50:I1:WU30:DOWNLOAD 8% 2.49MiB of 31.23MiB
10:43:54:I1:WU30:DOWNLOAD 9% 2.80MiB of 31.23MiB
10:45:48:I1:WU30:DOWNLOAD 10% 3.11MiB of 31.23MiB
10:47:30:I1:WU30:DOWNLOAD 11% 3.43MiB of 31.23MiB
10:48:58:I1:WU30:DOWNLOAD 12% 3.74MiB of 31.23MiB
10:50:48:I1:WU30:DOWNLOAD 13% 4.05MiB of 31.23MiB
10:52:28:I1:WU30:DOWNLOAD 14% 4.36MiB of 31.23MiB
10:54:28:I1:WU30:DOWNLOAD 15% 4.68MiB of 31.23MiB
10:55:48:I1:WU30:DOWNLOAD 16% 4.99MiB of 31.23MiB
10:58:15:I1:WU30:DOWNLOAD 17% 5.30MiB of 31.23MiB
11:00:00:I1:WU30:DOWNLOAD 18% 5.61MiB of 31.23MiB
11:01:49:I1:WU30:DOWNLOAD 19% 5.93MiB of 31.23MiB
11:03:29:I1:WU30:DOWNLOAD 20% 6.24MiB of 31.23MiB
11:04:59:I1:WU30:DOWNLOAD 21% 6.55MiB of 31.23MiB
11:07:11:E :OUT76:Failed response: EOF
11:07:11:I1:WU30:Retry #1 in 2 secs
11:07:13:I1:WU30:Downloading WU
11:07:13:I3:Connecting to highland2.seas.upenn.edu:443
11:07:17:I1:OUT77:> POST https://highland2.seas.upenn.edu/api/assign HTTP/1.1
11:07:27:I1:WU30:DOWNLOAD 100% 55B of 55B
11:07:27:I1:OUT77:< HTTP/1.1 500 HTTP_INTERNAL_SERVER_ERROR
11:07:27:E :OUT77:HTTP_INTERNAL_SERVER_ERROR: {"error":{"message":"Can't dereference NULL pointer!"}}
Ideas welcome.