Project: 14719 (Run 802, Clone 4, Gen 0) GROMACS Error

[HendricksSA]

Project: 14719 (Run 802, Clone 4, Gen 0) is stuck on my 48 thread server with this error. Any way I can process this or should I get rid of it? I have not seen this error before. Log extract follows:

Code: Select all

15:03:18:WU01:FS00:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:14719 run:802 clone:4 gen:0 core:0xa7 unit:0x000000022879986c5ea9670ab49b086c
15:03:18:WU01:FS00:Starting
15:03:18:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7 -dir 01 -suffix 01 -version 706 -lifeline 1979 -checkpoint 15 -np 48
15:03:18:WU01:FS00:Started FahCore on PID 14407
15:03:18:WU01:FS00:Core PID:14411
15:03:18:WU01:FS00:FahCore 0xa7 started
15:03:18:WU01:FS00:0xa7:*********************** Log Started 2020-07-26T15:03:18Z ***********************
15:03:18:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
15:03:18:WU01:FS00:0xa7:       Type: 0xa7
15:03:18:WU01:FS00:0xa7:       Core: Gromacs
15:03:18:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 14407 -checkpoint 15 -np
15:03:18:WU01:FS00:0xa7:             48
15:03:18:WU01:FS00:0xa7:************************************ CBang *************************************
15:03:18:WU01:FS00:0xa7:       Date: Nov 27 2019
15:03:18:WU01:FS00:0xa7:       Time: 11:26:54
15:03:18:WU01:FS00:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
15:03:18:WU01:FS00:0xa7:     Branch: master
15:03:18:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
15:03:18:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
15:03:18:WU01:FS00:0xa7:             -fno-pie -fPIC
15:03:18:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
15:03:18:WU01:FS00:0xa7:       Bits: 64
15:03:18:WU01:FS00:0xa7:       Mode: Release
15:03:18:WU01:FS00:0xa7:************************************ System ************************************
15:03:18:WU01:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz
15:03:18:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
15:03:18:WU01:FS00:0xa7:       CPUs: 48
15:03:18:WU01:FS00:0xa7:     Memory: 62.80GiB
15:03:18:WU01:FS00:0xa7:Free Memory: 59.87GiB
15:03:18:WU01:FS00:0xa7:    Threads: POSIX_THREADS
15:03:18:WU01:FS00:0xa7: OS Version: 5.3
15:03:18:WU01:FS00:0xa7:Has Battery: false
15:03:18:WU01:FS00:0xa7: On Battery: false
15:03:18:WU01:FS00:0xa7: UTC Offset: -5
15:03:18:WU01:FS00:0xa7:        PID: 14411
15:03:18:WU01:FS00:0xa7:        CWD: /var/lib/fahclient/work
15:03:18:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
15:03:18:WU01:FS00:0xa7:    Version: 0.0.19
15:03:18:WU01:FS00:0xa7:     Author: Joseph Coffland <[email protected]>
15:03:18:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
15:03:18:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
15:03:18:WU01:FS00:0xa7:       Date: Nov 26 2019
15:03:18:WU01:FS00:0xa7:       Time: 00:41:42
15:03:18:WU01:FS00:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
15:03:18:WU01:FS00:0xa7:     Branch: master
15:03:18:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
15:03:18:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
15:03:18:WU01:FS00:0xa7:             -fno-pie
15:03:18:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
15:03:18:WU01:FS00:0xa7:       Bits: 64
15:03:18:WU01:FS00:0xa7:       Mode: Release
15:03:18:WU01:FS00:0xa7:************************************ Build *************************************
15:03:18:WU01:FS00:0xa7:       SIMD: avx_256
15:03:18:WU01:FS00:0xa7:********************************************************************************
15:03:18:WU01:FS00:0xa7:Project: 14719 (Run 802, Clone 4, Gen 0)
15:03:18:WU01:FS00:0xa7:Unit: 0x000000022879986c5ea9670ab49b086c
15:03:18:WU01:FS00:0xa7:Reading tar file core.xml
15:03:18:WU01:FS00:0xa7:Reading tar file frame0.tpr
15:03:18:WU01:FS00:0xa7:Digital signatures verified
15:03:18:WU01:FS00:0xa7:Calling: mdrun -s frame0.tpr -o frame0.trr -cpt 15 -nt 48
15:03:18:WU01:FS00:0xa7:Steps: first=0 total=250000
15:03:20:WU01:FS00:0xa7:Completed 1 out of 250000 steps (0%)
15:03:23:WU00:FS00:Upload 79.17%
15:03:23:WU01:FS00:0xa7:ERROR:
15:03:23:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
15:03:24:WU01:FS00:Starting
15:03:24:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7 -dir 01 -suffix 01 -version 706 -lifeline 1979 -checkpoint 15 -np 48
15:03:24:WU01:FS00:Started FahCore on PID 14463
15:03:24:WU01:FS00:Core PID:14467
15:03:24:WU01:FS00:FahCore 0xa7 started
15:03:24:WU01:FS00:0xa7:*********************** Log Started 2020-07-26T15:03:24Z ***********************
15:03:24:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
15:03:24:WU01:FS00:0xa7:       Type: 0xa7
15:03:24:WU01:FS00:0xa7:       Core: Gromacs
15:03:24:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 14463 -checkpoint 15 -np
15:03:24:WU01:FS00:0xa7:             48
15:03:24:WU01:FS00:0xa7:************************************ CBang *************************************
15:03:24:WU01:FS00:0xa7:       Date: Nov 27 2019
15:03:24:WU01:FS00:0xa7:       Time: 11:26:54
15:03:24:WU01:FS00:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
15:03:24:WU01:FS00:0xa7:     Branch: master
15:03:24:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
15:03:24:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
15:03:24:WU01:FS00:0xa7:             -fno-pie -fPIC
15:03:24:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
15:03:24:WU01:FS00:0xa7:       Bits: 64
15:03:24:WU01:FS00:0xa7:       Mode: Release
15:03:24:WU01:FS00:0xa7:************************************ System ************************************
15:03:24:WU01:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz
15:03:24:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
15:03:24:WU01:FS00:0xa7:       CPUs: 48
15:03:24:WU01:FS00:0xa7:     Memory: 62.80GiB
15:03:24:WU01:FS00:0xa7:Free Memory: 59.86GiB
15:03:24:WU01:FS00:0xa7:    Threads: POSIX_THREADS
15:03:24:WU01:FS00:0xa7: OS Version: 5.3
15:03:24:WU01:FS00:0xa7:Has Battery: false
15:03:24:WU01:FS00:0xa7: On Battery: false
15:03:24:WU01:FS00:0xa7: UTC Offset: -5
15:03:24:WU01:FS00:0xa7:        PID: 14467
15:03:24:WU01:FS00:0xa7:        CWD: /var/lib/fahclient/work
15:03:24:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
15:03:24:WU01:FS00:0xa7:    Version: 0.0.19
15:03:24:WU01:FS00:0xa7:     Author: Joseph Coffland <[email protected]>
15:03:24:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
15:03:24:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
15:03:24:WU01:FS00:0xa7:       Date: Nov 26 2019
15:03:24:WU01:FS00:0xa7:       Time: 00:41:42
15:03:24:WU01:FS00:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
15:03:24:WU01:FS00:0xa7:     Branch: master
15:03:24:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
15:03:24:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
15:03:24:WU01:FS00:0xa7:             -fno-pie
15:03:24:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
15:03:24:WU01:FS00:0xa7:       Bits: 64
15:03:24:WU01:FS00:0xa7:       Mode: Release
15:03:24:WU01:FS00:0xa7:************************************ Build *************************************
15:03:24:WU01:FS00:0xa7:       SIMD: avx_256
15:03:24:WU01:FS00:0xa7:********************************************************************************
15:03:24:WU01:FS00:0xa7:Project: 14719 (Run 802, Clone 4, Gen 0)
15:03:24:WU01:FS00:0xa7:Unit: 0x000000022879986c5ea9670ab49b086c
15:03:24:WU01:FS00:0xa7:Digital signatures verified
15:03:24:WU01:FS00:0xa7:Calling: mdrun -s frame0.tpr -o frame0.trr -cpt 15 -nt 48
15:03:24:WU01:FS00:0xa7:Steps: first=0 total=250000
15:03:25:WU00:FS00:Upload complete
15:03:25:WU00:FS00:Server responded WORK_ACK (400)
15:03:25:WU00:FS00:Final credit estimate, 9043.00 points
15:03:25:WU00:FS00:Cleaning up
15:03:26:WU01:FS00:0xa7:Completed 1 out of 250000 steps (0%)
15:03:29:WU01:FS00:0xa7:ERROR:
15:03:29:WU01:FS00:0xa7:ERROR:-------------------------------------------------------
15:03:29:WU01:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
15:03:29:WU01:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/expanded.c, line: 946
15:03:29:WU01:FS00:0xa7:ERROR:
15:03:29:WU01:FS00:0xa7:ERROR:Fatal error:
15:03:29:WU01:FS00:0xa7:ERROR:Something wrong in choosing new lambda state with a Gibbs move -- probably underflow in weight determination.
15:03:29:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
15:04:24:WU01:FS00:Starting
15:04:24:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7 -dir 01 -suffix 01 -version 706 -lifeline 1979 -checkpoint 15 -np 48
15:04:24:WU01:FS00:Started FahCore on PID 14520
15:04:24:WU01:FS00:Core PID:14524
15:04:24:WU01:FS00:FahCore 0xa7 started
15:04:24:WU01:FS00:0xa7:*********************** Log Started 2020-07-26T15:04:24Z ***********************
15:04:24:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
15:04:24:WU01:FS00:0xa7:       Type: 0xa7
15:04:24:WU01:FS00:0xa7:       Core: Gromacs
15:04:24:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 14520 -checkpoint 15 -np
15:04:24:WU01:FS00:0xa7:             48
15:04:24:WU01:FS00:0xa7:************************************ CBang *********************************
... errors continue ...
16:20:26:WU01:FS00:0xa7:Project: 14719 (Run 802, Clone 4, Gen 0)
16:20:26:WU01:FS00:0xa7:Unit: 0x000000022879986c5ea9670ab49b086c
16:20:26:WU01:FS00:0xa7:Digital signatures verified
16:20:26:WU01:FS00:0xa7:Calling: mdrun -s frame0.tpr -o frame0.trr -cpt 15 -nt 48
16:20:26:WU01:FS00:0xa7:Steps: first=0 total=250000
16:20:28:WU01:FS00:0xa7:Completed 1 out of 250000 steps (0%)
16:20:31:WU01:FS00:0xa7:ERROR:
16:20:31:WU01:FS00:0xa7:ERROR:-------------------------------------------------------
16:20:31:WU01:FS00:0xa7:ERROR:Program GROMACS, VERSION 5.0.4-20191026-456f0d636-unknown
16:20:31:WU01:FS00:0xa7:ERROR:Source code file: /host/debian-stable-64bit-core-a7-avx-release/gromacs-core/build/gromacs/src/gromacs/mdlib/expanded.c, line: 946
16:20:31:WU01:FS00:0xa7:ERROR:
16:20:31:WU01:FS00:0xa7:ERROR:Fatal error:
16:20:31:WU01:FS00:0xa7:ERROR:Something wrong in choosing new lambda state with a Gibbs move -- probably underflow in weight determination.
16:20:31:WU01:FS00:0xa7:ERROR:Denominator is:   0 1.0000000000e+00
16:20:31:WU01:FS00:0xa7:ERROR:  i                dE        numerator          weights
16:20:31:WU01:FS00:0xa7:ERROR:  0  0.0000000000e+00 1.0000000000e+00 0.0000000000e+00
16:20:31:WU01:FS00:0xa7:ERROR:  1 -3.5460235596e+01 3.9793794585e-16 1.0000000000e+01
16:20:31:WU01:FS00:0xa7:ERROR:  2 -7.0920471191e+01 1.5835460875e-31 1.0000000000e+01
16:20:31:WU01:FS00:0xa7:ERROR:  3 -1.0638024139e+02 6.3044641435e-47 1.0000000000e+01
16:20:32:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)

[bruce]

You should dump it.

Acording to the WU app, that WU has been reissued several times and successfully completed. Only one error was reported.

[HendricksSA]

If at first you don't succeed ...

After nearly three hours of trying to do this work unit, my computer finally went right through it without problems and successfully completed it. Bruce, I am at a loss to explain this one.

Code: Select all

17:05:27:WU01:FS00:Starting
17:05:27:WU01:FS00:Removing old file 'work/01/logfile_01-20200726-163326.txt'
17:05:27:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7 -dir 01 -suffix 01 -version 706 -lifeline 1979 -checkpoint 15 -np 48
17:05:27:WU01:FS00:Started FahCore on PID 21734
17:05:27:WU01:FS00:Core PID:21738
17:05:27:WU01:FS00:FahCore 0xa7 started
17:05:28:WU01:FS00:0xa7:*********************** Log Started 2020-07-26T17:05:27Z ***********************
17:05:28:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
17:05:28:WU01:FS00:0xa7:       Type: 0xa7
17:05:28:WU01:FS00:0xa7:       Core: Gromacs
17:05:28:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 21734 -checkpoint 15 -np
17:05:28:WU01:FS00:0xa7:             48
17:05:28:WU01:FS00:0xa7:************************************ CBang *************************************
17:05:28:WU01:FS00:0xa7:       Date: Nov 27 2019
17:05:28:WU01:FS00:0xa7:       Time: 11:26:54
17:05:28:WU01:FS00:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
17:05:28:WU01:FS00:0xa7:     Branch: master
17:05:28:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
17:05:28:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
17:05:28:WU01:FS00:0xa7:             -fno-pie -fPIC
17:05:28:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
17:05:28:WU01:FS00:0xa7:       Bits: 64
17:05:28:WU01:FS00:0xa7:       Mode: Release
17:05:28:WU01:FS00:0xa7:************************************ System ************************************
17:05:28:WU01:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz
17:05:28:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
17:05:28:WU01:FS00:0xa7:       CPUs: 48
17:05:28:WU01:FS00:0xa7:     Memory: 62.80GiB
17:05:28:WU01:FS00:0xa7:Free Memory: 60.50GiB
17:05:28:WU01:FS00:0xa7:    Threads: POSIX_THREADS
17:05:28:WU01:FS00:0xa7: OS Version: 5.3
17:05:28:WU01:FS00:0xa7:Has Battery: false
17:05:28:WU01:FS00:0xa7: On Battery: false
17:05:28:WU01:FS00:0xa7: UTC Offset: -5
17:05:28:WU01:FS00:0xa7:        PID: 21738
17:05:28:WU01:FS00:0xa7:        CWD: /var/lib/fahclient/work
17:05:28:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
17:05:28:WU01:FS00:0xa7:    Version: 0.0.19
17:05:28:WU01:FS00:0xa7:     Author: Joseph Coffland <[email protected]>
17:05:28:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
17:05:28:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
17:05:28:WU01:FS00:0xa7:       Date: Nov 26 2019
17:05:28:WU01:FS00:0xa7:       Time: 00:41:42
17:05:28:WU01:FS00:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
17:05:28:WU01:FS00:0xa7:     Branch: master
17:05:28:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
17:05:28:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
17:05:28:WU01:FS00:0xa7:             -fno-pie
17:05:28:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
17:05:28:WU01:FS00:0xa7:       Bits: 64
17:05:28:WU01:FS00:0xa7:       Mode: Release
17:05:28:WU01:FS00:0xa7:************************************ Build *************************************
17:05:28:WU01:FS00:0xa7:       SIMD: avx_256
17:05:28:WU01:FS00:0xa7:********************************************************************************
17:05:28:WU01:FS00:0xa7:Project: 14719 (Run 802, Clone 4, Gen 0)
17:05:28:WU01:FS00:0xa7:Unit: 0x000000022879986c5ea9670ab49b086c
17:05:28:WU01:FS00:0xa7:Digital signatures verified
17:05:28:WU01:FS00:0xa7:Calling: mdrun -s frame0.tpr -o frame0.trr -cpt 15 -nt 48
17:05:28:WU01:FS00:0xa7:Steps: first=0 total=250000
17:05:30:WU01:FS00:0xa7:Completed 1 out of 250000 steps (0%)
17:05:33:WU01:FS00:0xa7:ERROR:
17:05:33:WU01:FS00:0xa7:ERROR:-------------------------------------------------------
17:05:33:WU01:FS00:FahCore returned: INTERRUPTED (102 = 0x66)
17:06:27:WU01:FS00:Starting
17:06:27:WU01:FS00:Removing old file 'work/01/logfile_01-20200726-163426.txt'
17:06:27:WU01:FS00:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit-avx-256/a7-0.0.19/Core_a7.fah/FahCore_a7 -dir 01 -suffix 01 -version 706 -lifeline 1979 -checkpoint 15 -np 48
17:06:27:WU01:FS00:Started FahCore on PID 21790
17:06:27:WU01:FS00:Core PID:21794
17:06:27:WU01:FS00:FahCore 0xa7 started
17:06:28:WU01:FS00:0xa7:*********************** Log Started 2020-07-26T17:06:27Z ***********************
17:06:28:WU01:FS00:0xa7:************************** Gromacs Folding@home Core ***************************
17:06:28:WU01:FS00:0xa7:       Type: 0xa7
17:06:28:WU01:FS00:0xa7:       Core: Gromacs
17:06:28:WU01:FS00:0xa7:       Args: -dir 01 -suffix 01 -version 706 -lifeline 21790 -checkpoint 15 -np
17:06:28:WU01:FS00:0xa7:             48
17:06:28:WU01:FS00:0xa7:************************************ CBang *************************************
17:06:28:WU01:FS00:0xa7:       Date: Nov 27 2019
17:06:28:WU01:FS00:0xa7:       Time: 11:26:54
17:06:28:WU01:FS00:0xa7:   Revision: d25803215b59272441049dfa05a0a9bf7a6e3c48
17:06:28:WU01:FS00:0xa7:     Branch: master
17:06:28:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
17:06:28:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
17:06:28:WU01:FS00:0xa7:             -fno-pie -fPIC
17:06:28:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
17:06:28:WU01:FS00:0xa7:       Bits: 64
17:06:28:WU01:FS00:0xa7:       Mode: Release
17:06:28:WU01:FS00:0xa7:************************************ System ************************************
17:06:28:WU01:FS00:0xa7:        CPU: Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz
17:06:28:WU01:FS00:0xa7:     CPU ID: GenuineIntel Family 6 Model 63 Stepping 2
17:06:28:WU01:FS00:0xa7:       CPUs: 48
17:06:28:WU01:FS00:0xa7:     Memory: 62.80GiB
17:06:28:WU01:FS00:0xa7:Free Memory: 60.50GiB
17:06:28:WU01:FS00:0xa7:    Threads: POSIX_THREADS
17:06:28:WU01:FS00:0xa7: OS Version: 5.3
17:06:28:WU01:FS00:0xa7:Has Battery: false
17:06:28:WU01:FS00:0xa7: On Battery: false
17:06:28:WU01:FS00:0xa7: UTC Offset: -5
17:06:28:WU01:FS00:0xa7:        PID: 21794
17:06:28:WU01:FS00:0xa7:        CWD: /var/lib/fahclient/work
17:06:28:WU01:FS00:0xa7:******************************** Build - libFAH ********************************
17:06:28:WU01:FS00:0xa7:    Version: 0.0.19
17:06:28:WU01:FS00:0xa7:     Author: Joseph Coffland <[email protected]>
17:06:28:WU01:FS00:0xa7:  Copyright: 2019 foldingathome.org
17:06:28:WU01:FS00:0xa7:   Homepage: https://foldingathome.org/
17:06:28:WU01:FS00:0xa7:       Date: Nov 26 2019
17:06:28:WU01:FS00:0xa7:       Time: 00:41:42
17:06:28:WU01:FS00:0xa7:   Revision: d5b5c747532224f986b7cd02c968ed9a20c16d6e
17:06:28:WU01:FS00:0xa7:     Branch: master
17:06:28:WU01:FS00:0xa7:   Compiler: GNU 8.3.0
17:06:28:WU01:FS00:0xa7:    Options: -std=c++11 -ffunction-sections -fdata-sections -O3 -funroll-loops
17:06:28:WU01:FS00:0xa7:             -fno-pie
17:06:28:WU01:FS00:0xa7:   Platform: linux2 4.19.0-5-amd64
17:06:28:WU01:FS00:0xa7:       Bits: 64
17:06:28:WU01:FS00:0xa7:       Mode: Release
17:06:28:WU01:FS00:0xa7:************************************ Build *************************************
17:06:28:WU01:FS00:0xa7:       SIMD: avx_256
17:06:28:WU01:FS00:0xa7:********************************************************************************
17:06:28:WU01:FS00:0xa7:Project: 14719 (Run 802, Clone 4, Gen 0)
17:06:28:WU01:FS00:0xa7:Unit: 0x000000022879986c5ea9670ab49b086c
17:06:28:WU01:FS00:0xa7:Digital signatures verified
17:06:28:WU01:FS00:0xa7:Calling: mdrun -s frame0.tpr -o frame0.trr -cpt 15 -nt 48
17:06:28:WU01:FS00:0xa7:Steps: first=0 total=250000
17:06:30:WU01:FS00:0xa7:Completed 1 out of 250000 steps (0%)
17:06:56:WU01:FS00:0xa7:Completed 2500 out of 250000 steps (1%)
17:07:22:WU01:FS00:0xa7:Completed 5000 out of 250000 steps (2%)
17:07:50:WU01:FS00:0xa7:Completed 7500 out of 250000 steps (3%)
17:08:16:WU01:FS00:0xa7:Completed 10000 out of 250000 steps (4%)
17:08:41:WU01:FS00:0xa7:Completed 12500 out of 250000 steps (5%)
17:09:06:WU01:FS00:0xa7:Completed 15000 out of 250000 steps (6%)
17:09:32:WU01:FS00:0xa7:Completed 17500 out of 250000 steps (7%)
17:09:55:WU01:FS00:0xa7:Completed 20000 out of 250000 steps (8%)
17:10:18:WU01:FS00:0xa7:Completed 22500 out of 250000 steps (9%)
17:10:40:WU01:FS00:0xa7:Completed 25000 out of 250000 steps (10%)
17:11:03:WU01:FS00:0xa7:Completed 27500 out of 250000 steps (11%)
17:11:26:WU01:FS00:0xa7:Completed 30000 out of 250000 steps (12%)
17:11:48:WU01:FS00:0xa7:Completed 32500 out of 250000 steps (13%)
17:12:10:WU01:FS00:0xa7:Completed 35000 out of 250000 steps (14%)
17:12:32:WU01:FS00:0xa7:Completed 37500 out of 250000 steps (15%)
17:12:53:WU01:FS00:0xa7:Completed 40000 out of 250000 steps (16%)
17:13:16:WU01:FS00:0xa7:Completed 42500 out of 250000 steps (17%)
17:13:38:WU01:FS00:0xa7:Completed 45000 out of 250000 steps (18%)
17:14:00:WU01:FS00:0xa7:Completed 47500 out of 250000 steps (19%)
17:14:24:WU01:FS00:0xa7:Completed 50000 out of 250000 steps (20%)
17:14:47:WU01:FS00:0xa7:Completed 52500 out of 250000 steps (21%)
17:15:11:WU01:FS00:0xa7:Completed 55000 out of 250000 steps (22%)
17:15:34:WU01:FS00:0xa7:Completed 57500 out of 250000 steps (23%)
17:15:58:WU01:FS00:0xa7:Completed 60000 out of 250000 steps (24%)
17:16:22:WU01:FS00:0xa7:Completed 62500 out of 250000 steps (25%)
17:16:45:WU01:FS00:0xa7:Completed 65000 out of 250000 steps (26%)
17:17:10:WU01:FS00:0xa7:Completed 67500 out of 250000 steps (27%)
17:17:34:WU01:FS00:0xa7:Completed 70000 out of 250000 steps (28%)
17:17:57:WU01:FS00:0xa7:Completed 72500 out of 250000 steps (29%)
17:18:20:WU01:FS00:0xa7:Completed 75000 out of 250000 steps (30%)
17:18:44:WU01:FS00:0xa7:Completed 77500 out of 250000 steps (31%)
17:19:09:WU01:FS00:0xa7:Completed 80000 out of 250000 steps (32%)
17:19:33:WU01:FS00:0xa7:Completed 82500 out of 250000 steps (33%)
17:20:00:WU01:FS00:0xa7:Completed 85000 out of 250000 steps (34%)
17:20:26:WU01:FS00:0xa7:Completed 87500 out of 250000 steps (35%)
17:20:49:WU01:FS00:0xa7:Completed 90000 out of 250000 steps (36%)
17:21:16:WU01:FS00:0xa7:Completed 92500 out of 250000 steps (37%)
17:21:43:WU01:FS00:0xa7:Completed 95000 out of 250000 steps (38%)
17:22:07:WU01:FS00:0xa7:Completed 97500 out of 250000 steps (39%)
17:22:31:WU01:FS00:0xa7:Completed 100000 out of 250000 steps (40%)
17:22:55:WU01:FS00:0xa7:Completed 102500 out of 250000 steps (41%)
17:23:20:WU01:FS00:0xa7:Completed 105000 out of 250000 steps (42%)
17:23:46:WU01:FS00:0xa7:Completed 107500 out of 250000 steps (43%)
17:24:12:WU01:FS00:0xa7:Completed 110000 out of 250000 steps (44%)
17:24:38:WU01:FS00:0xa7:Completed 112500 out of 250000 steps (45%)
17:25:04:WU01:FS00:0xa7:Completed 115000 out of 250000 steps (46%)
17:25:26:WU01:FS00:0xa7:Completed 117500 out of 250000 steps (47%)
17:25:53:WU01:FS00:0xa7:Completed 120000 out of 250000 steps (48%)
17:26:18:WU01:FS00:0xa7:Completed 122500 out of 250000 steps (49%)
17:26:40:WU01:FS00:0xa7:Completed 125000 out of 250000 steps (50%)
17:27:02:WU01:FS00:0xa7:Completed 127500 out of 250000 steps (51%)
17:27:23:WU01:FS00:0xa7:Completed 130000 out of 250000 steps (52%)
17:27:45:WU01:FS00:0xa7:Completed 132500 out of 250000 steps (53%)
17:28:08:WU01:FS00:0xa7:Completed 135000 out of 250000 steps (54%)
17:28:30:WU01:FS00:0xa7:Completed 137500 out of 250000 steps (55%)
17:28:53:WU01:FS00:0xa7:Completed 140000 out of 250000 steps (56%)
17:29:16:WU01:FS00:0xa7:Completed 142500 out of 250000 steps (57%)
17:29:39:WU01:FS00:0xa7:Completed 145000 out of 250000 steps (58%)
17:30:02:WU01:FS00:0xa7:Completed 147500 out of 250000 steps (59%)
17:30:26:WU01:FS00:0xa7:Completed 150000 out of 250000 steps (60%)
17:30:51:WU01:FS00:0xa7:Completed 152500 out of 250000 steps (61%)
17:31:14:WU01:FS00:0xa7:Completed 155000 out of 250000 steps (62%)
17:31:38:WU01:FS00:0xa7:Completed 157500 out of 250000 steps (63%)
17:32:03:WU01:FS00:0xa7:Completed 160000 out of 250000 steps (64%)
17:32:28:WU01:FS00:0xa7:Completed 162500 out of 250000 steps (65%)
17:32:52:WU01:FS00:0xa7:Completed 165000 out of 250000 steps (66%)
17:33:15:WU01:FS00:0xa7:Completed 167500 out of 250000 steps (67%)
17:33:37:WU01:FS00:0xa7:Completed 170000 out of 250000 steps (68%)
17:33:58:WU01:FS00:0xa7:Completed 172500 out of 250000 steps (69%)
17:34:19:WU01:FS00:0xa7:Completed 175000 out of 250000 steps (70%)
17:34:42:WU01:FS00:0xa7:Completed 177500 out of 250000 steps (71%)
17:35:04:WU01:FS00:0xa7:Completed 180000 out of 250000 steps (72%)
17:35:26:WU01:FS00:0xa7:Completed 182500 out of 250000 steps (73%)
17:35:49:WU01:FS00:0xa7:Completed 185000 out of 250000 steps (74%)
17:36:13:WU01:FS00:0xa7:Completed 187500 out of 250000 steps (75%)
17:36:35:WU01:FS00:0xa7:Completed 190000 out of 250000 steps (76%)
17:36:56:WU01:FS00:0xa7:Completed 192500 out of 250000 steps (77%)
17:37:18:WU01:FS00:0xa7:Completed 195000 out of 250000 steps (78%)
17:37:40:WU01:FS00:0xa7:Completed 197500 out of 250000 steps (79%)
17:38:01:WU01:FS00:0xa7:Completed 200000 out of 250000 steps (80%)
17:38:22:WU01:FS00:0xa7:Completed 202500 out of 250000 steps (81%)
17:38:44:WU01:FS00:0xa7:Completed 205000 out of 250000 steps (82%)
17:39:06:WU01:FS00:0xa7:Completed 207500 out of 250000 steps (83%)
17:39:27:WU01:FS00:0xa7:Completed 210000 out of 250000 steps (84%)
17:39:49:WU01:FS00:0xa7:Completed 212500 out of 250000 steps (85%)
17:40:11:WU01:FS00:0xa7:Completed 215000 out of 250000 steps (86%)
17:40:33:WU01:FS00:0xa7:Completed 217500 out of 250000 steps (87%)
17:40:55:WU01:FS00:0xa7:Completed 220000 out of 250000 steps (88%)
17:41:17:WU01:FS00:0xa7:Completed 222500 out of 250000 steps (89%)
17:41:39:WU01:FS00:0xa7:Completed 225000 out of 250000 steps (90%)
17:42:01:WU01:FS00:0xa7:Completed 227500 out of 250000 steps (91%)
17:42:23:WU01:FS00:0xa7:Completed 230000 out of 250000 steps (92%)
17:42:45:WU01:FS00:0xa7:Completed 232500 out of 250000 steps (93%)
17:43:08:WU01:FS00:0xa7:Completed 235000 out of 250000 steps (94%)
17:43:31:WU01:FS00:0xa7:Completed 237500 out of 250000 steps (95%)
17:43:54:WU01:FS00:0xa7:Completed 240000 out of 250000 steps (96%)
17:44:17:WU01:FS00:0xa7:Completed 242500 out of 250000 steps (97%)
17:44:40:WU01:FS00:0xa7:Completed 245000 out of 250000 steps (98%)
17:45:03:WU01:FS00:0xa7:Completed 247500 out of 250000 steps (99%)
17:45:27:WU01:FS00:0xa7:Completed 250000 out of 250000 steps (100%)
17:45:28:WU00:FS00:Connecting to assign1.foldingathome.org:80
17:45:29:WU00:FS00:Assigned to work server 3.21.157.11
17:45:29:WU00:FS00:Requesting new work unit for slot 00: RUNNING cpu:48 from 3.21.157.11
17:45:29:WU00:FS00:Connecting to 3.21.157.11:8080
17:45:29:WU01:FS00:0xa7:Saving result file ../logfile_01.txt
17:45:29:WU01:FS00:0xa7:Saving result file dhdl.xvg
17:45:29:WU01:FS00:0xa7:Saving result file frame0.trr
17:45:29:WU01:FS00:0xa7:Saving result file md.log
17:45:29:WU01:FS00:0xa7:Saving result file pullf.xvg
17:45:29:WU01:FS00:0xa7:Saving result file pullx.xvg
17:45:29:WU01:FS00:0xa7:Saving result file science.log
17:45:29:WU01:FS00:0xa7:Saving result file traj_comp.xtc
17:45:29:WU01:FS00:0xa7:Folding@home Core Shutdown: FINISHED_UNIT
17:45:30:WU01:FS00:FahCore returned: FINISHED_UNIT (100 = 0x64)
17:45:30:WU01:FS00:Sending unit results: id:01 state:SEND error:NO_ERROR project:14719 run:802 clone:4 gen:0 core:0xa7 unit:0x000000022879986c5ea9670ab49b086c
17:45:30:WU01:FS00:Uploading 6.95MiB to 40.121.152.108
17:45:30:WU01:FS00:Connecting to 40.121.152.108:8080
17:45:36:WU01:FS00:Upload 80.98%
17:45:38:WU01:FS00:Upload complete
17:45:38:WU01:FS00:Server responded WORK_ACK (400)
17:45:38:WU01:FS00:Final credit estimate, 4310.00 points
17:45:38:WU01:FS00:Cleaning up