My nvidia graphic card keeps failing FAH

It seems that a lot of GPU problems revolve around specific versions of drivers. Though NVidia has their own support structure, you can often learn from information reported by others who fold.

Moderators: Site Moderators, FAHC Science Team

Post Reply
jayman
Posts: 5
Joined: Sun May 09, 2021 8:43 am

My nvidia graphic card keeps failing FAH

Post by jayman »

My nvidia graphic card keeps failing FAH...any idea how to fix

Code: Select all

07:29:32:WU02:FS02:0x22:  opencl-device 0 specified
07:29:32:WU02:FS02:0x22:Platform 3: CUDA
07:29:32:WU02:FS02:0x22:  cuda-device 0 specified
07:29:38:WU01:FS02:Upload 33.18%
07:29:44:WU01:FS02:Upload 37.67%
07:29:46:WU02:FS02:0x22:Attempting to create CUDA context:
07:29:46:WU02:FS02:0x22:  Configuring platform CUDA
07:29:50:WU01:FS02:Upload 43.20%
07:29:50:WU02:FS02:0x22:  Using CUDA and gpu 0
07:29:50:WU02:FS02:0x22:Completed 0 out of 750000 steps (0%)
07:29:52:WU02:FS02:0x22:Checkpoint completed at step 0
07:29:56:WU01:FS02:Upload 49.42%
07:30:02:WU01:FS02:Upload 55.30%
07:30:08:WU01:FS02:Upload 60.14%
07:30:14:WU01:FS02:Upload 65.32%
07:30:20:WU01:FS02:Upload 70.16%
07:30:26:WU01:FS02:Upload 75.00%
07:30:32:WU01:FS02:Upload 79.15%
07:30:38:WU01:FS02:Upload 84.33%
07:30:44:WU01:FS02:Upload 90.21%
07:30:50:WU01:FS02:Upload 92.97%
07:30:56:WU01:FS02:Upload 97.12%
07:30:59:WU01:FS02:Upload complete
07:30:59:WU01:FS02:Server responded WORK_ACK (400)
07:30:59:WU01:FS02:Cleaning up
07:31:33:WU02:FS02:0x22:Completed 7500 out of 750000 steps (1%)
07:33:15:WU02:FS02:0x22:Completed 15000 out of 750000 steps (2%)
07:33:17:WU02:FS02:0x22:Checkpoint completed at step 15000
07:34:59:WU02:FS02:0x22:Completed 22500 out of 750000 steps (3%)
07:36:42:WU02:FS02:0x22:An exception occurred at step 29617: Particle coordinate is nan
07:36:42:WU02:FS02:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
07:36:42:WU02:FS02:0x22:Folding@home Core Shutdown: CORE_RESTART
07:36:43:WARNING:WU02:FS02:FahCore returned: CORE_RESTART (98 = 0x62)
07:36:43:WU02:FS02:Starting
07:36:43:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:\Users\Red Mining Ship\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe" -dir 02 -suffix 01 -version 706 -lifeline 15840 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
07:36:43:WU02:FS02:Started FahCore on PID 1748
07:36:43:WU02:FS02:Core PID:15608
07:36:43:WU02:FS02:FahCore 0x22 started
07:36:43:WU02:FS02:0x22:*********************** Log Started 2021-05-09T07:36:43Z ***********************
07:36:43:WU02:FS02:0x22:*************************** Core22 Folding@home Core ***************************
07:36:43:WU02:FS02:0x22:       Core: Core22
07:36:43:WU02:FS02:0x22:       Type: 0x22
07:36:43:WU02:FS02:0x22:    Version: 0.0.13
07:36:43:WU02:FS02:0x22:     Author: Joseph Coffland <[email protected]>
07:36:43:WU02:FS02:0x22:  Copyright: 2020 foldingathome.org
07:36:43:WU02:FS02:0x22:   Homepage: https://foldingathome.org/
07:36:43:WU02:FS02:0x22:       Date: Sep 19 2020
07:36:43:WU02:FS02:0x22:       Time: 02:35:58
07:36:43:WU02:FS02:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
07:36:43:WU02:FS02:0x22:     Branch: core22-0.0.13
07:36:44:WU02:FS02:0x22:   Compiler: Visual C++ 2015
07:36:44:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:36:44:WU02:FS02:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
07:36:44:WU02:FS02:0x22:   Platform: win32 10
07:36:44:WU02:FS02:0x22:       Bits: 64
07:36:44:WU02:FS02:0x22:       Mode: Release
07:36:44:WU02:FS02:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
07:36:44:WU02:FS02:0x22:             <[email protected]>
07:36:44:WU02:FS02:0x22:       Args: -dir 02 -suffix 01 -version 706 -lifeline 1748 -checkpoint 15
07:36:44:WU02:FS02:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
07:36:44:WU02:FS02:0x22:             0 -gpu 0
07:36:44:WU02:FS02:0x22:************************************ libFAH ************************************
07:36:44:WU02:FS02:0x22:       Date: Sep 7 2020
07:36:44:WU02:FS02:0x22:       Time: 19:09:56
07:36:44:WU02:FS02:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
07:36:44:WU02:FS02:0x22:     Branch: HEAD
07:36:44:WU02:FS02:0x22:   Compiler: Visual C++ 2015
07:36:44:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:36:44:WU02:FS02:0x22:   Platform: win32 10
07:36:44:WU02:FS02:0x22:       Bits: 64
07:36:44:WU02:FS02:0x22:       Mode: Release
07:36:44:WU02:FS02:0x22:************************************ CBang *************************************
07:36:44:WU02:FS02:0x22:       Date: Sep 7 2020
07:36:44:WU02:FS02:0x22:       Time: 19:08:30
07:36:44:WU02:FS02:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
07:36:44:WU02:FS02:0x22:     Branch: HEAD
07:36:44:WU02:FS02:0x22:   Compiler: Visual C++ 2015
07:36:44:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:36:44:WU02:FS02:0x22:   Platform: win32 10
07:36:44:WU02:FS02:0x22:       Bits: 64
07:36:44:WU02:FS02:0x22:       Mode: Release
07:36:44:WU02:FS02:0x22:************************************ System ************************************
07:36:44:WU02:FS02:0x22:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
07:36:44:WU02:FS02:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
07:36:44:WU02:FS02:0x22:       CPUs: 12
07:36:44:WU02:FS02:0x22:     Memory: 15.87GiB
07:36:44:WU02:FS02:0x22:Free Memory: 11.57GiB
07:36:44:WU02:FS02:0x22:    Threads: WINDOWS_THREADS
07:36:44:WU02:FS02:0x22: OS Version: 6.2
07:36:44:WU02:FS02:0x22:Has Battery: false
07:36:44:WU02:FS02:0x22: On Battery: false
07:36:44:WU02:FS02:0x22: UTC Offset: 1
07:36:44:WU02:FS02:0x22:        PID: 15608
07:36:44:WU02:FS02:0x22:        CWD: C:\Users\Red Mining Ship\AppData\Roaming\FAHClient\work
07:36:44:WU02:FS02:0x22:************************************ OpenMM ************************************
07:36:44:WU02:FS02:0x22:   Revision: 189320d0
07:36:44:WU02:FS02:0x22:********************************************************************************
07:36:44:WU02:FS02:0x22:Project: 17343 (Run 2, Clone 592, Gen 44)
07:36:44:WU02:FS02:0x22:Unit: 0x00000000000000000000000000000000
07:36:44:WU02:FS02:0x22:Digital signatures verified
07:36:44:WU02:FS02:0x22:Folding@home GPU Core22 Folding@home Core
07:36:44:WU02:FS02:0x22:Version 0.0.13
07:36:44:WU02:FS02:0x22:  Checkpoint write interval: 15000 steps (2%) [50 total]
07:36:44:WU02:FS02:0x22:  JSON viewer frame write interval: 7500 steps (1%) [100 total]
07:36:44:WU02:FS02:0x22:  XTC frame write interval: 250000 steps (33%) [3 total]
07:36:44:WU02:FS02:0x22:  Global context and integrator variables write interval: disabled
07:36:44:WU02:FS02:0x22:There are 4 platforms available.
07:36:44:WU02:FS02:0x22:Platform 0: Reference
07:36:44:WU02:FS02:0x22:Platform 1: CPU
07:36:44:WU02:FS02:0x22:Platform 2: OpenCL
07:36:44:WU02:FS02:0x22:  opencl-device 0 specified
07:36:44:WU02:FS02:0x22:Platform 3: CUDA
07:36:44:WU02:FS02:0x22:  cuda-device 0 specified
07:36:57:WU02:FS02:0x22:Attempting to create CUDA context:
07:36:57:WU02:FS02:0x22:  Configuring platform CUDA
07:37:01:WU02:FS02:0x22:  Using CUDA and gpu 0
07:37:02:WU02:FS02:0x22:Completed 15000 out of 750000 steps (2%)
07:38:43:WU02:FS02:0x22:Completed 22500 out of 750000 steps (3%)
07:40:25:WU02:FS02:0x22:Completed 30000 out of 750000 steps (4%)
07:40:27:WU02:FS02:0x22:Checkpoint completed at step 30000
07:41:09:WU02:FS02:0x22:An exception occurred at step 32629: Particle coordinate is nan
07:41:09:WU02:FS02:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
07:41:09:WU02:FS02:0x22:Folding@home Core Shutdown: CORE_RESTART
07:41:10:WARNING:WU02:FS02:FahCore returned: CORE_RESTART (98 = 0x62)
07:41:10:WU02:FS02:Starting
07:41:10:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:\Users\Red Mining Ship\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe" -dir 02 -suffix 01 -version 706 -lifeline 15840 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
07:41:10:WU02:FS02:Started FahCore on PID 3928
07:41:10:WU02:FS02:Core PID:10664
07:41:10:WU02:FS02:FahCore 0x22 started
07:41:11:WU02:FS02:0x22:*********************** Log Started 2021-05-09T07:41:10Z ***********************
07:41:11:WU02:FS02:0x22:*************************** Core22 Folding@home Core ***************************
07:41:11:WU02:FS02:0x22:       Core: Core22
07:41:11:WU02:FS02:0x22:       Type: 0x22
07:41:11:WU02:FS02:0x22:    Version: 0.0.13
07:41:11:WU02:FS02:0x22:     Author: Joseph Coffland <[email protected]>
07:41:11:WU02:FS02:0x22:  Copyright: 2020 foldingathome.org
07:41:11:WU02:FS02:0x22:   Homepage: https://foldingathome.org/
07:41:11:WU02:FS02:0x22:       Date: Sep 19 2020
07:41:11:WU02:FS02:0x22:       Time: 02:35:58
07:41:11:WU02:FS02:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
07:41:11:WU02:FS02:0x22:     Branch: core22-0.0.13
07:41:11:WU02:FS02:0x22:   Compiler: Visual C++ 2015
07:41:11:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:41:11:WU02:FS02:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
07:41:11:WU02:FS02:0x22:   Platform: win32 10
07:41:11:WU02:FS02:0x22:       Bits: 64
07:41:11:WU02:FS02:0x22:       Mode: Release
07:41:11:WU02:FS02:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
07:41:11:WU02:FS02:0x22:             <[email protected]>
07:41:11:WU02:FS02:0x22:       Args: -dir 02 -suffix 01 -version 706 -lifeline 3928 -checkpoint 15
07:41:11:WU02:FS02:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
07:41:11:WU02:FS02:0x22:             0 -gpu 0
07:41:11:WU02:FS02:0x22:************************************ libFAH ************************************
07:41:11:WU02:FS02:0x22:       Date: Sep 7 2020
07:41:11:WU02:FS02:0x22:       Time: 19:09:56
07:41:11:WU02:FS02:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
07:41:11:WU02:FS02:0x22:     Branch: HEAD
07:41:11:WU02:FS02:0x22:   Compiler: Visual C++ 2015
07:41:11:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:41:11:WU02:FS02:0x22:   Platform: win32 10
07:41:11:WU02:FS02:0x22:       Bits: 64
07:41:11:WU02:FS02:0x22:       Mode: Release
07:41:11:WU02:FS02:0x22:************************************ CBang *************************************
07:41:11:WU02:FS02:0x22:       Date: Sep 7 2020
07:41:11:WU02:FS02:0x22:       Time: 19:08:30
07:41:11:WU02:FS02:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
07:41:11:WU02:FS02:0x22:     Branch: HEAD
07:41:11:WU02:FS02:0x22:   Compiler: Visual C++ 2015
07:41:11:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:41:11:WU02:FS02:0x22:   Platform: win32 10
07:41:11:WU02:FS02:0x22:       Bits: 64
07:41:11:WU02:FS02:0x22:       Mode: Release
07:41:11:WU02:FS02:0x22:************************************ System ************************************
07:41:11:WU02:FS02:0x22:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
07:41:11:WU02:FS02:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
07:41:11:WU02:FS02:0x22:       CPUs: 12
07:41:11:WU02:FS02:0x22:     Memory: 15.87GiB
07:41:11:WU02:FS02:0x22:Free Memory: 11.55GiB
07:41:11:WU02:FS02:0x22:    Threads: WINDOWS_THREADS
07:41:11:WU02:FS02:0x22: OS Version: 6.2
07:41:11:WU02:FS02:0x22:Has Battery: false
07:41:11:WU02:FS02:0x22: On Battery: false
07:41:11:WU02:FS02:0x22: UTC Offset: 1
07:41:11:WU02:FS02:0x22:        PID: 10664
07:41:11:WU02:FS02:0x22:        CWD: C:\Users\Red Mining Ship\AppData\Roaming\FAHClient\work
07:41:11:WU02:FS02:0x22:************************************ OpenMM ************************************
07:41:11:WU02:FS02:0x22:   Revision: 189320d0
07:41:11:WU02:FS02:0x22:********************************************************************************
07:41:11:WU02:FS02:0x22:Project: 17343 (Run 2, Clone 592, Gen 44)
07:41:11:WU02:FS02:0x22:Unit: 0x00000000000000000000000000000000
07:41:11:WU02:FS02:0x22:Digital signatures verified
07:41:11:WU02:FS02:0x22:Folding@home GPU Core22 Folding@home Core
07:41:11:WU02:FS02:0x22:Version 0.0.13
07:41:11:WU02:FS02:0x22:  Checkpoint write interval: 15000 steps (2%) [50 total]
07:41:11:WU02:FS02:0x22:  JSON viewer frame write interval: 7500 steps (1%) [100 total]
07:41:11:WU02:FS02:0x22:  XTC frame write interval: 250000 steps (33%) [3 total]
07:41:11:WU02:FS02:0x22:  Global context and integrator variables write interval: disabled
07:41:11:WU02:FS02:0x22:There are 4 platforms available.
07:41:11:WU02:FS02:0x22:Platform 0: Reference
07:41:11:WU02:FS02:0x22:Platform 1: CPU
07:41:11:WU02:FS02:0x22:Platform 2: OpenCL
07:41:11:WU02:FS02:0x22:  opencl-device 0 specified
07:41:11:WU02:FS02:0x22:Platform 3: CUDA
07:41:11:WU02:FS02:0x22:  cuda-device 0 specified
07:41:24:WU02:FS02:0x22:Attempting to create CUDA context:
07:41:24:WU02:FS02:0x22:  Configuring platform CUDA
07:41:29:WU02:FS02:0x22:  Using CUDA and gpu 0
07:41:29:WU02:FS02:0x22:Completed 30000 out of 750000 steps (4%)
07:41:42:WU02:FS02:0x22:An exception occurred at step 30621: Particle coordinate is nan
07:41:42:WU02:FS02:0x22:Max number of attempts to resume from last checkpoint (2) reached. Aborting.
07:41:42:WU02:FS02:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
07:41:42:WU02:FS02:0x22:Saving result file ..\logfile_01.txt
07:41:42:WU02:FS02:0x22:Saving result file science.log
07:41:42:WU02:FS02:0x22:Saving result file state.xml.bz2
07:41:42:WU02:FS02:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
07:41:42:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
07:41:42:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:17343 run:2 clone:592 gen:44 core:0x22 unit:0x000002500000002c000043bf00000002
07:41:42:WU02:FS02:Uploading 18.09MiB to 140.163.4.200
07:41:42:WU02:FS02:Connecting to 140.163.4.200:8080
07:41:43:WU01:FS02:Connecting to assign1.foldingathome.org:80
07:41:43:WU01:FS02:Assigned to work server 140.163.4.200
07:41:43:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GP104 [GeForce GTX 1080] 8873 from 140.163.4.200
07:41:43:WU01:FS02:Connecting to 140.163.4.200:8080
07:41:47:WU01:FS02:Downloading 20.25MiB
07:41:48:WU02:FS02:Upload 2.42%
07:41:53:WU01:FS02:Download 7.72%
07:41:54:WU02:FS02:Upload 7.26%
07:41:59:WU01:FS02:Download 19.14%
07:42:00:WU02:FS02:Upload 13.13%
07:42:05:WU01:FS02:Download 29.32%
07:42:06:WU02:FS02:Upload 20.73%
07:42:11:WU01:FS02:Download 39.20%
07:42:12:WU02:FS02:Upload 26.95%
07:42:17:WU01:FS02:Download 47.53%
07:42:18:WU02:FS02:Upload 32.48%
07:42:23:WU01:FS02:Download 61.12%
07:42:24:WU02:FS02:Upload 37.67%
07:42:29:WU01:FS02:Download 79.64%
07:42:30:WU02:FS02:Upload 44.58%
07:42:35:WU01:FS02:Download 87.35%
07:42:36:WU02:FS02:Upload 51.83%
07:42:41:WU01:FS02:Download 93.83%
07:42:42:WU02:FS02:Upload 57.71%
07:42:45:WU01:FS02:Download complete
07:42:45:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:17341 run:1 clone:819 gen:23 core:0x22 unit:0x0000033300000017000043bd00000001
07:42:45:WU01:FS02:Starting
07:42:45:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:\Users\Red Mining Ship\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe" -dir 01 -suffix 01 -version 706 -lifeline 15840 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
07:42:45:WU01:FS02:Started FahCore on PID 16476
07:42:45:WU01:FS02:Core PID:16008
07:42:45:WU01:FS02:FahCore 0x22 started
07:42:46:WU01:FS02:0x22:*********************** Log Started 2021-05-09T07:42:45Z ***********************
07:42:46:WU01:FS02:0x22:*************************** Core22 Folding@home Core ***************************
07:42:46:WU01:FS02:0x22:       Core: Core22
07:42:46:WU01:FS02:0x22:       Type: 0x22
07:42:46:WU01:FS02:0x22:    Version: 0.0.13
07:42:46:WU01:FS02:0x22:     Author: Joseph Coffland <[email protected]>
07:42:46:WU01:FS02:0x22:  Copyright: 2020 foldingathome.org
07:42:46:WU01:FS02:0x22:   Homepage: https://foldingathome.org/
07:42:46:WU01:FS02:0x22:       Date: Sep 19 2020
07:42:46:WU01:FS02:0x22:       Time: 02:35:58
07:42:46:WU01:FS02:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
07:42:46:WU01:FS02:0x22:     Branch: core22-0.0.13
07:42:46:WU01:FS02:0x22:   Compiler: Visual C++ 2015
07:42:46:WU01:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:42:46:WU01:FS02:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
07:42:46:WU01:FS02:0x22:   Platform: win32 10
07:42:46:WU01:FS02:0x22:       Bits: 64
07:42:46:WU01:FS02:0x22:       Mode: Release
07:42:46:WU01:FS02:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
07:42:46:WU01:FS02:0x22:             <[email protected]>
07:42:46:WU01:FS02:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 16476 -checkpoint 15
07:42:46:WU01:FS02:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
07:42:46:WU01:FS02:0x22:             0 -gpu 0
07:42:46:WU01:FS02:0x22:************************************ libFAH ************************************
07:42:46:WU01:FS02:0x22:       Date: Sep 7 2020
07:42:46:WU01:FS02:0x22:       Time: 19:09:56
07:42:46:WU01:FS02:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
07:42:46:WU01:FS02:0x22:     Branch: HEAD
07:42:46:WU01:FS02:0x22:   Compiler: Visual C++ 2015
07:42:46:WU01:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:42:46:WU01:FS02:0x22:   Platform: win32 10
07:42:46:WU01:FS02:0x22:       Bits: 64
07:42:46:WU01:FS02:0x22:       Mode: Release
07:42:46:WU01:FS02:0x22:************************************ CBang *************************************
07:42:46:WU01:FS02:0x22:       Date: Sep 7 2020
07:42:46:WU01:FS02:0x22:       Time: 19:08:30
07:42:46:WU01:FS02:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
07:42:46:WU01:FS02:0x22:     Branch: HEAD
07:42:46:WU01:FS02:0x22:   Compiler: Visual C++ 2015
07:42:46:WU01:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:42:46:WU01:FS02:0x22:   Platform: win32 10
07:42:46:WU01:FS02:0x22:       Bits: 64
07:42:46:WU01:FS02:0x22:       Mode: Release
07:42:46:WU01:FS02:0x22:************************************ System ************************************
07:42:46:WU01:FS02:0x22:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
07:42:46:WU01:FS02:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
07:42:46:WU01:FS02:0x22:       CPUs: 12
07:42:46:WU01:FS02:0x22:     Memory: 15.87GiB
07:42:46:WU01:FS02:0x22:Free Memory: 11.56GiB
07:42:46:WU01:FS02:0x22:    Threads: WINDOWS_THREADS
07:42:46:WU01:FS02:0x22: OS Version: 6.2
07:42:46:WU01:FS02:0x22:Has Battery: false
07:42:46:WU01:FS02:0x22: On Battery: false
07:42:46:WU01:FS02:0x22: UTC Offset: 1
07:42:46:WU01:FS02:0x22:        PID: 16008
07:42:46:WU01:FS02:0x22:        CWD: C:\Users\Red Mining Ship\AppData\Roaming\FAHClient\work
07:42:46:WU01:FS02:0x22:************************************ OpenMM ************************************
07:42:46:WU01:FS02:0x22:   Revision: 189320d0
07:42:46:WU01:FS02:0x22:********************************************************************************
07:42:46:WU01:FS02:0x22:Project: 17341 (Run 1, Clone 819, Gen 23)
07:42:46:WU01:FS02:0x22:Unit: 0x00000000000000000000000000000000
07:42:46:WU01:FS02:0x22:Reading tar file core.xml
07:42:46:WU01:FS02:0x22:Reading tar file integrator.xml.bz2
07:42:46:WU01:FS02:0x22:Reading tar file state.xml.bz2
07:42:46:WU01:FS02:0x22:Reading tar file system.xml.bz2
07:42:46:WU01:FS02:0x22:Digital signatures verified
07:42:46:WU01:FS02:0x22:Folding@home GPU Core22 Folding@home Core
07:42:46:WU01:FS02:0x22:Version 0.0.13
07:42:46:WU01:FS02:0x22:  Checkpoint write interval: 15000 steps (2%) [50 total]
07:42:46:WU01:FS02:0x22:  JSON viewer frame write interval: 7500 steps (1%) [100 total]
07:42:46:WU01:FS02:0x22:  XTC frame write interval: 250000 steps (33%) [3 total]
07:42:46:WU01:FS02:0x22:  Global context and integrator variables write interval: disabled
07:42:46:WU01:FS02:0x22:There are 4 platforms available.
07:42:46:WU01:FS02:0x22:Platform 0: Reference
07:42:46:WU01:FS02:0x22:Platform 1: CPU
07:42:46:WU01:FS02:0x22:Platform 2: OpenCL
07:42:46:WU01:FS02:0x22:  opencl-device 0 specified
07:42:46:WU01:FS02:0x22:Platform 3: CUDA
07:42:46:WU01:FS02:0x22:  cuda-device 0 specified
07:42:48:WU02:FS02:Upload 64.27%
07:42:54:WU02:FS02:Upload 68.77%
07:43:00:WU01:FS02:0x22:Attempting to create CUDA context:
07:43:00:WU01:FS02:0x22:  Configuring platform CUDA
07:43:00:WU02:FS02:Upload 74.64%
07:43:05:WU01:FS02:0x22:  Using CUDA and gpu 0
07:43:05:WU01:FS02:0x22:Completed 0 out of 750000 steps (0%)
07:43:06:WU02:FS02:Upload 83.28%
07:43:06:WU01:FS02:0x22:Checkpoint completed at step 0
07:43:12:WU02:FS02:Upload 90.88%
07:43:18:WU02:FS02:Upload 96.41%
07:43:22:WU02:FS02:Upload complete
07:43:23:WU02:FS02:Server responded WORK_ACK (400)
07:43:23:WU02:FS02:Cleaning up
07:43:46:WU01:FS02:0x22:An exception occurred at step 2258: Particle coordinate is nan
07:43:46:WU01:FS02:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
07:43:46:WU01:FS02:0x22:Folding@home Core Shutdown: CORE_RESTART
07:43:47:WARNING:WU01:FS02:FahCore returned: CORE_RESTART (98 = 0x62)
07:43:47:WU01:FS02:Starting
07:43:47:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:\Users\Red Mining Ship\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe" -dir 01 -suffix 01 -version 706 -lifeline 15840 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
07:43:47:WU01:FS02:Started FahCore on PID 3096
07:43:47:WU01:FS02:Core PID:7552
07:43:47:WU01:FS02:FahCore 0x22 started
07:43:48:WU01:FS02:0x22:*********************** Log Started 2021-05-09T07:43:47Z ***********************
07:43:48:WU01:FS02:0x22:*************************** Core22 Folding@home Core ***************************
07:43:48:WU01:FS02:0x22:       Core: Core22
07:43:48:WU01:FS02:0x22:       Type: 0x22
07:43:48:WU01:FS02:0x22:    Version: 0.0.13
07:43:48:WU01:FS02:0x22:     Author: Joseph Coffland <[email protected]>
07:43:48:WU01:FS02:0x22:  Copyright: 2020 foldingathome.org
07:43:48:WU01:FS02:0x22:   Homepage: https://foldingathome.org/
07:43:48:WU01:FS02:0x22:       Date: Sep 19 2020
07:43:48:WU01:FS02:0x22:       Time: 02:35:58
07:43:48:WU01:FS02:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
07:43:48:WU01:FS02:0x22:     Branch: core22-0.0.13
07:43:48:WU01:FS02:0x22:   Compiler: Visual C++ 2015
07:43:48:WU01:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:43:48:WU01:FS02:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
07:43:48:WU01:FS02:0x22:   Platform: win32 10
07:43:48:WU01:FS02:0x22:       Bits: 64
07:43:48:WU01:FS02:0x22:       Mode: Release
07:43:48:WU01:FS02:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
07:43:48:WU01:FS02:0x22:             <[email protected]>
07:43:48:WU01:FS02:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 3096 -checkpoint 15
07:43:48:WU01:FS02:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
07:43:48:WU01:FS02:0x22:             0 -gpu 0
07:43:48:WU01:FS02:0x22:************************************ libFAH ************************************
07:43:48:WU01:FS02:0x22:       Date: Sep 7 2020
07:43:48:WU01:FS02:0x22:       Time: 19:09:56
07:43:48:WU01:FS02:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
07:43:48:WU01:FS02:0x22:     Branch: HEAD
07:43:48:WU01:FS02:0x22:   Compiler: Visual C++ 2015
07:43:48:WU01:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:43:48:WU01:FS02:0x22:   Platform: win32 10
07:43:48:WU01:FS02:0x22:       Bits: 64
07:43:48:WU01:FS02:0x22:       Mode: Release
07:43:48:WU01:FS02:0x22:************************************ CBang *************************************
07:43:48:WU01:FS02:0x22:       Date: Sep 7 2020
07:43:48:WU01:FS02:0x22:       Time: 19:08:30
07:43:48:WU01:FS02:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
07:43:48:WU01:FS02:0x22:     Branch: HEAD
07:43:48:WU01:FS02:0x22:   Compiler: Visual C++ 2015
07:43:48:WU01:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:43:48:WU01:FS02:0x22:   Platform: win32 10
07:43:48:WU01:FS02:0x22:       Bits: 64
07:43:48:WU01:FS02:0x22:       Mode: Release
07:43:48:WU01:FS02:0x22:************************************ System ************************************
07:43:48:WU01:FS02:0x22:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
07:43:48:WU01:FS02:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
07:43:48:WU01:FS02:0x22:       CPUs: 12
07:43:48:WU01:FS02:0x22:     Memory: 15.87GiB
07:43:48:WU01:FS02:0x22:Free Memory: 11.57GiB
07:43:48:WU01:FS02:0x22:    Threads: WINDOWS_THREADS
07:43:48:WU01:FS02:0x22: OS Version: 6.2
07:43:48:WU01:FS02:0x22:Has Battery: false
07:43:48:WU01:FS02:0x22: On Battery: false
07:43:48:WU01:FS02:0x22: UTC Offset: 1
07:43:48:WU01:FS02:0x22:        PID: 7552
07:43:48:WU01:FS02:0x22:        CWD: C:\Users\Red Mining Ship\AppData\Roaming\FAHClient\work
07:43:48:WU01:FS02:0x22:************************************ OpenMM ************************************
07:43:48:WU01:FS02:0x22:   Revision: 189320d0
07:43:48:WU01:FS02:0x22:********************************************************************************
07:43:48:WU01:FS02:0x22:Project: 17341 (Run 1, Clone 819, Gen 23)
07:43:48:WU01:FS02:0x22:Unit: 0x00000000000000000000000000000000
07:43:48:WU01:FS02:0x22:Digital signatures verified
07:43:48:WU01:FS02:0x22:Folding@home GPU Core22 Folding@home Core
07:43:48:WU01:FS02:0x22:Version 0.0.13
07:43:48:WU01:FS02:0x22:  Checkpoint write interval: 15000 steps (2%) [50 total]
07:43:48:WU01:FS02:0x22:  JSON viewer frame write interval: 7500 steps (1%) [100 total]
07:43:48:WU01:FS02:0x22:  XTC frame write interval: 250000 steps (33%) [3 total]
07:43:48:WU01:FS02:0x22:  Global context and integrator variables write interval: disabled
07:43:48:WU01:FS02:0x22:There are 4 platforms available.
07:43:48:WU01:FS02:0x22:Platform 0: Reference
07:43:48:WU01:FS02:0x22:Platform 1: CPU
07:43:48:WU01:FS02:0x22:Platform 2: OpenCL
07:43:48:WU01:FS02:0x22:  opencl-device 0 specified
07:43:48:WU01:FS02:0x22:Platform 3: CUDA
07:43:48:WU01:FS02:0x22:  cuda-device 0 specified
07:44:01:WU01:FS02:0x22:Attempting to create CUDA context:
07:44:01:WU01:FS02:0x22:  Configuring platform CUDA
07:44:05:WU01:FS02:0x22:  Using CUDA and gpu 0
07:44:05:WU01:FS02:0x22:Completed 0 out of 750000 steps (0%)
07:44:22:WU01:FS02:0x22:An exception occurred at step 1254: Particle coordinate is nan
07:44:22:WU01:FS02:0x22:Max number of attempts to resume from last checkpoint (2) reached. Aborting.
07:44:22:WU01:FS02:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
07:44:22:WU01:FS02:0x22:Saving result file ..\logfile_01.txt
07:44:22:WU01:FS02:0x22:Saving result file science.log
07:44:22:WU01:FS02:0x22:Saving result file state.xml.bz2
07:44:22:WU01:FS02:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
07:44:23:WARNING:WU01:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
07:44:23:WU01:FS02:Sending unit results: id:01 state:SEND error:FAULTY project:17341 run:1 clone:819 gen:23 core:0x22 unit:0x0000033300000017000043bd00000001
07:44:23:WU01:FS02:Uploading 18.08MiB to 140.163.4.200
07:44:23:WU01:FS02:Connecting to 140.163.4.200:8080
07:44:23:WU02:FS02:Connecting to assign1.foldingathome.org:80
07:44:24:WU02:FS02:Assigned to work server 140.163.4.200
07:44:24:WU02:FS02:Requesting new work unit for slot 02: READY gpu:1:GP104 [GeForce GTX 1080] 8873 from 140.163.4.200
07:44:24:WU02:FS02:Connecting to 140.163.4.200:8080
07:44:24:WU02:FS02:Downloading 19.02MiB
07:44:29:WU01:FS02:Upload 6.92%
07:44:30:WU02:FS02:Download 18.40%
07:44:35:WU01:FS02:Upload 13.14%
07:44:36:WU02:FS02:Download 35.16%
07:44:41:WU01:FS02:Upload 22.13%
07:44:42:WU02:FS02:Download 46.99%
07:44:47:WU01:FS02:Upload 26.62%
07:44:48:WU02:FS02:Download 62.43%
07:44:53:WU01:FS02:Upload 32.50%
07:44:54:WU02:FS02:Download 74.58%
07:44:59:WU01:FS02:Upload 37.00%
07:45:00:WU02:FS02:Download 86.74%
07:45:05:WU01:FS02:Upload 42.88%
07:45:06:WU02:FS02:Download 97.26%
07:45:07:WU02:FS02:Download complete
07:45:07:WU02:FS02:Received Unit: id:02 state:DOWNLOAD error:NO_ERROR project:17347 run:3 clone:593 gen:10 core:0x22 unit:0x000002510000000a000043c300000003
07:45:07:WU02:FS02:Starting
07:45:07:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:\Users\Red Mining Ship\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe" -dir 02 -suffix 01 -version 706 -lifeline 15840 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
07:45:07:WU02:FS02:Started FahCore on PID 13660
07:45:07:WU02:FS02:Core PID:16964
07:45:07:WU02:FS02:FahCore 0x22 started
07:45:08:WU02:FS02:0x22:*********************** Log Started 2021-05-09T07:45:07Z ***********************
07:45:08:WU02:FS02:0x22:*************************** Core22 Folding@home Core ***************************
07:45:08:WU02:FS02:0x22:       Core: Core22
07:45:08:WU02:FS02:0x22:       Type: 0x22
07:45:08:WU02:FS02:0x22:    Version: 0.0.13
07:45:08:WU02:FS02:0x22:     Author: Joseph Coffland <[email protected]>
07:45:08:WU02:FS02:0x22:  Copyright: 2020 foldingathome.org
07:45:08:WU02:FS02:0x22:   Homepage: https://foldingathome.org/
07:45:08:WU02:FS02:0x22:       Date: Sep 19 2020
07:45:08:WU02:FS02:0x22:       Time: 02:35:58
07:45:08:WU02:FS02:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
07:45:08:WU02:FS02:0x22:     Branch: core22-0.0.13
07:45:08:WU02:FS02:0x22:   Compiler: Visual C++ 2015
07:45:08:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:45:08:WU02:FS02:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
07:45:08:WU02:FS02:0x22:   Platform: win32 10
07:45:08:WU02:FS02:0x22:       Bits: 64
07:45:08:WU02:FS02:0x22:       Mode: Release
07:45:08:WU02:FS02:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
07:45:08:WU02:FS02:0x22:             <[email protected]>
07:45:08:WU02:FS02:0x22:       Args: -dir 02 -suffix 01 -version 706 -lifeline 13660 -checkpoint 15
07:45:08:WU02:FS02:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
07:45:08:WU02:FS02:0x22:             0 -gpu 0
07:45:08:WU02:FS02:0x22:************************************ libFAH ************************************
07:45:08:WU02:FS02:0x22:       Date: Sep 7 2020
07:45:08:WU02:FS02:0x22:       Time: 19:09:56
07:45:08:WU02:FS02:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
07:45:08:WU02:FS02:0x22:     Branch: HEAD
07:45:08:WU02:FS02:0x22:   Compiler: Visual C++ 2015
07:45:08:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:45:08:WU02:FS02:0x22:   Platform: win32 10
07:45:08:WU02:FS02:0x22:       Bits: 64
07:45:08:WU02:FS02:0x22:       Mode: Release
07:45:08:WU02:FS02:0x22:************************************ CBang *************************************
07:45:08:WU02:FS02:0x22:       Date: Sep 7 2020
07:45:08:WU02:FS02:0x22:       Time: 19:08:30
07:45:08:WU02:FS02:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
07:45:08:WU02:FS02:0x22:     Branch: HEAD
07:45:08:WU02:FS02:0x22:   Compiler: Visual C++ 2015
07:45:08:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:45:08:WU02:FS02:0x22:   Platform: win32 10
07:45:08:WU02:FS02:0x22:       Bits: 64
07:45:08:WU02:FS02:0x22:       Mode: Release
07:45:08:WU02:FS02:0x22:************************************ System ************************************
07:45:08:WU02:FS02:0x22:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
07:45:08:WU02:FS02:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
07:45:08:WU02:FS02:0x22:       CPUs: 12
07:45:08:WU02:FS02:0x22:     Memory: 15.87GiB
07:45:08:WU02:FS02:0x22:Free Memory: 11.56GiB
07:45:08:WU02:FS02:0x22:    Threads: WINDOWS_THREADS
07:45:08:WU02:FS02:0x22: OS Version: 6.2
07:45:08:WU02:FS02:0x22:Has Battery: false
07:45:08:WU02:FS02:0x22: On Battery: false
07:45:08:WU02:FS02:0x22: UTC Offset: 1
07:45:08:WU02:FS02:0x22:        PID: 16964
07:45:08:WU02:FS02:0x22:        CWD: C:\Users\Red Mining Ship\AppData\Roaming\FAHClient\work
07:45:08:WU02:FS02:0x22:************************************ OpenMM ************************************
07:45:08:WU02:FS02:0x22:   Revision: 189320d0
07:45:08:WU02:FS02:0x22:********************************************************************************
07:45:08:WU02:FS02:0x22:Project: 17347 (Run 3, Clone 593, Gen 10)
07:45:08:WU02:FS02:0x22:Unit: 0x00000000000000000000000000000000
07:45:08:WU02:FS02:0x22:Reading tar file core.xml
07:45:08:WU02:FS02:0x22:Reading tar file integrator.xml.bz2
07:45:08:WU02:FS02:0x22:Reading tar file state.xml.bz2
07:45:08:WU02:FS02:0x22:Reading tar file system.xml.bz2
07:45:08:WU02:FS02:0x22:Digital signatures verified
07:45:08:WU02:FS02:0x22:Folding@home GPU Core22 Folding@home Core
07:45:08:WU02:FS02:0x22:Version 0.0.13
07:45:08:WU02:FS02:0x22:  Checkpoint write interval: 15000 steps (2%) [50 total]
07:45:08:WU02:FS02:0x22:  JSON viewer frame write interval: 7500 steps (1%) [100 total]
07:45:08:WU02:FS02:0x22:  XTC frame write interval: 250000 steps (33%) [3 total]
07:45:08:WU02:FS02:0x22:  Global context and integrator variables write interval: disabled
07:45:08:WU02:FS02:0x22:There are 4 platforms available.
07:45:08:WU02:FS02:0x22:Platform 0: Reference
07:45:08:WU02:FS02:0x22:Platform 1: CPU
07:45:08:WU02:FS02:0x22:Platform 2: OpenCL
07:45:08:WU02:FS02:0x22:  opencl-device 0 specified
07:45:08:WU02:FS02:0x22:Platform 3: CUDA
07:45:08:WU02:FS02:0x22:  cuda-device 0 specified
07:45:11:WU01:FS02:Upload 50.48%
07:45:17:WU01:FS02:Upload 55.32%
07:45:21:WU02:FS02:0x22:Attempting to create CUDA context:
07:45:21:WU02:FS02:0x22:  Configuring platform CUDA
07:45:23:WU01:FS02:Upload 63.62%
07:45:25:WU02:FS02:0x22:  Using CUDA and gpu 0
07:45:25:WU02:FS02:0x22:Completed 0 out of 750000 steps (0%)
07:45:27:WU02:FS02:0x22:Checkpoint completed at step 0
07:45:29:WU01:FS02:Upload 70.19%
07:45:35:WU01:FS02:Upload 84.72%
07:45:41:WU01:FS02:Upload 88.52%
07:45:47:WU01:FS02:Upload 96.13%
07:45:50:WU01:FS02:Upload complete
07:45:51:WU01:FS02:Server responded WORK_ACK (400)
07:45:51:WU01:FS02:Cleaning up
07:47:01:WU02:FS02:0x22:Completed 7500 out of 750000 steps (1%)
07:48:36:WU02:FS02:0x22:Completed 15000 out of 750000 steps (2%)
07:48:37:WU02:FS02:0x22:Checkpoint completed at step 15000
07:50:12:WU02:FS02:0x22:Completed 22500 out of 750000 steps (3%)
07:51:20:WU02:FS02:0x22:An exception occurred at step 27107: Particle coordinate is nan
07:51:20:WU02:FS02:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
07:51:20:WU02:FS02:0x22:Folding@home Core Shutdown: CORE_RESTART
07:51:21:WARNING:WU02:FS02:FahCore returned: CORE_RESTART (98 = 0x62)
07:51:21:WU02:FS02:Starting
07:51:21:WU02:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:\Users\Red Mining Ship\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe" -dir 02 -suffix 01 -version 706 -lifeline 15840 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
07:51:21:WU02:FS02:Started FahCore on PID 11052
07:51:21:WU02:FS02:Core PID:11104
07:51:21:WU02:FS02:FahCore 0x22 started
07:51:22:WU02:FS02:0x22:*********************** Log Started 2021-05-09T07:51:21Z ***********************
07:51:22:WU02:FS02:0x22:*************************** Core22 Folding@home Core ***************************
07:51:22:WU02:FS02:0x22:       Core: Core22
07:51:22:WU02:FS02:0x22:       Type: 0x22
07:51:22:WU02:FS02:0x22:    Version: 0.0.13
07:51:22:WU02:FS02:0x22:     Author: Joseph Coffland <[email protected]>
07:51:22:WU02:FS02:0x22:  Copyright: 2020 foldingathome.org
07:51:22:WU02:FS02:0x22:   Homepage: https://foldingathome.org/
07:51:22:WU02:FS02:0x22:       Date: Sep 19 2020
07:51:22:WU02:FS02:0x22:       Time: 02:35:58
07:51:22:WU02:FS02:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
07:51:22:WU02:FS02:0x22:     Branch: core22-0.0.13
07:51:22:WU02:FS02:0x22:   Compiler: Visual C++ 2015
07:51:22:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:51:22:WU02:FS02:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
07:51:22:WU02:FS02:0x22:   Platform: win32 10
07:51:22:WU02:FS02:0x22:       Bits: 64
07:51:22:WU02:FS02:0x22:       Mode: Release
07:51:22:WU02:FS02:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
07:51:22:WU02:FS02:0x22:             <[email protected]>
07:51:22:WU02:FS02:0x22:       Args: -dir 02 -suffix 01 -version 706 -lifeline 11052 -checkpoint 15
07:51:22:WU02:FS02:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
07:51:22:WU02:FS02:0x22:             0 -gpu 0
07:51:22:WU02:FS02:0x22:************************************ libFAH ************************************
07:51:22:WU02:FS02:0x22:       Date: Sep 7 2020
07:51:22:WU02:FS02:0x22:       Time: 19:09:56
07:51:22:WU02:FS02:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
07:51:22:WU02:FS02:0x22:     Branch: HEAD
07:51:22:WU02:FS02:0x22:   Compiler: Visual C++ 2015
07:51:22:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:51:22:WU02:FS02:0x22:   Platform: win32 10
07:51:22:WU02:FS02:0x22:       Bits: 64
07:51:22:WU02:FS02:0x22:       Mode: Release
07:51:22:WU02:FS02:0x22:************************************ CBang *************************************
07:51:22:WU02:FS02:0x22:       Date: Sep 7 2020
07:51:22:WU02:FS02:0x22:       Time: 19:08:30
07:51:22:WU02:FS02:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
07:51:22:WU02:FS02:0x22:     Branch: HEAD
07:51:22:WU02:FS02:0x22:   Compiler: Visual C++ 2015
07:51:22:WU02:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:51:22:WU02:FS02:0x22:   Platform: win32 10
07:51:22:WU02:FS02:0x22:       Bits: 64
07:51:22:WU02:FS02:0x22:       Mode: Release
07:51:22:WU02:FS02:0x22:************************************ System ************************************
07:51:22:WU02:FS02:0x22:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
07:51:22:WU02:FS02:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
07:51:22:WU02:FS02:0x22:       CPUs: 12
07:51:22:WU02:FS02:0x22:     Memory: 15.87GiB
07:51:22:WU02:FS02:0x22:Free Memory: 11.55GiB
07:51:22:WU02:FS02:0x22:    Threads: WINDOWS_THREADS
07:51:22:WU02:FS02:0x22: OS Version: 6.2
07:51:22:WU02:FS02:0x22:Has Battery: false
07:51:22:WU02:FS02:0x22: On Battery: false
07:51:22:WU02:FS02:0x22: UTC Offset: 1
07:51:22:WU02:FS02:0x22:        PID: 11104
07:51:22:WU02:FS02:0x22:        CWD: C:\Users\Red Mining Ship\AppData\Roaming\FAHClient\work
07:51:22:WU02:FS02:0x22:************************************ OpenMM ************************************
07:51:22:WU02:FS02:0x22:   Revision: 189320d0
07:51:22:WU02:FS02:0x22:********************************************************************************
07:51:22:WU02:FS02:0x22:Project: 17347 (Run 3, Clone 593, Gen 10)
07:51:22:WU02:FS02:0x22:Unit: 0x00000000000000000000000000000000
07:51:22:WU02:FS02:0x22:Digital signatures verified
07:51:22:WU02:FS02:0x22:Folding@home GPU Core22 Folding@home Core
07:51:22:WU02:FS02:0x22:Version 0.0.13
07:51:22:WU02:FS02:0x22:  Checkpoint write interval: 15000 steps (2%) [50 total]
07:51:22:WU02:FS02:0x22:  JSON viewer frame write interval: 7500 steps (1%) [100 total]
07:51:22:WU02:FS02:0x22:  XTC frame write interval: 250000 steps (33%) [3 total]
07:51:22:WU02:FS02:0x22:  Global context and integrator variables write interval: disabled
07:51:22:WU02:FS02:0x22:There are 4 platforms available.
07:51:22:WU02:FS02:0x22:Platform 0: Reference
07:51:22:WU02:FS02:0x22:Platform 1: CPU
07:51:22:WU02:FS02:0x22:Platform 2: OpenCL
07:51:22:WU02:FS02:0x22:  opencl-device 0 specified
07:51:22:WU02:FS02:0x22:Platform 3: CUDA
07:51:22:WU02:FS02:0x22:  cuda-device 0 specified
07:51:35:WU02:FS02:0x22:Attempting to create CUDA context:
07:51:35:WU02:FS02:0x22:  Configuring platform CUDA
07:51:38:WU02:FS02:0x22:  Using CUDA and gpu 0
07:51:38:WU02:FS02:0x22:Completed 15000 out of 750000 steps (2%)
07:51:57:WU02:FS02:0x22:An exception occurred at step 15812: Particle coordinate is nan
07:51:57:WU02:FS02:0x22:Max number of attempts to resume from last checkpoint (2) reached. Aborting.
07:51:57:WU02:FS02:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
07:51:57:WU02:FS02:0x22:Saving result file ..\logfile_01.txt
07:51:57:WU02:FS02:0x22:Saving result file science.log
07:51:57:WU02:FS02:0x22:Saving result file state.xml.bz2
07:51:57:WU02:FS02:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
07:51:57:WARNING:WU02:FS02:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
07:51:57:WU02:FS02:Sending unit results: id:02 state:SEND error:FAULTY project:17347 run:3 clone:593 gen:10 core:0x22 unit:0x000002510000000a000043c300000003
07:51:57:WU02:FS02:Uploading 16.96MiB to 140.163.4.200
07:51:57:WU02:FS02:Connecting to 140.163.4.200:8080
07:51:58:WU01:FS02:Connecting to assign1.foldingathome.org:80
07:51:58:WU01:FS02:Assigned to work server 207.53.233.146
07:51:58:WU01:FS02:Requesting new work unit for slot 02: READY gpu:1:GP104 [GeForce GTX 1080] 8873 from 207.53.233.146
07:51:58:WU01:FS02:Connecting to 207.53.233.146:8080
07:51:58:WU01:FS02:Downloading 6.10MiB
07:52:02:WU01:FS02:Download complete
07:52:02:WU01:FS02:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:17804 run:40 clone:59 gen:7 core:0x22 unit:0x0000003b000000070000458c00000028
07:52:02:WU01:FS02:Starting
07:52:02:WU01:FS02:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" "C:\Users\Red Mining Ship\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.13/Core_22.fah/FahCore_22.exe" -dir 01 -suffix 01 -version 706 -lifeline 15840 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
07:52:02:WU01:FS02:Started FahCore on PID 8404
07:52:02:WU01:FS02:Core PID:3644
07:52:02:WU01:FS02:FahCore 0x22 started
07:52:03:WU01:FS02:0x22:*********************** Log Started 2021-05-09T07:52:02Z ***********************
07:52:03:WU01:FS02:0x22:*************************** Core22 Folding@home Core ***************************
07:52:03:WU01:FS02:0x22:       Core: Core22
07:52:03:WU01:FS02:0x22:       Type: 0x22
07:52:03:WU01:FS02:0x22:    Version: 0.0.13
07:52:03:WU01:FS02:0x22:     Author: Joseph Coffland <[email protected]>
07:52:03:WU01:FS02:0x22:  Copyright: 2020 foldingathome.org
07:52:03:WU01:FS02:0x22:   Homepage: https://foldingathome.org/
07:52:03:WU01:FS02:0x22:       Date: Sep 19 2020
07:52:03:WU01:FS02:0x22:       Time: 02:35:58
07:52:03:WU01:FS02:0x22:   Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
07:52:03:WU01:FS02:0x22:     Branch: core22-0.0.13
07:52:03:WU01:FS02:0x22:   Compiler: Visual C++ 2015
07:52:03:WU01:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:52:03:WU01:FS02:0x22:             -DOPENMM_GIT_HASH="\"189320d0\""
07:52:03:WU01:FS02:0x22:   Platform: win32 10
07:52:03:WU01:FS02:0x22:       Bits: 64
07:52:03:WU01:FS02:0x22:       Mode: Release
07:52:03:WU01:FS02:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
07:52:03:WU01:FS02:0x22:             <[email protected]>
07:52:03:WU01:FS02:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 8404 -checkpoint 15
07:52:03:WU01:FS02:0x22:             -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
07:52:03:WU01:FS02:0x22:             0 -gpu 0
07:52:03:WU01:FS02:0x22:************************************ libFAH ************************************
07:52:03:WU01:FS02:0x22:       Date: Sep 7 2020
07:52:03:WU01:FS02:0x22:       Time: 19:09:56
07:52:03:WU01:FS02:0x22:   Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
07:52:03:WU01:FS02:0x22:     Branch: HEAD
07:52:03:WU01:FS02:0x22:   Compiler: Visual C++ 2015
07:52:03:WU01:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:52:03:WU01:FS02:0x22:   Platform: win32 10
07:52:03:WU01:FS02:0x22:       Bits: 64
07:52:03:WU01:FS02:0x22:       Mode: Release
07:52:03:WU01:FS02:0x22:************************************ CBang *************************************
07:52:03:WU01:FS02:0x22:       Date: Sep 7 2020
07:52:03:WU01:FS02:0x22:       Time: 19:08:30
07:52:03:WU01:FS02:0x22:   Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
07:52:03:WU01:FS02:0x22:     Branch: HEAD
07:52:03:WU01:FS02:0x22:   Compiler: Visual C++ 2015
07:52:03:WU01:FS02:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Ob3 /Zc:throwingNew /MT
07:52:03:WU01:FS02:0x22:   Platform: win32 10
07:52:03:WU01:FS02:0x22:       Bits: 64
07:52:03:WU01:FS02:0x22:       Mode: Release
07:52:03:WU01:FS02:0x22:************************************ System ************************************
07:52:03:WU01:FS02:0x22:        CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz
07:52:03:WU01:FS02:0x22:     CPU ID: GenuineIntel Family 6 Model 158 Stepping 10
07:52:03:WU01:FS02:0x22:       CPUs: 12
07:52:03:WU01:FS02:0x22:     Memory: 15.87GiB
07:52:03:WU01:FS02:0x22:Free Memory: 11.53GiB
07:52:03:WU01:FS02:0x22:    Threads: WINDOWS_THREADS
07:52:03:WU01:FS02:0x22: OS Version: 6.2
07:52:03:WU01:FS02:0x22:Has Battery: false
07:52:03:WU01:FS02:0x22: On Battery: false
07:52:03:WU01:FS02:0x22: UTC Offset: 1
07:52:03:WU01:FS02:0x22:        PID: 3644
07:52:03:WU01:FS02:0x22:        CWD: C:\Users\Red Mining Ship\AppData\Roaming\FAHClient\work
07:52:03:WU01:FS02:0x22:************************************ OpenMM ************************************
07:52:03:WU01:FS02:0x22:   Revision: 189320d0
07:52:03:WU01:FS02:0x22:********************************************************************************
07:52:03:WU01:FS02:0x22:Project: 17804 (Run 40, Clone 59, Gen 7)
07:52:03:WU01:FS02:0x22:Unit: 0x00000000000000000000000000000000
07:52:03:WU01:FS02:0x22:Reading tar file core.xml
07:52:03:WU01:FS02:0x22:Reading tar file integrator.xml.bz2
07:52:03:WU01:FS02:0x22:Reading tar file state.xml.bz2
07:52:03:WU01:FS02:0x22:Reading tar file system.xml.bz2
07:52:03:WU01:FS02:0x22:Digital signatures verified
07:52:03:WU01:FS02:0x22:Folding@home GPU Core22 Folding@home Core
07:52:03:WU01:FS02:0x22:Version 0.0.13
07:52:03:WU01:FS02:0x22:  Checkpoint write interval: 125000 steps (5%) [20 total]
07:52:03:WU01:FS02:0x22:  JSON viewer frame write interval: 25000 steps (1%) [100 total]
07:52:03:WU01:FS02:0x22:  XTC frame write interval: 25000 steps (1%) [100 total]
07:52:03:WU01:FS02:0x22:  Global context and integrator variables write interval: disabled
07:52:03:WU01:FS02:0x22:There are 4 platforms available.
07:52:03:WU01:FS02:0x22:Platform 0: Reference
07:52:03:WU01:FS02:0x22:Platform 1: CPU
07:52:03:WU01:FS02:0x22:Platform 2: OpenCL
07:52:03:WU01:FS02:0x22:  opencl-device 0 specified
07:52:03:WU01:FS02:0x22:Platform 3: CUDA
07:52:03:WU01:FS02:0x22:  cuda-device 0 specified
07:52:03:WU02:FS02:Upload 3.32%
07:52:06:WU01:FS02:0x22:Attempting to create CUDA context:
07:52:06:WU01:FS02:0x22:  Configuring platform CUDA
07:52:09:WU02:FS02:Upload 13.27%
07:52:11:WU01:FS02:0x22:  Using CUDA and gpu 0
07:52:11:WU01:FS02:0x22:Completed 0 out of 2500000 steps (0%)
07:52:11:WU01:FS02:0x22:Checkpoint completed at step 0
07:52:15:WU02:FS02:Upload 20.27%
07:52:20:WU01:FS02:0x22:An exception occurred at step 2007: Particle coordinate is nan
07:52:20:WU01:FS02:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
07:52:20:WU01:FS02:0x22:Folding@home Core Shutdown: CORE_RESTART
07:52:21:WARNING:WU01:FS02:FahCore returned: CORE_RESTART (98 = 0x62)
07:52:21:WU02:FS02:Upload 25.07%
07:52:21:WU01:FS02:Starting
Top
JimboPalmer
Posts: 2522
Joined: Mon Feb 16, 2009 4:12 am
Location: Greenwood MS USA

Re: My nvidia graphic card keeps failing FAH

Post by JimboPalmer »

Welcome to Folding@Home!

I am just wildly guessing, for more accurate guesses you would post the first 200 lines of your log.
viewtopic.php?f=24&t=26036

If this is a desktop, it is possible your card is overclocked, many have a factory overclock. While MSI Afterburner is advertised and an over clocking tool, you can use it to underclock and see if that fixes the NotANumber problem.
https://www.msi.com/Landing/afterburner/graphics-cards

If you have a laptop, it may be overheating, or it may be a technology called Optimus which presents more issues
https://www.nvidia.com/en-us/geforce/te ... echnology/
Optimus does not use your Nvidia card by default.

So give us some detail and we will try to help
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
Top
jayman
Posts: 5
Joined: Sun May 09, 2021 8:43 am

Re: My nvidia graphic card keeps failing FAH

Post by jayman »

Hello Jimbo, I was uploading the log and ran out of lines lol, In the time since posting this morning, I think the problem is my graphic card (not overclocked), I think it has got fault when pressure is on it, even tried on a different computer and got the same problem. so sadly at the moment computer with no GPU :(
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: My nvidia graphic card keeps failing FAH

Post by bruce »

If the computer runs fine when the GPU is not folding, there's a very good chance it's a thermal problem, though Optimus is another possibility.
Top
jayman
Posts: 5
Joined: Sun May 09, 2021 8:43 am

Re: My nvidia graphic card keeps failing FAH

Post by jayman »

Hello Bruce, 95% sure it was not a thermal problem as it did not get above 60 c.

could you explain Optimus?....and how to test it
Top
JimboPalmer
Posts: 2522
Joined: Mon Feb 16, 2009 4:12 am
Location: Greenwood MS USA

Re: My nvidia graphic card keeps failing FAH

Post by JimboPalmer »

jayman wrote: could you explain Optimus?....and how to test it
So far as I know, Optimus only is on laptops, and we do not know if you have a laptop. We know very little about your rig as you declined to give us a log.

Many laptops use a built in Intel (or more rarely, AMD) embedded GPU to display the screen, but can do the screen composition on an Nvidia (or more rarely AMD) GPU chip separate from the CPU.
As a energy saver, the built in Intel chip is used until a heavy use of graphics forces a change to the NVidia ship.
F@H cannot use Intel GPUs to fold and even if it could, it cannot change GPUs in mid Work Unit. We need to switch to Nvidia before starting to fold.

A decade ago I had an Optimus laptop that had a BIOS setting, but users these days are not expected to set things in the BIOS.
More recently some folks have found a setting in the Nvidia Control Panel that forces More Performance This is a setting that will only be available with multiple GPUs so I do not have it on my PC.
At least one Folder found success making an adjustment in MSI Afterburner to the Nvidia GPU and leaving Afterburner open during folding.

Sadly I have not owned a Optimus Laptop made recently and folks I give advice to rarely give detailed explanations of what worked. All I have are these hints.
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
Top
jayman
Posts: 5
Joined: Sun May 09, 2021 8:43 am

Re: My nvidia graphic card keeps failing FAH

Post by jayman »

Hello Jimbo,

My computer
processor : 8700k intel
Ram: 16gb corsair vengeance rgb pro
MB : msi z390 gaming edge ac
Windows : 10
GPU was rog 1080 (has been removed at the moment)
and it is a desktop

I do not currently have a log with errors in, as at the moment GPU is out but the cpu folding is working fine.

After FAH app said about the fault, I tested it on fortnite and every few matches it would crash back to desktop, tried on total war...same again, then tried it on 3dmark firestorm and you can see the gpu is falling behind then you get error. I have tried updating and downgrading the driver and putting the GPU in a different computer and get similar results.

do you think the GPU is dying? :(
Top
JimboPalmer
Posts: 2522
Joined: Mon Feb 16, 2009 4:12 am
Location: Greenwood MS USA

Re: My nvidia graphic card keeps failing FAH

Post by JimboPalmer »

Great, looks like you can quit thinking about Optimus.

"1835 MHz boost clock in OC mode for outstanding performance and gaming experience." - https://rog.asus.com/graphics-cards/gra ... ing-model/
This implies a factory overclock, it also appears that you could set it back to not overclocked.
https://dlcdnets.asus.com/pub/ASUS/vga/ ... 170426.pdf
Trying less aggressive settings may help. But with errors in games and F@H, I will not make long term plans for my 1080.
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends
Top
jayman
Posts: 5
Joined: Sun May 09, 2021 8:43 am

Re: My nvidia graphic card keeps failing FAH

Post by jayman »

Hello Jimbo, thank you for your help.
Top
bruce
Posts: 20824
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: My nvidia graphic card keeps failing FAH

Post by bruce »

jayman wrote:Hello Bruce
could you explain Optimus?....and how to test it
I'll add two more sentences of explanation to the one Jimbo has offered.

Optimus is a really good idea for laptops that spend most of their time browsing or composing documents because it can switch to the low-powered (Intel) iGPU and save battery but switch to the more powerful GPU when it's needed. (For FAH, the other GPU needs to be on all the time.)
Top
Post Reply

Return to “Problems with NVidia drivers”