Win10, GTX 670 : Failed to create CUDA context

[MatthewJH]

Currently using version 466 driver from NVidias site. This card was running wonderfully just a few moths ago, IDK what has happened since then...

Code: Select all

21:12:08:WU00:FS01:0x22:    Version: 7.7.0
21:12:08:WU00:FS01:0x22:********************************************************************************
21:12:08:WU00:FS01:0x22:Project: 16701 (Run 7, Clone 0, Gen 115)
21:12:08:WU00:FS01:0x22:Digital signatures verified
21:12:08:WU00:FS01:0x22:Folding@home GPU Core22 Folding@home Core
21:12:08:WU00:FS01:0x22:Version 0.0.20
21:12:08:WU00:FS01:0x22:  Checkpoint write interval: 62500 steps (5%) [20 total]
21:12:08:WU00:FS01:0x22:  JSON viewer frame write interval: 12500 steps (1%) [100 total]
21:12:08:WU00:FS01:0x22:  XTC frame write interval: 10000 steps (0.8%) [125 total]
21:12:08:WU00:FS01:0x22:  Global context and integrator variables write interval: disabled
21:12:08:WU00:FS01:0x22:There are 4 platforms available.
21:12:08:WU00:FS01:0x22:Platform 0: Reference
21:12:08:WU00:FS01:0x22:Platform 1: CPU
21:12:08:WU00:FS01:0x22:Platform 2: OpenCL
21:12:08:WU00:FS01:0x22:  opencl-device 0 specified
21:12:08:WU00:FS01:0x22:Platform 3: CUDA
21:12:08:WU00:FS01:0x22:  cuda-device 0 specified
21:12:56:WU00:FS01:0x22:Attempting to create CUDA context:
21:12:56:WU00:FS01:0x22:  Configuring platform CUDA
21:12:57:WU00:FS01:0x22:Failed to create CUDA context:
21:12:57:WU00:FS01:0x22:Error compiling program: nvrtc: error: invalid value for --gpu-architecture (-arch)
21:12:57:WU00:FS01:0x22:Attempting to create OpenCL context:
21:12:57:WU00:FS01:0x22:  Configuring platform OpenCL
21:13:11:WU00:FS01:0x22:  Using OpenCL on platformId 0 and gpu 0
21:13:11:WU00:FS01:0x22:Completed 0 out of 1250000 steps (0%)
21:14:21:WU00:FS01:0x22:An exception occurred at step 250: Particle coordinate is nan
21:14:21:WU00:FS01:0x22:Max number of attempts to resume from last checkpoint (2) reached. Aborting.
21:14:21:WU00:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
21:14:21:WU00:FS01:0x22:Saving result file ..\logfile_01.txt
21:14:21:WU00:FS01:0x22:Saving result file science.log
21:14:21:WU00:FS01:0x22:Saving result file state.xml
21:14:28:WU00:FS01:0x22:Saving result file xtcAtoms.csv.bz2
21:14:28:WU00:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
21:14:29:WARNING:WU00:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
21:14:29:WU00:FS01:Sending unit results: id:00 state:SEND error:FAULTY project:16701 run:7 clone:0 gen:115 core:0x22

[Joe_H]

You may be running into support issues with your card. My understanding is that recent versions of the Core_22 folding core have dropped CUDA support for Kepler based cards like your GTX 670. WUs should fall back to OpenCL processing. You may also need to update your drivers to the last version supporting the GTX 670, version 473.47 released in May. That was end of support from Nvidia.

[MatthewJH]

You may be running into support issues with your card. My understanding is that recent versions of the Core_22 folding core have dropped CUDA support for Kepler based cards like your GTX 670. WUs should fall back to OpenCL processing. You may also need to update your drivers to the last version supporting the GTX 670, version 473.47 released in May. That was end of support from Nvidia.

I was told in the Discord that because it was a Kepler card, I should not use driver's newer than 470.

[Joe_H]

Did the person(s) who told you this give reasons not to use the newer drivers?

[MatthewJH]

Did the person(s) who told you this give reasons not to use the newer drivers?

"That's a Kepler GPU, make sure your drivers are no newer than Nvidia 470. After 470, Nvidia dropped support for Kepler"

[Joe_H]

Did the person(s) who told you this give reasons not to use the newer drivers?

"That's a Kepler GPU, make sure your drivers are no newer than Nvidia 470. After 470, Nvidia dropped support for Kepler"

Well the latest version on the Nvidia site when you search for drivers for Kepler based GPUs such as the GTX 670 is 4.73. Now it is possible they removed support in that driver for something such as OpenCL or CUDA, but it is posted up on the site as being for Kepler.

[MatthewJH]

Did the person(s) who told you this give reasons not to use the newer drivers?

"That's a Kepler GPU, make sure your drivers are no newer than Nvidia 470. After 470, Nvidia dropped support for Kepler"

Well the latest version on the Nvidia site when you search for drivers for Kepler based GPUs such as the GTX 670 is 4.73. Now it is possible they removed support in that driver for something such as OpenCL or CUDA, but it is posted up on the site as being for Kepler.

Just did a clean install of the newest drivers, but I'm getting the same results all the same. Below is the full log, if it helps any.

Code: Select all

*********************** Log Started 2022-07-25T00:21:48Z ***********************
00:21:48:FS01:Initialized folding slot 01: gpu:1:0 GK104 [GeForce GTX 670/GTX 760Ti OEM] 2634 
00:22:08:FS01:Unpaused
00:22:09:WU01:FS01:Connecting to assign1.foldingathome.org:80
00:22:10:WU01:FS01:Assigned to work server 66.170.111.50
00:22:10:WU01:FS01:Requesting new work unit for slot 01: gpu:1:0 GK104 [GeForce GTX 670/GTX 760Ti OEM] 2634  from 66.170.111.50
00:22:10:WU01:FS01:Connecting to 66.170.111.50:8080
00:22:33:WU01:FS01:Downloading 46.35MiB
00:22:39:WU01:FS01:Download 42.07%
00:22:45:WU01:FS01:Download 88.06%
00:22:46:WU01:FS01:Download complete
00:22:46:WU01:FS01:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:16701 run:93 clone:3 gen:119 core:0x22 unit:0x00000003000000770000413d0000005d
00:22:46:WU01:FS01:Starting
00:22:46:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Matt\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 9124 -checkpoint 15 -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor nvidia -gpu 0 -gpu-usage 100
00:22:46:WU01:FS01:Started FahCore on PID 5652
00:22:46:WU01:FS01:Core PID:8612
00:22:46:WU01:FS01:FahCore 0x22 started
00:22:48:WU01:FS01:0x22:*********************** Log Started 2022-07-25T00:22:48Z ***********************
00:22:48:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
00:22:48:WU01:FS01:0x22:       Core: Core22
00:22:48:WU01:FS01:0x22:       Type: 0x22
00:22:48:WU01:FS01:0x22:    Version: 0.0.20
00:22:48:WU01:FS01:0x22:     Author: Joseph Coffland <[email protected]>
00:22:48:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
00:22:48:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
00:22:48:WU01:FS01:0x22:       Date: Jan 20 2022
00:22:48:WU01:FS01:0x22:       Time: 01:15:36
00:22:48:WU01:FS01:0x22:   Revision: 3f211b8a4346514edbff34e3cb1c0e0ec951373c
00:22:48:WU01:FS01:0x22:     Branch: HEAD
00:22:48:WU01:FS01:0x22:   Compiler: Visual C++
00:22:48:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
00:22:48:WU01:FS01:0x22:             -DOPENMM_VERSION="\"7.7.0\""
00:22:48:WU01:FS01:0x22:   Platform: win32 10
00:22:48:WU01:FS01:0x22:       Bits: 64
00:22:48:WU01:FS01:0x22:       Mode: Release
00:22:48:WU01:FS01:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
00:22:48:WU01:FS01:0x22:             <[email protected]>
00:22:48:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 5652 -checkpoint 15
00:22:48:WU01:FS01:0x22:             -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
00:22:48:WU01:FS01:0x22:             nvidia -gpu 0 -gpu-usage 100
00:22:48:WU01:FS01:0x22:************************************ libFAH ************************************
00:22:48:WU01:FS01:0x22:       Date: Jan 20 2022
00:22:48:WU01:FS01:0x22:       Time: 01:14:17
00:22:48:WU01:FS01:0x22:   Revision: 9f4ad694e75c2350d4bb6b8b5b769ba27e483a2f
00:22:48:WU01:FS01:0x22:     Branch: HEAD
00:22:48:WU01:FS01:0x22:   Compiler: Visual C++
00:22:48:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
00:22:48:WU01:FS01:0x22:   Platform: win32 10
00:22:48:WU01:FS01:0x22:       Bits: 64
00:22:48:WU01:FS01:0x22:       Mode: Release
00:22:48:WU01:FS01:0x22:************************************ CBang *************************************
00:22:48:WU01:FS01:0x22:       Date: Jan 20 2022
00:22:48:WU01:FS01:0x22:       Time: 01:13:20
00:22:48:WU01:FS01:0x22:   Revision: ab023d155b446906d55b0f6c9a1eedeea04f7a1a
00:22:48:WU01:FS01:0x22:     Branch: HEAD
00:22:48:WU01:FS01:0x22:   Compiler: Visual C++
00:22:48:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
00:22:48:WU01:FS01:0x22:   Platform: win32 10
00:22:48:WU01:FS01:0x22:       Bits: 64
00:22:48:WU01:FS01:0x22:       Mode: Release
00:22:48:WU01:FS01:0x22:************************************ System ************************************
00:22:48:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz
00:22:48:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
00:22:48:WU01:FS01:0x22:       CPUs: 4
00:22:48:WU01:FS01:0x22:     Memory: 15.95GiB
00:22:48:WU01:FS01:0x22:Free Memory: 13.85GiB
00:22:48:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
00:22:48:WU01:FS01:0x22: OS Version: 6.2
00:22:48:WU01:FS01:0x22:Has Battery: false
00:22:48:WU01:FS01:0x22: On Battery: false
00:22:48:WU01:FS01:0x22: UTC Offset: -4
00:22:48:WU01:FS01:0x22:        PID: 8612
00:22:48:WU01:FS01:0x22:        CWD: C:\Users\Matt\AppData\Roaming\FAHClient\work
00:22:48:WU01:FS01:0x22:************************************ OpenMM ************************************
00:22:48:WU01:FS01:0x22:    Version: 7.7.0
00:22:48:WU01:FS01:0x22:********************************************************************************
00:22:48:WU01:FS01:0x22:Project: 16701 (Run 93, Clone 3, Gen 119)
00:22:48:WU01:FS01:0x22:Reading tar file core.xml
00:22:48:WU01:FS01:0x22:Reading tar file integrator.xml
00:22:48:WU01:FS01:0x22:Reading tar file state.xml
00:22:50:WU01:FS01:0x22:Reading tar file system.xml
00:22:51:WU01:FS01:0x22:Digital signatures verified
00:22:51:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
00:22:51:WU01:FS01:0x22:Version 0.0.20
00:22:55:WU01:FS01:0x22:  Checkpoint write interval: 62500 steps (5%) [20 total]
00:22:55:WU01:FS01:0x22:  JSON viewer frame write interval: 12500 steps (1%) [100 total]
00:22:55:WU01:FS01:0x22:  XTC frame write interval: 10000 steps (0.8%) [125 total]
00:22:55:WU01:FS01:0x22:  Global context and integrator variables write interval: disabled
00:22:58:WU01:FS01:0x22:There are 4 platforms available.
00:22:58:WU01:FS01:0x22:Platform 0: Reference
00:22:58:WU01:FS01:0x22:Platform 1: CPU
00:22:58:WU01:FS01:0x22:Platform 2: OpenCL
00:22:58:WU01:FS01:0x22:  opencl-device 0 specified
00:22:58:WU01:FS01:0x22:Platform 3: CUDA
00:22:58:WU01:FS01:0x22:  cuda-device 0 specified
00:23:49:WU01:FS01:0x22:Attempting to create CUDA context:
00:23:49:WU01:FS01:0x22:  Configuring platform CUDA
00:23:49:WU01:FS01:0x22:Failed to create CUDA context:
00:23:49:WU01:FS01:0x22:Error compiling program: nvrtc: error: invalid value for --gpu-architecture (-arch)
00:23:49:WU01:FS01:0x22:Attempting to create OpenCL context:
00:23:49:WU01:FS01:0x22:  Configuring platform OpenCL
00:24:11:WU01:FS01:0x22:  Using OpenCL on platformId 0 and gpu 0
00:24:11:WU01:FS01:0x22:Completed 0 out of 1250000 steps (0%)
00:24:14:WU01:FS01:0x22:Checkpoint completed at step 0
00:27:59:WU01:FS01:0x22:An exception occurred at step 1756: Particle coordinate is nan
00:27:59:WU01:FS01:0x22:ERROR:98: Attempting to restart from last good checkpoint by restarting core.
00:27:59:WU01:FS01:0x22:Folding@home Core Shutdown: CORE_RESTART
00:28:01:WARNING:WU01:FS01:FahCore returned: CORE_RESTART (98 = 0x62)
00:28:01:WU01:FS01:Starting
00:28:01:WU01:FS01:Running FahCore: "C:\Program Files (x86)\FAHClient/FAHCoreWrapper.exe" C:\Users\Matt\AppData\Roaming\FAHClient\cores/cores.foldingathome.org/win/64bit/22-0.0.20/Core_22.fah/FahCore_22.exe -dir 01 -suffix 01 -version 706 -lifeline 9124 -checkpoint 15 -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor nvidia -gpu 0 -gpu-usage 100
00:28:01:WU01:FS01:Started FahCore on PID 828
00:28:01:WU01:FS01:Core PID:1324
00:28:01:WU01:FS01:FahCore 0x22 started
00:28:02:WU01:FS01:0x22:*********************** Log Started 2022-07-25T00:28:01Z ***********************
00:28:02:WU01:FS01:0x22:*************************** Core22 Folding@home Core ***************************
00:28:02:WU01:FS01:0x22:       Core: Core22
00:28:02:WU01:FS01:0x22:       Type: 0x22
00:28:02:WU01:FS01:0x22:    Version: 0.0.20
00:28:02:WU01:FS01:0x22:     Author: Joseph Coffland <[email protected]>
00:28:02:WU01:FS01:0x22:  Copyright: 2020 foldingathome.org
00:28:02:WU01:FS01:0x22:   Homepage: https://foldingathome.org/
00:28:02:WU01:FS01:0x22:       Date: Jan 20 2022
00:28:02:WU01:FS01:0x22:       Time: 01:15:36
00:28:02:WU01:FS01:0x22:   Revision: 3f211b8a4346514edbff34e3cb1c0e0ec951373c
00:28:02:WU01:FS01:0x22:     Branch: HEAD
00:28:02:WU01:FS01:0x22:   Compiler: Visual C++
00:28:02:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
00:28:02:WU01:FS01:0x22:             -DOPENMM_VERSION="\"7.7.0\""
00:28:02:WU01:FS01:0x22:   Platform: win32 10
00:28:02:WU01:FS01:0x22:       Bits: 64
00:28:02:WU01:FS01:0x22:       Mode: Release
00:28:02:WU01:FS01:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
00:28:02:WU01:FS01:0x22:             <[email protected]>
00:28:02:WU01:FS01:0x22:       Args: -dir 01 -suffix 01 -version 706 -lifeline 828 -checkpoint 15
00:28:02:WU01:FS01:0x22:             -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu-vendor
00:28:02:WU01:FS01:0x22:             nvidia -gpu 0 -gpu-usage 100
00:28:02:WU01:FS01:0x22:************************************ libFAH ************************************
00:28:02:WU01:FS01:0x22:       Date: Jan 20 2022
00:28:02:WU01:FS01:0x22:       Time: 01:14:17
00:28:02:WU01:FS01:0x22:   Revision: 9f4ad694e75c2350d4bb6b8b5b769ba27e483a2f
00:28:02:WU01:FS01:0x22:     Branch: HEAD
00:28:02:WU01:FS01:0x22:   Compiler: Visual C++
00:28:02:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
00:28:02:WU01:FS01:0x22:   Platform: win32 10
00:28:02:WU01:FS01:0x22:       Bits: 64
00:28:02:WU01:FS01:0x22:       Mode: Release
00:28:02:WU01:FS01:0x22:************************************ CBang *************************************
00:28:02:WU01:FS01:0x22:       Date: Jan 20 2022
00:28:02:WU01:FS01:0x22:       Time: 01:13:20
00:28:02:WU01:FS01:0x22:   Revision: ab023d155b446906d55b0f6c9a1eedeea04f7a1a
00:28:02:WU01:FS01:0x22:     Branch: HEAD
00:28:02:WU01:FS01:0x22:   Compiler: Visual C++
00:28:02:WU01:FS01:0x22:    Options: /TP /nologo /EHa /wd4297 /wd4103 /O2 /Zc:throwingNew /MT
00:28:02:WU01:FS01:0x22:   Platform: win32 10
00:28:02:WU01:FS01:0x22:       Bits: 64
00:28:02:WU01:FS01:0x22:       Mode: Release
00:28:02:WU01:FS01:0x22:************************************ System ************************************
00:28:02:WU01:FS01:0x22:        CPU: Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz
00:28:02:WU01:FS01:0x22:     CPU ID: GenuineIntel Family 6 Model 58 Stepping 9
00:28:02:WU01:FS01:0x22:       CPUs: 4
00:28:02:WU01:FS01:0x22:     Memory: 15.95GiB
00:28:02:WU01:FS01:0x22:Free Memory: 13.88GiB
00:28:02:WU01:FS01:0x22:    Threads: WINDOWS_THREADS
00:28:02:WU01:FS01:0x22: OS Version: 6.2
00:28:02:WU01:FS01:0x22:Has Battery: false
00:28:02:WU01:FS01:0x22: On Battery: false
00:28:02:WU01:FS01:0x22: UTC Offset: -4
00:28:02:WU01:FS01:0x22:        PID: 1324
00:28:02:WU01:FS01:0x22:        CWD: C:\Users\Matt\AppData\Roaming\FAHClient\work
00:28:02:WU01:FS01:0x22:************************************ OpenMM ************************************
00:28:02:WU01:FS01:0x22:    Version: 7.7.0
00:28:02:WU01:FS01:0x22:********************************************************************************
00:28:02:WU01:FS01:0x22:Project: 16701 (Run 93, Clone 3, Gen 119)
00:28:02:WU01:FS01:0x22:Digital signatures verified
00:28:02:WU01:FS01:0x22:Folding@home GPU Core22 Folding@home Core
00:28:02:WU01:FS01:0x22:Version 0.0.20
00:28:02:WU01:FS01:0x22:  Checkpoint write interval: 62500 steps (5%) [20 total]
00:28:02:WU01:FS01:0x22:  JSON viewer frame write interval: 12500 steps (1%) [100 total]
00:28:02:WU01:FS01:0x22:  XTC frame write interval: 10000 steps (0.8%) [125 total]
00:28:02:WU01:FS01:0x22:  Global context and integrator variables write interval: disabled
00:28:02:WU01:FS01:0x22:There are 4 platforms available.
00:28:02:WU01:FS01:0x22:Platform 0: Reference
00:28:02:WU01:FS01:0x22:Platform 1: CPU
00:28:02:WU01:FS01:0x22:Platform 2: OpenCL
00:28:02:WU01:FS01:0x22:  opencl-device 0 specified
00:28:02:WU01:FS01:0x22:Platform 3: CUDA
00:28:02:WU01:FS01:0x22:  cuda-device 0 specified
00:28:51:WU01:FS01:0x22:Attempting to create CUDA context:
00:28:51:WU01:FS01:0x22:  Configuring platform CUDA
00:28:51:WU01:FS01:0x22:Failed to create CUDA context:
00:28:51:WU01:FS01:0x22:Error compiling program: nvrtc: error: invalid value for --gpu-architecture (-arch)
00:28:51:WU01:FS01:0x22:Attempting to create OpenCL context:
00:28:51:WU01:FS01:0x22:  Configuring platform OpenCL
00:29:05:WU01:FS01:0x22:  Using OpenCL on platformId 0 and gpu 0
00:29:06:WU01:FS01:0x22:Completed 0 out of 1250000 steps (0%)
00:30:38:WU01:FS01:0x22:An exception occurred at step 793: clWaitForEvents
00:30:38:WU01:FS01:0x22:Max number of attempts to resume from last checkpoint (2) reached. Aborting.
00:30:38:WU01:FS01:0x22:ERROR:114: Max number of attempts to resume from last checkpoint reached.
00:30:38:WU01:FS01:0x22:Saving result file ..\logfile_01.txt
00:30:38:WU01:FS01:0x22:Saving result file science.log
00:30:38:WU01:FS01:0x22:Saving result file state.xml
00:30:45:WU01:FS01:0x22:Saving result file xtcAtoms.csv.bz2
00:30:45:WU01:FS01:0x22:Folding@home Core Shutdown: BAD_WORK_UNIT
00:31:43:WARNING:WU01:FS01:FahCore returned: BAD_WORK_UNIT (114 = 0x72)
00:31:43:WU01:FS01:Sending unit results: id:01 state:SEND error:FAULTY project:16701 run:93 clone:3 gen:119 core:0x22 unit:0x00000003000000770000413d0000005d
00:31:43:WU01:FS01:Uploading 38.95MiB to 66.170.111.50
00:31:43:WU01:FS01:Connecting to 66.170.111.50:8080
00:31:43:WU02:FS01:Connecting to assign1.foldingathome.org:80
00:31:44:WU02:FS01:Assigned to work server 129.32.209.202
00:31:44:WU02:FS01:Requesting new work unit for slot 01: gpu:1:0 GK104 [GeForce GTX 670/GTX 760Ti OEM] 2634  from 129.32.209.202
00:31:44:WU02:FS01:Connecting to 129.32.209.202:8080
00:31:44:WU02:FS01:Downloading 59.71MiB
00:31:49:WU01:FS01:Upload 3.69%

[toTOW]

473.81 driver downloaded from nVidia website should work correctly on you Kepler GPU : https://www.nvidia.fr/Download/driverRe ... px/192194/

Since it's a 10 years old GPU, it might be starting to fail ... is stable for something else ?

0x22:An exception occurred at step 1756: Particle coordinate is nan

This is usually the sign of a hardware issue (unstable overclocking or underclocking, overheating, failing memory or GPU, ...).