Page 2 of 7
Re: CUDA Update
Posted: Tue Sep 29, 2020 10:11 pm
by PantherX
gunnarre wrote:sirdakz03 wrote:On a side note, it had to work on the WU from scratch, as it didn't seem to recognize the OpenCL checkpoint.
This is expected behavior, and shouldn't happen more than once when you get the new core...
During testing, this was discovered and this is an edge case that would rarely happen on common donor systems. If it happens, it would be a one-off case. However, I am aware that there are plans to make the checkpoint platform agnostic in future to ensure that OpenCL and CUDA checkpoints are interchangeable.
Re: CUDA Update
Posted: Tue Sep 29, 2020 10:39 pm
by PantherX
foldy wrote:...If user have any CUDA toolkit installed then FAH seems to use that instead of the nvidia driver. That is not a good idea, FAH should always run using the nvidia driver for CUDA. viewtopic.php?f=80&t=36167
Yep, it's a known issue and dev is working with Nvidia to investigate this further since it is cross-platform (happens on Linux and Windows) so once it is fixed, issues on both platforms would be sorted out.
However, if you do need to use CUDA toolkit and would like to prevent seeing the fallback error in the log, you can use this slot configuration instead:
Code: Select all
<slot id='0' type='GPU'>
<extra-core-args v='-disable-cuda'/>
</slot>
Re: CUDA Update
Posted: Tue Sep 29, 2020 10:52 pm
by bruce
HaloJones wrote:I'm seeing massively better CUDA performance on Linux than Windows10. And I'm meaning up to 40% on identical cards.
Be careful. The Moonshot projects, including p134xx, are not like more traditional projects. They are non-uniform. When comparing the speed of one PRCG with a different PRCG it's easy to assume that WUs are essentially identical except for the OS since the GPUs are the same. THat's not necessarily true. For many projects the atomic structure is identical and the differenses in run1 vs run2 nor between clone1 vs clone2 differ only because the have different starting positions/velocities. For the Moonshot projects, run1 vs. run2 generally have different atomic structures, too.
Re: CUDA Update
Posted: Wed Sep 30, 2020 8:22 am
by ajm
The last previous days, I was hovering around 8M/day. Yesterday, with no change whatsoever in the configurations, the overall result jumped to over 11M. Only Win 10 2004 machines.
Re: CUDA Update
Posted: Wed Sep 30, 2020 8:36 am
by PantherX
I would say that would be a strong indication of a very smooth automatic upgrade from FahCore_22 version 0.0.11 to FahCore_22 version 0.0.13 across all your systems without any hiccups!
Re: CUDA Update
Posted: Wed Sep 30, 2020 8:43 am
by ajm
Indeed! 0.0.13 everywhere! Good job, guys!
Re: CUDA Update
Posted: Wed Sep 30, 2020 4:24 pm
by psaam0001
And in the meanwhile, I am not going to be running GPU jobs on my system that is currently using Windows 7.0 SP1, as the drivers are the latest that can be installed for that OS/GPU combo (v452.06)--and they are crashing with the new Gromacs core. I'll be putting Fedora on a fresh HD, and getting more practice with installing more current NVidia drivers this weekend.
Paul
Re: CUDA Update
Posted: Wed Sep 30, 2020 6:24 pm
by HaloJones
psaam0001 wrote:And in the meanwhile, I am not going to be running GPU jobs on my system that is currently using Windows 7.0 SP1, as the drivers are the latest that can be installed for that OS/GPU combo (v452.06)--and they are crashing with the new Gromacs core. I'll be putting Fedora on a fresh HD, and getting more practice with installing more current NVidia drivers this weekend.
Paul
You'll likely see a decent boost in production with Linux compared to Windows - at least that's what I've seen.
Re: CUDA Update
Posted: Wed Sep 30, 2020 6:37 pm
by foldy
psaam0001 wrote:And in the meanwhile, I am not going to be running GPU jobs on my system that is currently using Windows 7.0 SP1, as the drivers are the latest that can be installed for that OS/GPU combo (v452.06)--and they are crashing with the new Gromacs core.
I run Windows 7 SP1 too and nvidia 441.66 works perfect with gtx 1080ti
Re: CUDA Update to FAHCore_22
Posted: Wed Sep 30, 2020 8:29 pm
by psaam0001
I have yet to get the updated core for the Fedora system that has a GT 710 yet, but it is running stable w/a WU that uses the previous core version.
Paul
Re: CUDA Update to FAHCore_22
Posted: Wed Sep 30, 2020 9:00 pm
by Foliant
Is there a minimum requirement for running Cuda?
Works like a charm on my GTX 1660 Super with
Nvidia 450.66; Compute: 7.5; Driver: 11.0
GTX 1660 Super from 730-750k Avg. to 1mil estimated.
On my second Computer with all the old Hardware and
Nvidia 390.138; Compute: 3.0; Driver: 9.1
I get the
Code: Select all
Error loading CUDA module: CUDA_ERROR_INVALID_PTX (218)
Code: Select all
*********************** Log Started 2020-09-30T20:21:14Z ***********************
20:21:14:Trying to access database...
20:21:15:Successfully acquired database lock
20:21:15:Read GPUs.txt
20:21:15:Enabled folding slot 00: PAUSED cpu:1 (by user)
20:21:19:Enabled folding slot 01: READY gpu:0:GK104 [GeForce GTX 670/GTX 760Ti OEM] 2634
20:21:19:Enabled folding slot 02: READY gpu:1:GK104 [GeForce GTX 770] 3213
20:21:19:Enabled folding slot 03: READY gpu:2:GK106 [GeForce GTX 660]
20:21:19:Enabled folding slot 04: READY gpu:3:GK107 [GeForce GTX 650] 812
20:21:19:****************************** FAHClient ******************************
20:21:19: Version: 7.6.13
20:21:19: Author: Joseph Coffland <[email protected]>
20:21:19: Copyright: 2020 foldingathome.org
20:21:19: Homepage: https://foldingathome.org/
20:21:19: Date: Apr 28 2020
20:21:19: Time: 04:20:16
20:21:19: Revision: 5a652817f46116b6e135503af97f18e094414e3b
20:21:19: Branch: master
20:21:19: Compiler: GNU 8.3.0
20:21:19: Options: -std=c++11 -ffunction-sections -fdata-sections -O3
20:21:19: -funroll-loops -fno-pie
20:21:19: Platform: linux2 4.19.0-5-amd64
20:21:19: Bits: 64
20:21:19: Mode: Release
20:21:19: Args: --child --run-as fahclient --pid-file=/var/run/fahclient.pid
20:21:19: --daemon
20:21:19: Config: /var/lib/fahclient/config.xml
20:21:19:******************************** CBang ********************************
20:21:19: Date: Apr 25 2020
20:21:19: Time: 00:07:53
20:21:19: Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
20:21:19: Branch: master
20:21:19: Compiler: GNU 8.3.0
20:21:19: Options: -std=c++11 -ffunction-sections -fdata-sections -O3
20:21:19: -funroll-loops -fno-pie -fPIC
20:21:19: Platform: linux2 4.19.0-5-amd64
20:21:19: Bits: 64
20:21:19: Mode: Release
20:21:19:******************************* System ********************************
20:21:19: CPU: AMD Phenom(tm) II X6 1090T Processor
20:21:19: CPU ID: AuthenticAMD Family 16 Model 10 Stepping 0
20:21:19: CPUs: 6
20:21:19: Memory: 7.75GiB
20:21:19: Free Memory: 7.40GiB
20:21:19: Threads: POSIX_THREADS
20:21:19: OS Version: 5.4
20:21:19: Has Battery: false
20:21:19: On Battery: false
20:21:19: UTC Offset: 2
20:21:19: PID: 1053
20:21:19: CWD: /var/lib/fahclient
20:21:19: OS: Linux 5.4.0-47-generic x86_64
20:21:19: OS Arch: AMD64
20:21:19: GPUs: 4
20:21:19: GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:4 GK104 [GeForce GTX 670/GTX 760Ti
20:21:19: OEM] 2634
20:21:19: GPU 1: Bus:2 Slot:0 Func:0 NVIDIA:4 GK104 [GeForce GTX 770] 3213
20:21:19: GPU 2: Bus:3 Slot:0 Func:0 NVIDIA:3 GK106 [GeForce GTX 660]
20:21:19: GPU 3: Bus:6 Slot:0 Func:0 NVIDIA:3 GK107 [GeForce GTX 650] 812
20:21:19: CUDA Device 0: Platform:0 Device:0 Bus:2 Slot:0 Compute:3.0 Driver:9.1
20:21:19: CUDA Device 1: Platform:0 Device:1 Bus:1 Slot:0 Compute:3.0 Driver:9.1
20:21:19: CUDA Device 2: Platform:0 Device:2 Bus:3 Slot:0 Compute:3.0 Driver:9.1
20:21:19: CUDA Device 3: Platform:0 Device:3 Bus:6 Slot:0 Compute:3.0 Driver:9.1
20:21:19:OpenCL Device 0: Platform:0 Device:0 Bus:2 Slot:0 Compute:1.2 Driver:390.138
20:21:19:OpenCL Device 1: Platform:0 Device:1 Bus:1 Slot:0 Compute:1.2 Driver:390.138
20:21:19:OpenCL Device 2: Platform:0 Device:2 Bus:3 Slot:0 Compute:1.2 Driver:390.138
20:21:19:OpenCL Device 3: Platform:0 Device:3 Bus:6 Slot:0 Compute:1.2 Driver:390.138
20:21:19:******************************* libFAH ********************************
20:21:19: Date: Apr 15 2020
20:21:19: Time: 21:43:24
20:21:19: Revision: 216968bc7025029c841ed6e36e81a03a316890d3
20:21:19: Branch: master
20:21:19: Compiler: GNU 8.3.0
20:21:19: Options: -std=c++11 -ffunction-sections -fdata-sections -O3
20:21:19: -funroll-loops -fno-pie
20:21:19: Platform: linux2 4.19.0-5-amd64
20:21:19: Bits: 64
20:21:19: Mode: Release
20:21:19:***********************************************************************
20:21:19:<config>
20:21:19: <!-- HTTP Server -->
20:21:19: <allow v='192.168.1.0/24'/>
20:21:19:
20:21:19: <!-- Network -->
20:21:19: <proxy v=':8080'/>
20:21:19:
20:21:19: <!-- Remote Command Server -->
20:21:19: <command-allow-no-pass v='127.0.0.1 192.168.1.0/24'/>
20:21:19: <password v='*****'/>
20:21:19:
20:21:19: <!-- User Information -->
20:21:19: <passkey v='*****'/>
20:21:19: <team v='*****'/>
20:21:19: <user v='*****'/>
20:21:19:
20:21:19: <!-- Web Server -->
20:21:19: <web-allow v='127.0.0.1 192.168.1.0/24'/>
20:21:19:
20:21:19: <!-- Folding Slots -->
20:21:19: <slot id='0' type='CPU'>
20:21:19: <paused v='true'/>
20:21:19: </slot>
20:21:19: <slot id='1' type='GPU'/>
20:21:19: <slot id='2' type='GPU'/>
20:21:19: <slot id='3' type='GPU'/>
20:21:19: <slot id='4' type='GPU'/>
20:21:19:</config>
20:21:19:WU04:FS03:Starting
20:21:19:WU04:FS03:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit/22-0.0.13/Core_22.fah/FahCore_22 -dir 04 -suffix 01 -version 706 -lifeline 1053 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 2 -cuda-device 2 -gpu 2
20:21:19:WU04:FS03:Started FahCore on PID 1308
20:21:20:WU04:FS03:Core PID:1312
20:21:20:WU04:FS03:FahCore 0x22 started
20:21:22:WU03:FS01:Starting
20:21:22:WU03:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit/22-0.0.13/Core_22.fah/FahCore_22 -dir 03 -suffix 01 -version 706 -lifeline 1053 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 1 -cuda-device 1 -gpu 1
20:21:22:WU03:FS01:Started FahCore on PID 1315
20:21:22:WU03:FS01:Core PID:1319
20:21:22:WU03:FS01:FahCore 0x22 started
20:21:23:WU04:FS03:0x22:*********************** Log Started 2020-09-30T20:21:22Z ***********************
20:21:23:WU04:FS03:0x22:*************************** Core22 Folding@home Core ***************************
20:21:23:WU04:FS03:0x22: Core: Core22
20:21:23:WU04:FS03:0x22: Type: 0x22
20:21:23:WU04:FS03:0x22: Version: 0.0.13
20:21:23:WU04:FS03:0x22: Author: Joseph Coffland <[email protected]>
20:21:23:WU04:FS03:0x22: Copyright: 2020 foldingathome.org
20:21:23:WU04:FS03:0x22: Homepage: https://foldingathome.org/
20:21:23:WU04:FS03:0x22: Date: Sep 19 2020
20:21:23:WU04:FS03:0x22: Time: 01:10:35
20:21:23:WU04:FS03:0x22: Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
20:21:23:WU04:FS03:0x22: Branch: core22-0.0.13
20:21:23:WU04:FS03:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:23:WU04:FS03:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:23:WU04:FS03:0x22: -funroll-loops -DOPENMM_GIT_HASH="\"189320d0\""
20:21:23:WU04:FS03:0x22: Platform: linux2 4.19.76-linuxkit
20:21:23:WU04:FS03:0x22: Bits: 64
20:21:23:WU04:FS03:0x22: Mode: Release
20:21:23:WU04:FS03:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
20:21:23:WU04:FS03:0x22: <[email protected]>
20:21:23:WU04:FS03:0x22: Args: -dir 04 -suffix 01 -version 706 -lifeline 1308 -checkpoint 15
20:21:23:WU04:FS03:0x22: -gpu-vendor nvidia -opencl-platform 0 -opencl-device 2 -cuda-device
20:21:23:WU04:FS03:0x22: 2 -gpu 2
20:21:23:WU04:FS03:0x22:************************************ libFAH ************************************
20:21:23:WU04:FS03:0x22: Date: Sep 15 2020
20:21:23:WU04:FS03:0x22: Time: 05:14:43
20:21:23:WU04:FS03:0x22: Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
20:21:23:WU04:FS03:0x22: Branch: HEAD
20:21:23:WU04:FS03:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:23:WU04:FS03:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:23:WU04:FS03:0x22: -funroll-loops
20:21:23:WU04:FS03:0x22: Platform: linux2 4.19.76-linuxkit
20:21:23:WU04:FS03:0x22: Bits: 64
20:21:23:WU04:FS03:0x22: Mode: Release
20:21:23:WU04:FS03:0x22:************************************ CBang *************************************
20:21:23:WU04:FS03:0x22: Date: Sep 15 2020
20:21:23:WU04:FS03:0x22: Time: 05:11:04
20:21:23:WU04:FS03:0x22: Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
20:21:23:WU04:FS03:0x22: Branch: HEAD
20:21:23:WU04:FS03:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:23:WU04:FS03:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:23:WU04:FS03:0x22: -funroll-loops -fPIC
20:21:23:WU04:FS03:0x22: Platform: linux2 4.19.76-linuxkit
20:21:23:WU04:FS03:0x22: Bits: 64
20:21:23:WU04:FS03:0x22: Mode: Release
20:21:23:WU04:FS03:0x22:************************************ System ************************************
20:21:23:WU04:FS03:0x22: CPU: AMD Phenom(tm) II X6 1090T Processor
20:21:23:WU04:FS03:0x22: CPU ID: AuthenticAMD Family 16 Model 10 Stepping 0
20:21:23:WU04:FS03:0x22: CPUs: 6
20:21:23:WU04:FS03:0x22: Memory: 7.75GiB
20:21:23:WU04:FS03:0x22:Free Memory: 7.19GiB
20:21:23:WU04:FS03:0x22: Threads: POSIX_THREADS
20:21:23:WU04:FS03:0x22: OS Version: 5.4
20:21:23:WU04:FS03:0x22:Has Battery: false
20:21:23:WU04:FS03:0x22: On Battery: false
20:21:23:WU04:FS03:0x22: UTC Offset: 2
20:21:23:WU04:FS03:0x22: PID: 1312
20:21:23:WU04:FS03:0x22: CWD: /var/lib/fahclient/work
20:21:23:WU04:FS03:0x22:************************************ OpenMM ************************************
20:21:23:WU04:FS03:0x22: Revision: 189320d0
20:21:23:WU04:FS03:0x22:********************************************************************************
20:21:23:WU04:FS03:0x22:Project: 16918 (Run 72, Clone 107, Gen 94)
20:21:23:WU04:FS03:0x22:Unit: 0x000000860002894c5f1761a1a9a1fd22
20:21:23:WU04:FS03:0x22:Digital signatures verified
20:21:23:WU04:FS03:0x22:Folding@home GPU Core22 Folding@home Core
20:21:23:WU04:FS03:0x22:Version 0.0.13
20:21:23:WU04:FS03:0x22: Checkpoint write interval: 100000 steps (2%) [50 total]
20:21:23:WU04:FS03:0x22: JSON viewer frame write interval: 50000 steps (1%) [100 total]
20:21:23:WU04:FS03:0x22: XTC frame write interval: 250000 steps (5%) [20 total]
20:21:23:WU04:FS03:0x22: Global context and integrator variables write interval: disabled
20:21:23:WU03:FS01:0x22:*********************** Log Started 2020-09-30T20:21:23Z ***********************
20:21:23:WU03:FS01:0x22:*************************** Core22 Folding@home Core ***************************
20:21:23:WU03:FS01:0x22: Core: Core22
20:21:23:WU03:FS01:0x22: Type: 0x22
20:21:23:WU03:FS01:0x22: Version: 0.0.13
20:21:23:WU03:FS01:0x22: Author: Joseph Coffland <[email protected]>
20:21:23:WU03:FS01:0x22: Copyright: 2020 foldingathome.org
20:21:23:WU03:FS01:0x22: Homepage: https://foldingathome.org/
20:21:23:WU03:FS01:0x22: Date: Sep 19 2020
20:21:23:WU03:FS01:0x22: Time: 01:10:35
20:21:23:WU03:FS01:0x22: Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
20:21:23:WU03:FS01:0x22: Branch: core22-0.0.13
20:21:23:WU03:FS01:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:23:WU03:FS01:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:23:WU03:FS01:0x22: -funroll-loops -DOPENMM_GIT_HASH="\"189320d0\""
20:21:23:WU03:FS01:0x22: Platform: linux2 4.19.76-linuxkit
20:21:23:WU03:FS01:0x22: Bits: 64
20:21:23:WU03:FS01:0x22: Mode: Release
20:21:23:WU03:FS01:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
20:21:23:WU03:FS01:0x22: <[email protected]>
20:21:23:WU03:FS01:0x22: Args: -dir 03 -suffix 01 -version 706 -lifeline 1315 -checkpoint 15
20:21:23:WU03:FS01:0x22: -gpu-vendor nvidia -opencl-platform 0 -opencl-device 1 -cuda-device
20:21:23:WU03:FS01:0x22: 1 -gpu 1
20:21:23:WU03:FS01:0x22:************************************ libFAH ************************************
20:21:23:WU03:FS01:0x22: Date: Sep 15 2020
20:21:23:WU03:FS01:0x22: Time: 05:14:43
20:21:23:WU03:FS01:0x22: Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
20:21:23:WU03:FS01:0x22: Branch: HEAD
20:21:23:WU03:FS01:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:23:WU03:FS01:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:23:WU03:FS01:0x22: -funroll-loops
20:21:23:WU03:FS01:0x22: Platform: linux2 4.19.76-linuxkit
20:21:23:WU03:FS01:0x22: Bits: 64
20:21:23:WU03:FS01:0x22: Mode: Release
20:21:23:WU03:FS01:0x22:************************************ CBang *************************************
20:21:23:WU03:FS01:0x22: Date: Sep 15 2020
20:21:23:WU03:FS01:0x22: Time: 05:11:04
20:21:23:WU03:FS01:0x22: Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
20:21:23:WU03:FS01:0x22: Branch: HEAD
20:21:23:WU03:FS01:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:23:WU03:FS01:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:23:WU03:FS01:0x22: -funroll-loops -fPIC
20:21:23:WU03:FS01:0x22: Platform: linux2 4.19.76-linuxkit
20:21:23:WU03:FS01:0x22: Bits: 64
20:21:23:WU03:FS01:0x22: Mode: Release
20:21:23:WU03:FS01:0x22:************************************ System ************************************
20:21:23:WU03:FS01:0x22: CPU: AMD Phenom(tm) II X6 1090T Processor
20:21:23:WU03:FS01:0x22: CPU ID: AuthenticAMD Family 16 Model 10 Stepping 0
20:21:23:WU03:FS01:0x22: CPUs: 6
20:21:23:WU03:FS01:0x22: Memory: 7.75GiB
20:21:23:WU03:FS01:0x22:Free Memory: 7.19GiB
20:21:23:WU03:FS01:0x22: Threads: POSIX_THREADS
20:21:23:WU03:FS01:0x22: OS Version: 5.4
20:21:23:WU03:FS01:0x22:Has Battery: false
20:21:23:WU03:FS01:0x22: On Battery: false
20:21:23:WU03:FS01:0x22: UTC Offset: 2
20:21:23:WU03:FS01:0x22: PID: 1319
20:21:23:WU03:FS01:0x22: CWD: /var/lib/fahclient/work
20:21:23:WU03:FS01:0x22:************************************ OpenMM ************************************
20:21:23:WU03:FS01:0x22: Revision: 189320d0
20:21:23:WU03:FS01:0x22:********************************************************************************
20:21:23:WU03:FS01:0x22:Project: 17405 (Run 0, Clone 150, Gen 8)
20:21:23:WU03:FS01:0x22:Unit: 0x00000008cedfaa925f59be422880489a
20:21:23:WU03:FS01:0x22:Digital signatures verified
20:21:23:WU03:FS01:0x22:Folding@home GPU Core22 Folding@home Core
20:21:23:WU03:FS01:0x22:Version 0.0.13
20:21:23:WU03:FS01:0x22: Checkpoint write interval: 25000 steps (2%) [50 total]
20:21:23:WU03:FS01:0x22: JSON viewer frame write interval: 12500 steps (1%) [100 total]
20:21:23:WU03:FS01:0x22: XTC frame write interval: 10000 steps (0.8%) [125 total]
20:21:23:WU03:FS01:0x22: Global context and integrator variables write interval: disabled
20:21:23:WU00:FS02:Starting
20:21:23:WU00:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit/22-0.0.13/Core_22.fah/FahCore_22 -dir 00 -suffix 01 -version 706 -lifeline 1053 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
20:21:23:WU00:FS02:Started FahCore on PID 1325
20:21:23:WU00:FS02:Core PID:1329
20:21:23:WU00:FS02:FahCore 0x22 started
20:21:24:WU00:FS02:0x22:*********************** Log Started 2020-09-30T20:21:23Z ***********************
20:21:24:WU00:FS02:0x22:*************************** Core22 Folding@home Core ***************************
20:21:24:WU00:FS02:0x22: Core: Core22
20:21:24:WU00:FS02:0x22: Type: 0x22
20:21:24:WU00:FS02:0x22: Version: 0.0.13
20:21:24:WU00:FS02:0x22: Author: Joseph Coffland <[email protected]>
20:21:24:WU00:FS02:0x22: Copyright: 2020 foldingathome.org
20:21:24:WU00:FS02:0x22: Homepage: https://foldingathome.org/
20:21:24:WU00:FS02:0x22: Date: Sep 19 2020
20:21:24:WU00:FS02:0x22: Time: 01:10:35
20:21:24:WU00:FS02:0x22: Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
20:21:24:WU00:FS02:0x22: Branch: core22-0.0.13
20:21:24:WU00:FS02:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:24:WU00:FS02:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:24:WU00:FS02:0x22: -funroll-loops -DOPENMM_GIT_HASH="\"189320d0\""
20:21:24:WU00:FS02:0x22: Platform: linux2 4.19.76-linuxkit
20:21:24:WU00:FS02:0x22: Bits: 64
20:21:24:WU00:FS02:0x22: Mode: Release
20:21:24:WU00:FS02:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
20:21:24:WU00:FS02:0x22: <[email protected]>
20:21:24:WU00:FS02:0x22: Args: -dir 00 -suffix 01 -version 706 -lifeline 1325 -checkpoint 15
20:21:24:WU00:FS02:0x22: -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
20:21:24:WU00:FS02:0x22: 0 -gpu 0
20:21:24:WU00:FS02:0x22:************************************ libFAH ************************************
20:21:24:WU00:FS02:0x22: Date: Sep 15 2020
20:21:24:WU00:FS02:0x22: Time: 05:14:43
20:21:24:WU00:FS02:0x22: Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
20:21:24:WU00:FS02:0x22: Branch: HEAD
20:21:24:WU00:FS02:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:24:WU00:FS02:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:24:WU00:FS02:0x22: -funroll-loops
20:21:24:WU00:FS02:0x22: Platform: linux2 4.19.76-linuxkit
20:21:24:WU00:FS02:0x22: Bits: 64
20:21:24:WU00:FS02:0x22: Mode: Release
20:21:24:WU00:FS02:0x22:************************************ CBang *************************************
20:21:24:WU00:FS02:0x22: Date: Sep 15 2020
20:21:24:WU00:FS02:0x22: Time: 05:11:04
20:21:24:WU00:FS02:0x22: Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
20:21:24:WU00:FS02:0x22: Branch: HEAD
20:21:24:WU00:FS02:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:24:WU00:FS02:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:24:WU00:FS02:0x22: -funroll-loops -fPIC
20:21:24:WU00:FS02:0x22: Platform: linux2 4.19.76-linuxkit
20:21:24:WU00:FS02:0x22: Bits: 64
20:21:24:WU00:FS02:0x22: Mode: Release
20:21:24:WU00:FS02:0x22:************************************ System ************************************
20:21:24:WU00:FS02:0x22: CPU: AMD Phenom(tm) II X6 1090T Processor
20:21:24:WU00:FS02:0x22: CPU ID: AuthenticAMD Family 16 Model 10 Stepping 0
20:21:24:WU00:FS02:0x22: CPUs: 6
20:21:24:WU00:FS02:0x22: Memory: 7.75GiB
20:21:24:WU00:FS02:0x22:Free Memory: 7.15GiB
20:21:24:WU00:FS02:0x22: Threads: POSIX_THREADS
20:21:24:WU00:FS02:0x22: OS Version: 5.4
20:21:24:WU00:FS02:0x22:Has Battery: false
20:21:24:WU00:FS02:0x22: On Battery: false
20:21:24:WU00:FS02:0x22: UTC Offset: 2
20:21:24:WU00:FS02:0x22: PID: 1329
20:21:24:WU00:FS02:0x22: CWD: /var/lib/fahclient/work
20:21:24:WU00:FS02:0x22:************************************ OpenMM ************************************
20:21:24:WU00:FS02:0x22: Revision: 189320d0
20:21:24:WU00:FS02:0x22:********************************************************************************
20:21:24:WU00:FS02:0x22:Project: 17405 (Run 0, Clone 466, Gen 7)
20:21:24:WU00:FS02:0x22:Unit: 0x00000008cedfaa925f59be32b7702159
20:21:24:WU00:FS02:0x22:Digital signatures verified
20:21:24:WU00:FS02:0x22:Folding@home GPU Core22 Folding@home Core
20:21:24:WU00:FS02:0x22:Version 0.0.13
20:21:24:WU00:FS02:0x22: Checkpoint write interval: 25000 steps (2%) [50 total]
20:21:24:WU00:FS02:0x22: JSON viewer frame write interval: 12500 steps (1%) [100 total]
20:21:24:WU00:FS02:0x22: XTC frame write interval: 10000 steps (0.8%) [125 total]
20:21:24:WU00:FS02:0x22: Global context and integrator variables write interval: disabled
20:21:27:WU00:FS02:0x22:There are 3 platforms available.
20:21:27:WU00:FS02:0x22:Platform 0: Reference
20:21:27:WU00:FS02:0x22:Platform 1: OpenCL
20:21:27:WU00:FS02:0x22: opencl-device 0 specified
20:21:27:WU00:FS02:0x22:Platform 2: CUDA
20:21:27:WU00:FS02:0x22: cuda-device 0 specified
20:21:27:WU04:FS03:0x22:There are 3 platforms available.
20:21:27:WU04:FS03:0x22:Platform 0: Reference
20:21:27:WU04:FS03:0x22:Platform 1: OpenCL
20:21:27:WU04:FS03:0x22: opencl-device 2 specified
20:21:27:WU04:FS03:0x22:Platform 2: CUDA
20:21:27:WU04:FS03:0x22: cuda-device 2 specified
20:21:27:WU03:FS01:0x22:There are 3 platforms available.
20:21:27:WU03:FS01:0x22:Platform 0: Reference
20:21:27:WU03:FS01:0x22:Platform 1: OpenCL
20:21:27:WU03:FS01:0x22: opencl-device 1 specified
20:21:27:WU03:FS01:0x22:Platform 2: CUDA
20:21:27:WU03:FS01:0x22: cuda-device 1 specified
20:21:34:WU04:FS03:0x22:Attempting to create CUDA context:
20:21:34:WU04:FS03:0x22: Configuring platform CUDA
20:21:40:WU04:FS03:0x22:Failed to create CUDA context:
20:21:40:WU04:FS03:0x22:Error loading CUDA module: CUDA_ERROR_INVALID_PTX (218)
20:21:40:WU04:FS03:0x22:Attempting to create OpenCL context:
20:21:40:WU04:FS03:0x22: Configuring platform OpenCL
20:21:46:WU03:FS01:0x22:Attempting to create CUDA context:
20:21:46:WU03:FS01:0x22: Configuring platform CUDA
20:21:47:WU03:FS01:0x22:Failed to create CUDA context:
20:21:47:WU03:FS01:0x22:Error loading CUDA module: CUDA_ERROR_INVALID_PTX (218)
20:21:47:WU03:FS01:0x22:Attempting to create OpenCL context:
20:21:47:WU03:FS01:0x22: Configuring platform OpenCL
20:21:47:WU00:FS02:0x22:Attempting to create CUDA context:
20:21:47:WU00:FS02:0x22: Configuring platform CUDA
20:21:47:WU00:FS02:0x22:Failed to create CUDA context:
20:21:47:WU00:FS02:0x22:Error loading CUDA module: CUDA_ERROR_INVALID_PTX (218)
20:21:47:WU00:FS02:0x22:Attempting to create OpenCL context:
20:21:47:WU00:FS02:0x22: Configuring platform OpenCL
20:21:58:WU01:FS04:Connecting to assign1.foldingathome.org:80
20:22:00:WU01:FS04:Assigned to work server 66.170.111.50
20:22:00:WU01:FS04:Requesting new work unit for slot 04: READY gpu:3:GK107 [GeForce GTX 650] 812 from 66.170.111.50
20:22:00:WU01:FS04:Connecting to 66.170.111.50:8080
20:22:01:WU01:FS04:Downloading 10.20MiB
*********************** Log Started 2020-09-30T20:21:14Z ***********************
20:21:14:Trying to access database...
20:21:15:Successfully acquired database lock
20:21:15:Read GPUs.txt
20:21:15:Enabled folding slot 00: PAUSED cpu:1 (by user)
20:21:19:Enabled folding slot 01: READY gpu:0:GK104 [GeForce GTX 670/GTX 760Ti OEM] 2634
20:21:19:Enabled folding slot 02: READY gpu:1:GK104 [GeForce GTX 770] 3213
20:21:19:Enabled folding slot 03: READY gpu:2:GK106 [GeForce GTX 660]
20:21:19:Enabled folding slot 04: READY gpu:3:GK107 [GeForce GTX 650] 812
20:21:19:****************************** FAHClient ******************************
20:21:19: Version: 7.6.13
20:21:19: Author: Joseph Coffland <[email protected]>
20:21:19: Copyright: 2020 foldingathome.org
20:21:19: Homepage: https://foldingathome.org/
20:21:19: Date: Apr 28 2020
20:21:19: Time: 04:20:16
20:21:19: Revision: 5a652817f46116b6e135503af97f18e094414e3b
20:21:19: Branch: master
20:21:19: Compiler: GNU 8.3.0
20:21:19: Options: -std=c++11 -ffunction-sections -fdata-sections -O3
20:21:19: -funroll-loops -fno-pie
20:21:19: Platform: linux2 4.19.0-5-amd64
20:21:19: Bits: 64
20:21:19: Mode: Release
20:21:19: Args: --child --run-as fahclient --pid-file=/var/run/fahclient.pid
20:21:19: --daemon
20:21:19: Config: /var/lib/fahclient/config.xml
20:21:19:******************************** CBang ********************************
20:21:19: Date: Apr 25 2020
20:21:19: Time: 00:07:53
20:21:19: Revision: ea081a3b3b0f4a37c4d0440b4f1bc184197c7797
20:21:19: Branch: master
20:21:19: Compiler: GNU 8.3.0
20:21:19: Options: -std=c++11 -ffunction-sections -fdata-sections -O3
20:21:19: -funroll-loops -fno-pie -fPIC
20:21:19: Platform: linux2 4.19.0-5-amd64
20:21:19: Bits: 64
20:21:19: Mode: Release
20:21:19:******************************* System ********************************
20:21:19: CPU: AMD Phenom(tm) II X6 1090T Processor
20:21:19: CPU ID: AuthenticAMD Family 16 Model 10 Stepping 0
20:21:19: CPUs: 6
20:21:19: Memory: 7.75GiB
20:21:19: Free Memory: 7.40GiB
20:21:19: Threads: POSIX_THREADS
20:21:19: OS Version: 5.4
20:21:19: Has Battery: false
20:21:19: On Battery: false
20:21:19: UTC Offset: 2
20:21:19: PID: 1053
20:21:19: CWD: /var/lib/fahclient
20:21:19: OS: Linux 5.4.0-47-generic x86_64
20:21:19: OS Arch: AMD64
20:21:19: GPUs: 4
20:21:19: GPU 0: Bus:1 Slot:0 Func:0 NVIDIA:4 GK104 [GeForce GTX 670/GTX 760Ti
20:21:19: OEM] 2634
20:21:19: GPU 1: Bus:2 Slot:0 Func:0 NVIDIA:4 GK104 [GeForce GTX 770] 3213
20:21:19: GPU 2: Bus:3 Slot:0 Func:0 NVIDIA:3 GK106 [GeForce GTX 660]
20:21:19: GPU 3: Bus:6 Slot:0 Func:0 NVIDIA:3 GK107 [GeForce GTX 650] 812
20:21:19: CUDA Device 0: Platform:0 Device:0 Bus:2 Slot:0 Compute:3.0 Driver:9.1
20:21:19: CUDA Device 1: Platform:0 Device:1 Bus:1 Slot:0 Compute:3.0 Driver:9.1
20:21:19: CUDA Device 2: Platform:0 Device:2 Bus:3 Slot:0 Compute:3.0 Driver:9.1
20:21:19: CUDA Device 3: Platform:0 Device:3 Bus:6 Slot:0 Compute:3.0 Driver:9.1
20:21:19:OpenCL Device 0: Platform:0 Device:0 Bus:2 Slot:0 Compute:1.2 Driver:390.138
20:21:19:OpenCL Device 1: Platform:0 Device:1 Bus:1 Slot:0 Compute:1.2 Driver:390.138
20:21:19:OpenCL Device 2: Platform:0 Device:2 Bus:3 Slot:0 Compute:1.2 Driver:390.138
20:21:19:OpenCL Device 3: Platform:0 Device:3 Bus:6 Slot:0 Compute:1.2 Driver:390.138
20:21:19:******************************* libFAH ********************************
20:21:19: Date: Apr 15 2020
20:21:19: Time: 21:43:24
20:21:19: Revision: 216968bc7025029c841ed6e36e81a03a316890d3
20:21:19: Branch: master
20:21:19: Compiler: GNU 8.3.0
20:21:19: Options: -std=c++11 -ffunction-sections -fdata-sections -O3
20:21:19: -funroll-loops -fno-pie
20:21:19: Platform: linux2 4.19.0-5-amd64
20:21:19: Bits: 64
20:21:19: Mode: Release
20:21:19:***********************************************************************
20:21:19:<config>
20:21:19: <!-- HTTP Server -->
20:21:19: <allow v='192.168.1.0/24'/>
20:21:19:
20:21:19: <!-- Network -->
20:21:19: <proxy v=':8080'/>
20:21:19:
20:21:19: <!-- Remote Command Server -->
20:21:19: <command-allow-no-pass v='127.0.0.1 192.168.1.0/24'/>
20:21:19: <password v='*****'/>
20:21:19:
20:21:19: <!-- User Information -->
20:21:19: <passkey v='*****'/>
20:21:19: <team v='*****'/>
20:21:19: <user v='*****'/>
20:21:19:
20:21:19: <!-- Web Server -->
20:21:19: <web-allow v='127.0.0.1 192.168.1.0/24'/>
20:21:19:
20:21:19: <!-- Folding Slots -->
20:21:19: <slot id='0' type='CPU'>
20:21:19: <paused v='true'/>
20:21:19: </slot>
20:21:19: <slot id='1' type='GPU'/>
20:21:19: <slot id='2' type='GPU'/>
20:21:19: <slot id='3' type='GPU'/>
20:21:19: <slot id='4' type='GPU'/>
20:21:19:</config>
20:21:19:WU04:FS03:Starting
20:21:19:WU04:FS03:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit/22-0.0.13/Core_22.fah/FahCore_22 -dir 04 -suffix 01 -version 706 -lifeline 1053 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 2 -cuda-device 2 -gpu 2
20:21:19:WU04:FS03:Started FahCore on PID 1308
20:21:20:WU04:FS03:Core PID:1312
20:21:20:WU04:FS03:FahCore 0x22 started
20:21:22:WU03:FS01:Starting
20:21:22:WU03:FS01:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit/22-0.0.13/Core_22.fah/FahCore_22 -dir 03 -suffix 01 -version 706 -lifeline 1053 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 1 -cuda-device 1 -gpu 1
20:21:22:WU03:FS01:Started FahCore on PID 1315
20:21:22:WU03:FS01:Core PID:1319
20:21:22:WU03:FS01:FahCore 0x22 started
20:21:23:WU04:FS03:0x22:*********************** Log Started 2020-09-30T20:21:22Z ***********************
20:21:23:WU04:FS03:0x22:*************************** Core22 Folding@home Core ***************************
20:21:23:WU04:FS03:0x22: Core: Core22
20:21:23:WU04:FS03:0x22: Type: 0x22
20:21:23:WU04:FS03:0x22: Version: 0.0.13
20:21:23:WU04:FS03:0x22: Author: Joseph Coffland <[email protected]>
20:21:23:WU04:FS03:0x22: Copyright: 2020 foldingathome.org
20:21:23:WU04:FS03:0x22: Homepage: https://foldingathome.org/
20:21:23:WU04:FS03:0x22: Date: Sep 19 2020
20:21:23:WU04:FS03:0x22: Time: 01:10:35
20:21:23:WU04:FS03:0x22: Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
20:21:23:WU04:FS03:0x22: Branch: core22-0.0.13
20:21:23:WU04:FS03:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:23:WU04:FS03:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:23:WU04:FS03:0x22: -funroll-loops -DOPENMM_GIT_HASH="\"189320d0\""
20:21:23:WU04:FS03:0x22: Platform: linux2 4.19.76-linuxkit
20:21:23:WU04:FS03:0x22: Bits: 64
20:21:23:WU04:FS03:0x22: Mode: Release
20:21:23:WU04:FS03:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
20:21:23:WU04:FS03:0x22: <[email protected]>
20:21:23:WU04:FS03:0x22: Args: -dir 04 -suffix 01 -version 706 -lifeline 1308 -checkpoint 15
20:21:23:WU04:FS03:0x22: -gpu-vendor nvidia -opencl-platform 0 -opencl-device 2 -cuda-device
20:21:23:WU04:FS03:0x22: 2 -gpu 2
20:21:23:WU04:FS03:0x22:************************************ libFAH ************************************
20:21:23:WU04:FS03:0x22: Date: Sep 15 2020
20:21:23:WU04:FS03:0x22: Time: 05:14:43
20:21:23:WU04:FS03:0x22: Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
20:21:23:WU04:FS03:0x22: Branch: HEAD
20:21:23:WU04:FS03:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:23:WU04:FS03:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:23:WU04:FS03:0x22: -funroll-loops
20:21:23:WU04:FS03:0x22: Platform: linux2 4.19.76-linuxkit
20:21:23:WU04:FS03:0x22: Bits: 64
20:21:23:WU04:FS03:0x22: Mode: Release
20:21:23:WU04:FS03:0x22:************************************ CBang *************************************
20:21:23:WU04:FS03:0x22: Date: Sep 15 2020
20:21:23:WU04:FS03:0x22: Time: 05:11:04
20:21:23:WU04:FS03:0x22: Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
20:21:23:WU04:FS03:0x22: Branch: HEAD
20:21:23:WU04:FS03:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:23:WU04:FS03:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:23:WU04:FS03:0x22: -funroll-loops -fPIC
20:21:23:WU04:FS03:0x22: Platform: linux2 4.19.76-linuxkit
20:21:23:WU04:FS03:0x22: Bits: 64
20:21:23:WU04:FS03:0x22: Mode: Release
20:21:23:WU04:FS03:0x22:************************************ System ************************************
20:21:23:WU04:FS03:0x22: CPU: AMD Phenom(tm) II X6 1090T Processor
20:21:23:WU04:FS03:0x22: CPU ID: AuthenticAMD Family 16 Model 10 Stepping 0
20:21:23:WU04:FS03:0x22: CPUs: 6
20:21:23:WU04:FS03:0x22: Memory: 7.75GiB
20:21:23:WU04:FS03:0x22:Free Memory: 7.19GiB
20:21:23:WU04:FS03:0x22: Threads: POSIX_THREADS
20:21:23:WU04:FS03:0x22: OS Version: 5.4
20:21:23:WU04:FS03:0x22:Has Battery: false
20:21:23:WU04:FS03:0x22: On Battery: false
20:21:23:WU04:FS03:0x22: UTC Offset: 2
20:21:23:WU04:FS03:0x22: PID: 1312
20:21:23:WU04:FS03:0x22: CWD: /var/lib/fahclient/work
20:21:23:WU04:FS03:0x22:************************************ OpenMM ************************************
20:21:23:WU04:FS03:0x22: Revision: 189320d0
20:21:23:WU04:FS03:0x22:********************************************************************************
20:21:23:WU04:FS03:0x22:Project: 16918 (Run 72, Clone 107, Gen 94)
20:21:23:WU04:FS03:0x22:Unit: 0x000000860002894c5f1761a1a9a1fd22
20:21:23:WU04:FS03:0x22:Digital signatures verified
20:21:23:WU04:FS03:0x22:Folding@home GPU Core22 Folding@home Core
20:21:23:WU04:FS03:0x22:Version 0.0.13
20:21:23:WU04:FS03:0x22: Checkpoint write interval: 100000 steps (2%) [50 total]
20:21:23:WU04:FS03:0x22: JSON viewer frame write interval: 50000 steps (1%) [100 total]
20:21:23:WU04:FS03:0x22: XTC frame write interval: 250000 steps (5%) [20 total]
20:21:23:WU04:FS03:0x22: Global context and integrator variables write interval: disabled
20:21:23:WU03:FS01:0x22:*********************** Log Started 2020-09-30T20:21:23Z ***********************
20:21:23:WU03:FS01:0x22:*************************** Core22 Folding@home Core ***************************
20:21:23:WU03:FS01:0x22: Core: Core22
20:21:23:WU03:FS01:0x22: Type: 0x22
20:21:23:WU03:FS01:0x22: Version: 0.0.13
20:21:23:WU03:FS01:0x22: Author: Joseph Coffland <[email protected]>
20:21:23:WU03:FS01:0x22: Copyright: 2020 foldingathome.org
20:21:23:WU03:FS01:0x22: Homepage: https://foldingathome.org/
20:21:23:WU03:FS01:0x22: Date: Sep 19 2020
20:21:23:WU03:FS01:0x22: Time: 01:10:35
20:21:23:WU03:FS01:0x22: Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
20:21:23:WU03:FS01:0x22: Branch: core22-0.0.13
20:21:23:WU03:FS01:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:23:WU03:FS01:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:23:WU03:FS01:0x22: -funroll-loops -DOPENMM_GIT_HASH="\"189320d0\""
20:21:23:WU03:FS01:0x22: Platform: linux2 4.19.76-linuxkit
20:21:23:WU03:FS01:0x22: Bits: 64
20:21:23:WU03:FS01:0x22: Mode: Release
20:21:23:WU03:FS01:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
20:21:23:WU03:FS01:0x22: <[email protected]>
20:21:23:WU03:FS01:0x22: Args: -dir 03 -suffix 01 -version 706 -lifeline 1315 -checkpoint 15
20:21:23:WU03:FS01:0x22: -gpu-vendor nvidia -opencl-platform 0 -opencl-device 1 -cuda-device
20:21:23:WU03:FS01:0x22: 1 -gpu 1
20:21:23:WU03:FS01:0x22:************************************ libFAH ************************************
20:21:23:WU03:FS01:0x22: Date: Sep 15 2020
20:21:23:WU03:FS01:0x22: Time: 05:14:43
20:21:23:WU03:FS01:0x22: Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
20:21:23:WU03:FS01:0x22: Branch: HEAD
20:21:23:WU03:FS01:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:23:WU03:FS01:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:23:WU03:FS01:0x22: -funroll-loops
20:21:23:WU03:FS01:0x22: Platform: linux2 4.19.76-linuxkit
20:21:23:WU03:FS01:0x22: Bits: 64
20:21:23:WU03:FS01:0x22: Mode: Release
20:21:23:WU03:FS01:0x22:************************************ CBang *************************************
20:21:23:WU03:FS01:0x22: Date: Sep 15 2020
20:21:23:WU03:FS01:0x22: Time: 05:11:04
20:21:23:WU03:FS01:0x22: Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
20:21:23:WU03:FS01:0x22: Branch: HEAD
20:21:23:WU03:FS01:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:23:WU03:FS01:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:23:WU03:FS01:0x22: -funroll-loops -fPIC
20:21:23:WU03:FS01:0x22: Platform: linux2 4.19.76-linuxkit
20:21:23:WU03:FS01:0x22: Bits: 64
20:21:23:WU03:FS01:0x22: Mode: Release
20:21:23:WU03:FS01:0x22:************************************ System ************************************
20:21:23:WU03:FS01:0x22: CPU: AMD Phenom(tm) II X6 1090T Processor
20:21:23:WU03:FS01:0x22: CPU ID: AuthenticAMD Family 16 Model 10 Stepping 0
20:21:23:WU03:FS01:0x22: CPUs: 6
20:21:23:WU03:FS01:0x22: Memory: 7.75GiB
20:21:23:WU03:FS01:0x22:Free Memory: 7.19GiB
20:21:23:WU03:FS01:0x22: Threads: POSIX_THREADS
20:21:23:WU03:FS01:0x22: OS Version: 5.4
20:21:23:WU03:FS01:0x22:Has Battery: false
20:21:23:WU03:FS01:0x22: On Battery: false
20:21:23:WU03:FS01:0x22: UTC Offset: 2
20:21:23:WU03:FS01:0x22: PID: 1319
20:21:23:WU03:FS01:0x22: CWD: /var/lib/fahclient/work
20:21:23:WU03:FS01:0x22:************************************ OpenMM ************************************
20:21:23:WU03:FS01:0x22: Revision: 189320d0
20:21:23:WU03:FS01:0x22:********************************************************************************
20:21:23:WU03:FS01:0x22:Project: 17405 (Run 0, Clone 150, Gen 8)
20:21:23:WU03:FS01:0x22:Unit: 0x00000008cedfaa925f59be422880489a
20:21:23:WU03:FS01:0x22:Digital signatures verified
20:21:23:WU03:FS01:0x22:Folding@home GPU Core22 Folding@home Core
20:21:23:WU03:FS01:0x22:Version 0.0.13
20:21:23:WU03:FS01:0x22: Checkpoint write interval: 25000 steps (2%) [50 total]
20:21:23:WU03:FS01:0x22: JSON viewer frame write interval: 12500 steps (1%) [100 total]
20:21:23:WU03:FS01:0x22: XTC frame write interval: 10000 steps (0.8%) [125 total]
20:21:23:WU03:FS01:0x22: Global context and integrator variables write interval: disabled
20:21:23:WU00:FS02:Starting
20:21:23:WU00:FS02:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit/22-0.0.13/Core_22.fah/FahCore_22 -dir 00 -suffix 01 -version 706 -lifeline 1053 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device 0 -gpu 0
20:21:23:WU00:FS02:Started FahCore on PID 1325
20:21:23:WU00:FS02:Core PID:1329
20:21:23:WU00:FS02:FahCore 0x22 started
20:21:24:WU00:FS02:0x22:*********************** Log Started 2020-09-30T20:21:23Z ***********************
20:21:24:WU00:FS02:0x22:*************************** Core22 Folding@home Core ***************************
20:21:24:WU00:FS02:0x22: Core: Core22
20:21:24:WU00:FS02:0x22: Type: 0x22
20:21:24:WU00:FS02:0x22: Version: 0.0.13
20:21:24:WU00:FS02:0x22: Author: Joseph Coffland <[email protected]>
20:21:24:WU00:FS02:0x22: Copyright: 2020 foldingathome.org
20:21:24:WU00:FS02:0x22: Homepage: https://foldingathome.org/
20:21:24:WU00:FS02:0x22: Date: Sep 19 2020
20:21:24:WU00:FS02:0x22: Time: 01:10:35
20:21:24:WU00:FS02:0x22: Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
20:21:24:WU00:FS02:0x22: Branch: core22-0.0.13
20:21:24:WU00:FS02:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:24:WU00:FS02:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:24:WU00:FS02:0x22: -funroll-loops -DOPENMM_GIT_HASH="\"189320d0\""
20:21:24:WU00:FS02:0x22: Platform: linux2 4.19.76-linuxkit
20:21:24:WU00:FS02:0x22: Bits: 64
20:21:24:WU00:FS02:0x22: Mode: Release
20:21:24:WU00:FS02:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
20:21:24:WU00:FS02:0x22: <[email protected]>
20:21:24:WU00:FS02:0x22: Args: -dir 00 -suffix 01 -version 706 -lifeline 1325 -checkpoint 15
20:21:24:WU00:FS02:0x22: -gpu-vendor nvidia -opencl-platform 0 -opencl-device 0 -cuda-device
20:21:24:WU00:FS02:0x22: 0 -gpu 0
20:21:24:WU00:FS02:0x22:************************************ libFAH ************************************
20:21:24:WU00:FS02:0x22: Date: Sep 15 2020
20:21:24:WU00:FS02:0x22: Time: 05:14:43
20:21:24:WU00:FS02:0x22: Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
20:21:24:WU00:FS02:0x22: Branch: HEAD
20:21:24:WU00:FS02:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:24:WU00:FS02:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:24:WU00:FS02:0x22: -funroll-loops
20:21:24:WU00:FS02:0x22: Platform: linux2 4.19.76-linuxkit
20:21:24:WU00:FS02:0x22: Bits: 64
20:21:24:WU00:FS02:0x22: Mode: Release
20:21:24:WU00:FS02:0x22:************************************ CBang *************************************
20:21:24:WU00:FS02:0x22: Date: Sep 15 2020
20:21:24:WU00:FS02:0x22: Time: 05:11:04
20:21:24:WU00:FS02:0x22: Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
20:21:24:WU00:FS02:0x22: Branch: HEAD
20:21:24:WU00:FS02:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:21:24:WU00:FS02:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:21:24:WU00:FS02:0x22: -funroll-loops -fPIC
20:21:24:WU00:FS02:0x22: Platform: linux2 4.19.76-linuxkit
20:21:24:WU00:FS02:0x22: Bits: 64
20:21:24:WU00:FS02:0x22: Mode: Release
20:21:24:WU00:FS02:0x22:************************************ System ************************************
20:21:24:WU00:FS02:0x22: CPU: AMD Phenom(tm) II X6 1090T Processor
20:21:24:WU00:FS02:0x22: CPU ID: AuthenticAMD Family 16 Model 10 Stepping 0
20:21:24:WU00:FS02:0x22: CPUs: 6
20:21:24:WU00:FS02:0x22: Memory: 7.75GiB
20:21:24:WU00:FS02:0x22:Free Memory: 7.15GiB
20:21:24:WU00:FS02:0x22: Threads: POSIX_THREADS
20:21:24:WU00:FS02:0x22: OS Version: 5.4
20:21:24:WU00:FS02:0x22:Has Battery: false
20:21:24:WU00:FS02:0x22: On Battery: false
20:21:24:WU00:FS02:0x22: UTC Offset: 2
20:21:24:WU00:FS02:0x22: PID: 1329
20:21:24:WU00:FS02:0x22: CWD: /var/lib/fahclient/work
20:21:24:WU00:FS02:0x22:************************************ OpenMM ************************************
20:21:24:WU00:FS02:0x22: Revision: 189320d0
20:21:24:WU00:FS02:0x22:********************************************************************************
20:21:24:WU00:FS02:0x22:Project: 17405 (Run 0, Clone 466, Gen 7)
20:21:24:WU00:FS02:0x22:Unit: 0x00000008cedfaa925f59be32b7702159
20:21:24:WU00:FS02:0x22:Digital signatures verified
20:21:24:WU00:FS02:0x22:Folding@home GPU Core22 Folding@home Core
20:21:24:WU00:FS02:0x22:Version 0.0.13
20:21:24:WU00:FS02:0x22: Checkpoint write interval: 25000 steps (2%) [50 total]
20:21:24:WU00:FS02:0x22: JSON viewer frame write interval: 12500 steps (1%) [100 total]
20:21:24:WU00:FS02:0x22: XTC frame write interval: 10000 steps (0.8%) [125 total]
20:21:24:WU00:FS02:0x22: Global context and integrator variables write interval: disabled
20:21:27:WU00:FS02:0x22:There are 3 platforms available.
20:21:27:WU00:FS02:0x22:Platform 0: Reference
20:21:27:WU00:FS02:0x22:Platform 1: OpenCL
20:21:27:WU00:FS02:0x22: opencl-device 0 specified
20:21:27:WU00:FS02:0x22:Platform 2: CUDA
20:21:27:WU00:FS02:0x22: cuda-device 0 specified
20:21:27:WU04:FS03:0x22:There are 3 platforms available.
20:21:27:WU04:FS03:0x22:Platform 0: Reference
20:21:27:WU04:FS03:0x22:Platform 1: OpenCL
20:21:27:WU04:FS03:0x22: opencl-device 2 specified
20:21:27:WU04:FS03:0x22:Platform 2: CUDA
20:21:27:WU04:FS03:0x22: cuda-device 2 specified
20:21:27:WU03:FS01:0x22:There are 3 platforms available.
20:21:27:WU03:FS01:0x22:Platform 0: Reference
20:21:27:WU03:FS01:0x22:Platform 1: OpenCL
20:21:27:WU03:FS01:0x22: opencl-device 1 specified
20:21:27:WU03:FS01:0x22:Platform 2: CUDA
20:21:27:WU03:FS01:0x22: cuda-device 1 specified
20:21:34:WU04:FS03:0x22:Attempting to create CUDA context:
20:21:34:WU04:FS03:0x22: Configuring platform CUDA
20:21:40:WU04:FS03:0x22:Failed to create CUDA context:
20:21:40:WU04:FS03:0x22:Error loading CUDA module: CUDA_ERROR_INVALID_PTX (218)
20:21:40:WU04:FS03:0x22:Attempting to create OpenCL context:
20:21:40:WU04:FS03:0x22: Configuring platform OpenCL
20:21:46:WU03:FS01:0x22:Attempting to create CUDA context:
20:21:46:WU03:FS01:0x22: Configuring platform CUDA
20:21:47:WU03:FS01:0x22:Failed to create CUDA context:
20:21:47:WU03:FS01:0x22:Error loading CUDA module: CUDA_ERROR_INVALID_PTX (218)
20:21:47:WU03:FS01:0x22:Attempting to create OpenCL context:
20:21:47:WU03:FS01:0x22: Configuring platform OpenCL
20:21:47:WU00:FS02:0x22:Attempting to create CUDA context:
20:21:47:WU00:FS02:0x22: Configuring platform CUDA
20:21:47:WU00:FS02:0x22:Failed to create CUDA context:
20:21:47:WU00:FS02:0x22:Error loading CUDA module: CUDA_ERROR_INVALID_PTX (218)
20:21:47:WU00:FS02:0x22:Attempting to create OpenCL context:
20:21:47:WU00:FS02:0x22: Configuring platform OpenCL
20:21:58:WU01:FS04:Connecting to assign1.foldingathome.org:80
20:22:00:WU01:FS04:Assigned to work server 66.170.111.50
20:22:00:WU01:FS04:Requesting new work unit for slot 04: READY gpu:3:GK107 [GeForce GTX 650] 812 from 66.170.111.50
20:22:00:WU01:FS04:Connecting to 66.170.111.50:8080
20:22:01:WU01:FS04:Downloading 10.20MiB
20:22:07:WU01:FS04:Download 34.31%
20:22:13:WU01:FS04:Download 83.94%
20:22:15:WU01:FS04:Download complete
20:22:15:WU01:FS04:Received Unit: id:01 state:DOWNLOAD error:NO_ERROR project:14489 run:0 clone:1757 gen:66 core:0x22 unit:0x0000005942aa6f325f45dea7995d8441
20:22:15:WU01:FS04:Starting
20:22:15:WU01:FS04:Running FahCore: /usr/bin/FAHCoreWrapper /var/lib/fahclient/cores/cores.foldingathome.org/lin/64bit/22-0.0.13/Core_22.fah/FahCore_22 -dir 01 -suffix 01 -version 706 -lifeline 1053 -checkpoint 15 -gpu-vendor nvidia -opencl-platform 0 -opencl-device 3 -cuda-device 3 -gpu 3
20:22:15:WU01:FS04:Started FahCore on PID 1734
20:22:15:WU01:FS04:Core PID:1738
20:22:15:WU01:FS04:FahCore 0x22 started
20:22:16:WU01:FS04:0x22:*********************** Log Started 2020-09-30T20:22:15Z ***********************
20:22:16:WU01:FS04:0x22:*************************** Core22 Folding@home Core ***************************
20:22:16:WU01:FS04:0x22: Core: Core22
20:22:16:WU01:FS04:0x22: Type: 0x22
20:22:16:WU01:FS04:0x22: Version: 0.0.13
20:22:16:WU01:FS04:0x22: Author: Joseph Coffland <[email protected]>
20:22:16:WU01:FS04:0x22: Copyright: 2020 foldingathome.org
20:22:16:WU01:FS04:0x22: Homepage: https://foldingathome.org/
20:22:16:WU01:FS04:0x22: Date: Sep 19 2020
20:22:16:WU01:FS04:0x22: Time: 01:10:35
20:22:16:WU01:FS04:0x22: Revision: 571cf95de6de2c592c7c3ed48fcfb2e33e9ea7d3
20:22:16:WU01:FS04:0x22: Branch: core22-0.0.13
20:22:16:WU01:FS04:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:22:16:WU01:FS04:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:22:16:WU01:FS04:0x22: -funroll-loops -DOPENMM_GIT_HASH="\"189320d0\""
20:22:16:WU01:FS04:0x22: Platform: linux2 4.19.76-linuxkit
20:22:16:WU01:FS04:0x22: Bits: 64
20:22:16:WU01:FS04:0x22: Mode: Release
20:22:16:WU01:FS04:0x22:Maintainers: John Chodera <[email protected]> and Peter Eastman
20:22:16:WU01:FS04:0x22: <[email protected]>
20:22:16:WU01:FS04:0x22: Args: -dir 01 -suffix 01 -version 706 -lifeline 1734 -checkpoint 15
20:22:16:WU01:FS04:0x22: -gpu-vendor nvidia -opencl-platform 0 -opencl-device 3 -cuda-device
20:22:16:WU01:FS04:0x22: 3 -gpu 3
20:22:16:WU01:FS04:0x22:************************************ libFAH ************************************
20:22:16:WU01:FS04:0x22: Date: Sep 15 2020
20:22:16:WU01:FS04:0x22: Time: 05:14:43
20:22:16:WU01:FS04:0x22: Revision: 44301ed97b996b63fe736bb8073f22209cb2b603
20:22:16:WU01:FS04:0x22: Branch: HEAD
20:22:16:WU01:FS04:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:22:16:WU01:FS04:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:22:16:WU01:FS04:0x22: -funroll-loops
20:22:16:WU01:FS04:0x22: Platform: linux2 4.19.76-linuxkit
20:22:16:WU01:FS04:0x22: Bits: 64
20:22:16:WU01:FS04:0x22: Mode: Release
20:22:16:WU01:FS04:0x22:************************************ CBang *************************************
20:22:16:WU01:FS04:0x22: Date: Sep 15 2020
20:22:16:WU01:FS04:0x22: Time: 05:11:04
20:22:16:WU01:FS04:0x22: Revision: 33fcfc2b3ed2195a423606a264718e31e6b3903f
20:22:16:WU01:FS04:0x22: Branch: HEAD
20:22:16:WU01:FS04:0x22: Compiler: GNU 4.8.2 20140120 (Red Hat 4.8.2-15)
20:22:16:WU01:FS04:0x22: Options: -std=c++11 -fsigned-char -ffunction-sections -fdata-sections -O3
20:22:16:WU01:FS04:0x22: -funroll-loops -fPIC
20:22:16:WU01:FS04:0x22: Platform: linux2 4.19.76-linuxkit
20:22:16:WU01:FS04:0x22: Bits: 64
20:22:16:WU01:FS04:0x22: Mode: Release
20:22:16:WU01:FS04:0x22:************************************ System ************************************
20:22:16:WU01:FS04:0x22: CPU: AMD Phenom(tm) II X6 1090T Processor
20:22:16:WU01:FS04:0x22: CPU ID: AuthenticAMD Family 16 Model 10 Stepping 0
20:22:16:WU01:FS04:0x22: CPUs: 6
20:22:16:WU01:FS04:0x22: Memory: 7.75GiB
20:22:16:WU01:FS04:0x22:Free Memory: 4.35GiB
20:22:16:WU01:FS04:0x22: Threads: POSIX_THREADS
20:22:16:WU01:FS04:0x22: OS Version: 5.4
20:22:16:WU01:FS04:0x22:Has Battery: false
20:22:16:WU01:FS04:0x22: On Battery: false
20:22:16:WU01:FS04:0x22: UTC Offset: 2
20:22:16:WU01:FS04:0x22: PID: 1738
20:22:16:WU01:FS04:0x22: CWD: /var/lib/fahclient/work
20:22:16:WU01:FS04:0x22:************************************ OpenMM ************************************
20:22:16:WU01:FS04:0x22: Revision: 189320d0
20:22:16:WU01:FS04:0x22:********************************************************************************
20:22:16:WU01:FS04:0x22:Project: 14489 (Run 0, Clone 1757, Gen 66)
20:22:16:WU01:FS04:0x22:Unit: 0x0000005942aa6f325f45dea7995d8441
20:22:16:WU01:FS04:0x22:Reading tar file core.xml
20:22:16:WU01:FS04:0x22:Reading tar file integrator.xml.bz2
20:22:16:WU01:FS04:0x22:Reading tar file state.xml.bz2
20:22:16:WU01:FS04:0x22:Reading tar file system.xml.bz2
20:22:16:WU01:FS04:0x22:Digital signatures verified
20:22:16:WU01:FS04:0x22:Folding@home GPU Core22 Folding@home Core
20:22:16:WU01:FS04:0x22:Version 0.0.13
20:22:16:WU01:FS04:0x22: Checkpoint write interval: 25000 steps (2%) [50 total]
20:22:16:WU01:FS04:0x22: JSON viewer frame write interval: 12500 steps (1%) [100 total]
20:22:16:WU01:FS04:0x22: XTC frame write interval: 10000 steps (0.8%) [125 total]
20:22:16:WU01:FS04:0x22: Global context and integrator variables write interval: disabled
20:22:16:WU01:FS04:0x22:There are 3 platforms available.
20:22:16:WU01:FS04:0x22:Platform 0: Reference
20:22:16:WU01:FS04:0x22:Platform 1: OpenCL
20:22:16:WU01:FS04:0x22: opencl-device 3 specified
20:22:16:WU01:FS04:0x22:Platform 2: CUDA
20:22:16:WU01:FS04:0x22: cuda-device 3 specified
20:22:19:WU04:FS03:0x22: Using OpenCL on platformId 0 and gpu 2
20:22:24:WU04:FS03:0x22:Completed 3500000 out of 5000000 steps (70%)
20:22:28:WU01:FS04:0x22:Attempting to create CUDA context:
20:22:28:WU01:FS04:0x22: Configuring platform CUDA
20:22:29:WU01:FS04:0x22:Failed to create CUDA context:
20:22:29:WU01:FS04:0x22:Error loading CUDA module: CUDA_ERROR_INVALID_PTX (218)
20:22:29:WU01:FS04:0x22:Attempting to create OpenCL context:
20:22:29:WU01:FS04:0x22: Configuring platform OpenCL
20:23:02:WU03:FS01:0x22: Using OpenCL on platformId 0 and gpu 1
20:23:02:WU00:FS02:0x22: Using OpenCL on platformId 0 and gpu 0
20:23:03:WU03:FS01:0x22:Completed 1100000 out of 1250000 steps (88%)
20:23:03:WU00:FS02:0x22:Completed 25000 out of 1250000 steps (2%)
20:23:19:WU01:FS04:0x22: Using OpenCL on platformId 0 and gpu 3
20:23:19:WU01:FS04:0x22:Completed 0 out of 1250000 steps (0%)
20:23:39:WU01:FS04:0x22:Checkpoint completed at step 0
Re: CUDA Update to FAHCore_22
Posted: Wed Sep 30, 2020 9:49 pm
by psaam0001
If it has been awhile since you updated your Linux system, go into terminal (console mode) and enter the dnf update command once you have logged in as the root user/administrator of your machine. That will start the process of finding/downloading the latest stable updates for the software/OS and drivers you have on it. You will be prompted to enter Y to proceed with specific update packages.
Once that is completed, please issue the dnf clean all and reboot commands.
Caution: Please make sure you have paused all F@H slots before doing an update to avoid unexpected results.
Paul
Re: CUDA Update to FAHCore_22
Posted: Wed Sep 30, 2020 9:52 pm
by bollix47
Older NVIDIA GPUs (Fermi and older) may not be able to make use of CUDA, but will fall back to OpenCL instead
from:
viewtopic.php?p=343064#p343064
Re: CUDA Update to FAHCore_22
Posted: Thu Oct 01, 2020 1:33 am
by skydivingcatfan
My system AMD Ryzen 5 3600 and EVGA 2060 KO had been running about 1.35 mpd updated the firmware and now about 1.8 mpd.
Re: CUDA Update to FAHCore_22
Posted: Thu Oct 01, 2020 1:48 am
by gs60
As someone who is considering a 3070 (and have been before the cuda update), how has the cuda update translated into the actual increased science value of completed wu's returned per day?