How long is the data about old WU's retained?
Moderators: Site Moderators, FAHC Science Team
-
- Posts: 105
- Joined: Mon Jan 30, 2023 10:43 am
- Hardware configuration: NVIDIA RTX 4070
20 x Raspberry Pi 5 Model B 2GB RAM - Location: VIC, Australia
How long is the data about old WU's retained?
How long is the data about old WU's, including those credited, dumped, failed, pause(d) or rejected retained?
I've got 26 days worth of data, which is how long 8.4.9 has been installed on my various machines.
Will it be purged at some stage, or will I need to do that manually if so desired?
I've got 26 days worth of data, which is how long 8.4.9 has been installed on my various machines.
Will it be purged at some stage, or will I need to do that manually if so desired?
-
- Posts: 24
- Joined: Tue Jun 08, 2021 1:14 pm
- Hardware configuration: Mac Studio M1 Max
Mac Mini M4 Pro
Folding since 2005 - Location: Atlantic County, NJ
Re: How long is the data about old WU's retained?
I'm seeing 167 days worth of work under my Units tab, less than 6MB of log files.
So that would be about 12MB/year for this CPU WUs-only machine. So I’m not too concerned personally, but if you’re doing GPU work, I could see this eventually becoming a problem?
So that would be about 12MB/year for this CPU WUs-only machine. So I’m not too concerned personally, but if you’re doing GPU work, I could see this eventually becoming a problem?
-
- Posts: 1426
- Joined: Sun Dec 16, 2007 6:22 pm
- Hardware configuration: 9950x, 7950x3D, 5950x, 5800x3D
7900xtx, RX9070, Radeon 7, 5700xt, 6900xt, RX 550 640SP - Location: London
- Contact:
Re: How long is the data about old WU's retained?
The limit is hard set to 500 entries per machine. I tried negotiating for more, no luck, since after 500 entries in the db file performance degrades considerably, I am told.
This is about the v8 Work Units section
This is about the v8 Work Units section
-
- Posts: 105
- Joined: Mon Jan 30, 2023 10:43 am
- Hardware configuration: NVIDIA RTX 4070
20 x Raspberry Pi 5 Model B 2GB RAM - Location: VIC, Australia
-
- Posts: 142
- Joined: Sun Jun 15, 2008 4:39 pm
- Hardware configuration: Intel® Core™ 2 Duo processor E8500, dual 3.16GHz cores, 6MB L2 Cache, 1333MHz FSB (45nm); 4096MB Corsair™ XMS2 DDR2-800 RAM; 256MB eVGA™ NVIDIA® GeForce™ 8600 GT Video Card
- Location: NYC Metro Area
Re: How long is the data about old WU's retained?
Is there a way to delete the data on old work units before 500? Does it affect processing time?
Thanks.
Thanks.
Re: How long is the data about old WU's retained?
When FAH isn't running, you can try running a vacuum operation on the client.db file. sqlite3 client.db vacuum.
-
- Posts: 1426
- Joined: Sun Dec 16, 2007 6:22 pm
- Hardware configuration: 9950x, 7950x3D, 5950x, 5800x3D
7900xtx, RX9070, Radeon 7, 5700xt, 6900xt, RX 550 640SP - Location: London
- Contact:
Re: How long is the data about old WU's retained?
Let's not suggest these type of operations, please
Re: How long is the data about old WU's retained?
What would go wrong with a vacuum operation? Unless I am mistaken about sqlite3, the only time a vacuum operation can go wrong is if the database is already seriously corrupted (it would just make it worse although that could be said for any write operation).
-
- Posts: 1426
- Joined: Sun Dec 16, 2007 6:22 pm
- Hardware configuration: 9950x, 7950x3D, 5950x, 5800x3D
7900xtx, RX9070, Radeon 7, 5700xt, 6900xt, RX 550 640SP - Location: London
- Contact:
Re: How long is the data about old WU's retained?
Let's not suggest outside actions to the files run by fahclient. Period.
Re: How long is the data about old WU's retained?
It's a regular sqlite3 database, whether or not recommending doing things is a good idea in general, vacuum should be a safe operation.
Is your recommendation just a matter of leaving things alone because some people may not understand which operations are safe and which are not? Since it can grow pretty large, I might add a ticket to the tracker to add the auto_vacuum pragma to the database.
Is your recommendation just a matter of leaving things alone because some people may not understand which operations are safe and which are not? Since it can grow pretty large, I might add a ticket to the tracker to add the auto_vacuum pragma to the database.
-
- Site Moderator
- Posts: 1406
- Joined: Sat Dec 08, 2007 1:33 am
- Location: San Francisco, CA
- Contact:
Re: How long is the data about old WU's retained?
There is already a ticket suggesting vacuum
It is old. Someone should probably offer a PR.
I think it would be a one line fix to add the pragma auto.
https://github.com/FoldingAtHome/fah-cl ... issues/123
It is old. Someone should probably offer a PR.
I think it would be a one line fix to add the pragma auto.
https://github.com/FoldingAtHome/fah-cl ... issues/123
-
- Posts: 1426
- Joined: Sun Dec 16, 2007 6:22 pm
- Hardware configuration: 9950x, 7950x3D, 5950x, 5800x3D
7900xtx, RX9070, Radeon 7, 5700xt, 6900xt, RX 550 640SP - Location: London
- Contact:
Re: How long is the data about old WU's retained?
The reason I'm saying that is that regular people use this forum, not fah Devs, with some exceptions. So you might know what you are doing, but there might be some people who think that your suggestion is a solution, and use it, and break things, however unlikely the breakdown might be. And then we have to listen and troubleshoot those people's problems.arisu wrote: ↑Wed Mar 05, 2025 7:48 am It's a regular sqlite3 database, whether or not recommending doing things is a good idea in general, vacuum should be a safe operation.
Is your recommendation just a matter of leaving things alone because some people may not understand which operations are safe and which are not? Since it can grow pretty large, I might add a ticket to the tracker to add the auto_vacuum pragma to the database.
Any low level suggestions should be done in GitHub. Dev resides there and you will get most attention to your suggestions.
The deletion of dumped, crashed WUs have been already suggested in GitHub few times. Latest one might have even been mine.