strangely large workunits (174,500,016 steps)

If you're new to FAH and need help getting started or you have very basic questions, start here.

Moderators: Site Moderators, FAHC Science Team

Post Reply
folder123
Posts: 1
Joined: Fri Aug 19, 2011 10:54 am

strangely large workunits (174,500,016 steps)

Post by folder123 »

Hi, I am using the smp a3 core on linux, and have recently upgraded my config to specify 8194 mb for available memory.
8 physical cores, 16 including virtual.



according to my calculations, I seem to have been assigned a workunit
that will take about 72 days to complete, although the unitinfo shows a
deadline of 6 days.

please advise:

unitinfo.txt:

Code: Select all

Current Work Unit
-----------------
Name: Gromacs
Tag: P6057R0C98G348
Download time: August 19 09:57:01
Due time: August 25 09:57:01
Progress: 0%  [__________]

work/logfile_08.txt:

Code: Select all

*------------------------------*
Folding@Home Gromacs SMP Core
Version 2.27 (Dec. 15, 2010)

Preparing to commence simulation
- Looking at optimizations...
- Created dyn
- Files status OK
- Expanded 1389801 -> 2251569 (decompressed 162.0 percent)
Called DecompressByteArray: compressed_data_size=1389801 data_size=2251569, decompressed_data_size=2251569 diff=0
- Digital signature verified

Project: 6057 (Run 0, Clone 98, Gen 348)

Assembly optimizations on if available.
Entering M.D.
Mapping NT from 12 to 12 
Completed 0 out of 174500016 steps  (0%)

As you can see from the log below, I received two such units, I deleted
the first one thinking that there is a problem locally, but the second
massive unit was received (the info above is for the latest unit).

FAHlog.txt:

Code: Select all

--- Opening Log file [August 19 00:54:55 UTC] 
# Linux SMP Console Edition ###################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /home/cs3mmh/smp/FAH6.34-Linux64
Executable: ./fah6
Arguments: -smp 12 -verbosity 9 -oneunit 

[00:54:55] - Ask before connecting: No
[00:54:55] - User name: AHameed (Team 10)
[00:54:55] - User ID: 53C34386159A5975
[00:54:55] - Machine ID: 7
[00:54:55] 
[00:54:55] Loaded queue successfully.
[00:54:55] - Preparing to get new work unit...
[00:54:55] Cleaning up work directory
[00:54:55] - Autosending finished units... [August 19 00:54:55 UTC]
[00:54:55] + Attempting to get work packet
[00:54:55] Passkey found
[00:54:55] Trying to send all finished work units
[00:54:55] - Will indicate memory of 8192 MB
[00:54:55] + No unsent completed units remaining.
[00:54:55] - Connecting to assignment server
[00:54:55] - Autosend completed
[00:54:55] Connecting to http://assign.stanford.edu:8080/
[00:54:57] Posted data.
[00:54:57] Initial: 40AB; - Successful: assigned to (171.64.65.54).
[00:54:57] + News From Folding@Home: Welcome to Folding@Home
[00:54:57] Loaded queue successfully.
[00:54:57] Sent data
[00:54:57] Connecting to http://171.64.65.54:8080/
[00:54:58] Posted data.
[00:54:58] Initial: 0000; - Receiving payload (expected size: 1760238)
[00:55:04] - Downloaded at ~286 kB/s
[00:55:04] - Averaged speed for that direction ~368 kB/s
[00:55:04] + Received work.
[00:55:04] + Closed connections
[00:55:04] 
[00:55:04] + Processing work unit
[00:55:04] Core required: FahCore_a3.exe
[00:55:04] Core found.
[00:55:04] Working on queue slot 06 [August 19 00:55:04 UTC]
[00:55:04] + Working ...
[00:55:04] - Calling './FahCore_a3.exe -dir work/ -nice 19 -suffix 06 -np 12 -priority 96 -checkpoint 30 -verbose -lifeline 1535 -version 634'

[00:55:04] 
[00:55:04] *------------------------------*
[00:55:04] Folding@Home Gromacs SMP Core
[00:55:04] Version 2.27 (Dec. 15, 2010)
[00:55:04] 
[00:55:04] Preparing to commence simulation
[00:55:04] - Looking at optimizations...
[00:55:04] - Created dyn
[00:55:04] - Files status OK
[00:55:04] - Expanded 1759726 -> 2243881 (decompressed 127.5 percent)
[00:55:04] Called DecompressByteArray: compressed_data_size=1759726 data_size=2243881, decompressed_data_size=2243881 diff=0
[00:55:04] - Digital signature verified
[00:55:04] 
[00:55:04] Project: 6072 (Run 1, Clone 53, Gen 304)
[00:55:04] 
[00:55:04] Assembly optimizations on if available.
[00:55:04] Entering M.D.
[00:55:10] Mapping NT from 12 to 12 
[00:55:11] Completed 0 out of 500000 steps  (0%)
[00:59:00] Completed 5000 out of 500000 steps  (1%)
[01:03:42] Completed 10000 out of 500000 steps  (2%)
...
...
...
[05:42:48] Completed 485000 out of 500000 steps  (97%)
[05:45:40] Completed 490000 out of 500000 steps  (98%)
[05:48:33] Completed 495000 out of 500000 steps  (99%)
[05:51:31] Completed 500000 out of 500000 steps  (100%)
[05:51:32] DynamicWrapper: Finished Work Unit: sleep=10000
[05:51:42] 
[05:51:42] Finished Work Unit:
[05:51:42] - Reading up to 3694848 from "work/wudata_06.trr": Read 3694848
[05:51:42] trr file hash check passed.
[05:51:42] edr file hash check passed.
[05:51:42] logfile size: 56328
[05:51:42] Leaving Run
[05:51:43] - Writing 3787136 bytes of core data to disk...
[05:51:44]   ... Done.
[05:53:42] - Shutting down core
[05:53:42] 
[05:53:42] Folding@home Core Shutdown: FINISHED_UNIT
[05:53:58] CoreStatus = 64 (100)
[05:53:58] Unit 6 finished with 97 percent of time to deadline remaining.
[05:53:58] Updated performance fraction: 0.956904
[05:53:58] Sending work to server
[05:53:58] Project: 6072 (Run 1, Clone 53, Gen 304)


[05:53:58] + Attempting to send results [August 19 05:53:58 UTC]
[05:53:58] - Reading file work/wuresults_06.dat from core
[05:53:58]   (Read 3787136 bytes from disk)
[05:53:58] Connecting to http://171.64.65.54:8080/
[05:54:02] Posted data.
[05:54:02] Initial: 0000; - Uploaded at ~739 kB/s
[05:54:03] - Averaged speed for that direction ~680 kB/s
[05:54:03] + Results successfully sent
[05:54:03] Thank you for your contribution to Folding@Home.
[05:54:03] + Number of Units Completed: 1032

[05:54:38] Trying to send all finished work units
[05:54:38] + No unsent completed units remaining.
[05:54:38] + -oneunit flag given and have now finished a unit. Exiting.- Preparing to get new work unit...
[05:54:38] Cleaning up work directory
[05:54:38] ***** Got a SIGTERM signal (15)
[05:54:38] + Attempting to get work packet
[05:54:38] Passkey found
[05:54:38] - Will indicate memory of 8192 MB
[05:54:38] - Connecting to assignment server
[05:54:38] Connecting to http://assign.stanford.edu:8080/
[05:54:38] Killing all core threads

Folding@Home Client Shutdown.


--- Opening Log file [August 19 05:54:38 UTC] 


# Linux SMP Console Edition ###################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /home/cs3mmh/smp/FAH6.34-Linux64
Executable: ./fah6
Arguments: -smp 12 -verbosity 9 -oneunit 

[05:54:38] - Ask before connecting: No
[05:54:38] - User name: AHameed (Team 10)
[05:54:38] - User ID: 53C34386159A5975
[05:54:38] - Machine ID: 7
[05:54:38] 
[05:54:38] Loaded queue successfully.
[05:54:38] - Preparing to get new work unit...
[05:54:38] Cleaning up work directory
[05:54:38] - Autosending finished units... [August 19 05:54:38 UTC]
[05:54:38] + Attempting to get work packet
[05:54:38] Passkey found
[05:54:38] Trying to send all finished work units
[05:54:38] - Will indicate memory of 8192 MB
[05:54:38] + No unsent completed units remaining.
[05:54:38] - Connecting to assignment server
[05:54:38] - Autosend completed
[05:54:38] Connecting to http://assign.stanford.edu:8080/
[05:54:39] Posted data.
[05:54:39] Initial: 40AB; - Successful: assigned to (171.64.65.54).
[05:54:39] + News From Folding@Home: Welcome to Folding@Home
[05:54:39] Loaded queue successfully.
[05:54:39] Sent data
[05:54:39] Connecting to http://171.64.65.54:8080/
[05:54:41] Posted data.
[05:54:41] Initial: 0000; - Receiving payload (expected size: 1390313)
[05:54:46] - Downloaded at ~271 kB/s
[05:54:46] - Averaged speed for that direction ~348 kB/s
[05:54:46] + Received work.
[05:54:46] + Closed connections
[05:54:46] 
[05:54:46] + Processing work unit
[05:54:46] Core required: FahCore_a3.exe
[05:54:46] Core found.
[05:54:46] Working on queue slot 07 [August 19 05:54:46 UTC]
[05:54:46] + Working ...
[05:54:46] - Calling './FahCore_a3.exe -dir work/ -nice 19 -suffix 07 -np 12 -priority 96 -checkpoint 30 -verbose -lifeline 7264 -version 634'

[05:54:46] 
[05:54:46] *------------------------------*
[05:54:46] Folding@Home Gromacs SMP Core
[05:54:46] Version 2.27 (Dec. 15, 2010)
[05:54:46] 
[05:54:46] Preparing to commence simulation
[05:54:46] - Looking at optimizations...
[05:54:46] - Created dyn
[05:54:46] - Files status OK
[05:54:47] - Expanded 1389801 -> 2251569 (decompressed 162.0 percent)
[05:54:47] Called DecompressByteArray: compressed_data_size=1389801 data_size=2251569, decompressed_data_size=2251569 diff=0
[05:54:47] - Digital signature verified
[05:54:47] 
[05:54:47] Project: 6057 (Run 0, Clone 98, Gen 348)
[05:54:47] 
[05:54:47] Assembly optimizations on if available.
[05:54:47] Entering M.D.
[05:54:53] Mapping NT from 12 to 12 
[05:54:53] Completed 0 out of 174500016 steps  (0%)
[09:33:51] ***** Got an Activate signal (2)
[09:33:51] Killing all core threads

Folding@Home Client Shutdown.


--- Opening Log file [August 19 09:33:51 UTC] 


# Linux SMP Console Edition ###################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /home/cs3mmh/smp/FAH6.34-Linux64
Executable: ./fah6
Arguments: -smp 8 -verbosity 9 

[09:33:51] - Ask before connecting: No
[09:33:51] - User name: AHameed (Team 10)
[09:33:51] - User ID: 53C34386159A5975
[09:33:51] - Machine ID: 7
[09:33:51] 
[09:33:51] Loaded queue successfully.
[09:33:51] 
[09:33:51] - Autosending finished units... [09:33:51]
[09:33:51] + Processing work unit
[09:33:51] Trying to send all finished work units
[09:33:51] Core required: FahCore_a3.exe
[09:33:51] Core found.
[09:33:51] + No unsent completed units remaining.
[09:33:51] - Autosend completed
[09:33:51] Working on queue slot 07 [August 19 09:33:51 UTC]
[09:33:51] + Working ...
[09:33:51] - Calling './FahCore_a3.exe -dir work/ -nice 19 -suffix 07 -np 8 -priority 96 -checkpoint 30 -verbose -lifeline 10868 -version 634'

[09:33:52] 
[09:33:52] *------------------------------*
[09:33:52] Folding@Home Gromacs SMP Core
[09:33:52] Version 2.27 (Dec. 15, 2010)
[09:33:52] 
[09:33:52] Preparing to commence simulation
[09:33:52] - Ensuring status. Please wait.
[09:34:01] - Looking at optimizations...
[09:34:01] - Files status OK
[09:34:02] - Expanded 1389801 -> 2251569 (decompressed 162.0 percent)
[09:34:02] Called DecompressByteArray: compressed_data_size=1389801 data_size=2251569, decompressed_data_size=2251569 diff=0
[09:34:02] - Digital signature verified
[09:34:02] 
[09:34:02] Project: 6057 (Run 0, Clone 98, Gen 348)
[09:34:02] 
[09:34:02] Assembly optimizations on if available.
[09:34:02] Entering M.D.
[09:34:05] ***** Got an Activate signal (2)
[09:34:05] Killing all core threads

Folding@Home Client Shutdown.


--- Opening Log file [August 19 09:34:56 UTC] 


# Linux SMP Console Edition ###################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /home/cs3mmh/smp/FAH6.34-Linux64
Executable: ./fah6
Arguments: -smp 12 -verbosity 9 -oneunit 

[09:34:56] - Ask before connecting: No
[09:34:56] - User name: AHameed (Team 10)
[09:34:56] - User ID: 53C34386159A5975
[09:34:56] - Machine ID: 7
[09:34:56] 
[09:34:56] Loaded queue successfully.
[09:34:56] 
[09:34:56] + Processing work unit
[09:34:56] Core required: FahCore_a3.exe
[09:34:56] Core found.
[09:34:56] - Autosending finished units... [August 19 09:34:56 UTC]
[09:34:56] Trying to send all finished work units
[09:34:56] + No unsent completed units remaining.
[09:34:56] - Autosend completed
[09:34:56] Working on queue slot 07 [August 19 09:34:56 UTC]
[09:34:56] + Working ...
[09:34:56] - Calling './FahCore_a3.exe -dir work/ -nice 19 -suffix 07 -np 12 -priority 96 -checkpoint 30 -verbose -lifeline 10887 -version 634'

[09:34:56] 
[09:34:56] *------------------------------*
[09:34:56] Folding@Home Gromacs SMP Core
[09:34:56] Version 2.27 (Dec. 15, 2010)
[09:34:56] 
[09:34:56] Preparing to commence simulation
[09:34:56] - Looking at optimizations...
[09:34:56] - Files status OK
[09:34:57] - Expanded 1389801 -> 2251569 (decompressed 162.0 percent)
[09:34:57] Called DecompressByteArray: compressed_data_size=1389801 data_size=2251569, decompressed_data_size=2251569 diff=0
[09:34:57] - Digital signature verified
[09:34:57] 
[09:34:57] Project: 6057 (Run 0, Clone 98, Gen 348)
[09:34:57] 
[09:34:57] Assembly optimizations on if available.
[09:34:57] Entering M.D.
[09:35:03] Using Gromacs checkpoints
[09:35:03] Mapping NT from 12 to 12 
[09:35:04] Resuming from checkpoint
[09:35:04] Verified work/wudata_07.log
[09:35:04] Verified work/wudata_07.trr
[09:35:04] Verified work/wudata_07.edr
[09:35:04] Completed 377110 out of 174500016 steps  (0%)
[09:35:57] ***** Got an Activate signal (2)
[09:35:57] Killing all core threads

Folding@Home Client Shutdown.


--- Opening Log file [August 19 09:36:23 UTC] 


# Linux SMP Console Edition ###################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /home/cs3mmh/smp/FAH6.34-Linux64
Executable: ./fah6
Arguments: -configonly -smp 

[09:36:23] - Ask before connecting: No
[09:36:23] - User name: AHameed (Team 10)
[09:36:23] - User ID: 53C34386159A5975
[09:36:23] - Machine ID: 7
[09:36:23] 
[09:36:23] Configuring Folding@Home...


[09:37:25] - Ask before connecting: No
[09:37:25] - User name: AHameed (Team 10)
[09:37:25] - User ID: 53C34386159A5975
[09:37:25] - Machine ID: 7
[09:37:25] 
[09:37:25] -configonly flag given, so exiting.


--- Opening Log file [August 19 09:37:32 UTC] 


# Linux SMP Console Edition ###################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /home/cs3mmh/smp/FAH6.34-Linux64
Executable: ./fah6
Arguments: -smp 12 -verbosity 9 -oneunit 

[09:37:32] - Ask before connecting: No
[09:37:32] - User name: AHameed (Team 10)
[09:37:32] - User ID: 53C34386159A5975
[09:37:32] - Machine ID: 7
[09:37:32] 
[09:37:32] Loaded queue successfully.
[09:37:32] 
[09:37:32] + Processing work unit
[09:37:32] Core required: FahCore_a3.exe
[09:37:32] Core found.
[09:37:32] - Autosending finished units... [August 19 09:37:32 UTC]
[09:37:32] Trying to send all finished work units
[09:37:32] + No unsent completed units remaining.
[09:37:32] - Autosend completed
[09:37:32] Working on queue slot 07 [August 19 09:37:32 UTC]
[09:37:32] + Working ...
[09:37:32] - Calling './FahCore_a3.exe -dir work/ -nice 19 -suffix 07 -np 12 -priority 96 -checkpoint 10 -verbose -lifeline 10932 -version 634'

[09:37:32] 
[09:37:32] *------------------------------*
[09:37:32] Folding@Home Gromacs SMP Core
[09:37:32] Version 2.27 (Dec. 15, 2010)
[09:37:32] 
[09:37:32] Preparing to commence simulation
[09:37:32] - Looking at optimizations...
[09:37:32] - Files status OK
[09:37:33] - Expanded 1389801 -> 2251569 (decompressed 162.0 percent)
[09:37:33] Called DecompressByteArray: compressed_data_size=1389801 data_size=2251569, decompressed_data_size=2251569 diff=0
[09:37:33] - Digital signature verified
[09:37:33] 
[09:37:33] Project: 6057 (Run 0, Clone 98, Gen 348)
[09:37:33] 
[09:37:33] Assembly optimizations on if available.
[09:37:33] Entering M.D.
[09:37:39] Using Gromacs checkpoints
[09:37:39] Mapping NT from 12 to 12 
[09:37:39] Resuming from checkpoint
[09:37:40] Verified work/wudata_07.log
[09:37:40] Verified work/wudata_07.trr
[09:37:40] Verified work/wudata_07.edr
[09:37:40] Completed 378180 out of 174500016 steps  (0%)
[09:55:47] ***** Got an Activate signal (2)
[09:55:47] Killing all core threads

Folding@Home Client Shutdown.


--- Opening Log file [August 19 09:56:53 UTC] 


# Linux SMP Console Edition ###################################################
###############################################################################

                       Folding@Home Client Version 6.34

                          http://folding.stanford.edu

###############################################################################
###############################################################################

Launch directory: /home/cs3mmh/smp/FAH6.34-Linux64
Executable: ./fah6
Arguments: -smp 12 -verbosity 9 -oneunit 

[09:56:53] - Ask before connecting: No
[09:56:53] - User name: AHameed (Team 10)
[09:56:53] - User ID: 53C34386159A5975
[09:56:53] - Machine ID: 7
[09:56:53] 
[09:56:53] Work directory not found. Creating...
[09:56:53] Loaded queue successfully.
[09:56:53] 
[09:56:53] + Processing work unit
[09:56:53] Core required: FahCore_a3.exe
[09:56:53] Core found.
[09:56:53] - Autosending finished units... [August 19 09:56:53 UTC]
[09:56:53] Trying to send all finished work units
[09:56:53] + No unsent completed units remaining.
[09:56:53] - Autosend completed
[09:56:53] Working on queue slot 07 [09:56:53]
[09:56:53] + Working ...
[09:56:53] - Calling './FahCore_a3.exe -dir work/ -nice 19 -suffix 07 -np 12 -priority 96 -checkpoint 10 -verbose -lifeline 11110 -version 634'

[09:56:54] 
[09:56:54] *------------------------------*
[09:56:54] Folding@Home Gromacs SMP Core
[09:56:54] Version 2.27 (Dec. 15, 2010)
[09:56:54] 
[09:56:54] Preparing to commence simulation
[09:56:54] - Looking at optimizations...
[09:56:54] - Created dyn
[09:56:54] - Files status OK
[09:56:54] Error: Missing work file=<>
[09:56:54] 
[09:56:54] Folding@home Core Shutdown: MISSING_WORK_FILES
[09:56:54] CoreStatus = 74 (116)
[09:56:54] The core could not find the work files specified. Removing from queue
[09:56:54] Deleting current work unit & continuing...
[09:56:54] Trying to send all finished work units
[09:56:54] + No unsent completed units remaining.
[09:56:54] - Preparing to get new work unit...
[09:56:54] Cleaning up work directory
[09:56:54] + Attempting to get work packet
[09:56:54] Passkey found
[09:56:54] - Will indicate memory of 8192 MB
[09:56:54] - Connecting to assignment server
[09:56:54] Connecting to http://assign.stanford.edu:8080/
[09:56:56] Posted data.
[09:56:56] Initial: 40AB; - Successful: assigned to (171.64.65.54).
[09:56:56] + News From Folding@Home: Welcome to Folding@Home
[09:56:56] Loaded queue successfully.
[09:56:56] Sent data
[09:56:56] Connecting to http://171.64.65.54:8080/
[09:56:57] Posted data.
[09:56:57] Initial: 0000; - Receiving payload (expected size: 1390313)
[09:57:01] - Downloaded at ~339 kB/s
[09:57:01] - Averaged speed for that direction ~346 kB/s
[09:57:01] + Received work.
[09:57:02] + Closed connections
[09:57:07] 
[09:57:07] + Processing work unit
[09:57:07] Core required: FahCore_a3.exe
[09:57:07] Core found.
[09:57:07] Working on queue slot 08 [August 19 09:57:07 UTC]
[09:57:07] + Working ...
[09:57:07] - Calling './FahCore_a3.exe -dir work/ -nice 19 -suffix 08 -np 12 -priority 96 -checkpoint 10 -verbose -lifeline 11110 -version 634'

[09:57:07] 
[09:57:07] *------------------------------*
[09:57:07] Folding@Home Gromacs SMP Core
[09:57:07] Version 2.27 (Dec. 15, 2010)
[09:57:07] 
[09:57:07] Preparing to commence simulation
[09:57:07] - Looking at optimizations...
[09:57:07] - Created dyn
[09:57:07] - Files status OK
[09:57:07] - Expanded 1389801 -> 2251569 (decompressed 162.0 percent)
[09:57:07] Called DecompressByteArray: compressed_data_size=1389801 data_size=2251569, decompressed_data_size=2251569 diff=0
[09:57:07] - Digital signature verified
[09:57:07] 
[09:57:07] Project: 6057 (Run 0, Clone 98, Gen 348)
[09:57:07] 
[09:57:07] Assembly optimizations on if available.
[09:57:07] Entering M.D.
[09:57:13] Mapping NT from 12 to 12 
[09:57:13] Completed 0 out of 174500016 steps  (0%)
Thank you for your time and advise.
Top
tjlane
Pande Group Member
Posts: 161
Joined: Wed Jun 01, 2011 11:19 pm
Location: Stanford, CA

Re: strangely large workunits (174,500,016 steps)

Post by tjlane »

folder123,

That is definitely not intentional. Did you actively dump the WU from your queue? If not try that, you should get a different WU that behaves normally. I've also contacted the project manager who should be able to shut that WU down.

Thanks for the report!

TJ
Top
kasson
Pande Group Member
Posts: 1459
Joined: Thu Nov 29, 2007 9:37 pm

Re: strangely large workunits (174,500,016 steps)

Post by kasson »

Thanks. We fixed it on the server. If you delete all local traces of that WU, any further assignment should work.
Top
Leonardo
Posts: 260
Joined: Tue Dec 04, 2007 5:09 am
Hardware configuration: GPU slots on home-built, purpose-built PCs.
Location: Eagle River, Alaska

Re: strangely large workunits (174,500,016 steps)

Post by Leonardo »

that will take about 72 days to complete
And when you finish it, you will be crowned King of Stanford, Protector of Pande, Defender of the Distributed! :o
Image
Top
Post Reply

Return to “New Donors start here”