groups:bes3:users:howell:farm:howell-t1
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revision | |
| groups:bes3:users:howell:farm:howell-t1 [2011/05/23 13:24] – howell | groups:bes3:users:howell:farm:howell-t1 [2011/05/27 11:57] (current) – howell |
|---|
| |
| === Log === | === Log === |
| | == 2011-05-27 == |
| | * Problem (appears to be) fixed in commit bb2f314196b3758a6ffb971636e56b9daa8f321c; it was caused by temporary output files being kept separate from the staging directory. After a job is finished, the staging directory gets cleaned up (if it succeeded), but the temporary output folder doesn't. We now only use the staging directory, and commit 668445192aa5659db52200c4773a43311d11ccd4 adds some insurance that it gets cleaned up and no data files get synced to the work directory. |
| | * Also added commit d147245991fe89f8cdfb3e3846d98e5145bec371, which keeps jobs which have completed from re-running. Jobs would never re-run a complete stage in the first place, but in the case of temporary stages (where the output isn't kept), it would try to re-run that in anticipation of non-temporary stages requiring the temporary output. Thus, this saves us a generation step in the event that reconstruction, etc., are all finished. |
| == 2011-05-23 == | == 2011-05-23 == |
| * even after sed script, farm still broken | * even after sed script, farm still broken |
groups/bes3/users/howell/farm/howell-t1.1306175042.txt.gz · Last modified: 2011/05/23 13:24 by howell