| Age | Commit message (Collapse) | Author |
|---|
|
|
|
There was no reason not to do this with wipeonly as well, and sure enough a
single broken PNG image in a wipeonly task would cause the queue to exponentially
fill as happened previously.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
as that isnt present on go1.11
|
|
|
|
queue
This prevents the current situation where a failed preprocessing job
is endlessly repeated, potentially spawning thousands of ocrpage
jobs in its wake each time.
Note that the email stuff works but requires putting secrets into
.go files, so need to rewrite that to read from somewhere more
sensible like a dotfile on the host.
|
|
|
|
and change WipeFile() to take advantage of them
|
|
|
|
|
|
|
|
|
|
This was a nasty one. By closing the up channel, the up() function
would finish and send to the done channel. This means that the select
between err and done would be random as to which was picked, whereas
of course if there has been an error that path must be taken.
|
|
|
|
|
|
|
|
|
|
There are several ways that disk usage is reduced with this patch:
- Files are deleted as soon as they have been uploaded
- Once a page image has been added to a PDF, immediately delete it
This should allow much larger books to be processed without needing
bigger disks.
|
|
|
|
|
|
|
|
the cloudsettings documentation slightly
|
|
|
|
|
|
|
|
(which reenables it for spot instances)
|
|
HeartbeatSeconds, as it is not a Time
|
|
ensure it is always a / delimeter
|
|
|
|
|
|
|
|
minutes
|
|
|
|
|
|
|
|
|
|
|
|
permissions
|
|
This simplifies things nicely from using conn.GetLogger().Println() to
conn.Log()
|
|
Embarassing I hadn't noticed the fmt.Errorf function before, but
better late than never.
|
|
analysis as failed if graph isn't made for that reason
|
|
|
|
|
|
|
|
|
