utils - Packages and tools for image preprocessing

Age	Commit message (Collapse)	Author
2019-10-08	Remove parts that have been moved elsewhere, and rename to rescribe.xyz/utils	Nick White
	bookpipeline is now at rescribe.xyz/bookpipeline preproc is now at rescribe.xyz/preproc integralimg is now at rescribe.xyz/preproc/integralimg
2019-10-02	Add wipeonly queue and functionality	Nick White
	This is useful for prebinarised images, which don't need full preprocessing, but do require wiping, albeit with a more conservative threshold.
2019-09-24	Rewrite GetInstanceDetails so page function is separate	Nick White

2019-09-24	Move ec2 stuff out of lspipeline and into aws.go	Nick White

2019-09-23	gofmt	Nick White

2019-09-23	Move the sqs stuff out to aws.go	Nick White

2019-09-16	Be more careful to try to grab the message after a heartbeat failure more ↵	Nick White
	quickly Rather than waiting for the whole length of a visibility timeout, in which time another process may grab the message, instead wait a short amount of time, each time the message is searched for. Also add a bit more logging.
2019-09-14	Ensure enough time has elapsed before looking for the message to reget in ↵	Nick White
	the case of heartbeat running out
2019-09-11	Work around the SQS limit of 12 hours of visibility timeout	Nick White
	This is done by checking for the error that is emitted in such a case, and if it's found trying several times to find the message back in the queue, and returning the message with an updated handle back to the caller to use in the future.
2019-09-05	gofmt	Nick White

2019-09-04	Rewrite heartbeat so errors during it will be reported, and the aws api ↵	Nick White
	doesn't rely on channels
2019-08-28	Split out bookpipeline to cmd/	Nick White

2019-08-23	Fix gaping bugs by using correct queues and downloads	Nick White
	This has involved refactoring to make the interface simpler, and just use the URLs / IDs for the necessary queues and storage locations, rather than wrap these in functions.
2019-08-22	gofmt	Nick White

2019-08-22	Update usage string, and comments	Nick White