bookpipeline - Tools to process books in a cloud based pipeline system

Age	Commit message (Collapse)	Author
2019-08-20	Handle errors properly with goroutines	Nick White

2019-08-20	Handle errors correctly in main parts of program	Nick White

2019-08-20	Substantially improve problematic object listing part of API	Nick White
	Switch to regular non-concurrent stuff, concurrency is better handled by the main program anyway. Now we handle errors properly, and things are way simpler.
2019-08-20	Add basic OCR support, and reorganise code	Nick White
	The previously committed thing didn't work, as listobjects was sending to a channel synchronously, so it was never being received. The current API isn't great, mixing synchronous and non-synchronous things, not handling errors consistently, and generally is over complicated. That will be fixed soon.
2019-08-20	Split aws implementation from main.go in pipelinepreprocess	Nick White

2019-08-20	Export qmsg type	Nick White

2019-08-19	Fix pipelinepreprocess segfaults	Nick White
	These were caused by using non-pointer methods, which meant that the values set in Init() were not saved.
2019-08-19	Work in progress rearchitecture to use interfaces; currently pointers are ↵	Nick White
	screwy causing segfaults
2019-08-13	Various improvements to pipelinepreprocess	Nick White
	- Ensure temporary directory already being present isn't an issue - Remove temporary directory when done with it - Ensure any already preprocessed files aren't preprocessed themselves (this could happen in the case of a run stopping half way through)
2019-08-13	Correct typo in bucket name for pipelinepreprocess; tested and seems to ↵	Nick White
	work, remarkably
2019-08-13	Add bonus verbose log points	Nick White

2019-08-13	Reduce SQS WaitTime to something in-spec, and add bonus verbose log points	Nick White

2019-08-13	Add basic verbose logging capabilities to pipelinepreprocess	Nick White

2019-07-25	Add first draft of pipelinepreprocess - completely untested, will contain bugs	Nick White