Age | Commit message (Collapse) | Author | |
---|---|---|---|
2019-08-20 | Substantially improve problematic object listing part of API | Nick White | |
Switch to regular non-concurrent stuff, concurrency is better handled by the main program anyway. Now we handle errors properly, and things are way simpler. | |||
2019-08-20 | Add basic OCR support, and reorganise code | Nick White | |
The previously committed thing didn't work, as listobjects was sending to a channel synchronously, so it was never being received. The current API isn't great, mixing synchronous and non-synchronous things, not handling errors consistently, and generally is over complicated. That will be fixed soon. | |||
2019-08-20 | Split aws implementation from main.go in pipelinepreprocess | Nick White | |
2019-08-20 | Export qmsg type | Nick White | |
2019-08-19 | Fix pipelinepreprocess segfaults | Nick White | |
These were caused by using non-pointer methods, which meant that the values set in Init() were not saved. | |||
2019-08-19 | Work in progress rearchitecture to use interfaces; currently pointers are ↵ | Nick White | |
screwy causing segfaults | |||
2019-08-13 | Various improvements to pipelinepreprocess | Nick White | |
- Ensure temporary directory already being present isn't an issue - Remove temporary directory when done with it - Ensure any already preprocessed files aren't preprocessed themselves (this could happen in the case of a run stopping half way through) | |||
2019-08-13 | Correct typo in bucket name for pipelinepreprocess; tested and seems to ↵ | Nick White | |
work, remarkably | |||
2019-08-13 | Add bonus verbose log points | Nick White | |
2019-08-13 | Reduce SQS WaitTime to something in-spec, and add bonus verbose log points | Nick White | |
2019-08-13 | Add basic verbose logging capabilities to pipelinepreprocess | Nick White | |
2019-07-25 | Add first draft of pipelinepreprocess - completely untested, will contain bugs | Nick White | |