summaryrefslogtreecommitdiff
path: root/bookpipeline/cmd/bookpipeline/main.go
AgeCommit message (Expand)Author
2019-10-08Continue separating the repository; remove all but preproc, and move integral...Nick White
2019-10-07Ensure wipe pipeline uses the expected png filesNick White
2019-10-02Add wipeonly queue and functionalityNick White
2019-09-17gofmtNick White
2019-09-16Be more careful to try to grab the message after a heartbeat failure more qui...Nick White
2019-09-14Ensure enough time has elapsed before looking for the message to reget in the...Nick White
2019-09-12Don't prefix date/time to logs, as logger will store that anywayNick White
2019-09-11Work around the SQS limit of 12 hours of visibility timeoutNick White
2019-09-06Add flags to disable checking various queuesNick White
2019-09-05Handle no words found error in a better way so any page that is actually 0 co...Nick White
2019-09-05Don't abort analysis if we encounter a hocr with no words, just skip itNick White
2019-09-05gofmtNick White
2019-09-05Update Pipeliner interface in getpipelinebook, and update some commentsNick White
2019-09-04Rewrite heartbeat so errors during it will be reported, and the aws api doesn...Nick White
2019-09-04Ensure any channels that need to be consumed before goroutine is finished are...Nick White
2019-09-03Improve debug loggingNick White
2019-09-02Log upload and download eventsNick White
2019-08-28Split out bookpipeline to cmd/Nick White