Age | Commit message (Collapse) | Author | |
---|---|---|---|
2019-09-24 | Move ec2 stuff out of lspipeline and into aws.go | Nick White | |
2019-09-23 | gofmt | Nick White | |
2019-09-23 | Move the sqs stuff out to aws.go | Nick White | |
2019-09-16 | Be more careful to try to grab the message after a heartbeat failure more ↵ | Nick White | |
quickly Rather than waiting for the whole length of a visibility timeout, in which time another process may grab the message, instead wait a short amount of time, each time the message is searched for. Also add a bit more logging. | |||
2019-09-14 | Ensure enough time has elapsed before looking for the message to reget in ↵ | Nick White | |
the case of heartbeat running out | |||
2019-09-11 | Work around the SQS limit of 12 hours of visibility timeout | Nick White | |
This is done by checking for the error that is emitted in such a case, and if it's found trying several times to find the message back in the queue, and returning the message with an updated handle back to the caller to use in the future. | |||
2019-09-05 | gofmt | Nick White | |
2019-09-04 | Rewrite heartbeat so errors during it will be reported, and the aws api ↵ | Nick White | |
doesn't rely on channels | |||
2019-08-28 | Split out bookpipeline to cmd/ | Nick White | |
2019-08-23 | Fix gaping bugs by using correct queues and downloads | Nick White | |
This has involved refactoring to make the interface simpler, and just use the URLs / IDs for the necessary queues and storage locations, rather than wrap these in functions. | |||
2019-08-22 | gofmt | Nick White | |
2019-08-22 | Update usage string, and comments | Nick White | |