index
:
bookpipeline
fullsizepdf
guirefactor
local
master
minimisedisk
rotation
separatelocal
Tools to process books in a cloud based pipeline system
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
aws.go
Age
Commit message (
Expand
)
Author
2021-07-12
Add test for upAndQueue function
Nick White
2021-02-01
Ensure DeleteObjects can handle over 1000 files to delete; fixes rmbook for l...
Nick White
2021-01-26
Make ListObjectsWithMeta generic again and create a specialised ListObjectWit...
Nick White
2021-01-26
Speed up lspipeline by making s3 requests concurrently and only processing si...
Nick White
2021-01-26
Stop limiting keys returned from listobjectprefixes' api usage; this speeds u...
Nick White
2020-12-14
Add rmbook tool
Nick White
2020-11-17
Add trimqueue and logwholequeue utilities which can help deal with weird queu...
Nick White
2020-10-20
Improve logging by using Println, which ensures there is a space between argu...
Nick White
2020-05-19
Add getandpurgequeue debugging tool
Nick White
2020-04-14
Remove unused PreprocPattern, allow sensible defaults with aws setup, and add...
Nick White
2020-04-07
Improve documentation
Nick White
2020-04-07
Remove unused OCR queue (was superceded by the ocrpage queue some time ago)
Nick White
2020-04-07
gofmt
Nick White
2020-04-07
Separate out cloud settings into a separate file; cloudsettings.go
Nick White
2020-03-31
Disable autoshutdown by default for bookpipeline, and update to ami 0.11 (whi...
Nick White
2020-03-31
[bookpipeline] Improve logging output
Nick White
2020-03-23
Add Log() function to Pipeliner interface
Nick White
2020-03-10
Update image used for spots
Nick White
2020-02-27
Add documentation, license notices, and license
Nick White
2019-12-13
Update StartInstance to point to the newest image
Nick White
2019-12-11
Use aws.go with mkpipeline too, plus fix one log.Fatal call in aws.go which s...
Nick White
2019-12-05
Remove (the generally empty) files in the case of a failed download
Nick White
2019-12-03
Rewrite lspipeline book listing part to be much faster by taking advantage of...
Nick White
2019-11-19
Add ocrpage queue for processing individual pages
Nick White
2019-11-12
Add spotme command to start appropriate spot instances
Nick White
2019-10-29
Another attempt to fix the ongoing heartbeat issue
Nick White
2019-10-28
Try to fix heartbeat renew issue more fully
Nick White
2019-10-17
Adjust the heartbeat searching function to hopefully have better luck at find...
Nick White
2019-10-16
Sort book list in lspipeline by modified date
Nick White
2019-10-08
Separate out bookpipeline from catch-all go.git repo, and rename to rescribe....
Nick White