bookpipeline/cmd/lspipeline, branch master Tools to process books in a cloud based pipeline system lspipeline: Rename to lspipeline-ng, and restore pre concurrency version to lspipeline as there are some hard to debug issues in concurrency version 2021-02-22T16:02:55+00:00 Nick White git@njw.name 2021-02-22T16:02:55+00:00 866aa409f8844ab2cb8d578672a703b4ddead30c 






Make ListObjectsWithMeta generic again and create a specialised ListObjectWithMeta for single file listing, so we can still be as fast, but do not have a misleading api
2021-01-26T14:56:10+00:00

Nick White
git@njw.name

2021-01-26T14:56:10+00:00

5c3cee66a90ce6ef87e125b3bf011a6903d38083












Improve lspipeline concurrency by removing WaitGroup stuff
2021-01-26T14:17:19+00:00

Nick White
git@njw.name

2021-01-26T14:17:19+00:00

54150b54cd06e3deba44e73b151070b74a4d8e76












Speed up lspipeline by making s3 requests concurrently and only processing single results from ListObjects requests
2021-01-26T13:50:02+00:00

Nick White
git@njw.name

2021-01-26T13:50:02+00:00

86cc5d6c921ac05e0d08f66b205b51e1f5adb938












Briefly document each of the commands in a godoc friendly way, and improve the cloudsettings documentation slightly
2020-04-14T09:45:12+00:00

Nick White
git@njw.name

2020-04-14T09:45:12+00:00

dacb5cf28e3ede3b9f1bbf2d9d80b5a9d0d1bc56












Remove unused OCR queue (was superceded by the ocrpage queue some time ago)
2020-04-07T11:18:38+00:00

Nick White
git@njw.name

2020-04-07T11:18:38+00:00

9fb0842f07320d47509865c689747d2c82379f3d












gofmt
2020-04-07T11:02:54+00:00

Nick White
git@njw.name

2020-04-07T11:02:54+00:00

af63449be98f1964b67981b2aedda0d2ea70fe6d












Add nobooks flag to lspipeline so it has a faster mode
2020-03-09T12:42:06+00:00

Nick White
git@njw.name

2020-03-09T12:42:06+00:00

62f8106c346ac8b631c82fd3546da67146d4262e












Add documentation, license notices, and license
2020-02-27T17:10:48+00:00

Nick White
git@njw.name

2020-02-27T17:05:13+00:00

6cce1b77f9ea5dec26099398b19d4edd39a88d4e












Fix usage message for getpipelinebook, and trim final slashes in lspipeline output
2019-12-16T10:39:51+00:00

Nick White
git@njw.name

2019-12-16T10:39:51+00:00

70eecf79704452d600f3edca9dec2e9726dcfe6d