bookpipeline/cmd, branch v0.3.2 Tools to process books in a cloud based pipeline system [rescribe] Fix up *.hocr glob, which ensures that using a savedir that already has a hocr directory in it will work 2020-12-07T17:04:12+00:00 Nick White git@njw.name 2020-12-07T17:04:12+00:00 17b2d91d5f323fd985ca012e50d36908cbceba87 






[rescribe] Allow saving of results to somewhere other than a directory named after the book being processed
2020-12-07T16:53:58+00:00

Nick White
git@njw.name

2020-12-07T16:53:58+00:00

068ad0b666705a49ab22d7b48cd6a7d67b37f234












[rescribe] Fix portability issue where hocrs may not be correctly moved and txt-ified on windows
2020-12-03T15:20:15+00:00

Nick White
git@njw.name

2020-12-03T15:20:15+00:00

cbe02a57377787cd34172453a477f68f200448e8












Merge branch 'master' of ssh://hammerhead/home/nick/rescribe/src/bookpipeline
2020-11-30T19:14:47+00:00

Nick White
git@njw.name

2020-11-30T19:14:47+00:00

df364cbf93e4ab5b4db8b924b8396f4fb9caa149












Add getstats tool
2020-11-30T19:13:53+00:00

Nick White
git@njw.name

2020-11-30T19:13:53+00:00

190e095b04ce61041d16eb5d0109f5073b83f624












[booktopipeline] Add a check to disallow adding a book that already exists
2020-11-24T12:40:54+00:00

Nick White
git@njw.name

2020-11-24T12:40:54+00:00

0d914a5de3f8169d41df4fcff1ee4aea6d01afbe

This is important as if a book is added which has already been done,
then an analyse job will be added every time a page is OCRed, which
will clog up the pipeline with unnecessary work. Also if a book was
added with the same name but differently named files, or a different
number of pages, the results would almost certainly not be as
intended.

In the case of a book really wanting to be added with a particular
name, either the original directory can be removed on S3, or "v2"
or similar can be appended to the book name before calling
booktopipeline.





This is important as if a book is added which has already been done,
then an analyse job will be added every time a page is OCRed, which
will clog up the pipeline with unnecessary work. Also if a book was
added with the same name but differently named files, or a different
number of pages, the results would almost certainly not be as
intended.

In the case of a book really wanting to be added with a particular
name, either the original directory can be removed on S3, or "v2"
or similar can be appended to the book name before calling
booktopipeline.







Add trimqueue and logwholequeue utilities which can help deal with weird queue states
2020-11-17T16:37:54+00:00

Nick White
git@njw.name

2020-11-17T16:37:54+00:00

2717c5ed21a082a7f24833f3d57b303fd22bd4e5












Remove _bin0.x from txt filenames
2020-11-17T12:24:42+00:00

Nick White
git@njw.name

2020-11-17T12:24:42+00:00

f71fd636f151e5cb7eafb2ae6c21c1c188d43fdd












[rescribe] Default to an appropriate tesscmd for Windows
2020-11-16T17:43:13+00:00

Nick White
git@njw.name

2020-11-16T17:43:13+00:00

eefa8f50d7ab915ce426c837cf504d26b7d4ccee












[rescribe] Add txt output, only keep colour pdf, and reorganise files so they're more user-friendly
2020-11-16T16:44:42+00:00

Nick White
git@njw.name

2020-11-16T16:44:42+00:00

56c1cf041aec9cb2352a3bd4a4b46e65a3cc04c0