bookpipeline/cmd, branch fullsizepdf Tools to process books in a cloud based pipeline system Add initial support for full-size PDF generation 2022-03-11T13:36:59+00:00 Nick White git@njw.name 2022-03-11T13:36:59+00:00 9d1382b69700129a66541d786ba3b784eda56e36 Some issues: 1) The PDF generation stores every page in memory while it constructs it. That means that there's a higher chance of failure due to running out of memory with these. There's no getting around this except by improving the PDF generation library, which is not easy. 2) Currently I've just changed the pipeline to always generate these full size PDFs, and then the rescribe tool will just delete them if they weren't requested. This is bad in particular because of point 1, and would probably cause issues of failures in the server pipeline as a result Therefore the plan is to add a tag to queue messages so that full size generation can be selectively enabled. Also, it should be split from the loop with colour pdf generation, as holding them both in RAM at the same time is unnecessary. 
Some issues:
1) The PDF generation stores every page in memory while it constructs it. That means that
there's a higher chance of failure due to running out of memory with these. There's no
getting around this except by improving the PDF generation library, which is not easy.

2) Currently I've just changed the pipeline to always generate these full size PDFs, and
then the rescribe tool will just delete them if they weren't requested. This is bad in
particular because of point 1, and would probably cause issues of failures in the server
pipeline as a result

Therefore the plan is to add a tag to queue messages so that full size generation can be
selectively enabled.

Also, it should be split from the loop with colour pdf generation, as holding them both in RAM at
the same time is unnecessary.
Name PDF extracted images so they sort correctly 2022-03-11T10:17:24+00:00 Nick White git@njw.name 2022-03-11T10:17:24+00:00 d6e1cb61da7a9155023ce9dece96da79c7246790 






rescribe: improve layout of completed popup
2022-02-28T17:56:12+00:00

Nick White
git@njw.name

2022-02-28T17:56:12+00:00

326bbf430125b69614ac4f4160cf5f1d8c6dedbe












rescribe: Further improve getembeds error reporting and recognition
2022-02-28T17:21:27+00:00

Nick White
git@njw.name

2022-02-28T17:21:27+00:00

fe9fd2e460762f60c1887b07727e6dd6668970a8












rescribe: Fix error printing with getembeds
2022-02-28T17:11:02+00:00

Nick White
git@njw.name

2022-02-28T17:11:02+00:00

7ebcab53b0e8e90dca1ed024e4d815529d49fd09












rescribe: Add embed_darwin.go to include getbook into OSX builds
2022-02-28T17:05:28+00:00

Nick White
git@njw.name

2022-02-28T17:05:28+00:00

65be1a688b9213e9e020ef00fe5726f18404a99b












rescribe: Add " searchable" to file name for saved PDF
2022-02-28T17:00:27+00:00

Nick White
git@njw.name

2022-02-28T17:00:27+00:00

2bf8016a4572d5f83812c03785db3d4248dac449












rescribe: Add popup on completion reporting where files were saved
2022-02-28T17:00:08+00:00

Nick White
git@njw.name

2022-02-28T17:00:08+00:00

a116e67e9b297c32c7dfa802cdf9fef54a2e0a74












rescribe: Improve wording of training dropdown
2022-02-28T16:38:23+00:00

Nick White
git@njw.name

2022-02-28T16:38:23+00:00

fac998f847f42ca2a849c425cb6d9fa7f002ada0












Add PreNoWipe queue, that just does binarisation but no wiping
2022-02-28T16:17:35+00:00

Nick White
git@njw.name

2022-02-28T16:17:35+00:00

21d49b546a27de6c53d8fe7d1a68d5a3b5506c93