bookpipeline, branch v0.5.1 Tools to process books in a cloud based pipeline system pdf: Always encode images as jpeg 2021-08-30T12:07:43+00:00 Nick White git@njw.name 2021-08-30T12:07:43+00:00 37a1581288447ca63412047fec0fb081043ba6fb Previously for PDFs using binarised images we kept them as PNG, but there's no good reason to do so, it's better to just get the space savings on offer from jpeg. 
Previously for PDFs using binarised images we kept them as PNG, but
there's no good reason to do so, it's better to just get the space
savings on offer from jpeg.
adjusted the height of the image in the pdf to 1000px if the smaller option is chosen 2021-08-30T11:49:23+00:00 Antonia Rescribe antonia@rescribe.xyz 2021-08-30T11:49:23+00:00 7bdfbedde14a21382440fbba8e65dc139c46b9f2 






rescribe: improve makefile to match the way we deploy to the website
2021-08-24T16:04:45+00:00

Nick White
git@njw.name

2021-08-24T16:04:45+00:00

eea92760c9f9f2fa108cf759f2b4ca17b57e8364












lspipeline-ng: Limit number of book details requests so we don't run into EC2's rate limiting
2021-08-19T16:50:11+00:00

Nick White
git@njw.name

2021-08-19T16:50:11+00:00

9f3fec3e0982c5b419338f68428f12bbeed4c2bb












rescribe: Update documentation on how to deal with M1 signing, and move makefile to where it makes sense
2021-08-18T21:37:40+00:00

Nick White
git@njw.name

2021-08-18T21:37:40+00:00

bde651bbde9df3a8c33b705dbe33bbcaf4e3e73d












pdf: Stretch words to fit in their boxes, for more perfect embedding
2021-08-17T12:39:09+00:00

Nick White
git@njw.name

2021-08-17T12:39:09+00:00

767b60db23311adaf1035e821bc189877d63b7f0

- Words are stretched to fit their boxes, which means the accuracy
  is now very high indeed. This was done by modifying gofpdf to add
  the SetCellStretchToFit function, which will hopefully be
  upstreamed in due course.
- Copy pasting from a PDF works well with lines rarely if ever being
  erroneously broken by the PDF reader. There was quite a bit of
  trial-and-error to improve this, and the stretched text plus a space
  being added after the word in CellFormat was the best (plus preserves
  accuracy of word and character locations).





- Words are stretched to fit their boxes, which means the accuracy
  is now very high indeed. This was done by modifying gofpdf to add
  the SetCellStretchToFit function, which will hopefully be
  upstreamed in due course.
- Copy pasting from a PDF works well with lines rarely if ever being
  erroneously broken by the PDF reader. There was quite a bit of
  trial-and-error to improve this, and the stretched text plus a space
  being added after the word in CellFormat was the best (plus preserves
  accuracy of word and character locations).







pipeline: use regular storage for tests, rather than a separate one
2021-08-17T12:18:04+00:00

Nick White
git@njw.name

2021-08-17T12:18:04+00:00

48c68cfa7f18992b26765c7b67c52c11687ad74a












pdf: use same line height and origin for all words on a line as it makes things neater in the PDF in most cases
2021-08-09T15:34:01+00:00

Nick White
git@njw.name

2021-08-09T15:34:01+00:00

2bac685f600b97676de14bb850e5b087f0d54b83












pdf: significantly improve character coordinates
2021-08-09T14:51:50+00:00

Nick White
git@njw.name

2021-08-09T14:51:50+00:00

69eeb41a33f6a764fc6baf1a95e629a6482b67ea

A few good changes to make word coordinate lookups significantly
more accurate:
- Set font size dynamically based on the line height (previously it was
  fixed as size 10)
- Correct height and width of word boxes (previously they were way too
  large, which probably didn't make a difference in the general case,
  but now they're correct)
- Set word box margin to zero

Also change PDF size to A5 paper, as that's closer to an average book page size.





A few good changes to make word coordinate lookups significantly
more accurate:
- Set font size dynamically based on the line height (previously it was
  fixed as size 10)
- Correct height and width of word boxes (previously they were way too
  large, which probably didn't make a difference in the general case,
  but now they're correct)
- Set word box margin to zero

Also change PDF size to A5 paper, as that's closer to an average book page size.







rescribe: Add experimental m1 build
2021-08-02T16:28:03+00:00

Nick White
git@njw.name

2021-08-02T16:28:03+00:00

1f2a05e466c195dde83effd82c96d4329259d249