this post was submitted on 17 Oct 2024
712 points (99.6% liked)

Science Memes

11021 readers
3530 users here now

Welcome to c/science_memes @ Mander.xyz!

A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.



Rules

  1. Don't throw mud. Behave like an intellectual and remember the human.
  2. Keep it rooted (on topic).
  3. No spam.
  4. Infographics welcome, get schooled.

This is a science community. We use the Dawkins definition of meme.



Research Committee

Other Mander Communities

Science and Research

Biology and Life Sciences

Physical Sciences

Humanities and Social Sciences

Practical and Applied Sciences

Memes

Miscellaneous

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 7 points 4 weeks ago (1 children)

I love that PDFs are so difficult to transform into HTML, too

FYI, if that's relevant to your field, every new article published on arxiv.org now has a HTML render as well.

And on many older publications, transforming "arxiv.org" into "ar5iv.org" leads to an HTML rendering that is a best-effort experiments they ran for a while.

[–] [email protected] 2 points 4 weeks ago (1 children)

That's really cool! What I really would like is a tool that converts PDFs to semantic HTML files. I took a peek there and it seems easier for them because they have the original LeX source.

I think for arbitrary PDFs files the information just isn't there. I've looked into it a bit and it's sort of all over. A tool called pdf2htmlex is pretty good but it makes the HTML look exactly like the PDF.

[–] [email protected] 2 points 4 weeks ago (2 children)

Yes, PDFs are much more permissive and may not have any semantic information at all. Hell, some old publications are just scanned images!

PDF -> semantic seems to be a hard problem that basically requires OCR, like these people are doing

[–] [email protected] 2 points 4 weeks ago

Oh nice, thanks for sharing that project. I haven't heard of it before!

[–] [email protected] 1 points 3 weeks ago

Not just semantics. PDFs doesn't even have segmentations like spaces/lines/paragraph. It's just text drawn at locations the text processor/any other softwares inserted into. Many pdf editor softwares just detect the closeness of the characters to group them together.

And one step further is you can convert text to path, which basically won't even have glyph (characters) info and font info, all characters will just be geometric shapes. In that case you can't even copy the text. OCR is your only choice.

PDF is for finalizing something and printing/sharing without the ability to edit.