have you ever noticed that someone post a screenshot of text without providing an image description, preventing you from being able to read it? or maybe they posted a huge amount of text that just can't possibly be described with the image description feature?

simply tag @OCRbot in a direct reply to the image. it will download the image and scan it using tesseract OCR to output the text contained in the image!

because OCRbot runs on fedi.lynnesbian.space, it has a character limit of 65535, so even the longest images should work OK!

check the reply to this image to see it parsing the attached screenshot!

some caveats:
- it's not perfect, and it will often make small mistakes
- some images won't work at all. tesseract works best with black text on a white background, or other simple layouts.
- OCRbot won't work with handwriting.

most importantly, OCRbot is *not* a substitute for captioning your images. it's imperfect, it trips up on anything but the simplest text screenshots (with basic fonts and single colour background images), and it puts the OCR output *in the replies*, meaning that people have to do an extra step to see the text output of an image.

more things it can't do:

- it doesn't know how to handle images (such as profile pictures within posts) at all. it'll usually know to ignore them but sometimes it'll try to read them as text.
- it can't handle complex text. even things as simple as italics can trip it up. text on angles, handwriting, etc. won't work.
- it doesn't do videos, not even the thumbnails. this includes GIFs.
- if your image doesn't make it to my instance, it won't work. for example, if you have a really slow server, and it takes more than 30 seconds for an image to get from your server to mine, it won't work.
- it can't read followers-only posts.

so please, please caption your images. OCRbot is a last resort for the vision impaired and others who want to get the text out of your image where you didn't provide it. OCRbot doesn't work anywhere near as well as an able-bodied human can. if the text is upside down, OCRbot doesn't have a chance, but you and i do.

and for the moment, it only does english. it works best with english, it'll probably trip up on accented letters, and it has no chance at arabic or japanese or anything else that doesn't use the latin alphabet.

if you have any suggestions, bug reports, requests, or anything else, you can either send me a direct message or open a github issue: github.com/Lynnesbian/OCRbot/i

ladies and/nand/or/xor/nor gentlemen...... i have solved the problem of accessibility forever.

in all seriousness though, this took me less than two days to make, and most of that time was spent watching youtube and playing factorio. the entire thing was put together from modified mstdn-ebooks code in a few hours. it's nothing special

Sign in to participate in the conversation
Elekk: Mastodon for Gamers

Elekk is a Mastodon instance by gamers, for gamers. Games of any type are welcome here - computer, video, tabletop, etc. - as well as game development of any kind. GAMERGATE AND THE ALT-RIGHT ARE NOT WELCOME HERE. Elekk is not hosted in the EU and does not recognize the authority of the EU to govern the internet.