You can self-host libretranslate: https://libretranslate.com/
this post was submitted on 24 Apr 2024
52 points (98.1% liked)
Selfhosted
39232 readers
332 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 1 year ago
MODERATORS
Looks like the engine behind it is https://opennmt.net/
Which can use a Tensor Flow backend, which can potentially be accelerated by a rather cheap Coral TPU. Neat!
Yes, just grab any recent LLM like Mistral-7B and ask it to translate for you. A local client is here https://github.com/LostRuins/koboldcpp but you might need a good GPU to get quick answers.
Alternatively use https://lite.koboldai.net to use someone else's computer.
How trustworthy are LLM translations? Normal machine translation may lose context but I imagine LLM could make up shit?
All translations are LLM translations by this point I believe.
Translator here. They do make up stuff or omit stuff they don't like. Machine translation is fine for tourists or to translate a ikea manual in the wrong language. If there are stakes, risky. They got good enough to make sentences that look right so it can be tricky to spot the errors if you don't pay attention.
Numbers are typical errors. Sometimes it's there but the number has changed. Sometimes it's not there at all. Oh and if you have currencies a translators knows a document from the UK in pounds that is adapted for France will have to be converted in euros. Machines don't.
Generally speaking when a client wants to use machine translation, it costs them more money in the end because of the extra time needed to correct everything to a high human grade standard.
From my experience: They're pretty good
A simpler answer might be llamafile if you're using Mac or Linux.
If you're on windows you're limited to some smaller LLMs without some work. In my experience the smaller LLMs are still pretty good as chat bots so they might translate well.
Please add a disclaimer to the documents stating it was machine translated. Machine translation can get it wrong or take liberties, make up stuff. Please inform your readers so they can be on the lookout.
Keep in mind the translated stuff by machine translation won't be 100% what you say in your native language to other students. Be careful not to spread wrong information or knowledge.