I'm getting strong "blue steel" vibes.
Noblesavage
Great. Now you're just making me rewatch allinall's animated video of Pelinal's slaughter for the 30th time: https://youtu.be/E5ix0_W-ouI?si=-2mGt8TDnU5wbwGO
That's a good point about the "AI as a service" model that is emerging.
I was reading that NaNoWriMo has had a significant turnover on their board die to the backlash against their pro-AI stance: https://www.cbc.ca/news/entertainment/nanowrimo-ai-controversty-1.7314090
Yes, you're right everything can cause serious harm or kill, but certain things are designed to harm or kill, or designed to look like something that could harm or kill.
Context is a big factor here. A person holding a 6 inch knife in a kitchen? No one is going to bat an eye. They're probably using that knife to prep vegetables. Same knife, same person but they are walking around a market/playground/movie theatre? Suddenly it's a very different situation and context.
Is that stranger with the knife safe? I don't know, but I do know that I don't have anything to defend myself aside from what is around me if they ARE NOT a safe person.
Thinking of your Superman example and an ubermensch having to think about everything, I think several comics and media that have explored aspects of this idea.
I remember reading that there's a Spiderman story arc where it's revealed that Peter Parker is holding back his "true" strength for nearly the entire time he's been Spiderman. It's only been his true strength of character that has made sure that he "pulls his punches" far enough back so as to not kill or harm the people he's fighting or saving.
I also think about Robert Kirkman's Invincible comic/animated series that explores how powerful people decide, either intentionally or accidentally, the fates of those around them, often with dramatic and violent conclusions. Invincible is the story of Superman if Clark Kent wasn't raised by an American family in the mid-West and was instead raised for another more sinister reason.