Unpopular opinion but I don't see what is wrong with this? With the current policy, if your account is public people who you block will still be able to see your tweets by simply logout (e.g. by opening twitter in a private window, using a different browser where they are not logged in, etc. doesn't take any effort).
I think this is setting the wrong expectations.