It Makes You Look Guilty
You may just be trying to be polite when you say sorry for something small, but it could be misinterpreted.
Being sorry goes hand in hand with having something to be guilty of, so if you don’t feel guilty, there’s no need to be sorry.