Feeling bad about something you've said or done is the first step towards being a better person.
So long as it's not the last step.
There is no last step, mind you.
It's a constant process that involves recognition of the wrongdoing, action to correct it (as much as can be corrected, some damage is permanent), and steps made to prevent it from happening again.
But it begins by feeling bad about what you've said or done, and if you are actively growing as a person you may in fact find you feel worse about it as time goes on.
(This may be from personal experience.)
The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!