Yeah, it really is best for the fish to have plenty of space as well as low bioload levels in the tank.
You are being a responsible fishkeeper by not giving in to the urge to add more.
Bioload is there pee and poo. They have no way for that to get out other than waterchanges. So once a week or so someone pulls out all of their poo and most of their pee, but they go a week with that in the tank. Kinda like breathing in
ammonia for a week, so the less ammonia there is to breath the better they are. Understocking and not overfeeding lead to healthy long lifespans (long is a relative term since some commonly kept fish even under prime conditions only live a few years) and prettier fish.
I commend you on being a responsible keeper.