I'm going to throw a guess out here: Do you live near a peat bog? That would explain the ph.
That's not horribly low. Actually, it's ideal for a few types of fish. You may want to look at keeping things like tetras, which live in water like that. In fact, I've been desperately trying to get water like that, so I can try to breed some of my fish.
Otherwise, you can get products like
this that add minerals to the water. It will up the pH a bit, and add a
buffer, which will keep the pH steady (which is the most important).