For the typical freshwater aquarium fish, phosphate compounds can be harmful, especially above 1ppm. So keep an eye on it, but it shouldn't be at zero because your plants need it. It would be best to use a different, phosphate free water source.
Aquatic Toxicity Assessment of Phosphate Compounds