PO4 can come from tap water, fish food, and other additives. Water changes may not help if tap water has PO4. I don't think you should worry at that level. Have algae grow on the back of the tank as they will consume PO4.
Run PO4 test on tap water. If PO4 is high, use
RO/DI (expensive to buy and run) or Tap Water Filter by
API (less expensive to buy and run) to remove PO4 as well as other s in tap water.
If your water is very hard (high mineral content like in well water) it will be expensive to run due to fact that cartridges have to be replaced more often.
There are PO4 remover which you can add to filter which will adsorb PO4 oout of tank. You may want to look into this method also.