It would be very strange for rocks to change the pH. If minerals change the pH, they usually raise it.
driftwood, dead plants, or an excess of food/waste in the substrate all can drop the pH, as they either add tanins to the water or build an acidic form of nitrogen in the water. CO2 can also drop the pH.
My first suggestion would be to test your tap water to make sure it hasn't changed. Then, re-test the aquarium. If the tap water tests at neutral, and if the aquarium still stays low, do a few partial water changes over the next few days, to see if this brings the pH up a bit. Be sure to do a thorough job of vacuuming (if you have an under-gravel filter, you may only want to vacuum half this week and half next week) to get the waste out of the gravel.
Keep a close eye on the pH over the next couple of weeks. If it drops quickly after a
water change, it may be a good idea to pull the new rocks out to try to confirm/deny if they're the problem.