I don't really move everything during every weekly
water change/vacuum but you have to move things sometimes. I'm kinda like beth in that I don't really have a system. I know there are some places in my tank that have to be vacuumed every time because they get dirtier than other parts. The driftwood where my bn pleco (poo factory lol) hangs out needs to be moved every week to be vacuumed underneath, for example.
I don't have java ferns on driftwood but I do uproot the swords plants after several months, trim off some roots and vacuum really well where they were.