Here are some ideas of stuff I have used in the past:
For caves and decoration:
-white
PVC (black is ABS, not PVC) or acrylic
-slate shingles (from a demolition site)
-lava stone from the garden center (silicone on PVC, or build something cool out of acrylic and silicone them on there)
-found stones by fresh water lakes and rivers
-water gutter from the hardware store (cut holes in the bottom, separate with garden liner to make multiple caves, flip over, brush on silicone cover with either substrate, sand, or lava stone to make a cave across the bottom of your tank, or string 3 or 4 together and hang to cover your rear wall.)
-found drift wood (non resinous)
-Styrofoam walls(carve them out of the styrofoam coolers), covered in quickcrete. This requires a lot of work, but results are amazing.
Make sure you are only using DAP Aquarium safe silicone. It is 3 dollars a tube at the hardware store.
Boil all rocks and wood, put it in a bucket of tested water for a few days and test the water. If anything is out of whack, repeat. You don't want to add anything that will spike the
pH. If the wood you get wont stay down, get a square piece of acrylic and screw the wood to it and bury the acrylic in the substrate. If the rocks and the wood are to big for your pots, you can put them in a bucket and pour boiling water over them, or/and bake them in the oven.
Well I have to get back to work here...lol Let me know if you need help building anything, I can send plans for stuff I have already built.
Have fun!
Cheers!