As far as I know, long ones tend to be able to cope with more fish because of the larger surface area, which is more important than volume for how many fish you can have in the tank. Some fish prefer taller aquariums because of their body shape (eg. angelfish, which can get to be 6" tall), and some need shallower water for breeding. Tall ones have a smaller area so would fit better if you don't have much room for a tank.
Other than those factors, I can't think of any real advantages/disadvantages one has over the other - it depends on what you want to do with the tank. I'd personally go for a long one so you can have more fish
