You're quite tall (well to my standings jejeje). I had a 5'6" potato and sold it and got a 5'2". The main reason is that that board had TONS of flotation for my weight (165lbs). I don't know what's your skill level but if you are somewhere between intermediate and advance I would go for a 5'4".
I was skeptic of going too small at the begging but once I got the board I realized how much foam this board packed.
At the end it's all a matter of preferences.
Something to remember also is that that board was designed to ride the small stuff, so going too small will in some sort defeat the original purpose of the board. I remember back on the 5'6" I was seating in the lineup at the same level as the long boarders and catching all sorts of waves