There's an awful lot more to it than that but, yeah.
If you turn it up and it doesn't hardly get any louder the best thing to do is turn it back down a tad and accept that is your lot.
Choosing a 4 ohm cab ''to get all the power out of the amp'' is often non optimal. It may pay to investigate further before you blow up a cab that is too small for you.