Compact gooseberry bush

I think your best bet would be a cordon or standard.

A cordon is trained to be a single stem with small side shoots, so will need supporting.  A standard is shaped like a small tree, so you will need to stake it.

Both are more expensive to buy, but if space is really short, it could be a worthwhile investment.