Can I Buy a 4G tablet and not activate the 4G and just use Wifi?

I was thinking about getting a tablet and I can get a 4G enabled without a contract – so when I get it I don’t have to activate it on a 4G network right? Then later on if I wanted to use it I would just have to activate it?