I always pull out my usb stick without using the option for safe removal and I never lost any data. The usb stick is hotplug so it can be treated like that.
What do you prefer?