My understanding was that the feature only used your search string. If the thing was harvesting data out of your hard earned files then this story would be a hell of a lot bigger than this post and a few passing mentions end of last year.

Still, turn off the feature.. uninstall it (likely possible) and get on with life