I have been developing mostly with VB/VBA/VBScript and I would choose C#. The main reason is that C# was developed by microsoft to be the Web Services language. Support by microsoft, and other web services developers is far greater than for VB.Net. If VB.net did not require as long a learning curve as learning VB.net, I would have chosen VB.net.
As far as features go, Microsoft says that they are the same. But from my understanding, and I wish I had some features to point out to be specific, is that C# has some features not found in VB.net. Now you have to determine whether this is true or some hype from C# supporters.
The key to both languages is learning the .net Framework and all the assemblies that are currently available. The final Choice as Microsoft usually says is whatever your preference is. I personally feel that from my observations, most people will be going with C#, and diehard VB shops that migrate to .net will go with VB.net.