VB gained >> and << bitwise operators in the latest version, although it still can't work with unsigned types so their usefulness is limited.
VB has optional parameters, C# doesn't
C# has operator overloading, VB doesn't
VB has late binding, C# doesn't
C# supports unsafe code (where you can work with pointers), VB doesn't
Although late binding is generally a bad idea, it has its uses. There is no CreateObject in C#, which makes working with unknown COM types impossible without heavy use of reflection.