Have you tried Application.Exit()? It will completely end your application.
If this is a game with a DoEvents in a loop, you should provide a cleaner solution. Meaning, when the user chooses to exit, set a variable, maybe bExit, to True. Exit your main loop if the variable is true.
-Nerseus