Hi,
Did you get some kind of error message? It sounds like you noticed this already, but you do need to deactivate the plugin before deleting it.
If it’s not working for some reason you can use your FTP client to just delete its directory from your plugins directory (/wp-content/plugins/).
If that doesn’t help, you can send a login if you like and I’ll try to install it for you.