Another addition:
If you are sure you want to delete a file permenantly, then you can use
shift+delete
to delete the file permenantly
It will not go into the recycle bin. Don't make a habit though.. Some of my friends have deleted things accidently (and permenantly) on more than one occasion

... though usually, those are movies and songs

which might not be in your case.
Cheers
