Can you remove an image you don't like from a camera without tranferring the image to a PC?

Most cameras have a facilty for pre-viewing and adjusting the images stored on it. Just navigate to the offending picture and select 'Delete' from the menu.

Do it all on the camera itself.