anincorrigible on "Uploading pictures"

Hi, when I upload pictures to my blog unless I give the image a caption, when they are published they have a pink or purple border. Is there a way to prevent this?

Thankyou

Also is there an 'undo' function that I may have missed?

Ta