I did a work around and used the Items[Index].Remove() function instead of Delete()
and handled the deletion of all old Temp files on another event by System FileInfo delete function.
It works for me now but I still want to know why it does not work with DeleteAttachment(Index) and DeleteAllAttachments()?