Should be fine as long as you let them know asap so they can make other arrangements. You wont stay there long anyway if its a rotten work environment. Just make sure that your inside info is reliable and not a hater trying to keep the competition out.