The ship was turned around in the early afternoon