Those who are hoping to swim, though, may want to venture elsewhere since these waters are known for their rough waves ... getting to Manly by way of the Circular Quay to Manly ferry.