Jack says that they spent a day in the water after the plane crashed and then the current washed them to an island. Only eight of them made it to the island.
Episode 4x12, There's No Place Like Home Part 1
Episode 4x12, There's No Place Like Home Part 1
Source...