Most of them were stranded during the weekend but rescue efforts have been hampered by the remote location of the island