BGB members noticed two people swimming ashore and challenged them, but the duo went back leaving their sacks behind