The actor revealed he had to drink "three Long Island iced teas" to take his shirt off on a recent beach trip.