Yes, either on you own or going as a group. One way or the other they have to make everyone clear the ship to zero the count.
I always get off & return to my car in Florida (we always do B2B trips) to bring items we don't need on our second voyage, like laundry, gifts, purchases, etc.. My wife stays aboard & always gets off the ship with the group. It can be aggravating at times since there are always a few people who are late for the meeting the group to depart the ship. They don't think it's all that important & can show up when they feel like it.
I stay in the hotel coffee shop and wait till they're boarding or go shopping if we need something... sunscreen, wine, soda.
They provide an in-transit card but it only bypasses a few steps to get back on the ship ahead of everyone else.