Create a convenient cleaning station next to your outside faucet or garden hose.
Collect all of your old soap slivers from around the house (or simply use a whole bar) and place in a plastic mesh bag.