A hanging shower caddy has detachable shelves which engage brackets that extend from the front of the legs of the caddy back; preferably a stringer on the shelf interacts with a tie that connects the legs, to inhibit vertical lifting of the shelf from the bracket. Alternatively, the top rear rail of a shelf engages notches at the front of the legs. A pole caddy has a removable shelf with tangs that engage holes or other features in a collar that is clamped to the pole. The legs of the back of a hanging caddy are hinged so the top of the back folds for compact shipment.