A Compton camera for medical imaging is divided into segments with each segment including part of the scatter detector, part of the catcher detector, and part of the electronics. The different segments may be positioned together to form the Compton camera arcing around part of the patient space. By using segments, any number of segments may be used to fit with a multi-modality imaging system.