A medical syringe container comprising a housing, an outlet through which a new syringe can be removed from the housing, an inlet through which a syringe can be replaced into the housing, and holding means to prevent a second syringe from being removed from the housing until a used syringe has been replaced into the housing. The container is particularly useful with needle exchange programs.