An audio plug connector includes a substantially pillared insulating body defining a fixing portion at one end thereof, a plurality of terminals formed in the insulating body, and a housing having a lower housing and an upper housing mated with each other to define a cylindrical receiving space therebetween for receiving the one end of the insulating body therein. The fixing portion defines at least one fixing hole passing therethrough. A portion of an inner surface of the lower housing protrudes corresponding to the fixing hole to form at least one locating portion inserted in the corresponding fixing hole. A portion of an inner surface of the upper housing protrudes corresponding to the locating portion to form at least one propping projection which defines a locating hole. A free end of the locating portion is further inserted in the corresponding locating hole.