A tool hanger assembly has a frame and a hanger. The frame has a back plate and a bracket. The bracket is mounted securely on the back plate and has a track formed in a top of the bracket. The hanger is mounted securely on the frame and has a base plate and multiple pillars. The base plate is mounted securely in the track. The pillars are securely mounted on the base plate at intervals to allow sleeves to be mounted around. Accordingly, to assemble the hanger having the multiple pillars with the frame is quick, reduces assembling cost and is convenient.