A bit holder having a body that includes a forward end that is diametrically smaller than a lower end and a shank depending axially from the lower end of the body. A substantial portion of the body is substantially solid and the shank is generally cylindrical with a bore axially extending from a distal end of the shank towards the lower end of the body. The bit holder also includes an annular sleeve mounted circumferentially around the upper end of the body and is configured protect the upper end of the body and is configured to receive a bit or insert.