Broaching with means to hold work during cutting with means on work or work holder to guide cutter during infeed