A handle device for a vehicle door is provided in which a tact switch that can switch between switching modes in response to a pressing-in operation of an operating button is housed and fixed within a housing recess of a handle main body so as to be electrically connected to printed wiring of a board. The printed wiring is disposed at a different site from one face, facing a cover member side, of the board, the tact switch which is fixed to the one face of the board is electrically connected to the printed wiring, a flange portion abutting against the one face of the board is provided integrally with a switch cover covering the tact switch and connected to the operating button, and the push-in stroke of the operating button is restricted to a predetermined value or below with a hold-down member engaged with the handle main body.