A polymer comprising recurring units of formulae (1) to (4) wherein R1, R3, R4 and R7 are hydrogen or methyl, R2 is an acid labile group, R5 and R6 are hydrogen or hydroxyl, and R8 is a lactone structure group and having a Mw of 1,000-50,000 is provided. A resist composition comprising the inventive polymer has a sensitivity to high-energy radiation, improved resolution and etching resistance and lends itself to lithographic micropatterning with electron beams or deep UV.