A vehicle fuel pump assembly includes a fuel pump received in a tank opening, an annular pump mounting ring securing the pump to the tank at the opening, and a cover assembly including an annular cover ring and a cover. The cover ring is removably attached onto the underlying pump mounting ring and the cover is removably attached onto the cover ring to overly at least part of the fuel pump. The cover system can include a flexible attachment element on the cover ring engaging a peripheral notch in the pump mounting ring and clip elements securing the cover to the cover ring. The cover can include a hinge to provide pivoting of the cover or a portion of the cover with respect to the cover ring.