A smart vehicle can be operated by generating a 3D model of a sensor's field of view; receiving information from neighboring vehicles to compensate for blindspots in the sensor's field of view and in a driver's field of view; receiving traffic information, weather information; adjusting one or more characteristics of the plurality of 3D models based on the received traffic and weather information and blindspot information; aggregating the plurality of 3D models to generate a comprehensive 3D model; and combining the comprehensive 3D model with detailed map information; and using the combined comprehensive 3D model with detailed map information to maneuver the vehicle.