A method for determining driving policies for a vehicle includes: receiving, in real-time during a trip of a vehicle, at least a set of input multimedia content elements captured by at least one sensor deployed in proximity to the vehicle, determining a plurality of possible future scenarios based at least on the set of input multimedia content elements, determining a probability score for each of the plurality of possible future scenarios, determining at least one driving policy according to at least the probability score for at least one of the plurality of possible future scenarios, and controlling the vehicle according to the at least one driving policy.