A vehicle control system having an engine and a hydro-mechanical transmission, which further comprises a decelerator for changing target engine speed according to the operating amount of a decelerator pedal; a hydrostatic transmission unit controlling means for controlling a hydrostatic transmission unit so as to make the actual speed of the engine coincident with the target engine speed; and engine controlling means for controlling the engine such that if the target engine speed is changed from a first target value to a second target value lower than the first target value by the decelerator, the output torque of the engine is reduced, while keeping the ratio of the amount of change in the output torque of the engine to the amount of change in the target engine speed constant or substantially constant.