The exhaust heat recovery system of the invention includes: a thermoelectric conversion element that generates electric energy by thermoelectric conversion using heat of exhaust gas discharged from an engine; and a heat pump including a heat recovery unit that absorbs the heat contained in the exhaust gas through an endothermic reaction using a heating medium, and a heat generation unit which generates heat through an exothermic reaction of the heating medium and which supplies the heat to the thermoelectric conversion element. With this configuration, the thermoelectric conversion element and the heat generation unit are movably attached to each other such that they can be placed in contact with and separated from each other, and the heat recovery unit is positioned in an exhaust gas passage in an exhaust gas downstream flow direction from the heat generation unit.