Provided are a method, system, and program for selecting a path to a device to use when sending data requests to the device. Data requests are submitted to the device on a first path. Device information is maintained indicating a position of a data transfer mechanism of the device that performs the submitted data request. A second path to the device is selected if the first path fails. Data requests are submitted to the indicated position at the device on the selected second path.