Separating a source in a stereo signal having a left channel and a right channel includes transforming the signal into a short-time transform domain; computing a short-time similarity measure between the left channel and the right channel; classifying portions of the signals having similar panning coefficients according to the short-time similarity measure; segregating a selected one of the classified portions of the signals corresponding to the source; and reconstructing the source from the selected portions of the signals.