A portable terminal device aborts a screen display process of the current application on a display in accordance with a switch of a communication partner during communication with a speaker A and executes a screen display process of an application corresponding to a speaker B after the switch operation. The application corresponding to the speaker B is the application executed during communication with the speaker B previously. The application is an E-mail or browser application.