A device for selectively inserting or removing cup liners having a generally elongated cylindrical body, a front cup and a rear lip from a milking cup apparatus. The device having a frame, a force-applying device pivotally connected to the frame and a liner holding device, connected in sliding engagement to the frame. The liner holding device is configured to connect with the liner and to pull the liner through the hard milk shell cup when activated by a user.