A low-cost tactile feedback mouse device for providing haptic feedback to a user for enhancing interactions and manipulations in a graphical environment provided by a computer. The mouse device includes a sensor device able to detect the movement of the mouse in the planar workspace. An actuator is coupled to the housing of the mouse and applies an inertial force in a particular degree of freedom, preferably along an axis perpendicular to the planar workspace, where the inertial force is transmitted through the housing to the user. The actuator outputs the inertial force preferably by linearly moving an inertial mass along the Z-axis. The output force is correlated with interaction of a controlled graphical object, such as a cursor, with other graphical objects in a graphical environment displayed by the host computer. The inertial force can be a pulse, vibration, texture force, or other type of force.