A latch assembly includes a lock case, two assembling plates, a latch bolt, a connecting plate, a first cam, and a second cam. The lock case and the assembling plates are connected together for receiving the latch bolt, the connecting plate, and the cams. Each assembling plate includes a first hole and a second hole, with the first holes being aligned with each other and with the second holes being aligned with each other. The connecting plate is connected to the latch bolt and the cams to move therewith. Each cam has a spindle hole. At least one cam has a stop wall that closes the respective spindle hole to form a closed non-circular hole. The spindle holes of the cams are separated by the stop wall, thereby preventing a spindle extending through one of the spindle holes from entering the other spindle hole.