Hook holder (1) for a hook (4), especially a fish hook, having a shank (5) and one or more curved end (portions) extending from the shank, said hook holder including a container part (2) provided with a cavity (7) for accommodating the curved end portions of the hook, and a container opening (8)through which the curved end portions of the hook are insertable into the cavity. The hook holder further includes retaining means to prevent the hook's curved end portions from unintentionally leaving the container part. The retaining means include a cover part (3) provided with a cover opening (9) and mounted on the container part (2) so as to be movable between a first position, in which the container opening (8) is accessible through the cover opening (9) to allow insertion of the curved end portions (6) of the hook, and a second position, in which the container opening (8) is closed by the cover part (3) to allow the hook shank (5) to project out of the hook holder through the container opening and the cover opening, and the curved end portions are prevented from leaving of the container part. The invention further relates to a hook holder set having a storage unit (27) and a plurality of hook holders (1).