A rolling bearing that attains long life against surface damage such as surface-originating separation or internally originating separation and allows caulking of its shaft end face, a cam-follower with roller employing the rolling bearing, and a cam are obtained. The rolling bearing includes an outer-roller, a roller shaft located inside the outer-roller, and a rolling element interposed between the outer-roller and the roller shaft. At least one member of the outer-roller and the roller shaft has a nitrogen enriched layer. A surface portion of an area in a rolling contact surface where the rolling element rolls has austenite grain size of No. 11 or larger. The end portion has hardness of not larger than HV300.