Haul truck driver was beginning to climb up truck's access ladder when the rubber hanger for the bottom ladder rung broke. This caused worker to strike right side of his torso against the truck bumper. Worker refused medical treatment but requested then requested treatment 3 days later.