The Marble Caves are so smooth, they look like they've been hollowed out with an ice cream scoop ... The stone in the caves was originally limestone, a sedimentary rock made of calcium carbonate.