While there are several differences between the two, the key difference between limestone and gravel is their compositions. Limestone, made from calcium carbonate, takes millions of years to form.