Soil erosion, by volume, continues to be the largest non-point source pollutant.
Soil carried in water affects:

Aquatic habitat
Must be removed before humans can safety consume it
Is an visual indicator that more than just soil (nutrients and pesticides) is also moving off fields