There is tons of archeological evidence dating back to the last ice age, roughly 10,000 years ago. Before that, there is ample evidence dating back to the middle paleolithic identifying cultural traditions including art, music, and ritual.
Ample is debatable. We have biased evidence from specific biomes and regions. We are restricted to artifacts that survived from this period - effectively tusks, rocks, and specific forms of art.
