Considering ~55% of the sun's energy that hits the earth is in the form of IR, my guess is IR systems would be marginal. I think it bears testing though to be sure.
As you say other creatures are much more sensitive to IR differences.
That's a good point, but also reminds me of moths circling a flame or porch light. The vast majority of light we see in the world comes from the sun, but when the sun is elsewhere, our artificial light triggers changes in how insects behave.
I wonder if ground-source lidar at night would have similar effects on animals that are "used to" IR coming from above.
As you say other creatures are much more sensitive to IR differences.