I don’t think anything is possible risk free. So it comes down to your/societies risk tolerance how save, expensive and slow or risky, cheap and fast progress should be. Ideally the risk is taken by conscious and free individuals. But yes, bystanders will be hit as well.

For manned flight it was totally worth the risk.