The sun's brightness per area is constant with distance. If you move twice as close to the sun, the brightness per area is exactly the same as it is on Earth, it just covers four times as much of the sky.

If every sight line ended on a star, you'd expect the entire sky's brightness per area to be that of a star.