Major, big big major, not just me either. How is it alarming beyond words? If I said "Im an emt and I just ask the AI everything" now that would be alarming beyond words.
I have a buddy who is a cop and he tells me that they use AI to write reports and even to check if their reason for pulling someone over will hold up later. As annoying as it is in SW, people using AI outside of SW is much more alarming.
I'm less concerned about the code and more concerned that you said there's no culture around reading it/reviewing it...at a bank.
If anything screws up, that's people's lives being messed with, potentially in a way none of the engineers on staff know how to fix. If I were an actuarial in that environment I'd blow a valve.
Its a big bank, Im not working on anyones debit account. Me and everyone Ive ever seen here is working on internal tools, nothings going to wipe out anyones savings. Also, yeah, its a bank, I hit the "im going to blow a gasket" line so long okay I cant even remember what things are supposed to be like.