I don't know. In that scenario, has any google software sold as being intelligent produced text encouraging and providing help with the act?

At the very least, selling a text completion api and a chat interface wrapper as "artificial intelligence" is false marketing.

Malleable software will eat you whole.

None of this makes any sense. Do you know how computers work?

This "AI" summer has turned into a drug fueled orgy of magical thinking. I am at my tether's end. I need to leave this industry to preserve my sanity at this point.

As soon as you send text to a text completion API, local or remote, and it returns some text completion that some code parses, finds commands and runs them, all bets are off.

All the semantics around "stochastic (parrot)", "non-deterministic", etc tries to convey this. But of course some people will latch on to the semantics and triumphantly "win" the argument by misunderstanding the point entirely.

Automation trades off generality. General automation is an oxymoron. But yeah by all means, plug a text generator to your hands off work flow and pray. Why not? I wouldn't touch such a contraption with a 10 feet pole.

>First of all, you absolutely cannot release an OS with a known zero day.

There is no such thing as a 'known zero day' vulnerability.

Zero day vulnerability means it is a newly discovered one. Today. The day zero.