I have very mixed feelings about AIOs ... they've been able to find things that I'd have had a lot of trouble finding with regular Search (just as Google's search was a major improvement over TF-IDF search, although TF-IDF does better for some kinds of information).
A programmer I very much respect has been successfully using Claude to clean up a lot of stale bugs (stale because they weren't easy to fix, difficult to reproduce, only showed up on one platform, etc.), but I don't think someone less capable than him (including me) would have been able to do this nearly as well.
I also agree that AIOs can be dangerous - just as Free Speech can be dangerous - and it's very difficult to draw the boundaries (see, for example, "hate speech" and political lies). The genie is out of the bottle and won't go back in; how do we deal with it?