Hi. Sorry, no time to read the replies and see if this has already been posted, but the scenario you outlined is definitely a thing , eg:
https://www.theguardian.com/technology/article/2024/jul/21/we-unleashed-facebook-and-instagrams-algorithms-on-blank-accounts-they-served-up-sexism-and-misogyny
And it doesn't even appear to require prompting - it lays on the misogyny by default, according to this study using a blank account.