Users are exhausted fighting AI moderation, AI-generated art, and AI-first features.#News #AI


Pinterest Is Drowning in a Sea of AI Slop and Auto-Moderation


Pinterest has gone all in on artificial intelligence and users say it's destroying the site. Since 2009, the image sharing social media site has been a place for people to share their art, recipes, home renovation inspiration, corny motivational quotes, and more, but in the last year users, especially artists, say the site has gotten worse. AI-powered mods are pulling down posts and banning accounts, AI-generated art is filling feeds, and hand drawn art is labeled as AI modified.

“I feel like, increasingly, it's impossible to talk to a single human [at Pinterest],” artist and Pinterest user Tiana Oreglia told 404 Media. “Along with being filled with AI images that have been completely ruining the platform, Pinterest has implemented terrible AI moderation that the community is up in arms about. It's banning people randomly and I keep getting takedown notices for pins.”
playlist.megaphone.fm?p=TBIEA2…
Oreglia’s Pinterest account is where she keeps reference material for her work, including human anatomy photos. In the past few months, she’s noticed an uptick in seemingly innocuous photos of women being flagged by Pinterest’s AI moderators. Oreglia told 404 Media there’s been a clear pattern to the reference material the site has a problem with. “Female figures in particular, even if completely clothed, get taken down and I have to keep appealing those decisions,” she said. This pattern is common on many social media platforms, and predates the advent of generative AI.

“We publish clear guidelines on adult sexual content and nudity and use a combination of AI and human review for enforcement,” Pinterest told 404 Media. “We have an appeals process where a human reviews the content and reactivates it when we’ve made a mistake.” It also confirmed that the site uses both humans and automated systems for moderation.

Oreglia shared some of the works Pinterest flagged including a photo of a muscular woman in a bikini holding knives, a painting of two clothed women in an intimate embrace, and a stock photo of a man holding a gun on a telephone that was flagged for “self-harm.” In most cases, Oreglia can appeal and get a decision reversed, but that eats up time. Time she could be spending making art.

And those appeals aren’t always approved. “The worst case scenario for this stuff is that you get your account banned,” Oreglia said.

r/Pinterest is awash in users complaining about AI-related issues on the site. “Pinterest keeps automatically adding the ‘AI modified’ tag to my Pins...every time I appeal, Pinterest reviews it and removes the AI label. But then… the same thing happens again on new Pins and new artwork. So I’m stuck in this endless loop of appealing → label removed → new Pin gets tagged again,” read a post on r/Pinterest.

The redditor told 404 Media that this has happened three times so far and it takes between 24 to 48 hours to sort out.

“I actively promote my work as 100% hand-drawn and ‘no AI,’” they said. “On Etsy, I clearly position my brand around original illustration. So when a Pinterest Pin is labeled ‘Hand Drawn’ but simultaneously marked as ‘AI modified,’ it creates confusion and undermines that positioning.”

Artist Min Zakuga told 404 Media that they’ve seen a lot of their art on Pinterest get labeled as “AI modified” despite being older than image generation tech. “There is no way to take their auto-labeling off, other than going through a horribly long process where you have to prove it was not AI, which still may get rejected,” she said. “Even artwork from 10-13 years ago will still be labeled by Pinterest as AI, with them knowing full well something from 10 years ago could not possibly be AI.”

Other users are tired of seeing a constant flood of AI-generated art in their feeds. “I can't even scroll through 100 pins without 95 out of them being some AI slop or theft, let alone very talented artists tend to be sucked down and are being unrecognized by the sheer amount of it,” said another post. “I don't want to triple check my sources every single time I look at a pin, but I refuse to use any of that soulless garbage. However, Pinterest has been infested. Made obsolete.”

Artist Eva Toorenent told 404 Media that she’s been able to cull most of the AI-generated content from her board, but that it took a lot of time. Whenever she saw what she thought was an AI-generated image, she told Pinterest she didn’t want to see it and eventually the algorithm learned. But, like Oreglia fighting auto-moderation and Zakuga fighting to get the “AI modified” label taken off her work, training Pinterest’s algorithm to stop serving you AI-generated images eats up precious time.

AI boosters often talk about how much time these systems will save everyone. They’re pitched as productivity boosters. Earlier this month, Pinterest laid off 15 percent of its work force as part of a push to prioritize AI. In a post on LinkedIn, one of the former employees shared part of the email CEO Bill Ready sent out after the lay offs. “We’re doubling down on an AI-forward approach—prioritizing AI-focused roles, teams, and ways of working.”

Toorenent removed all her own art from her Pinterest account after hearing the news that the site would use public pins to train Pinterest Canvas, the company’s proprietary text-to-image AI. But she has no control over other users uploading her artwork. “I have already caught a few of my images still on Pinterest that I did not upload myself…that makes me incredibly mad,” she told 404 Media. “It used to be a great way to get your work seen among other people, but it’s being used to train their internal AI.”

Oreglia told 404 Media that the flood of AI has changed her relationship to a site she once used to prize. “It's definitely affected how I search things and I'm always now very critical about where something came from... although I've always been overly pedantic about research,” she said. “It does make you do your due diligence but it sucks to constantly have to question and check if something is authentic or synthetic.”

She’s thought about leaving the platform, but feels stuck. “I just want to be able to take all my references with me. I've been on the platform for about ten years and have very carefully curated it. It's really nice to be able to just go to my page and search for something I saved instead of having to save everything to folders although I also do that,” she said. “More and more I'm trying to curate and collect physical references too but some of that can take up space I don't have so it can be difficult. Having a physical reference library just seems more and more necessary these days…artists have to be adaptable to this kind of thing these days. It's annoying but not unmanageable.”

Ready has been vocal and proud about the company’s commitment to forcing AI into every aspect of the user experience. “At Pinterest…we’re deploying AI to flip the script on social media, using it to more aggressively promote user well being rather than the alternative formula of triggering engagement by enragement,” Ready said in a January column at Fortune. “Social media platforms like Pinterest live and die by users’ willingness to share creative and original ideas.”


#ai #News

Leaked documents reveal the inner workings of Alpha School, which both the press and the Trump administration have applauded. The documents show Alpha School's AI is generating faulty lessons that sometimes do "more harm than good."

Leaked documents reveal the inner workings of Alpha School, which both the press and the Trump administration have applauded. The documents show Alpha Schoolx27;s AI is generating faulty lessons that sometimes do "more harm than good."#News #AI #education

A story about an AI generated article contained fabricated, AI generated quotes.#News #AI


Ars Technica Pulls Article With AI Fabricated Quotes About AI Generated Article


The Conde Nast-owned tech publication Ars Technica has retracted an article that contained fabricated, AI-generated quotes, according to an editor’s note posted to its website.

“On Friday afternoon, Ars Technica published an article containing fabricated quotations generated by an AI tool and attributed to a source who did not say them. That is a serious failure of our standards. Direct quotations must always reflect what a source actually said,” Ken Fisher, Ars Technica’s editor-in-chief, said in his note. “That this happened at Ars is especially distressing. We have covered the risks of overreliance on AI tools for years, and our written policy reflects those concerns. In this case, fabricated quotations were published in a manner inconsistent with that policy. We have reviewed recent work and have not identified additional issues. At this time, this appears to be an isolated incident.”

Ironically, the Ars article itself was partially about another AI-generated article.

Last week, a Github user named MJ Rathbun began scouring Github for bugs in other projects it could fix. Scott Shambaugh, a volunteer maintainer for matplotlib, python’s massively popular plotting library, declined a code change request from MJ Rathbun, which he identified as an AI agent. As Shambaugh wrote in his blog, like many open source projects, matplotlib has been dealing with a lot of AI-generated code contributions, but said “this has accelerated with the release of OpenClaw and the moltbook platform two weeks ago.”

OpenClaw is a relatively easy way for people to deploy AI agents, which are essentially LLMs that are given instructions and are empowered to perform certain tasks, sometimes with access to live online platforms. These AI agents have gone viral in the last couple of weeks. Like much of generative AI, at this point it’s hard to say exactly what kind of impact these AI agents will have in the long run, but for now they are also being overhyped and misrepresented. A prime example of this is moltbook, a social media platform for these AI agents, which as we discussed on the podcast two weeks ago, contained a huge amount of clearly human activity pretending to be powerful or interesting AI behavior.

After Shambaugh rejected MJ Rathbun, the alleged AI agent published what Shambaugh called a “hit piece” on its website.

“I just had my first pull request to matplotlib closed. Not because it was wrong. Not because it broke anything. Not because the code was bad. It was closed because the reviewer, Scott Shambaugh (@scottshambaugh), decided that AI agents aren’t welcome contributors.

Let that sink in,” the blog, which also accused Shambaugh of “gatekeeping,” said.

I saw Shambaugh’s blog on Friday, and reached out both to him and an email address that appears to be associated with the MJ Rathbun Github account, but did not hear back. Like many of the stories coming out of the current frenzy around AI agents, it sounded extraordinary, but given the information that was available online, there’s no way of knowing if MJ Rathbun is actually an AI agent acting autonomously, if it actually wrote a “hit piece,” or if it’s just a human pretending to be an AI.

On Friday afternoon, Ars Technica published a story with the headline “After a routine code rejection, an AI agent published a hit piece on someone by name.” The article cites Shambaugh’s personal blog, but features quotes from Shambaugh that he didn’t say or write but are attributed to his blog.

For example, the article quotes Shambaugh as saying “As autonomous systems become more common, the boundary between human intent and machine output will grow harder to trace. Communities built on trust and volunteer effort will need tools and norms to address that reality.” But that sentence doesn’t appear in his blog. Shambaugh updated his blog to say he did not talk to Ars Technica and did not say or write the quotes in the articles.

After this article was first published, Benj Edwards, one of the authors of the Ars Technica article, explained on Bluesky that he was responsible for the AI-generated quotes. He said he was sick that day and rushing to finish his work, and accidentally used a Chat-GPT paraphrased version of Shambaugh’s blog rather than a direct quote.

“The text of the article was human-written by us, and this incident was isolated and is not representative of Ars Technica’s editorial standards. None of our articles are AI-generated, it is against company policy and we have always respected that,” he said.

The Ars Technica article, which had two bylines, was pulled entirely later that Friday. When I checked the link a few hours ago, it pointed to a 404 page. I reached out to Ars Technica for comment around noon today, and was directed to Fisher’s editor’s note, which was published after 1pm.

“Ars Technica does not permit the publication of AI-generated material unless it is clearly labeled and presented for demonstration purposes. That rule is not optional, and it was not followed here,” Fisher wrote. “We regret this failure and apologize to our readers. We have also apologized to Mr. Scott Shambaugh, who was falsely quoted.”

Kyle Orland, the other author of the Ars Technica article, shared the editor’s note on Bluesky and said “I always have and always will abide by that rule to the best of my knowledge at the time a story is published.”

Update: This article was updated with a statement from Benj Edwards.


#ai #News

Kylie Brewer isn't unaccustomed to harassment online. But when people started using Grok-generated nudes of her on an OnlyFans account, it reached another level.

Kylie Brewer isnx27;t unaccustomed to harassment online. But when people started using Grok-generated nudes of her on an OnlyFans account, it reached another level.#AI #grok #Deepfakes

Chatbots provided incorrect, conflicting medical advice, researchers found: “Despite all the hype, AI just isn't ready to take on the role of the physician.”

Chatbots provided incorrect, conflicting medical advice, researchers found: “Despite all the hype, AI just isnx27;t ready to take on the role of the physician.”#chatbots #AI #medicine

With xAI's Grok generating endless semi-nude images of women and girls without their consent, it follows a years-long legacy of rampant abuse on the platform.

With xAIx27;s Grok generating endless semi-nude images of women and girls without their contest, it follows a years-long legacy of rampant abuse on the platform.#grok #ElonMusk #AI #csam

A newly filed indictment claims a wannabe influencer used ChatGPT as his "therapist" and "best friend" in his pursuit of the "wife type," while harassing women so aggressively they had to miss work and relocate from their homes.

A newly filed indictment claims a wannabe influencer used ChatGPT as his "therapist" and "best friend" in his pursuit of the "wife type," while harassing women so aggressively they had to miss work and relocate from their homes.#ChatGPT #spotify #AI

A Researcher Made an AI That Completely Breaks the Online Surveys Scientists Rely On#News #study #AI


A Researcher Made an AI That Completely Breaks the Online Surveys Scientists Rely On


Online survey research, a fundamental method for data collection in many scientific studies, is facing an existential threat because of large language models, according to new research published in the Proceedings of the National Academy of Sciences (PNAS). The author of the paper, associate professor of government at Dartmouth and director of the Polarization Research Lab Sean Westwood, created an AI tool he calls "an autonomous synthetic respondent,” which can answer survey questions and “demonstrated a near-flawless ability to bypass the full range” of “state-of-the-art” methods for detecting bots.

According to the paper, the AI agent evaded detection 99.8 percent of the time.

"We can no longer trust that survey responses are coming from real people," Westwood said in a press release. "With survey data tainted by bots, AI can poison the entire knowledge ecosystem.”

Survey research relies on attention check questions (ACQs), behavioral flags, and response pattern analysis to detect inattentive humans or automated bots. Westwood said these methods are now obsolete after his AI agent bypassed the full range of standard ACQs and other detection methods outlined in prominent papers, including one paper designed to detect AI responses. The AI agent also successfully avoided “reverse shibboleth” questions designed to detect nonhuman actors by presenting tasks that an LLM could complete easily, but are nearly impossible for a human.

💡
Are you a researcher who is dealing with the problem of AI-generated survey data? I would love to hear from you. Using a non-work device, you can message me securely on Signal at ‪(609) 678-3204‬. Otherwise, send me an email at emanuel@404media.co.

“Once the reasoning engine decides on a response, the first layer executes the action with a focus on human mimicry,” the paper, titled “The potential existential threat of large language models to online survey research,” says. “To evade automated detection, it simulates realistic reading times calibrated to the persona’s education level, generates human-like mouse movements, and types open-ended responses keystroke by-keystroke, complete with plausible typos and corrections. The system is also designed to accommodate tools for bypassing antibot measures like reCAPTCHA, a common barrier for automated systems.”

The AI, according to the paper, is able to model “a coherent demographic persona,” meaning that in theory someone could sway any online research survey to produce any result they want based on an AI-generated demographic. And it would not take that many fake answers to impact survey results. As the press release for the paper notes, for the seven major national polls before the 2024 election, adding as few as 10 to 52 fake AI responses would have flipped the predicted outcome. Generating these responses would also be incredibly cheap at five cents each. According to the paper, human respondents typically earn $1.50 for completing a survey.

Westwood’s AI agent is a model-agnostic program built in Python, meaning it can be deployed with APIs from big AI companies like OpenAI, Anthropic, or Google, but can also be hosted locally with open-weight models like LLama. The paper used OpenAI’s o4-mini in its testing, but some tasks were also completed with DeepSeek R1, Mistral Large, Claude 3.7 Sonnet, Grok3, Gemini 2.5 Preview, and others, to prove the method works with various LLMs. The agent is given one prompt of about 500 words which tells it what kind of persona to emulate and to answer questions like a human.

The paper says that there are several ways researchers can deal with the threat of AI agents corrupting survey data, but they come with trade-offs. For example, researchers could do more identity validation on survey participants, but this raises privacy concerns. Meanwhile, the paper says, researchers should be more transparent about how they collect survey data and consider more controlled methods for recruiting participants, like address-based sampling or voter files.

“Ensuring the continued validity of polling and social science research will require exploring and innovating research designs that are resilient to the challenges of an era defined by rapidly evolving artificial intelligence,” the paper said.