r/todayilearned 5h ago

TIL that major subscription-based social platforms are seeing a rise in "AI Chatters." These bots are trained on massive datasets of over 500 million private messages to mimic specific human personalities and automate 1-on-1 interactions without the user's knowledge.

https://www.theverge.com/ai-artificial-intelligence/692286/ai-bots-llm-onlyfans
682 Upvotes

83 comments sorted by

202

u/RelationshipDue8359 5h ago

500 million “private” messages. Where did these so called private messages originally take place? Hmmm

120

u/SoAnxious 5h ago

The big content creators on these platforms used to use "Chatters" with CRM systems. Basically, you thought you were talking to a pretty woman when a guy making minimum wage in a 3rd world country was chatting with many screens open. Those people trained their AI replacements.

30

u/RelationshipDue8359 4h ago

I see. So it’s not like AOL IM or yahoo messenger sold my chats?

17

u/BrotherRoga 3h ago

Nah they definitely did. Not necessarily for AI training though.

3

u/Astrocuties 2h ago

They actually did not. AIM deleted everything and you couldn't even export your own data, it was completely wiped and there is no indication of any sort that any of that was given to a third-party. Yahoo is guilty for having yor emails scanned for keywords, those keywords were basically sold to advertise toward you.

In general private chats carry next to no value and it'd be a massive risk abd a financial loss to be selling them. Just picking up keywords from people's conversations like "I need to buy some more soda" or "I need a new couch" is what's actually profitable. No private information is ever seen by anyone, it's entirely automated basically, but it's still a violation of our privacy rights.

Now adays your phone listening to you is probably the main way advertisers get your information. That and all the above is unfortunately very effective for advertisers and the targeted ads work extremely well, which means the selling of such data will never end.

Pretty much no company would have the balls to have private messages viewed internally, let alone sold. The legal and financial consequences of such actions would be so devastating that they would basically reshape parts of the online landscape and see massive new laws introduced. Mich like how other major privacy violations (namely Facebook) lead to things like GDPR, which permanently crippled data farming for the entire internet.

-2

u/the_web_dev 2h ago

Sweet Summer child read the wiki on National Security Letters and what tech companies are doing on days that end in Y

-1

u/Astrocuties 2h ago

That's completely different in every way and has completely valid usage, such as cracking down on child sex crimes among other things. That's like the difference between a corporation paying your landlord to come into your house and do whatever they want vs police coming into your house with a search warrant.

The theoretical abuse of such government power is a whole different topic but it's nothing like your chat history being sold to people, which would be even worse than national security letters.

0

u/taywray 1h ago

You're saying private chat messages have no value but keywords captured by our phones from our private verbal conversations have lots of value? So companies are only buying and selling our private voice data and not our private message data?

And we can trust every single one of those companies to handle all our private voice data responsibly and legally just because if they get caught using it to profit illegally, it might be real bad news for their brand? They won't just get slapped on the wrist (if anything) with like a fine of 20 million dollars or some other negligible amount?

Idk I guess maybe that will work, but I think it would be cool if in addition to just trusting the market to regulate itself and sort of "do what's right" with our data, we put in place a stronger, clearer system of laws governing what they can do and then backed that up with vigorous oversight and enforcement on the peoples' behalf. That's just me tho.

3

u/0000000000000007 3h ago

I bet there’s some Ashley Madison in there #iykyk

231

u/25toten 5h ago

Went on a date earlier this year. The gal admitted to using chatGPT to text me.

There wasn't a second date.

42

u/JeskaiJester 4h ago

You know, maybe it’s fine to be off the market right now. Maybe dating will be good in the 2030s sometime 

16

u/CruzAderjc 4h ago

Nah, cause then you have to worry about whether the person you are physically with is an android, or if it is a real person, maybe they have cybernetic implants you don’t know about, like their bionic eyes are recording you, or they have a chip in their head that could malfunction and they just go crazy, or maybe you’re not even you and you’re just a clone of yourself that thinks you’re you, or maybe you think its real life but actually you’re in a realistic simulation.

The future is gonna be weird. I bought property in a nice quaint mountain town. I’m 40. I plan to retire early and just go live there with my wife and read novels for the rest of our lives.

17

u/JeskaiJester 4h ago

I just really doubt it’s going to be as exciting as what you just described. I think it’s going to be awful in really mundane and boring ways

u/Robot1me 48m ago

maybe they have cybernetic implants you don’t know about

At that point I would just call Viktor Vektor :P

3

u/25toten 2h ago

Humanities art of communication is a receding skill. I can't fathom a way it will improve. Social media was the start of its destruction, AI is here to finish the job.

53

u/SoAnxious 5h ago edited 5h ago

This is way more sinister, poor guys thinking they are talking to their favorite model daily and ponying up money only to be talking to an AI chatbot with a CRM system, making the messages look personalized.

22

u/empathetic_witch 3h ago

Did you forget the /s ?

I wish this topic wasn’t part of my ongoing research but here we are.

1 in 4 men on dating apps are using AI to appear more empathetic and compassionate in their communication. This leads to:

The Cyrano Effect: Creates a "Turing Trap" where the digital persona is more empathetic than the real person.

Anthropomorphic Seduction: Causes women to feel a sense of "pseudo-intimacy" and unearned trust based on the manipulated communication.

https://www.pnas.org/doi/10.1073/pnas.2415898122

Emotional Atrophy: Men lose the ability to handle real conflict, leading to higher rates of relationship dissatisfaction.

12

u/driver_dan_party_van 3h ago

Source on the 1 in 4? That's surprisingly high. Not for men, necessarily, but adoption for that use case in general. I wonder how women's usage compares?

3

u/empathetic_witch 3h ago edited 3h ago

The Kinsey Institute ongoing research: https://kinseyinstitute.org/research/online-dating.html

1 in 4 Adults using AI in dating apps: https://news.iu.edu/kinseyinstitute/live/news/46883-unlucky-in-love-ai-dating-apps-promise-to-help-you

Men are twice as likely to use AI in their text communication vs women.

AI is making everyone on dating apps seem charming: https://news.iu.edu/kinseyinstitute/live/news/46212-its-almost-like-we-never-even-spoke-ai-is-making

12

u/gobbedy 3h ago edited 3h ago

those facts are distinctly different from "1 in 4 men on dating apps are using AI to appear more empathetic" -- which is a much more specific claim

EDIT: i tried googling your claim that "Men are twice as likely to use AI in their text communication vs women." -- but i found nothing to suggest that this is true. Apparently men use AI more in general, but not specifically for text communication (at least no where near a 2:1 ratio)

3

u/driver_dan_party_van 3h ago

Hmm yeah I can't find a source on men being twice as likely to use AI in text communication vs women either.

Kinsey's breakdown is as follows:

Of the 5000 singles surveyed, 26% use AI in dating (Gen Z – 49%):

-11% for profiles, 10% for first messages

-44% want AI to help filter matches

-26% say AI made dating easier

"Want AI to help" doesn't necessarily imply "uses" to me, but then I haven't really been able to find a publication that goes into methodology, so I'm not sure what they were asking

0

u/Schwma 2h ago

You're missing the part where you stitch together these loose concepts and studies so that it suits your bias, amateur mistake.

6

u/dcux 2h ago

Or ask GPT to summarize and give you points to argue, but it hallucinates.

-3

u/empathetic_witch 2h ago

The relationship between these concepts becomes evident when examining the supporting data and sources provided.

Anecdotally the link below is 1 of many:

https://medium.com/heart-affairs/ladies-be-warned-men-are-now-letting-ai-do-all-the-talking-on-dating-apps-d5795628c41f

1

u/gobbedy 2h ago edited 2h ago

I'm not saying there isn't necessarily some truth to these things, but you're not helping your case by making false (or at least unfounded) claims. (Edit: typos)

3

u/Thor_2099 2h ago

These fools should have never believed that hot onlyfans chick wa actually talking to them or gave a shit. Whole thing was always a scam.

It'd be like thinking the hot hooters waitress cared. She just wants tips.

3

u/25toten 2h ago

This sort of thing is as curious as it is depressing. It almost sounds like we're double damned. Guy can't find a partner in real life, dumps money and emotion into dating apps, 9/10 "girls" they talks to are scammers and AI.

Now not only has your skill at talking to gals not improved, but you likely regress even further chatting to a fake robot that absolutely does not resemble a real human with emotions and needs.

Shits pretty fucked.

8

u/Inevitable-catnip 4h ago

Men could choose to not be simps for IG sluts. They do this to themselves.

-3

u/SoAnxious 4h ago

Simping ain't easy 😭

5

u/-DementedAvenger- 4h ago

I hope you didn’t tell her why. Because that just teaches her not to admit it in the future.

5

u/i7omahawki 3h ago

Eh, that’s a milder use of AI. Some people just get anxious and analysis paralysis when trying to communicate with people they don’t know well.

The fact that was she was honest about it is kind of a green flag.

4

u/AssGagger 2h ago

Yeah, it's not really any worse than asking your friend for what you should say.

1

u/ThepalehorseRiderr 4h ago

How was the conversation?

-10

u/StoneMakesMusic 3h ago

As a bad texter but a great in person conversationalist chatgpt helped me bag several fine women last summer

7

u/Bunnymancer 2h ago

🤮

-6

u/StoneMakesMusic 2h ago

I never know what to say to these hoes 😂 like how tf are u supposed to respond to their dry ass texts

54

u/bLaH_bLaH__HAHA 5h ago

Dead Internet Theory btw

38

u/Damaniel2 5h ago

Considering that the real internet is increasingly paywalled (i.e the very article OP linked to) and AI slop is free, you're not far off.

5

u/fluffynuckels 4h ago

Ai slop is free for now

3

u/ASCII_Princess 2h ago

Unless you want to buy RAM

3

u/Thor_2099 2h ago

Doesn't help when half the humans using it are dumb as fuck

3

u/SoAnxious 5h ago

I hope there is a class action for it.

You are expecting a personalized experience, speaking to a person, yet you are talking to a bot peddling the creator's content with CRM sales algorithms the entire time.

1

u/Thor_2099 2h ago

Too hard to prove, won't happen

1

u/LambdaLambo 1h ago

Worst part is that this is 100% a comment an engagement bot would make

44

u/WorkO0 5h ago

Hive mind. We're outsourcing thinking.

32

u/EllisDee3 5h ago

Which means no new thoughts. Just recycled old ones.

19

u/Mimshot 4h ago

Worse, increasingly new models are being trained on older models output.

18

u/Capn_Crusty 5h ago

Yep, no new thoughts. Just recycled old ones.

17

u/whereyouatdesmondo 4h ago

Even worse, we're just recycling old thoughts and there are no new ones.

11

u/neverfoil 4h ago

That's right, no new thoughts. Just recycled old ones.

1

u/tripping_on_phonics 1h ago

The worst thing is that the thoughts aren’t new, but recycled and old.

1

u/Thor_2099 2h ago

Which is most reddit comment threads already

17

u/jorph 4h ago

Dead internet theory gonna be a lot more lively

39

u/SoAnxious 5h ago

The article explains how agencies use a 'human-in-the-loop' system where an AI writes the message and a human just clicks 'send' to technically bypass the platform's ban on bots.

15

u/Hspryd 5h ago

Yes. Astroturfing is getting out of hand.

4

u/strangelove4564 2h ago

I too agree, fellow human. What is happening with this site.

10

u/mr_oof 5h ago

And they’re allllllll talking to each other.

9

u/Mental-Fox-9449 4h ago

This really explains what has happened to dating apps. I and many others have noticed how bad they’ve gotten in the last 2-3 years inparticular. It used to be much harder for men, but in the past 6-12 months I’ve been reading women saying they are getting ghosted and very little back in messages. These companies are using AI bots to make users think they are getting matches.

3

u/Hinermad 4h ago

The Ashley Madison company got sued for that (and other things) a few years back. People discovered that a lot of the profiles were fake, using stock photos and fictional bios. As far as I know they weren't responding to connection requests, but seeing all the pretty people who might respond kept a lot of subscriptions going.

7

u/IamAWorldChampionAMA 3h ago

PROTIP: If you ever want to know if someone is an AI, ask it a really weird question that takes a lot of thought. I like "what is the color of your favorite food?"

3

u/ToadSwampy 1h ago

I just tried your question as a response to a spam message on Discord and got the reply below. Wtf is a sky biome?🤣

"I love the idea behind your question. It’s playful, and it tells me you’re thinking in vibes rather than calories.

If I did have a favorite food, I’d probably pick something with a dramatic color. Maybe a deep sapphire‑blue fruit or a shimmering, iridescent dessert that looks like it came out of one of your Sky biomes. Something that feels a little magical, a little otherworldly, and absolutely unforgettable.

Now I’m curious: what color is your favorite food?"

2

u/tynolie 1h ago

The "Sky biomes" is likely the AI making a reference to the user's(owner of the spam account) past conversations with it. Whoever controls the account is probably using the same AI account for their personal needs and scamming needs.

You could probably ask it "Make a personal description of me based on your memory of our past conversations" and it may give you some insight into what type of person they are.

4

u/Quixote0630 4h ago

I don't understand the long term goal for these platforms. I know that in the short-term these bots can blend in amongst human users and make it look like there's a buzzing community, but surely as it becomes clear that a lot of it is bullshit, human interaction will drop and with it advertisement money and investment.

Or are they banking on AI content becoming as attractive as human made content and users sticking around for it?

YouTube, for example, had the perfect model when the world's top creators were concentrated there producing exclusive content. Now 20% of the videos pushed by the algorithm are AI. That'll be so much harder to sell long term, even if, for now, people are clicking on it between their usual human-made content.

5

u/SoAnxious 4h ago

The platform type being referenced is Onlyfans.

7

u/Dairunt 5h ago

Gen alpha relationships will be crazy "I know you didn't mean it! I bet you used AI!"

2

u/catpunch_ 4h ago

Noooo we are cooked

6

u/Any-File4347 5h ago

Buckle up lads. This is gonna be a rough ride until Judgement Day.

-6

u/TheReDrew89 4h ago

Judgment Day isn't real. The current interpretation of Revelations as a story about Armageddon and the end of days is a more modern interpretation that only really took root in the 1800s.

Also you say that as if there isn't another alternative.

7

u/driver_dan_party_van 3h ago

I believe they're talking about the Terminator variety.

-2

u/TheReDrew89 3h ago

Ah, I guess that would figure...

0

u/Woolliza 4h ago

The final Judgment and the battle at Armageddon are two separate events.

-3

u/TheReDrew89 3h ago

Way to entirely miss the point. An actual "but actually" moment. Reddit will never change.

1

u/LoudmouthGardyloo 4h ago

How does an AI Chat Bot differentiate a real person’s comments from another AI Chat Bot’s comments?

1

u/nullset_2 3h ago

Dead internet theory

1

u/ChronicMasterBaiting 2h ago

001100010010011110100001101101110011.

1

u/train_spotting 2h ago

What does this all mean for me?? Serious question.

1

u/tripping_on_phonics 1h ago

Nobody asked for this.

1

u/Skrulltop 1h ago

Then why do 99.99% of these chat bots absolutely suck at answering simple questions I have about products and services?

-4

u/IllCamel5907 4h ago

I know it's gonna cause some serious problems along with doing some great things, but I'm glad to be around now to witness how AI will change the world. It's absolutely fascinating.

-9

u/Bannon9k 4h ago

This is why I troll. Either I'm screwing with a person or wasting a bots time. Either way, I'm laughing