I didn't realize the original was behind a paywall.
craftkiller 1 days ago [-]
I've noticed on YouTube I see a lot of adult sexual ads. Things like home cleaning ads that have an unmistakable wood-grain image of fellatio. I've always wondered "how are these getting past the moderators?". I guess the answer is the obvious one: no one is moderating anything.
ryanjshaw 23 hours ago [-]
Google Play Store showed my child an ad of a bloody body on a bed for a murder mystery game. The game was rated 18+ and the account had my daughter’s correct single digit age.
I reported the ad and a week later it was still there. I switched to Apple.
remuskaos 6 hours ago [-]
The play store is pretty bad. About half the time I search for an app, BY NAME, without any way to confuse it with another app, the top result is a scam or copy cat, or adware. And always, without fail, they are paid-for ads instead of real search results. How can it still be somehow advantageous to trick your users into installing an app they clearly don't want. I wish there was a real alternative to the play store.
F Droid comes close and can even auto update now (never understood why that didn't work on the past), but most apps I want or need like banking, health insurance etc aren't on F Droid.
tremon 6 hours ago [-]
> never understood why that didn't work on the past
AIUI, Android simply didn't support it. The original way for apps to install other apps was via ACTION_INSTALL_PACKAGE, which is a user-visible action. The InstallPackage API did not support silent updates until sdk version 31: https://developer.android.com/reference/android/content/pm/P...
themaninthedark 22 hours ago [-]
Listen, we need you to verify your identity in order for us to not serve these ads to your kids. It's very important that you do this.
eayomi 9 hours ago [-]
[flagged]
smugma 20 hours ago [-]
Unfortunately, I’ve seen MA ads for kids games on iPhone as well. Possibly not as bad but not great. It seems to be better than it was two years ago.
kotaKat 12 hours ago [-]
Apple is equally pointless.
They don't remove apps like Facebook or Twitter for displaying CSAM, but apparently ganked Telegram at the first single report of an extortionist trying to remove a public Telegram group because they posted CSAM in it.
It's only okay when the American companies get away with CSAM.
lostlogin 13 hours ago [-]
> I switched to Apple.
Sadly, the dirty money is luring them in too.
uncletammy 23 hours ago [-]
How did that work out for you? Safer? What was the experience switching, for you and for your kid?
ryanjshaw 23 hours ago [-]
Haven’t seen any bloody bodies advertised to my child… yet.
joquarky 23 hours ago [-]
[flagged]
Spooky23 21 hours ago [-]
Yet you can’t run Linux on a Chromebook with a minor child user.
stephenbez 7 hours ago [-]
What do you mean? You can use Linux on a Chromebook just fine if the user is an adult but if the user is a child there is some Chromebook restriction?
ihuk 1 days ago [-]
Reported an obvious sexual ad the other day and got a very AI generated response that started with "Dear Username" stating that they reviewed the ad and found nothing wrong with it.
unsnap_biceps 23 hours ago [-]
Before I gave up on Facebook entirely, I reported an ad that was an explicit blow job and received a similar response and this was before AI was huge. I really don't think they've ever cared.
mullingitover 22 hours ago [-]
Facebook literally trolls you when you report criminal activity, rampant well-documented scams, on their site. They write back and tell you it's not violating their policy and ask if you want to support for your personal problem.
Spooky23 21 hours ago [-]
Absolutely. My uncle got taken by an “investment club” supposedly endorsed by Warren Buffet and run day to day by some real financial person.
All communications were via WhatsApp. They started with real stock tips (which were pretty good actually!) and then did a pump and dump.
I received a similar ad (mine was from the shark tank people), reported it and got a message similar to what you described. They were obviously stealing Mark Cuban’s likeness and peddling an obvious scam.
WorldMaker 14 hours ago [-]
Section 230 should have never applied to ads. Ads are a commercial relationship. Facebook and YouTube gets paid by these scammers so why would they want to accurately police them? The incentives are broken. Newspapers had to invent all sorts of ways to make sure that they had clear markers between ads, editorial content, and sponsored editorial content. Such things were enforced by lawsuits and a couple of Ad Bureaus. All of those rules should have applied to Meta (Facebook, WhatsApp, Instagram) and Google (YouTube). Just as it was a sign that you were reading a bad/unreliable tabloid when you couldn't tell what was an ad and what was an article, Meta and Google should have that reputation already as vendors accepting payments for bad ads and whitewashing them as other sorts of content and it is still sometimes surprising to me that they don't.
mullingitover 6 hours ago [-]
In my case I wasn't even reporting ads. These are plain old Facebook accounts and groups using very obvious AI-generated slop images of pets for 'adoption' or 'rehoming', so Facebook isn't even making money on this directly. They are participating in the fraud purely out of the malice (more realistically, incompetence spiced with greed) in their own hearts.
It's been a very well known problem on Facebook for years[1][2], and the pathetic part is that its so obvious. It really tells you how bad Facebook is with AI, because even I as a regular 1x engineer could wire up some very cheap inference that would lay waste to this fraud pattern as a part-time weekend project.
Section 230 doesn't say the advertiser can't go to jail or Facebook doesn't have to tell the police who the advertiser is.
specproc 8 hours ago [-]
Who goes to jail for displaying the ad in a public place? If I ran say, a shop, and put CSAM up on my notice board (because I was paid to) that would see me in prison, surely.
The lack of accountability here is astounding.
FireBeyond 8 hours ago [-]
My example was a comment that said "only a shame more [hard r n word]s didn't die. we need to get this place cleaned up" and told that was not in violation of community standards.
p0w3n3d 24 hours ago [-]
The Dead Internet Theory is real!
UltraSane 17 hours ago [-]
The AI is a gooner
cineticdaffodil 2 hours ago [-]
[dead]
nticompass 6 hours ago [-]
I've noticed this with obvious scam ads on the YouTube app or even Google search results. I've determined that (much like Twitter/X) the "verification" (or "moderation") is simply just "did they [the advertiser] pay us?"
EmbarrassedHelp 23 hours ago [-]
The other answer is that the people creating these ads have the resources to continuously try and bypass filters/moderation.
zakki 23 hours ago [-]
If there is filters/moderation.
SwellJoe 23 hours ago [-]
There are, but only for using IP of large corporations. If you put 12 seconds of a major label song in your video review of an album, that video belongs to the major label now.
UltraSane 17 hours ago [-]
It is really interesting how YouTube can detect short snippets of movies and songs but there are many full audiobooks illegally uploaded for years.
joshspankit 10 hours ago [-]
Movie and music studios are far more litigious
gowld 22 hours ago [-]
It's a lot easier to automatically detect a match to 1 specific thing than detect a match to a completely novel thing that offends sensibilities in a similar way to other things.
ben_w 23 hours ago [-]
There are basically always filters of some kind, though not necessarily the ones we want. The bigger the target that filter represents, the more effort is spent breaking it.
michaelt 23 hours ago [-]
The filter you want is named 'uBlock Origin' :)
phatfish 22 hours ago [-]
Indeed, and the Revanced apk customisation on Android, and SmartTube on Google TV.
I've not seen an ad from Youtube for probably 10+ years on my devices (since whenever Vanced made the apk customisations popular).
inigyou 12 hours ago [-]
Didn't Revanced get replaced by Morphe?
happymellon 17 hours ago [-]
I don't need Revanced as I already have uBlock Origin.
inigyou 9 hours ago [-]
For YouTube on a desktop OS you also want Sponsorblock. On a mobile OS, you want Revanced/Morphe as it integrates Sponsorblock into the app.
LargoLasskhyfv 5 hours ago [-]
> For YouTube on a desktop OS you also want Sponsorblock.
No. I don't. uBO suffices. Maybe with some additional rules and lists which aren't in its default setup.
Maybe it also depends on the sort of content one watches, but I tried, and it did nothing for me, except one extension more running. Which I tend to try to minimize.
inigyou 4 hours ago [-]
Did it block sponsors?
LargoLasskhyfv 3 hours ago [-]
That's the thing. I rarely watch, just listening to music doodling in a background tab.
I think I remember some sponsored crap in 'der8auer' or something like 'linus tech tips' eons ago, but I don't watch them anymore.
So I can't really tell, but for my use case it seems redundant.
I also remember having imported uBo-lists from somewhere, allegedly enabling sponsor-blocking somehow. But that was another install. I don't have these anymore, ATM.
ben_w 13 hours ago [-]
How is me installing that going to help prevent Facebook hosting unlawful adverts?
I barely visit the FB feed these days, about half of those visits being a notification that turns out to be someone's birthday.
Unlike FB themselves for the content they host, I find it easy to avoid them without needing the help of a filter, because on the rare occasion when I find myself being sucked into scrolling down the feed, this almost always stops within 3 items because that's how quickly I find the first utterly irrelevant item owing to how Facebook keeps trying to suggest (and advertise) nonsense.
The filter I want to see in the world is the legislative kind, the "Meta delenda est" style. This is of course *not* what Facebook would want: spammers want to break FB's filters, and FB would try to get past legislative filters. I count FB as a spammer trying to put ads into every third message you try to exchange with your friends.
cute_boi 22 hours ago [-]
Without ublock origin internet is so dirty.
Telaneo 24 hours ago [-]
There have been Youtube ads that are undeniable scams for years, so it's no surprise it's compleatly unmoderated.
malshe 22 hours ago [-]
I just don't get their algorithm. I used to show YT videos to my students but I stopped that totally because of this kind of crap.
amlib 21 hours ago [-]
Use the unhook extension, ublock origin extension and firefox. Also don't hesitate to use the "Block element" feature for ublock. Get some control back from big tech :)
duxup 22 hours ago [-]
Man I got a “clothing brand” last night on YouTube of a VERY young girl wearing… not much, and it didn’t fit well in all the wrong / revealing places…
Reported the add but damn YouTube, the freaky fake medical ads are bad enough.
nitwit005 22 hours ago [-]
The more surprising thing with YouTube is how much obvious copyright infringement is in ads. The whole platform seems oriented around copyright enforcement, but ads seem to get a pass.
inigyou 9 hours ago [-]
What copyright infringement did you see in an ad?
nitwit005 4 hours ago [-]
Anime characters they clearly haven't paid for the rights to use seem popular (anime studios typically announce their partnerships).
Also not a copyright violation, but using Elon Musk's likeness without permission for investment scams seems to be a big thing.
12_throw_away 20 hours ago [-]
But that can't be true! From the article (with a probably irrelevant fact added by me):
"Sexual exploitation is horrific, and we work aggressively to keep it off our platform" a Meta [which in the past 2 years has laid off and disbanded all teams responsible for this] spokesperson says.
13 hours ago [-]
karakoram 22 hours ago [-]
The worst ads are the shady games with all sorts of sexual references. They don't end no matter how many times you report it, block the ads or select the "less gaming ads" option.
24 hours ago [-]
UltraSane 17 hours ago [-]
Firefox and uBlock Origin will prevent you seeing any ads. I didn't even want to use it until the adds got so repetitive.
jlarocco 22 hours ago [-]
Is it surprising? Google and Facebook can barely police the content their human users post.
gs17 5 hours ago [-]
That seems to be by choice, not because it's inherently difficult at scale. It's not like we see them take things down when you report them, you'll get multiple reviews of "this obvious scam doesn't violate our rules".
CrzyLngPwd 1 days ago [-]
All their fines are merely a cost of doing business, and they won't change their ways until the fines hurt.
xtajv 5 hours ago [-]
I appreciate recent EU regulations choosing to penalize corporations on the basis of a percentage of revenue.
It effectively mandates a lower-limit on spend for budgeting purposes.
Sure, that money might be spent ineffectively... but corporations will figure it out if their only options are to
1. Not invest in regulatory compliance at all and get fined for noncompliance.
2. Throw money at the problem, spend it inefficiently, and STILL get fined for noncompliance.
3. Throw money at the problem, spend it well enough to pass muster, avoid fines.
xtajv 5 hours ago [-]
"They call them fines because if you can pay it, it's fine"
burningChrome 1 days ago [-]
This is so true. When you have a billion users, you can literally lose hundreds of millions of users and it wouldn't make a dent. The only way is to get the government involved and regulate this and just keep hammering them with massive fines that really make a dent in their bottom line.
For a lot of people, government regulation of this sort is not desirable, but at what point does someone need to drop the hammer to stop this?
ASalazarMX 24 hours ago [-]
I guess you're used to standard billions (a million millions). A US billion would certainly suffer from losing hundreds of millions, you're talking about a double-digit percent.
anamexis 23 hours ago [-]
I doubt they are saying any services out there have 1,000,000,000,000 users.
yetanotherjosh 23 hours ago [-]
10^9 is the standard definition of a billion, it's very wrong to call 10^12 a "standard billion." You can say "long scale billion" if you want to refer to the definitively non-standard 10^12 billion.
Terr_ 22 hours ago [-]
To quibble/add-nuance: The words have diverged into a false-friend [0] situation. It looks like the same word, but the correct/standard meaning depends on which language is being used at the time.
If someone is writing English and puts "billion" for 10^12, that's a translation error, much like writing "my grandfather became pregnant when he realized he'd locked the keys inside the car." (Instead of "embarrassed.")
Conversely, if I wrote a French or German sentence and put "billion" for 10^9, then I'd be the one making the translation mistake.
Something like three strikes and the CEO, top executives, and three primary share holders go to jail while forcing the company to dissolve seems to be the only solution to removing bad actors in corporate settings.
tadfisher 22 hours ago [-]
Careful, I was called a "radical" on this site for suggesting a corporate death penalty. Because jobs are so important that when a corporation risks its own existence so it can break laws, dissolving the corporation as punishment is the government's fault and not the corporation's.
tremon 6 hours ago [-]
A corporate death penalty does not necessarily imply all jobs are lost. The government can simply nationalize all assets, use standard vulture capital methods to restructure the business, them auction each business unit off to competitors. Only first-tier management and investors would be directly impacted.
yndoendo 17 hours ago [-]
I am not worried about that all nor any down votes.
Empathy for other people and the environment is a sign of intelligence. Those that don't think of how their actions affects those around them and the neighbors they will never meet nor the environment have an lack of intelligent.
Those that lack empathy are the same that idolize bad actors like Elon Musk and Mark Zuckerberg. Greed and the desire for it is a high indicator of lack of intelligence.
There is a difference between being well off and greedy. I would argue that Steve Wozniak is a great example and better of the two Steves from Apple to highlight this.
I have created jobs and brought in international commerce to where I live. I produce solutions for companies I don't even know their names. I have kept people safe and will never know their names nor will their families know mine. None of which has deluded my empathy for others, human and non-human, and the environment.
My previous statement was codified in another thread. This statement is a two part. One to re-enforce my empathy and a social experiment.
I feel sorry for those that lack empathy. Empathy is the only way to put yourself in someone else's shoes. Intelligence is a by-product. There is no other way to live a life you can never have nor experience.
Label of _radical_ is something I welcome. When former co-workers and people you meet want to shake your hand before leaving after giving them constructive criticize, it is a surreal experience. Not when it first happens, when it repeats itself.
zelphirkalt 22 hours ago [-]
Ah, what a pleasure to imagine that scenario, however unlikely, for just a few seconds. People profiting from running unethical ads and child sexual abuse material, for whom financial gain is more important than any ethics, laws or health of others, who frankly speaking don't give a fuck about anyone else but themselves amassing more money, being held responsible and being moved to a new, very different kind of home behind bars. It would be as if angels started to sing and cleanse planet Earth just a tiny little bit. We would have reason to rejoice and celebrate. On the streets! On the roofs! Everywhere! Celebrate that the law still has teeth, and is upheld. It would also be a nice measure to heal other businesses from many bad practices.
s1artibartfast 22 hours ago [-]
As long as we can also shoot tresspassers and thieves, you got a deal.
happymellon 17 hours ago [-]
Why are you desiring the ability to murder someone?
s1artibartfast 16 hours ago [-]
Seems to be the only solution to removing bad actors
inigyou 12 hours ago [-]
Okay, let's start now. Hey! This comment section is my property! Bang bang bang bang bang.
alex1138 22 hours ago [-]
> When you have a billion users
What if they make a shadow profile for you? Do you count as a user? What if you've tried to delete your account and you can't? (I meant a real account here, not even a shadow profile. People have had the things reactivated years later)
Ajedi32 1 days ago [-]
As it should be. If the cost of fixing the problem is greater than the amount of harm the problem is actually causing to society, then it shouldn't be fixed. Set fine amounts accordingly. (Whether we actually do set fines this way is, of course, questionable. And probably this particular problem would get fixed even if there were no fine merely because of the reputational damage it's causing, but I'm speaking in generalities here.)
mplewis 24 hours ago [-]
you don't think one of the world's biggest media platforms disseminating CSAM is causing meaningful harm to society?
Ajedi32 22 hours ago [-]
Yes it's meaningful, and the fine amount should reflect that. But hypothetically, if it's (just throwing a random number out there) 1 image in 50 billion, and Facebook gets more benefit from the 50 billion good images than society loses from the 1 bad one, and society recovers its loss from Facebook via a fine, but the fine isn't big enough to make them change their behavior, how exactly is that a problem?
callc 22 hours ago [-]
The problem is equating profitability with what societies want and don’t want.
Morality exists outside of the business world (and it should inside as well).
Further, it is a societies’ right to enforce the boundaries of what business are allow to do / not do.
For example: banning ads along roads and scenic areas.
Idk, the whole idea of “how much fines will I get doing X shitty business practice” is just gross. I’d rather see harsher enforcement to keep businesses on the straight and narrow more often than not.
Ajedi32 18 hours ago [-]
Perhaps, but when you're operating at any significant scale accidents become a statistical certainty. 0 screw ups, ever is not a realistically achievable goal. And if some limited number of screw ups is allowable, that necessarily becomes an insurable cost that amounts to "just the cost of doing business", so I don't really see the complaint.
Concrete example: If you run a construction business, even if you take all the required precautions, statistically you're going to get 9.2 of your employees killed for every 100,000 man-hours they work.[1] Is that proof all construction companies are evil, and we should shut them down for murdering their employees? Is it a problem that having to buy life insurance is "just a cost of doing business" for these companies?
This is the reaction to the FAANGs obviously not caring that they are publishing CSAM.
They will be given more leeway for small scale "screwups" if they can show that they are working to reduce large scale issues.
As it is we are dealing with organisations that don't give a shit, so peoples attitudes reflect that back at them.
FireBeyond 6 hours ago [-]
Yes, screw ups become a certainty. But these are screw ups that the company doesn't meaningfully care to fix. Just as we'd have an issue with a company that has OSHA findings that they continue to ignore. But with Facebook, "Our automated review found nothing wrong with [this ad that implies a young child performing sexual activities]".
Also, speaking of statistics, what?
> statistically you're going to get 9.2 of your employees killed for every 100,000 man-hours they work.
No, you're not. This would mean if you employed 50 full-time employees you'd expect 9 of them to die per year.
What that graph actually says: "In a population where there are 100,000 construction workers, you can expect 9 fatal workplace accidents per year".
Ajedi32 6 hours ago [-]
Yes sorry, man-workyears not man-hours.
> "Our automated review found nothing wrong with [this ad that implies a young child performing sexual activities]"
That's also a screw-up, and they should be fined accordingly, proportional to the amount of harm this screw up is causing to society. If there are any practical steps they can take to fix the problem, that should incentivize them to do so.
But if for whatever reason it turns out the only possible way to fix such screw-ups is for them to hire 100,000 employees to manually review every single ad, and the cost of that both exceeds the cost of paying the fines and the opportunity cost of turning off this feature completely, so they choose not to do that, is that a problem?
It's like if you tried to insist construction companies evacuate all workers from the construction site before operating any heavy machinery. Maybe that would save some lives, but it would also be completely impractical.
FireBeyond 5 hours ago [-]
> It's like if you tried to insist construction companies evacuate all workers from the construction site before operating any heavy machinery. Maybe that would save some lives, but it would also be completely impractical.
There's a degree of "consent" here - yes, certainly, one can choose not to be a FB user. But if the sites you visit utilize FB's ad program, well, you can still get hit. Construction workers understand that their work is not zero risk (as are many jobs - I used to work in Fire/EMS), but that is tempered by OSHA etc., that have teeth. You can't (at least in theory) keep operating a construction company that operates unsafely and outside regulations or laws and say "it's all good, I'm just going to pay the fines" - OSHA will shut you down and render you liable to criminal prosecution.
If OSHA was dismantled yesterday (and state-level agencies), and people knowing how some corporations value the dollar versus people, there'd be a lot less people willing to work for riskier companies or in riskier professions.
> It's like if you tried to insist construction companies evacuate all workers from the construction site before operating any heavy machinery.
In an admittedly limited subset of situations, this happens: "Lock out/tag out" systems that can physically prevent the operation of certain equipment if anyone is in the risk zone or performing maintenance. In some cases this is literally akin to a padlock workers carry at all times and put through the power switch of machinery when they go to work on it so someone else doesn't come along and turn it on.
nathan_compton 22 hours ago [-]
Pretty sure this isn't what they are teaching at the best business schools.
inigyou 12 hours ago [-]
I think we should restrict the term CSAM to M created by CSA, not AI hallucinations.
Dylan16807 23 hours ago [-]
First let's not use an unqualified label of "CSAM" when talking about generated images.
But if a thousand people see some ad then the amount of damage is not much compared to their overall business. I'd go for a healthy penalty on top, and adding in more transparency to make sure they don't hide the real extent of the problem, but it's still probably small to them.
Getting Facebook to put in a reasonable amount of blocking effort is good. But it wouldn't fully fix the problem.
happymellon 16 hours ago [-]
They could also put in place a real reporting button to remove CSAM.
Instead it's a "I don't like this" and they will continue to ignore it.
onlyrealcuzzo 23 hours ago [-]
Guys, it's fine.
Relax.
It's only a crime if someone else does it or is not sufficiently wealthy, otherwise it's a mistake.
_carbyau_ 21 hours ago [-]
I believe that is referred to as: organised crime.
tremon 6 hours ago [-]
Rather, this is institutional crime. Organised crime is when crime operates its own control structures in defiance of government enforcement; this is the government actively allowing the crime to proliferate.
thi2 21 hours ago [-]
Metas ads are all over the place. Thomas Kehl, one of the founders of "Finanzfluss" (a german site/content creation company about finance) is currently suing meta because scammers keep using his picture.
There really needs to be some harder punishments for this kind of behavior, after all meta profits by selling scammy ads.
Kalanos 1 days ago [-]
What's crazy is how long it takes to report something like this to a big company and actually have them take action on it. I remember 10 years ago I reported a Giphy ad for the same thing, and it took them months to take action.
jhartikainen 24 hours ago [-]
Out of curiosity, I've ran some experiments on Facebook for stuff like this.
Results:
- Reporting a message does nothing no matter how much the content breaks their terms of use. 100% of messages I reported bounced back in a matter of minutes with "no action"
- However, using the "request another review" function, which is available after the initial "no action" response, actually seems to work. How quickly this works seems to vary, I've had actions taken as result of this from 1 day to multiple weeks.
gs17 23 hours ago [-]
Interesting, I've kind of made a hobby of reporting scams and hate speech and watching it take a week to come back with "it's no violation", requesting another and getting the same response in another week. I've never seen them do anything no matter how obvious or awful it is.
inigyou 9 hours ago [-]
You have to actually, honestly, fall for the scam and lose all your money and only then will you have standing to sue Meta for making you lose all your money. You won't be able to afford to sue them, of course.
cindyllm 6 hours ago [-]
[dead]
bombcar 24 hours ago [-]
Meta doesn't have to give a shit, because they're huge.
Tiny providers have to scramble, because they'll be destroyed by a single failure to handle it fast enough.
evenhash 24 hours ago [-]
It’s not crazy when you consider that their customers are the advertisers, not you. They want to keep their customers happy and buying more ads.
KennyBlanken 23 hours ago [-]
Step 1: establish a process and business unit to "address the problem"
Step 2: wait for it to get out of the news cycle.
Step 3: donate heavily via lobbyists to the opponents of the politicians who called you out
Step 4: de-fund the unit down until just barely enough that you're not lying when you say you "have a team working very hard on the problem." A dozen people in some third world country you pay a dollar a month each, for example.
callamdelaney 23 hours ago [-]
Meta is still running ads that suggest violence against politicians, when reported they say it does not contravene their policies.
wredcoll 23 hours ago [-]
Politicians don't count.
inigyou 12 hours ago [-]
LW politicians don't count. If there was an ad calling for violence against an RW politician it'd be taken down and the poster would go to jail.
callamdelaney 9 hours ago [-]
Actually it’s for a right wing politician and there are many variations.
ticulatedspline 18 hours ago [-]
Personally I find these kinds of things fascinating. Partially for the practical problem it represents and it's facets but also the one sided backlash of it all. Moderation is an interesting conglomerate of so many factors.
First of all I don't think Meta is a good or honest company, but that doesn't mean they're not trying at all. In reality even if they were good and honest I genuinely believe their task is probably nearly impossible. Humans just suck too much. It certainly doesn't help that Meta has at least some perverse incentive to be permissive with ads, as they get money from them. Though Meta execs aren't stupid. Inflammatory political ads are one thing, kiddie porn is another I suspect they lose more money over CSAM than all the ad revenue from them. I believe them when they say they removed over 36 million pieces of child sexual exploitation content last year.
Which is a number that I should let sink in. Basically more than one piece of CSAM shows up in their ad stream every second of every day all year. If their moderation techniques are 99% effective that results in 360,000 CSAM ads leaking to the public annually.
Another interesting thought is how much would it cost to actually get that rate to 100%? let's assume human moderators aren't paid much but are infallible. That all-in a single moderator employee costs $65K , that's salary, benefits, HR ratio, psychological therapy, equipment, the works, all factored in.
let's say on average you get about 1 ad review ~every 2 minutes, so bout 250 ads per-day per-employee factoring in some time off you actually get about 65,000 reviews a year. So bout $1 per review. So the question begs how many distinct ads enter their system each year? which I haven't found a stat for. But assuming only 1 in 1000 ads are CSAM, which still feels high but is probably a reasonable ratio. we get 36 billion ads needing review annually. At a dollar each 23% of their gross annual ad revenue each year would be just moderation overhead and they would need to hire over 550,000 moderators.
Evil or not I think they organically built a thing that operates at an unimaginable scale, that even moderation with failures in the parts-per-million would result in tens of thousands of unsavory or unscrupulous ads reaching users and they have neither the incentive nor the capacity to reach even that level of accuracy.
happymellon 16 hours ago [-]
Disagree with essentially all of this.
To get a Facebook account they require all sorts of PII.
Why not have people give their PII to set up an advertising account and if they distribute CSAM then they are banned. Removing access to WhatsApp will stop a large portion of the world from participating.
And the parts that can't? Well, they can't advertise on Facebook/Instagram anymore.
ticulatedspline 16 hours ago [-]
Probably a case of "hate the game not the player"
CSAM is highly illegal, no doubt these accounts are getting banned but likely not charged (who knows what jurisdiction the advertiser is even in) clearly they're able to pass the current bar.
This is conjecture but I'd bet that in all likelihood someone at some meeting at Meta has floated the idea of moving impedance to the signup to try to limit this phenomena. Maybe more verification, or more hoops. And likely Meta crunched the numbers and was looking at billions of dollars lost in legit ad traffic and that just doesn't fly for a publicly traded company.
I'd guess that the folks at Meta would absolutely love CSAM to stop showing up, It's simply too dangerous, likely costs more than it earns, makes them look bad when it shows up, and alienates users who don't want to see it.
But those negative effects are probably all quantifiable to some dollar value that's less than the alternatives.
Executives don't get bonuses for altruism or ethical behavior. They get bonuses for making more money than they did last quarter. real fix is changing the game but that's a lot harder than it seems and can have many unintended consequences of it's own.
happymellon 16 hours ago [-]
> 'd guess that the folks at Meta would absolutely love CSAM to stop showing up, It's simply too dangerous
Presumably not dangerous enough.
ticulatedspline 15 hours ago [-]
Which could be a "change to the game" but that might be worse. Protections like Section 230 are absolutely abused by large companies. But protections like that are also what has made the internet even possible
Overly strict rules can also be weaponized. Imagine running a site that supports user content, but any appearance of CSAM on your site was jail-worthy, and you get an email demanding bitcoin or you're about to get hit with some posts that will shut you down. You have good moderation but you know you can't withstand a literal attack, someone who can automate that attack and has a financial motive to get illegal content onto your site. what do you do?
FireBeyond 5 hours ago [-]
You are talking about a company that willingly allowed one of its employees to be arrested when the government of that country was threatening to do so (apropos of the rightness or wrongness of that country in doing so), as a canary in a coal mine of sorts to decide whether they were willing to allow their executive team to travel there...
And then were okay with letting that person sit in jail longer because they thought it'd be better for Facebook PR if they did...
And then when they finally got that person out of jail, and later had him show up at a meet-n-greet with said executive team, Zuck didn't look up from his phone, looked confused, and said to his PA as he was leaving "who was that guy anyway, and why did he need to meet us?"
Or when Burmese dissidents, even the Burmese government itself, said that a FB feature would be used to track down and imprison, torture people the government didn't like, Zuck and FB leadership said "the feature is doing a lot to improve platform engagement, it needs to stay".
So the answer is worse. It's a combination of "the money" and pure psychopathy and sociopathy at the head of the dragon.
Too 15 hours ago [-]
> 36 billion ads needing review annually
This would mean every single user gets 10 uniquely personalized ads per year.
Even if that wasn't hilariously unreasonable by several orders of magnitude, if the moderation cost was was included in the cost of serving ads, this would all self regulate and only serious actors would participate. Treating it as a public bulletin board while still raking in a percentage of the impressions for sure is a nice business model, but not what's best for the rest of the society. Maybe ads just shouldn't be such a lucrative business.
Cpoll 13 hours ago [-]
> 550,000 moderators
You can bring this number down by only reviewing new/low-reputation advertisers, increasing minimum spend, rate limiting, etc.
You can also pre-filter for "definitely not CSAM" and only review the more ambiguous stuff.
I think your numbers are low too, surely a moderator can review over one ad per minute on average. And it may be more effective to split-screen multiple ads (with redundancy).
But at the end of the day it's a numbers game, something is going to slip through.
froobius 1 days ago [-]
I'm starting to wonder if any of this is better than local newspapers, where there's an editor with oversight over all content...
type0 1 days ago [-]
So that's why they are lobbying for age verification, i.e ID verification?
mplewis 24 hours ago [-]
Meta is lobbying for age verification because it helps provide an institutional moat for them against the open web.
barbazoo 20 hours ago [-]
Could you elaborate?
I thought Meta wants to put the burden onto the platform, i.e. Apple and Google, is what they are lobbying for.
but they lobby for specific (often pretty bad) forms of age verification to be able to
- spy on people better
- have a regulatory moat where due to beady designed laws new alternatives have a much higher hurdle/initial investments and in turn never get anywhere
shitloadofbooks 24 hours ago [-]
Meta will do whatever it can to run any and all ads.
> Reuters also reported that Meta internally projected in 2024 that it would earn about 10% of its overall annual revenue – or $16 billion – from running ads for scams and banned goods, internal company documents show.
At $employer we're CONSTANTLY fighting fake ads cloning our brand. Their various brand protection features seem deliberately inept and ineffective.
yalogin 23 hours ago [-]
Even if they are caught and it’s illegal, as long as the fine for it is less than the roi of running them the companies will not stop.
godwinson__4-8 1 days ago [-]
Somewhat related: open YouTube in an incognito window.
Search something rather innocuous like "news". Click the first thing then go back to the main page. You have to watch through the ad.
The amount of slop you will get suggested as soon as the algorithm warms up is nuts. The ad you are first served might also be slop. I mean AI generated video advertising overt bogus cures (a memorable one recently - "did you know the Bible has the answer to Alzheimer's?") over AI slop footage.
When I compare to my normal/auth'd Youtube experience, it feels like a totally different app. I have never really experienced such a cheap illustration of the "Youtube rabbit hole" effect. The degree to which AI authored advertising is participating in this is imo pretty concerning if you have, in particular, older parents or relatives.
otherayden 23 hours ago [-]
I tried this experiment out and it is right on the money. The ad I got was AI generated video with AI script & audio selling fake 16TB SSDs. Wonder if anybody has some insider info on how these ads are produced at scale / who's behind them
carljungslabtek 23 hours ago [-]
There is a whole dark ecosystem now for “UGC” (user generated content) and that includes services trying to disrupt it with AI. Ironically, (or fittingly?) the best research I’ve seen was via youtube videos.
carljungslabtek 24 hours ago [-]
Part of me would like to stop paying for a youtube premium family subscription because they keep raising the price, but my mom watches it a lot and I don’t want her to see (or have to see) those ads. They’re so unbelievably bad. It can’t be good for your brain to watch, the few times I’ve seen them on my work computer I can’t help but watch part of them.
olelele 24 hours ago [-]
Install Brave Browser for your mom?
carljungslabtek 23 hours ago [-]
It’s mostly on her tv so I don’t really know how to get around that, at least not in a way that’s easier and more reliable than paying. I tell myself at least it’s cheaper than cable haha.
olelele 23 hours ago [-]
yeah have been struggling w that myself. Good luck!
phatfish 21 hours ago [-]
If you have a Google TV try SmartTube. It's an independently developed app with a custom interface, so that might put some people off. For just watching videos without obnoxious ads its great though.
VCFundedGenYer 1 days ago [-]
Youtube is pushing a lot of AI features without creators' consent. Some of it can be turned off but others cannot. It's becoming a major problem. Can't wait till they lose so much money on the infrastructure that they have to remove it all.
bilegeek 23 hours ago [-]
The auto-translation especially bothers me. Kinda cool for casual viewing... but the inability to disable it gives me an immediate skeptical "this entire channel is probably AI slop" response before I recognize what's happened.
Aerroon 22 hours ago [-]
>Search something rather innocuous like "news". Click the first thing then go back to the main page. You have to watch through the ad.
>The amount of slop you will get suggested as soon as the algorithm warms up is nuts. The ad you are first served might also be slop.
This did not happen for me. I got news about the SpaceX rocket and then more suggestions for news on the homepage, many related to politics.
I did notice that a bunch of the videos were in languages I did not understand though.
fragmede 1 days ago [-]
By the by, if you watch a video while logged in that someone sent you as being batshit crazy, and it's affecting your recommendations, you can go into your watch history and delete it from there so you don't get recommended similar videos.
lp4v4n 1 days ago [-]
I'd be interested to know if the same amount of leniency shown here would be applied if we were talking about ads depicting violence against elected politicians.
shawn_w 1 days ago [-]
Depends on the politician.
inigyou 12 hours ago [-]
Only if they're LW.
danudey 1 days ago [-]
[flagged]
xhevahir 21 hours ago [-]
If stuff like this shows up in GAI I wonder what that means for how common such material is in the wild. Frightening.
ajdude 3 hours ago [-]
I reported a blatantly sexual adult ad on Facebook the other day, they got back to me and said that their moderators reviewed the ad and that it was appropriate.
blks 9 hours ago [-]
Good example why not to post your children faces online
dotcoma 1 days ago [-]
Classy as usual.
xgulfie 1 days ago [-]
Weird how they never thought to require ID verification for advertisers hmmm
woodrowbarlow 9 hours ago [-]
for real. if you want to make the web safer for children, start by holding ad networks to a higher accountability. it's painfully obvious "protect the children" is not the real goal.
cdrnsf 23 hours ago [-]
We were better off with landlines and local journalism.
randyrand 23 hours ago [-]
Non-specific terms are a pet peeve of mine in accusations.
Is this new term broader than the old term of CP or is it the same? Why did we even switch?
tbrownaw 22 hours ago [-]
> Is this new term broader than the old term of CP or is it the same? Why did we even switch?
The purpose of the new term was to emphasize that producing it involves the actual abuse of an actual child.
And then somehow it got applied to drawings and lately computer-generated stuff.
inigyou 12 hours ago [-]
The purpose of the new term was virtue signalling by suggesting that it's somehow outside of the definition of the word "porn".
bluefirebrand 22 hours ago [-]
> Why did we even switch?
If I had to guess, this is to try and distance child sexual assault from the concept of "pornography", and maybe make it more abundantly clear that "child porn" is always, 100% of the time, sexual abuse.
I dunno, language evolves like this sometimes. Like "smoking" which is now called "tobacco use" or "cannabis use" to clarify more what is being smoked
1 days ago [-]
meric_ 1 days ago [-]
I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number.
This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopefully detection and moderation will catch up
collinmcnulty 24 hours ago [-]
In many industries, if you can't do something safely, you simply can't do it at all. Maybe yeah, if you can't build a sufficiently strong automated system, then you need human moderators across a huge number of locations. Them's the breaks for running a wildly profitable service that half the world's population uses.
bonestamp2 24 hours ago [-]
> In many industries, if you can't do something safely, you simply can't do it at all.
Absolutely!
Related story... my wife works in a regulated industry and she was running facebook ads for one of their new products. Facebook had just introduced Ai generated ad-copy and the ad agency didn't know that option was turned on by default so they uploaded all of the ad-copy that was approved by legal and then facebook was running all of these alternative ads that were actually illegal because the copy it wrote were all claims they are not allowed to make in that industry. They only caught it because one of the ads was served to my wife and she immediately noticed it was copy that was not approved and something they could not claim.
I always assumed these shady ads were created by shady people, and I think a lot are, but I wonder how many companies are unintentionally running shady ads because facebook generated those ads.
23 hours ago [-]
golemiprague 23 hours ago [-]
Then let's not have any infrastructure or services because some people use it to commit crimes. The car industry doesn't prevent accidents, the telecom industry doesn't prevent scams, the school industry doesn't prevent bullying, the nightlife industry doesn't prevent rape or drug use and i can go on and on. You can't have a perfect system, people will do what they do, all you can do is trying to prevent those crimes but don't expect 100% success rate and certainly you can't stop everything.
bluefirebrand 22 hours ago [-]
> The car industry doesn't prevent accidents
The car industry is constantly innovating trying to prevent accidents and make them less damaging to occupants
> the school industry doesn't prevent bullying
They try to, though. There's all sorts of initiatives to reduce and prevent bullying. Whether or not they are effective, they are still trying and have been working on this for decades
> the nightlife industry doesn't prevent rape or drug use
There are tons of efforts in clubs and bars to make people aware of this problem and reduce occurrences of rapes. Drug use maybe less so.
> the telecom industry doesn't prevent scams
Yeah, they absolutely are shitting the bed on this one, I'll give you that. But they should be doing better.
joquarky 23 hours ago [-]
Although I agree, thats a textbook slippery slope you started out with there.
ben_w 23 hours ago [-]
> I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number.
It's Facebook's problem if Facebook can't do the things Facebook is required to do. "Oh no it is hard"? Tough. Either they find a way or find they're no longer allowed to do this business.
> This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopefully detection and moderation will catch up
AI *might* solve this, or Meta's AI may be trapped in an arms race with advertisers trying to get around it for whatever reason has driven them to do this in the first place; but fully automated mass-generation of personalised ads was never a mandatory part of their business plan, so it was a problem they never needed to have.
tyleo 1 days ago [-]
Your right! We should also reduce food safety requirements for McDonalds and other large restaurants. At their scale it’s just too hard to keep everything clean.
thereisnospork 20 hours ago [-]
There was just an outbreak at Taco Bell - should we fine Yum! Brands out of existence. liquidate their assets and imprison the executives, like some people elsewhere in the discussion seem to be advocating for? Should we add a few billion dollars in operating costs in increased food safety regulations?
The societally optimal amount of regulation will most likely not completely eliminate outbreaks, presuming diminishing returns.
anang 11 hours ago [-]
If YUM! brands demonstrated a pattern of negligence that led to frequent food safety issues I think absolutely there should be severe consequences.
Nobody is advocating for a one strike you’re out policy, just that at some point there should be more severe consequences than a fine.
20 hours ago [-]
sandcat_ 23 hours ago [-]
Posts? Fair. But adverts? There is literally no reason they cannot all be human moderated. Every single one. People are paying to have their adverts placed. Put a small fee on each ad, if they must, for the initial review. Done.
Don’t buy into Meta’s narrative that there’s nothing that can be done while they continue to make money hand over fist.
afavour 24 hours ago [-]
To my mind the simplest answer is that if it isn’t possible to do it safely then you shouldn’t be able to do it.
Is this firehose of social media actually a societal benefit? I’m less and less convinced that it is.
7952 24 hours ago [-]
They have the resources to hire a vast number of people. So yes they probably could manually review every ad. And either way it is their problem to solve. They are not entitled to be hugely profitable or free from the obligations that smaller organisations have.
newAccount2025 22 hours ago [-]
Surely there is no need to review every ad. Coke and Apple and whatnot are not going to be doing this. New companies or companies with a history of complaints can face extra scrutiny. With AI capabilities so far along you have tier 1 ready for free…
shakna 22 hours ago [-]
Every advert for TV and radio has to pass a review in most jurisdictions. Billboard laws vary wildly, but some also require a review.
Why not ads online? The industry would adapt pretty much overnight, because it is something everyone already does.
Dylan16807 21 hours ago [-]
Yeah, like $5 per unique ad would be basically nothing but it would pay for plenty of review.
dgellow 1 days ago [-]
Have you considered that some service just shouldn’t exist in their current form if they cannot be made to not offer illegal content representing minors?
tcfhgj 1 days ago [-]
> At this scale it's pretty mind bogglingly difficult to moderate down everything.
no, it's just more work, and it's not like facebook could not afford to pay more people
spacecadet404 1 days ago [-]
AI is generating ads that will be reviewed by AI that will then be pushed to humans largely to ignore.
Ad pipeline is malware at this point.
techjamie 23 hours ago [-]
> Ad pipeline is malware at this point.
Always has been.
Occasionally my girlfriend will comment on something she saw in an ad, even buy things off them. Thing is though that ad platforms don't seem to be doing anything meaningful to stop bad actors.
So really, clicking any ad and interacting with it amounts to placing your trust in a total stranger with the only criteria being they paid a little bit of money for you to see them. To which you will then download their software, give them your credit card, or whatever the end goal is.
It's far easier to assume anything in an advertisement is a scam and block them accordingly.
notahacker 24 hours ago [-]
tbf they generally don't even try with moderation. A few years back they made a multimillion pound settlement with a UK consumer finance guru who was sick his face being used to fake endorsements of scam products promoted mainly via Facebook ads
So you'd think that a sophisticated tech company that had paid that financial penalty would find it pretty easy to have a simple text filter for "Martin Lewis" and perhaps even an image filter for his very distinctive face which pushed those ads into a moderation queue, particularly if they both appear together in the scam-ridden investment opportunity category and the advertiser is a new one (that's probably not going to stick around under that name for very long). But no, they remained a common theme for years afterwards...
And, as the sibling ad points out, if you report stuff that's obvious scams you get told they've reviewed it and found it to be OK. Plus you get more of it promoted into your feed because hitting the report button is a form of interaction with it...
I actually had some sympathy for Facebook when they were condemned for not moderating fake news from Myanmar they have no real capacity to moderate, or condemned for daring to slap the gentlest of content warnings on antivax stuff in contexts they understand perfectly well... but when it comes to ads they get paid for, which is a much smaller fraction of Facebook content that is unambiguously not protected speech or a matter of opinion, their lack of effort is quite something to behold.
There are two separate content moderation issues at play here: user-generated content and Meta & advertisers-generated content. The moderation challenge related to the fomer is much harder. But this article is about the latter. The researchers literally found these ads in Meta's own ad library. Meta sells these ads so they must content moderate them. There is no excuse.
BLKNSLVR 23 hours ago [-]
> At this scale it's pretty mind bogglingly difficult to moderate down everything.
Well that means don't do the thing that you can't control, or they shouldn't be legally allowed to do the thing they can't control.
Additionally, for one of the biggest companies in the planet, that has done mind bogglingly difficult things in order to make profit, that's the lamest excuse ever.
Fine them out of existence.
michaelt 23 hours ago [-]
> I'm wondering what people expect these companies to do? Human moderators?
They could just set the minimum ad spend at a level that makes moderation possible.
Let's say it costs $15 to have a human spend 15 minutes checking an ad. If the minimum spend per ad is $100 it'd easily cover the costs of the check. And I imagine most ad campaigns are spending a lot more than $100.
boplicity 24 hours ago [-]
The entire world has social standards that people generally abide by in private residences -- set by the owners of those residences. Just because something is happening everywhere, doesn't mean another thing can't happen too.
nitwit005 22 hours ago [-]
The ads make money though. The cost to approve the media use and have someone quickly glance at it is going to be tiny compared to their revenue.
Barrin92 24 hours ago [-]
>I'm wondering what people expect these companies to do?
How is this our problem? We make the rules, the obey them. If they can't they ought to be shut down. If they want to argue that at their scale they can't abide by the rules society lays down for them we can cut them down to something human sized.
dijksterhuis 1 days ago [-]
It's not everyone else's fault that executives etc. decided to grow their userbase/business/profits at all costs, i.e. with no concerns for the harms they've been causing. It's similar to how adding more and more code, more and more features, more and more stuff into software increases technical debt. Apparently "growth at all costs" for a business equates to ethical/moral debt, quite obviously in this case. Which shouldn't be surprising to anyone who understands/recognises the mechanisms of greed.
For software, sometimes paying off that debt means getting rid of some of your features/code/stuff. i.e. there's another alternative to "let's AI the AI".
scale the business down. shrink the number of users. make less money.
reaperducer 1 days ago [-]
Human moderators? Sure, but Meta products have approximately half the worlds population using them.
It doesn't matter how many people are consuming the ads, it matters how many companies are placing the ads.
Let's not invent excuses for the trillion-dollar tech companies. Meta has plenty of money to put humans in the loop. It just chooses not to because some upper manager needs to buy a fifth house, or a third private island.
23 hours ago [-]
lossolo 22 hours ago [-]
> I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them
In this case, we are talking about ad images.
1000 moderators x 5 second per image to click deny or approve.
So 1000 moderators review 720000 ads/hour
Per 8 hour workday:
5,760,000 ads
Per full 24h day:
17,280,000 ads
So we will use 3k for 3 shifts.
51,840,000 new image ads moderated per day.
At ~$1,000 per moderator per month (most jobs are outsourced to Africa and Asia):
$3 million per month
$36 million per year
I don't see any public numbers for how many new ads they add daily but meta reported removing 159 million scam ads during 2025, so equivalent to around 436,000 scam ad removals per day.
PostOnce 23 hours ago [-]
They make 200 billion dollars a year, 60 billion of which is profit, so they could afford to hire a million more moderators at first world wages (50k/yr) and still be making 10 billion dollars a year in profit, and that's assuming nothing else changed, if they stopped spending money on VR, AI, and other horseshit, they'd have even more money for moderators.
They can also choose to show fewer ads, i.e., only show manually human reviewed ads, and if there are too many to review, charge more per ad until there aren't too many.
21 hours ago [-]
ethanwillis 23 hours ago [-]
Their right to a business model doesn't outweigh the right of the public to not be harmed.
padjo 14 hours ago [-]
They could absolutely moderate this at scale. They would just make less money so they have no incentive to do that.
elif 23 hours ago [-]
Think of it as an individual and instead of social property real property. If a person is stealing retail goods every day, no one asks "what should he do?" what he "should do" is face consequences until he is not a person who steals every day.
Just because the social property giant corporations steal is somewhat abstract doesn't change any of the fundamentals of right and wrong. I'm so tired of this ultra-capitalist "right to be massive" assumption which places the value of unhinged monopolistic growth over maintaining social commons. What these companies "should do" is face penalties until they can safely manage their scale, or scope their scale to a level they can maintain safely.
1 days ago [-]
nathan_compton 22 hours ago [-]
Facebook is a pox on civilization, so one possibility is just firing it into the sun.
skywhopper 24 hours ago [-]
What a terrible outlook. “It’s not possible to do this thing safely at Meta’s scale” is an apologist cop-out. First of all, yes it is, Meta makes tens of billions of dollars of pure profit every year. They were that profitable while blowing tens of billions on the Metaverse debacle! They are not resource-constrained in any meaningful sense.
Secondly, if I’m wrong and it’s not possible, then you stop providing the dangerous service! There’s no reason Meta has to exist in its current form. If it can’t meet basic standards of human dignity in its product offerings, then it should change or cease to exist.
23 hours ago [-]
disillusioned 23 hours ago [-]
Beyond these obviously deplorable ads, my wife got sniped by an ecommerce lookalike ad on Google the other day: a near-identical match of the vendor she was looking for, with a paid for sponsored ad (that was clearly linked to some chinese firm upon further review). Site had prices that were just a bit too good to be true, and a slightly different TLD that _I_ would've caught, but she missed because the price was a bit too good to be true. Only caught it when Citi asked me if I was spending 9000EGD on some random website.
And my point here is, we're in this great revolution of AI empowered everything and... these companies can't be bothered to scan this volume of AI ad slop to make sure we're not being actively scammed? Or having porn or CSAM spread? I understand it's a "perverse incentive" in the truest sense: they make money by taking the scammers money, but I was scammed once by an insanely clever lookalike Facebook ad, and had trusted their verified checkmark (about a decade ago)... with AI, these things should be a thing of the past.
pickleglitch 8 hours ago [-]
Zuckerberg should thrown in prison.
andy_ppp 24 hours ago [-]
If any of us did that clearly we’d be in jail for several years and put on the sex offenders register but when Meta appear to be hugely responsible for increases in teen suicide or crimes like these we get nothing. If corporations want the rights of individuals they equally should shoulder our shared societal responsibilities as well. I honestly don’t get how they can just pretend they aren’t responsible somehow because it’s slightly expensive to not commit crimes or something…
If you are downvoting this please explain why, it’s important that we come to a shared understanding how these things are ever okay for corporations and not individuals…
archildress 24 hours ago [-]
Our regulatory framework is so asleep at the wheel. It is as if there is this unpierceable veil if you operate as a corporate entity, as if multiple people's combined transgressions are less than a single person doing it.
carljungslabtek 23 hours ago [-]
Is it really asleep at the wheel or is it that decades of intense lobbying have crippled it? I mean of course it’s both, but I think it’s important to point out that it’s not just negligence, it’s more nefarious and selfish than that.
Telaneo 12 hours ago [-]
It's in an induced coma at the wheel.
olelele 24 hours ago [-]
Move fast and break literally everything. I am so depressed by what the internet has become. Such potential only to become monopolist behemoth bullshit.
cucumber3732842 23 hours ago [-]
>If any of us did that...
You don't have Metas legal team nor does the power structure find your valuable to have helping them out nor can you harm them if you don't like them.
There was, quite famously, a man who got away with these sorts of things for quite some time. He owned an island. I can't recall his name....
carljungslabtek 23 hours ago [-]
Oh yeah — you’re thinking of Sergey Brin’s buddy. They were neighbors for a while, they used to go kite surfing together. Great guy.
2OEH8eoCRo0 22 hours ago [-]
Repeal Section 230
lenerdenator 1 days ago [-]
This is what happens when you let a company be controlled by one person who has no reason to be accountable to anyone.
If Zuckerberg wants total voting control, then he can also deal with the consequences of being caught hosting CSAM.
olelele 24 hours ago [-]
Digital feudalism. Musk is building a city where he can prohibit worker organizing. Joe Hill died for nothing.
inigyou 12 hours ago [-]
Fork found in kitchen.
crmd 22 hours ago [-]
I asked my grandpa about the business idea of self-serve magazine advertising. He said if you do that wait till you see the weird shit people will try to publish.
I wonder if we could learn anything from these cranky old timers.
alex1138 1 days ago [-]
> and ran across Facebook, Threads, Messenger and Instagram.
So it's the SAME AD PLATFORM? Even in MESSENGER? My god. Not only is this whole thing horrible but it's doubly so
snitzr 1 days ago [-]
Shut it all down.
picofarad 1 days ago [-]
36 million CSAM media removed in 2025? Why aren't millions of people in jail? Wtf?
taurath 1 days ago [-]
That's a really common reaction to people first hearing about the delta between how society talks about the subject vs what they actually do about it. Its a bit like the fiction of the social safety net or strong institutions.
The truth is impunity is the rule, victims especially of CSA and CSAM, or revenge porn, or of Mark or Musk's companies generating naked images of their body have basically no power, and its an exception when someone who is an abuser AND has any amount of social standing is put away.
7952 24 hours ago [-]
I think AI should the point where companies take some responsibility for the content produced with their tools. When the entire purpose of a machine is a form of thinking there should be some responsibility for what it thinks. It is nothing like a general purpose tool that the user just invokes.
john_strinlai 1 days ago [-]
it can take awhile for things to work their way from NCMEC (national center for missing & exploited children) to the appropriate local agency, then have that agency do their investigation, get a warrant (if they can), etc. and that is assuming that there is even a cooperative jurisdiction for NCMEC to send the initial report to.
but, plenty of people do end up in prison, especially if its facebook/dropbox/gmail/etc... they just dont make the headlines (especially nationally) unless its especially heinous.
zimpenfish 1 days ago [-]
I think there's also the "roll up a whole network at once" approach they prefer to take for things like this - hence nothing will happen for months/years whilst investigations happen in secret and then there'll be a day where you get 40 coordinated raids across 10 countries which lead to tens of people being arrested. Then of course there's another period of months/years where they have to work on the new stuff they've got from that raid and also preparing for trials, etc.
_trampeltier 1 days ago [-]
In most western countrys, is often more than 50% from CSAM from underaged teenagers, like selfies etc. And then are cases like some overmotivated parents post nude baby pictures. I guess such pictures also get flaged. But even if its just 50%, 18 million, your point still standes. Why are not more people in jail.
rationalist 8 hours ago [-]
I don't think parents should overshare pictures of their kids, but FYI, nudity does not automatically mean porn or abuse, even of children (which is legal in the U.S. as long as it is not sexual or focuses on genitals).
xkcd1963 4 hours ago [-]
[dead]
TheOtherHobbes 23 hours ago [-]
Because the point of power and wealth is to avoid accountability for harm.
That is literally what "freedom" means in the US. It's not the pursuit of happiness, it's the pursuit of immorality without consequences.
If this isn't obvious - how many people mentioned in the Epstein files have been arrested?
Well, 36 million images doesn't necessary imply 36 million people (in fact, it could possibly just imply 36...)
bothers 1 days ago [-]
Does their definition of CSAM exclude material that's not unlawful in the US? People can be (let's say) tactical about its inclusion from case to case. But I can't say if it's the case here, nor how much it explains the 36 million not explained by other better replies.
chrisjj 24 hours ago [-]
Facebook's policy conspicuously lacks any definition of CSAM.
ceejayoz 1 days ago [-]
VPNs, hacked accounts, no jurisdiction, etc., I'd presume.
catlikesshrimp 1 days ago [-]
[flagged]
ceejayoz 23 hours ago [-]
No, it's the "local law enforcement struggles to handle largely anonymous international crimes" note. I'm not arguing anything; I'm just describing the reality.
ls612 1 days ago [-]
Because the overwhelming majority of these reports are for teens sexting each other.
tcfhgj 1 days ago [-]
media without abuse is labelled csam
chrisjj 21 hours ago [-]
Seems they've mistaken child pornography (as per the US legal definition) as CSAM.
chrisjj 24 hours ago [-]
> 36 million CSAM media removed in 2025?
No, not at all.
"removing over 36 million pieces of child sexual exploitation content last year"
Not CSAM.
carljungslabtek 23 hours ago [-]
Doesn’t the M stand for Material? What are you saying the difference is? Their quote just sounds like another phrasing
chrisjj 21 hours ago [-]
> Doesn’t the M stand for Material?
Yes. So?
> What are you saying the difference is?
Child sexual exploitation content is broader.
croes 1 days ago [-]
Bots, good luck finding the people responsible for them.
Also how much of the child exploitation material was created by the children themselves?
Teenagers who send each other nude photos are creating child exploitation material but you hardly want to put them jail for that.
giantrobot 24 hours ago [-]
> Teenagers who send each other nude photos are creating child exploitation material but you hardly want to put them jail for that.
Well rational thinking people wouldn't. A great many using CSAM as a wedge to de-anonymize the Internet or institute regressive "profanity" laws are often neither.
croes 23 hours ago [-]
It’s hard to discuss that topic properly because many people see pedophile rings everywhere.
They forget most child abuse happens in the family.
an0malous 1 days ago [-]
Because then half the world leaders would be in jail and the other half would lose their excuse for building mass surveillance systems
bigbuppo 1 days ago [-]
As if you didn't need another reason to use an ad blocker.
qwerpy 24 hours ago [-]
Meta is better than anyone at anti-ad-blocking. Even the best ad blockers struggle to keep ahead of the ever-changing structure served up by their websites, and the websites are intentionally bad to make you use the apps instead. But the apps are nearly immune to ad-blocking.
“Just stop using meta properties then”. Sure but some of us have wives, friends, etc
ToucanLoucan 1 days ago [-]
> but as Wired notes, it relies on "automated tools" as part of the process, which may have been how the more than 50 ads TTP discovered made it through.
Again, and again, and again, these technologies have proven ineffective to moderate content. User posted and otherwise. Until we have a legal mechanism in place to hold these companies meaningfully liable for this, it will not stop.
Every single one of these has the same damn list of excuses about cost of hiring human moderators, but I promise everyone reading this if you make the executives of a social network legally liable for distributing CSAM on their platforms, they will find all kinds of money to get human moderators really fucking quick.
danudey 1 days ago [-]
The article also mentions that a ton of even worse ads were posted between when they contacted Meta and when they were ready to go live with the article, and some of the offending ads which were taken down had just been re-uploaded again and automatically approved.
Not only are their AI tools ineffective at what they claim they should be doing, they can't even be bothered to prevent removed ads from being re-uploaded later on.
malshe 1 days ago [-]
I think people have been demanding this for ages but lobbying by social media companies against any change in the law is enormous.
As for the cost of content moderation, Meta has zero interest in any type of moderation to begin with. The cost is just a public-facing excuse. In Careless People, Wynn-Williams mentions that Facebook didn't do anything to stop anti rohingya posts in Myanmar because they did not have any fact checkers who could read Burmese. In other words, they did not have a single moderator in the damn country.
bigbuppo 1 days ago [-]
More specifically, these were for ads. They received compensation to distribute this matierial.
lstodd 1 days ago [-]
FB might or might not have a right to exist in someone's eyes, but the question remains: is 0.5c-like latency messaging across the world acceptable? Because facebook or not, given internets this is what you will end up with. People are people.
On the other hand, now try to ban that telecom. Gods will laugh.
alex1138 1 days ago [-]
Yeah and/but also the case it's not bidirectional enough
The eternal question of tech platforms - should we be responsible for what users post? (Ads are not user posted, so we can eliminated that factor. Even if posted by 'users' it's a separate pipeline) But with companies like Meta it doesn't even have to go that far - the philosophical conversation - because it's so hostile to users. People get banned for mild things all the time (apparently extra the case, since the 'pivot' to AI) while the absolutely horrible things you report never get taken down
ToucanLoucan 1 days ago [-]
> The eternal question of tech platforms - should we be responsible for what users post?
I would never say a platform has to be responsible for what a user posts, and to be clear, I mean either a user of the platform, or a user of the platform's ad tooling, or anything else. Anything that arrives via an upload button of some sort. However: If you as a platform then distribute what has been posted, yes, you are responsible for it. Your service is now broadcasting that content. If that content is harmful, you should be held responsible.
Who else conceivably could be? And if the response to this is "well we have way too much stuff coming in to moderate it" okay, then restrict how much stuff comes in. Require approval on individual posts or on accounts.
Like, this is such basic shit. If a newspaper printed CSAM on the front page, they would be arrested within the day. But because Facebook is real super big they just don't have to take care of their house? Ridiculous.
alex1138 1 days ago [-]
Yeah sure, I think we basically agree
I'm just bemoaning the fact FB can't even pretend they care when they're so busy banning people for nothing
ToucanLoucan 24 hours ago [-]
Oh yeah, wasn't meaning to imply we didn't agree. I'm just expanding on your point.
But they couldn't possibly do it at that the scale they're operating at. They couldn't hire enough people in the countries they operate, or know the language, or trust that who they do hire aren't corrupt or working against their interest. And they can't manually approve every ad, or make sure targeting isn't illegal or otherwise harmful.
---
This is sarcasm, by the way. Most decent people make sure what they're about to do won't harm other people and if would cause harm they wouldn't do it. But social media companies and ad networks aren't run by decent people. They're run by people who believe their business is entitled to infinite scale regardless of how many people are harmed along the way.
john_strinlai 1 days ago [-]
>But they couldn't possibly do it at that the scale they're operating at. They couldn't hire enough people in the countries they operate, or know the language, or trust that who they do hire aren't corrupt or working against their interest. And they can't manually approve every ad, or make sure targeting isn't illegal or otherwise harmful.
you say sarcasm, but i think this is literally true.
this isn't a defense of facebook, i think that their scale makes it actually impossible (while remaining a going concern). the result should be that they arent allowed to operate at a scale that they cant handle, instead of being able to brush it under the rug every ~6 months when an incident hits the news cycle.
lokar 1 days ago [-]
Don’t they have like an 80% gross margin?
john_strinlai 1 days ago [-]
the amount of content posted per second to facebook is unfathomable. a quick google (just for a rough order of magnitude) says ~65,000 posts per second. add in instagram (which is worse for CSAM) and its gotta be at least double that.
it would require millions on millions of employees, spread across ~every country. between the payroll, buildings and property, equipment, etc. i just dont think its possible at that scale.
(again, emphasizing that im not saying this as an excuse for facebook, but that i dont really think facebook/instagram should exist at all)
lokar 1 days ago [-]
I would think that they can classify most posts as safe with very high accuracy.
Certainly it’s not unreasonable to have them disprove that
And the scope could be further reduced by looking at posts with more then a few views.
gambiting 1 days ago [-]
Right, but the article isn't about posts, but about a paid ad campaign - surely those are started in numbers that could be moderated?
john_strinlai 1 days ago [-]
>Right, but the article isn't about posts, but about a paid ad campaign
the comment that started this thread says:
"these technologies have proven ineffective to moderate content. User posted and otherwise"
which is what i (and i assumed the parent to my comment) was replying to. i agree that paid ad campaigns alone is more tractable.
wmf 1 days ago [-]
No, because most ads are created by automated systems (many of which are scam/spam ads) and Meta doesn't want to lose revenue by slowing the system down to human speed.
1 days ago [-]
jimjimjim 24 hours ago [-]
"While remaining a going concern."
Well, tough. Maybe they should have to find a way. If that means requiring everybody to have to pay to afford the moderators then so be it. All the other companies would have to as well.
john_strinlai 23 hours ago [-]
>Well, tough.
right, that was my point.
duped 23 hours ago [-]
The point I'm making is they're not entitled to scale a business if they can't scale responsibly
john_strinlai 23 hours ago [-]
i agree with that, and said the very same thing in my comment
EA-3167 1 days ago [-]
I agree and the obvious solution is: Nothing should exist at that scale. In fact, "Able to effectively moderate your product," strikes me as an excellent standard to hold them to, then let their product find the natural usercount and price point they can manage.
Who ever said that companies should have the right to exploit network effects to dominate online communications?
kmeisthax 1 days ago [-]
Facebook absolutely could remain a going concern while dealing with all of these problems, the problem is that they would be spending money to lose money.
One of the more perverse aspects of risk prevention is that riskier customers are often way more lucrative. It's kind of inherent to the notion that markets price risk into transactions. The thing is, illegal behavior is also just a particular kind of risk: if someone wants to sell nudify apps or scam old people, Facebook could conceivably be on the hook[0] for damages if they're caught. And in a sense, a risk premium is just a fancy kind of bribe: if Facebook won't take my ads because they think they're too risky, then I'll just pay more and more until Facebook accepts them.
With illegal behavior, we hope that we can make the punishment high enough that Facebook refuses any conceivable risk premium the perpetrators of that behavior would be willing to pay. The problem is that Facebook is really desperate for any increasing growth story, and when you're too big to fail, your growth story is to drip-feed enshittify your stack. Increasing tolerance for illegal behavior is downstream of this: you cut enforcement, tell them to automate more, they become easier to bypass... and you make more money. Because it turns out all that risky behavior... is only risky for normal people. Facebook can launder[1] the risk away and make a tidy profit.
[0] Do not tell me about CDA 230, I was there when the old magic was written.
[1] See also, HSBC turning themselves into a literal money laundering operation.
ToucanLoucan 24 hours ago [-]
Right, which is why my suggestion is that we skip fines, because they demonstrably don't work, and we go directly to: you, $executive_at_facebook, have participated in the distribution of CSAM and will now be prosecuted.
Make that the policy, and I'd bet my life savings that Facebook, miraculously, will figure out how to detect this shit with bulletproof accuracy.
ratelimitsteve 1 days ago [-]
We used to say computers can't make decisions because they can't meaningfully be held responsible for those decisions. Now the vibe seems to be that computers should make decisions because instead of anyone being held responsible we can just say "the computer made a mistake and it is very sorry" and effectively shield anyone from being responsible. But the thing is, machines don't do stuff. Not from a responsibility standpoint. My car doesn't drive, I do. It may provide the means, but I decide where we're going and how we're going there. Even with the active cruise on, the car didn't speed, I did. The car may have hit the wall, but I caused the accident. the car ran that person over, but I killed someone, not the car. The machine did what someone told it to do. If someone told it to do a bad thing, or someone did a bad job telling it not to a bad thing, that person is responsible.
When people started using Grok to make CSAM the platform's response was to paywall image generation. If we don't start making the driver responsible for what the car does, the coder responsible for what the code does, the CEO responsible for what the company does, they will continue to exploit people in increasingly horiffic ways.
chrisjj 24 hours ago [-]
> AI-generated
How on earth can they know?
SV_BubbleTime 21 hours ago [-]
Read the article. Between the lines it doesn’t seem like the real issue is any specific image, it’s the ”nudify” AI apps.
This is why they pushed for the change from “child porn” to “child sexual assault material” because LOTS OF THINGS can be “materials”.
chrisjj 21 hours ago [-]
I did read the article. It does not answer the question.
So you throw theZuck in the hoosegow. Now what? FB will continue printing money and doing the things it always has even if under new management. Why do you think it'll change with just throw theZuck in jail?
mywittyname 1 days ago [-]
Presumably the new CEO would like to stay out of jail and will fix things?
bastardoperator 1 days ago [-]
Court monitor that ensures compliance. It's not that hard.
lenerdenator 1 days ago [-]
Because at that point, the last guy to run a company that displayed gross negligence to CSAM distribution is sitting in prison.
That serves as an example, a deterrent. "Clean up the act, or you too can go from being a hyper-wealthy executive to the biohazard cleanup detail in a cell block at Leavenworth."
daun_gee 1 days ago [-]
[flagged]
giancarlostoro 1 days ago [-]
So according to you 60% of Americans are all pedophiles and “retarded” because they use AI. Glad to have such constructive discourse with you bud.
Retric 1 days ago [-]
Saying X if for A and B, implies a non exclusive logical or.
Income is for daily necessities and long term investment.
steveBK123 1 days ago [-]
[flagged]
antonvs 1 days ago [-]
[flagged]
alex1138 1 days ago [-]
(This reminds me of, and not to be political. This is a technological, rather than political angle) There's a TED talk by Carole Cadwalladr about "Facebook's role in Brexit" in which she talks about the ads the Leave campaign ran. This is what is meant by Facebook's "breaking democracy", where campaigns don't have to go through the usual disclosure avenues
Are there reasons why Brexit might have been popular? Yes, in the sense I've heard about them. Should we then be blaming Facebook?
The problem is consolidated power. Carole herself said in her talk that it's not about Trump vs no Trump (sorry. It's been a bit since I've seen the talk. I shouldn't just paraphrase), it's about citizens' right to meaningfully choose in an information landscape
This is the problem with Facebook. It becomes an Everything App. Who cares about fraud (say, on marketplace, needless to say the site itself, the way it's screwed over businesses) on the platform when you can grow big? Let's say in this case, the actual case I'm commenting on - "Facebook didn't know". Well then that's the problem, isn't it? It's a company set up by someone of low moral reasoning (https://news.ycombinator.com/item?id=1692122) that doesn't set out to make a good product, something people will actually like. It's about dominating an industry and ads can be totally unvetted or scummy or scammy if it enables them to do this
throwatdem12311 22 hours ago [-]
Just shut the company down, throw the executives in a deep dark hole and forget they exist. The world will be better off.
I didn't realize the original was behind a paywall.
I reported the ad and a week later it was still there. I switched to Apple.
F Droid comes close and can even auto update now (never understood why that didn't work on the past), but most apps I want or need like banking, health insurance etc aren't on F Droid.
AIUI, Android simply didn't support it. The original way for apps to install other apps was via ACTION_INSTALL_PACKAGE, which is a user-visible action. The InstallPackage API did not support silent updates until sdk version 31: https://developer.android.com/reference/android/content/pm/P...
They don't remove apps like Facebook or Twitter for displaying CSAM, but apparently ganked Telegram at the first single report of an extortionist trying to remove a public Telegram group because they posted CSAM in it.
https://www.reuters.com/business/retail-consumer/telegram-sa...
It's only okay when the American companies get away with CSAM.
Sadly, the dirty money is luring them in too.
All communications were via WhatsApp. They started with real stock tips (which were pretty good actually!) and then did a pump and dump.
See: https://www.cleuremissionfund.com/
I received a similar ad (mine was from the shark tank people), reported it and got a message similar to what you described. They were obviously stealing Mark Cuban’s likeness and peddling an obvious scam.
It's been a very well known problem on Facebook for years[1][2], and the pathetic part is that its so obvious. It really tells you how bad Facebook is with AI, because even I as a regular 1x engineer could wire up some very cheap inference that would lay waste to this fraud pattern as a part-time weekend project.
[1] https://consumer.ftc.gov/consumer-alerts/2024/05/looking-buy...
[2] https://www.bbb.org/scamtracker/lookupscam/807274
The lack of accountability here is astounding.
I've not seen an ad from Youtube for probably 10+ years on my devices (since whenever Vanced made the apk customisations popular).
No. I don't. uBO suffices. Maybe with some additional rules and lists which aren't in its default setup.
Maybe it also depends on the sort of content one watches, but I tried, and it did nothing for me, except one extension more running. Which I tend to try to minimize.
I think I remember some sponsored crap in 'der8auer' or something like 'linus tech tips' eons ago, but I don't watch them anymore.
So I can't really tell, but for my use case it seems redundant.
I also remember having imported uBo-lists from somewhere, allegedly enabling sponsor-blocking somehow. But that was another install. I don't have these anymore, ATM.
I barely visit the FB feed these days, about half of those visits being a notification that turns out to be someone's birthday.
Unlike FB themselves for the content they host, I find it easy to avoid them without needing the help of a filter, because on the rare occasion when I find myself being sucked into scrolling down the feed, this almost always stops within 3 items because that's how quickly I find the first utterly irrelevant item owing to how Facebook keeps trying to suggest (and advertise) nonsense.
The filter I want to see in the world is the legislative kind, the "Meta delenda est" style. This is of course *not* what Facebook would want: spammers want to break FB's filters, and FB would try to get past legislative filters. I count FB as a spammer trying to put ads into every third message you try to exchange with your friends.
Reported the add but damn YouTube, the freaky fake medical ads are bad enough.
Also not a copyright violation, but using Elon Musk's likeness without permission for investment scams seems to be a big thing.
It effectively mandates a lower-limit on spend for budgeting purposes.
Sure, that money might be spent ineffectively... but corporations will figure it out if their only options are to
1. Not invest in regulatory compliance at all and get fined for noncompliance.
2. Throw money at the problem, spend it inefficiently, and STILL get fined for noncompliance.
3. Throw money at the problem, spend it well enough to pass muster, avoid fines.
For a lot of people, government regulation of this sort is not desirable, but at what point does someone need to drop the hammer to stop this?
If someone is writing English and puts "billion" for 10^12, that's a translation error, much like writing "my grandfather became pregnant when he realized he'd locked the keys inside the car." (Instead of "embarrassed.")
Conversely, if I wrote a French or German sentence and put "billion" for 10^9, then I'd be the one making the translation mistake.
[0] https://en.wikipedia.org/wiki/False_friend
https://www.etymonline.com/word/billion
I would vote to revert it.
Empathy for other people and the environment is a sign of intelligence. Those that don't think of how their actions affects those around them and the neighbors they will never meet nor the environment have an lack of intelligent.
Those that lack empathy are the same that idolize bad actors like Elon Musk and Mark Zuckerberg. Greed and the desire for it is a high indicator of lack of intelligence.
There is a difference between being well off and greedy. I would argue that Steve Wozniak is a great example and better of the two Steves from Apple to highlight this.
I have created jobs and brought in international commerce to where I live. I produce solutions for companies I don't even know their names. I have kept people safe and will never know their names nor will their families know mine. None of which has deluded my empathy for others, human and non-human, and the environment.
My previous statement was codified in another thread. This statement is a two part. One to re-enforce my empathy and a social experiment.
I feel sorry for those that lack empathy. Empathy is the only way to put yourself in someone else's shoes. Intelligence is a by-product. There is no other way to live a life you can never have nor experience.
Label of _radical_ is something I welcome. When former co-workers and people you meet want to shake your hand before leaving after giving them constructive criticize, it is a surreal experience. Not when it first happens, when it repeats itself.
What if they make a shadow profile for you? Do you count as a user? What if you've tried to delete your account and you can't? (I meant a real account here, not even a shadow profile. People have had the things reactivated years later)
Morality exists outside of the business world (and it should inside as well).
Further, it is a societies’ right to enforce the boundaries of what business are allow to do / not do.
For example: banning ads along roads and scenic areas.
Idk, the whole idea of “how much fines will I get doing X shitty business practice” is just gross. I’d rather see harsher enforcement to keep businesses on the straight and narrow more often than not.
Concrete example: If you run a construction business, even if you take all the required precautions, statistically you're going to get 9.2 of your employees killed for every 100,000 man-hours they work.[1] Is that proof all construction companies are evil, and we should shut them down for murdering their employees? Is it a problem that having to buy life insurance is "just a cost of doing business" for these companies?
[1]: https://www.bls.gov/charts/census-of-fatal-occupational-inju...
They will be given more leeway for small scale "screwups" if they can show that they are working to reduce large scale issues. As it is we are dealing with organisations that don't give a shit, so peoples attitudes reflect that back at them.
Also, speaking of statistics, what?
> statistically you're going to get 9.2 of your employees killed for every 100,000 man-hours they work.
No, you're not. This would mean if you employed 50 full-time employees you'd expect 9 of them to die per year.
What that graph actually says: "In a population where there are 100,000 construction workers, you can expect 9 fatal workplace accidents per year".
> "Our automated review found nothing wrong with [this ad that implies a young child performing sexual activities]"
That's also a screw-up, and they should be fined accordingly, proportional to the amount of harm this screw up is causing to society. If there are any practical steps they can take to fix the problem, that should incentivize them to do so.
But if for whatever reason it turns out the only possible way to fix such screw-ups is for them to hire 100,000 employees to manually review every single ad, and the cost of that both exceeds the cost of paying the fines and the opportunity cost of turning off this feature completely, so they choose not to do that, is that a problem?
It's like if you tried to insist construction companies evacuate all workers from the construction site before operating any heavy machinery. Maybe that would save some lives, but it would also be completely impractical.
There's a degree of "consent" here - yes, certainly, one can choose not to be a FB user. But if the sites you visit utilize FB's ad program, well, you can still get hit. Construction workers understand that their work is not zero risk (as are many jobs - I used to work in Fire/EMS), but that is tempered by OSHA etc., that have teeth. You can't (at least in theory) keep operating a construction company that operates unsafely and outside regulations or laws and say "it's all good, I'm just going to pay the fines" - OSHA will shut you down and render you liable to criminal prosecution.
If OSHA was dismantled yesterday (and state-level agencies), and people knowing how some corporations value the dollar versus people, there'd be a lot less people willing to work for riskier companies or in riskier professions.
> It's like if you tried to insist construction companies evacuate all workers from the construction site before operating any heavy machinery.
In an admittedly limited subset of situations, this happens: "Lock out/tag out" systems that can physically prevent the operation of certain equipment if anyone is in the risk zone or performing maintenance. In some cases this is literally akin to a padlock workers carry at all times and put through the power switch of machinery when they go to work on it so someone else doesn't come along and turn it on.
But if a thousand people see some ad then the amount of damage is not much compared to their overall business. I'd go for a healthy penalty on top, and adding in more transparency to make sure they don't hide the real extent of the problem, but it's still probably small to them.
Getting Facebook to put in a reasonable amount of blocking effort is good. But it wouldn't fully fix the problem.
Instead it's a "I don't like this" and they will continue to ignore it.
Relax.
It's only a crime if someone else does it or is not sufficiently wealthy, otherwise it's a mistake.
There really needs to be some harder punishments for this kind of behavior, after all meta profits by selling scammy ads.
Results:
- Reporting a message does nothing no matter how much the content breaks their terms of use. 100% of messages I reported bounced back in a matter of minutes with "no action"
- However, using the "request another review" function, which is available after the initial "no action" response, actually seems to work. How quickly this works seems to vary, I've had actions taken as result of this from 1 day to multiple weeks.
Tiny providers have to scramble, because they'll be destroyed by a single failure to handle it fast enough.
Step 2: wait for it to get out of the news cycle.
Step 3: donate heavily via lobbyists to the opponents of the politicians who called you out
Step 4: de-fund the unit down until just barely enough that you're not lying when you say you "have a team working very hard on the problem." A dozen people in some third world country you pay a dollar a month each, for example.
First of all I don't think Meta is a good or honest company, but that doesn't mean they're not trying at all. In reality even if they were good and honest I genuinely believe their task is probably nearly impossible. Humans just suck too much. It certainly doesn't help that Meta has at least some perverse incentive to be permissive with ads, as they get money from them. Though Meta execs aren't stupid. Inflammatory political ads are one thing, kiddie porn is another I suspect they lose more money over CSAM than all the ad revenue from them. I believe them when they say they removed over 36 million pieces of child sexual exploitation content last year.
Which is a number that I should let sink in. Basically more than one piece of CSAM shows up in their ad stream every second of every day all year. If their moderation techniques are 99% effective that results in 360,000 CSAM ads leaking to the public annually.
Another interesting thought is how much would it cost to actually get that rate to 100%? let's assume human moderators aren't paid much but are infallible. That all-in a single moderator employee costs $65K , that's salary, benefits, HR ratio, psychological therapy, equipment, the works, all factored in.
let's say on average you get about 1 ad review ~every 2 minutes, so bout 250 ads per-day per-employee factoring in some time off you actually get about 65,000 reviews a year. So bout $1 per review. So the question begs how many distinct ads enter their system each year? which I haven't found a stat for. But assuming only 1 in 1000 ads are CSAM, which still feels high but is probably a reasonable ratio. we get 36 billion ads needing review annually. At a dollar each 23% of their gross annual ad revenue each year would be just moderation overhead and they would need to hire over 550,000 moderators.
Evil or not I think they organically built a thing that operates at an unimaginable scale, that even moderation with failures in the parts-per-million would result in tens of thousands of unsavory or unscrupulous ads reaching users and they have neither the incentive nor the capacity to reach even that level of accuracy.
To get a Facebook account they require all sorts of PII.
Why not have people give their PII to set up an advertising account and if they distribute CSAM then they are banned. Removing access to WhatsApp will stop a large portion of the world from participating.
And the parts that can't? Well, they can't advertise on Facebook/Instagram anymore.
CSAM is highly illegal, no doubt these accounts are getting banned but likely not charged (who knows what jurisdiction the advertiser is even in) clearly they're able to pass the current bar.
This is conjecture but I'd bet that in all likelihood someone at some meeting at Meta has floated the idea of moving impedance to the signup to try to limit this phenomena. Maybe more verification, or more hoops. And likely Meta crunched the numbers and was looking at billions of dollars lost in legit ad traffic and that just doesn't fly for a publicly traded company.
I'd guess that the folks at Meta would absolutely love CSAM to stop showing up, It's simply too dangerous, likely costs more than it earns, makes them look bad when it shows up, and alienates users who don't want to see it.
But those negative effects are probably all quantifiable to some dollar value that's less than the alternatives.
Executives don't get bonuses for altruism or ethical behavior. They get bonuses for making more money than they did last quarter. real fix is changing the game but that's a lot harder than it seems and can have many unintended consequences of it's own.
Presumably not dangerous enough.
Overly strict rules can also be weaponized. Imagine running a site that supports user content, but any appearance of CSAM on your site was jail-worthy, and you get an email demanding bitcoin or you're about to get hit with some posts that will shut you down. You have good moderation but you know you can't withstand a literal attack, someone who can automate that attack and has a financial motive to get illegal content onto your site. what do you do?
And then were okay with letting that person sit in jail longer because they thought it'd be better for Facebook PR if they did...
And then when they finally got that person out of jail, and later had him show up at a meet-n-greet with said executive team, Zuck didn't look up from his phone, looked confused, and said to his PA as he was leaving "who was that guy anyway, and why did he need to meet us?"
Or when Burmese dissidents, even the Burmese government itself, said that a FB feature would be used to track down and imprison, torture people the government didn't like, Zuck and FB leadership said "the feature is doing a lot to improve platform engagement, it needs to stay".
So the answer is worse. It's a combination of "the money" and pure psychopathy and sociopathy at the head of the dragon.
This would mean every single user gets 10 uniquely personalized ads per year.
Even if that wasn't hilariously unreasonable by several orders of magnitude, if the moderation cost was was included in the cost of serving ads, this would all self regulate and only serious actors would participate. Treating it as a public bulletin board while still raking in a percentage of the impressions for sure is a nice business model, but not what's best for the rest of the society. Maybe ads just shouldn't be such a lucrative business.
You can bring this number down by only reviewing new/low-reputation advertisers, increasing minimum spend, rate limiting, etc.
You can also pre-filter for "definitely not CSAM" and only review the more ambiguous stuff.
I think your numbers are low too, surely a moderator can review over one ad per minute on average. And it may be more effective to split-screen multiple ads (with redundancy).
But at the end of the day it's a numbers game, something is going to slip through.
I thought Meta wants to put the burden onto the platform, i.e. Apple and Google, is what they are lobbying for.
https://pluribusnews.com/news-and-events/meta-lobbies-for-ap...
What is the institutional moat?
through meta might have lobbied on both
but they lobby for specific (often pretty bad) forms of age verification to be able to
- spy on people better
- have a regulatory moat where due to beady designed laws new alternatives have a much higher hurdle/initial investments and in turn never get anywhere
Meta knowingly runs scam ads, they just charge more to run them: https://www.reuters.com/legal/litigation/consumer-watchdog-g...
> Reuters also reported that Meta internally projected in 2024 that it would earn about 10% of its overall annual revenue – or $16 billion – from running ads for scams and banned goods, internal company documents show.
At $employer we're CONSTANTLY fighting fake ads cloning our brand. Their various brand protection features seem deliberately inept and ineffective.
Search something rather innocuous like "news". Click the first thing then go back to the main page. You have to watch through the ad.
The amount of slop you will get suggested as soon as the algorithm warms up is nuts. The ad you are first served might also be slop. I mean AI generated video advertising overt bogus cures (a memorable one recently - "did you know the Bible has the answer to Alzheimer's?") over AI slop footage.
When I compare to my normal/auth'd Youtube experience, it feels like a totally different app. I have never really experienced such a cheap illustration of the "Youtube rabbit hole" effect. The degree to which AI authored advertising is participating in this is imo pretty concerning if you have, in particular, older parents or relatives.
>The amount of slop you will get suggested as soon as the algorithm warms up is nuts. The ad you are first served might also be slop.
This did not happen for me. I got news about the SpaceX rocket and then more suggestions for news on the homepage, many related to politics.
I did notice that a bunch of the videos were in languages I did not understand though.
Is this new term broader than the old term of CP or is it the same? Why did we even switch?
The purpose of the new term was to emphasize that producing it involves the actual abuse of an actual child.
And then somehow it got applied to drawings and lately computer-generated stuff.
If I had to guess, this is to try and distance child sexual assault from the concept of "pornography", and maybe make it more abundantly clear that "child porn" is always, 100% of the time, sexual abuse.
I dunno, language evolves like this sometimes. Like "smoking" which is now called "tobacco use" or "cannabis use" to clarify more what is being smoked
This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopefully detection and moderation will catch up
Absolutely!
Related story... my wife works in a regulated industry and she was running facebook ads for one of their new products. Facebook had just introduced Ai generated ad-copy and the ad agency didn't know that option was turned on by default so they uploaded all of the ad-copy that was approved by legal and then facebook was running all of these alternative ads that were actually illegal because the copy it wrote were all claims they are not allowed to make in that industry. They only caught it because one of the ads was served to my wife and she immediately noticed it was copy that was not approved and something they could not claim.
I always assumed these shady ads were created by shady people, and I think a lot are, but I wonder how many companies are unintentionally running shady ads because facebook generated those ads.
The car industry is constantly innovating trying to prevent accidents and make them less damaging to occupants
> the school industry doesn't prevent bullying
They try to, though. There's all sorts of initiatives to reduce and prevent bullying. Whether or not they are effective, they are still trying and have been working on this for decades
> the nightlife industry doesn't prevent rape or drug use
There are tons of efforts in clubs and bars to make people aware of this problem and reduce occurrences of rapes. Drug use maybe less so.
> the telecom industry doesn't prevent scams
Yeah, they absolutely are shitting the bed on this one, I'll give you that. But they should be doing better.
It's Facebook's problem if Facebook can't do the things Facebook is required to do. "Oh no it is hard"? Tough. Either they find a way or find they're no longer allowed to do this business.
> This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopefully detection and moderation will catch up
AI *might* solve this, or Meta's AI may be trapped in an arms race with advertisers trying to get around it for whatever reason has driven them to do this in the first place; but fully automated mass-generation of personalised ads was never a mandatory part of their business plan, so it was a problem they never needed to have.
The societally optimal amount of regulation will most likely not completely eliminate outbreaks, presuming diminishing returns.
Nobody is advocating for a one strike you’re out policy, just that at some point there should be more severe consequences than a fine.
Don’t buy into Meta’s narrative that there’s nothing that can be done while they continue to make money hand over fist.
Is this firehose of social media actually a societal benefit? I’m less and less convinced that it is.
Why not ads online? The industry would adapt pretty much overnight, because it is something everyone already does.
no, it's just more work, and it's not like facebook could not afford to pay more people
Ad pipeline is malware at this point.
Always has been.
Occasionally my girlfriend will comment on something she saw in an ad, even buy things off them. Thing is though that ad platforms don't seem to be doing anything meaningful to stop bad actors.
So really, clicking any ad and interacting with it amounts to placing your trust in a total stranger with the only criteria being they paid a little bit of money for you to see them. To which you will then download their software, give them your credit card, or whatever the end goal is.
It's far easier to assume anything in an advertisement is a scam and block them accordingly.
So you'd think that a sophisticated tech company that had paid that financial penalty would find it pretty easy to have a simple text filter for "Martin Lewis" and perhaps even an image filter for his very distinctive face which pushed those ads into a moderation queue, particularly if they both appear together in the scam-ridden investment opportunity category and the advertiser is a new one (that's probably not going to stick around under that name for very long). But no, they remained a common theme for years afterwards...
And, as the sibling ad points out, if you report stuff that's obvious scams you get told they've reviewed it and found it to be OK. Plus you get more of it promoted into your feed because hitting the report button is a form of interaction with it...
I actually had some sympathy for Facebook when they were condemned for not moderating fake news from Myanmar they have no real capacity to moderate, or condemned for daring to slap the gentlest of content warnings on antivax stuff in contexts they understand perfectly well... but when it comes to ads they get paid for, which is a much smaller fraction of Facebook content that is unambiguously not protected speech or a matter of opinion, their lack of effort is quite something to behold.
Well that means don't do the thing that you can't control, or they shouldn't be legally allowed to do the thing they can't control.
Additionally, for one of the biggest companies in the planet, that has done mind bogglingly difficult things in order to make profit, that's the lamest excuse ever.
Fine them out of existence.
They could just set the minimum ad spend at a level that makes moderation possible.
Let's say it costs $15 to have a human spend 15 minutes checking an ad. If the minimum spend per ad is $100 it'd easily cover the costs of the check. And I imagine most ad campaigns are spending a lot more than $100.
How is this our problem? We make the rules, the obey them. If they can't they ought to be shut down. If they want to argue that at their scale they can't abide by the rules society lays down for them we can cut them down to something human sized.
For software, sometimes paying off that debt means getting rid of some of your features/code/stuff. i.e. there's another alternative to "let's AI the AI".
scale the business down. shrink the number of users. make less money.
It doesn't matter how many people are consuming the ads, it matters how many companies are placing the ads.
Let's not invent excuses for the trillion-dollar tech companies. Meta has plenty of money to put humans in the loop. It just chooses not to because some upper manager needs to buy a fifth house, or a third private island.
In this case, we are talking about ad images.
1000 moderators x 5 second per image to click deny or approve.
So 1000 moderators review 720000 ads/hour
Per 8 hour workday: 5,760,000 ads
Per full 24h day: 17,280,000 ads
So we will use 3k for 3 shifts.
51,840,000 new image ads moderated per day.
At ~$1,000 per moderator per month (most jobs are outsourced to Africa and Asia):
$3 million per month $36 million per year
I don't see any public numbers for how many new ads they add daily but meta reported removing 159 million scam ads during 2025, so equivalent to around 436,000 scam ad removals per day.
They can also choose to show fewer ads, i.e., only show manually human reviewed ads, and if there are too many to review, charge more per ad until there aren't too many.
Just because the social property giant corporations steal is somewhat abstract doesn't change any of the fundamentals of right and wrong. I'm so tired of this ultra-capitalist "right to be massive" assumption which places the value of unhinged monopolistic growth over maintaining social commons. What these companies "should do" is face penalties until they can safely manage their scale, or scope their scale to a level they can maintain safely.
Secondly, if I’m wrong and it’s not possible, then you stop providing the dangerous service! There’s no reason Meta has to exist in its current form. If it can’t meet basic standards of human dignity in its product offerings, then it should change or cease to exist.
And my point here is, we're in this great revolution of AI empowered everything and... these companies can't be bothered to scan this volume of AI ad slop to make sure we're not being actively scammed? Or having porn or CSAM spread? I understand it's a "perverse incentive" in the truest sense: they make money by taking the scammers money, but I was scammed once by an insanely clever lookalike Facebook ad, and had trusted their verified checkmark (about a decade ago)... with AI, these things should be a thing of the past.
If you are downvoting this please explain why, it’s important that we come to a shared understanding how these things are ever okay for corporations and not individuals…
You don't have Metas legal team nor does the power structure find your valuable to have helping them out nor can you harm them if you don't like them.
There was, quite famously, a man who got away with these sorts of things for quite some time. He owned an island. I can't recall his name....
If Zuckerberg wants total voting control, then he can also deal with the consequences of being caught hosting CSAM.
I wonder if we could learn anything from these cranky old timers.
So it's the SAME AD PLATFORM? Even in MESSENGER? My god. Not only is this whole thing horrible but it's doubly so
The truth is impunity is the rule, victims especially of CSA and CSAM, or revenge porn, or of Mark or Musk's companies generating naked images of their body have basically no power, and its an exception when someone who is an abuser AND has any amount of social standing is put away.
but, plenty of people do end up in prison, especially if its facebook/dropbox/gmail/etc... they just dont make the headlines (especially nationally) unless its especially heinous.
That is literally what "freedom" means in the US. It's not the pursuit of happiness, it's the pursuit of immorality without consequences.
If this isn't obvious - how many people mentioned in the Epstein files have been arrested?
No, not at all.
"removing over 36 million pieces of child sexual exploitation content last year"
Not CSAM.
Yes. So?
> What are you saying the difference is?
Child sexual exploitation content is broader.
Also how much of the child exploitation material was created by the children themselves?
Teenagers who send each other nude photos are creating child exploitation material but you hardly want to put them jail for that.
Well rational thinking people wouldn't. A great many using CSAM as a wedge to de-anonymize the Internet or institute regressive "profanity" laws are often neither.
They forget most child abuse happens in the family.
“Just stop using meta properties then”. Sure but some of us have wives, friends, etc
Again, and again, and again, these technologies have proven ineffective to moderate content. User posted and otherwise. Until we have a legal mechanism in place to hold these companies meaningfully liable for this, it will not stop.
Every single one of these has the same damn list of excuses about cost of hiring human moderators, but I promise everyone reading this if you make the executives of a social network legally liable for distributing CSAM on their platforms, they will find all kinds of money to get human moderators really fucking quick.
Not only are their AI tools ineffective at what they claim they should be doing, they can't even be bothered to prevent removed ads from being re-uploaded later on.
As for the cost of content moderation, Meta has zero interest in any type of moderation to begin with. The cost is just a public-facing excuse. In Careless People, Wynn-Williams mentions that Facebook didn't do anything to stop anti rohingya posts in Myanmar because they did not have any fact checkers who could read Burmese. In other words, they did not have a single moderator in the damn country.
On the other hand, now try to ban that telecom. Gods will laugh.
The eternal question of tech platforms - should we be responsible for what users post? (Ads are not user posted, so we can eliminated that factor. Even if posted by 'users' it's a separate pipeline) But with companies like Meta it doesn't even have to go that far - the philosophical conversation - because it's so hostile to users. People get banned for mild things all the time (apparently extra the case, since the 'pivot' to AI) while the absolutely horrible things you report never get taken down
I would never say a platform has to be responsible for what a user posts, and to be clear, I mean either a user of the platform, or a user of the platform's ad tooling, or anything else. Anything that arrives via an upload button of some sort. However: If you as a platform then distribute what has been posted, yes, you are responsible for it. Your service is now broadcasting that content. If that content is harmful, you should be held responsible.
Who else conceivably could be? And if the response to this is "well we have way too much stuff coming in to moderate it" okay, then restrict how much stuff comes in. Require approval on individual posts or on accounts.
Like, this is such basic shit. If a newspaper printed CSAM on the front page, they would be arrested within the day. But because Facebook is real super big they just don't have to take care of their house? Ridiculous.
I'm just bemoaning the fact FB can't even pretend they care when they're so busy banning people for nothing
Part a) https://news.ycombinator.com/item?id=24201306 part b) https://news.ycombinator.com/item?id=24776748
---
This is sarcasm, by the way. Most decent people make sure what they're about to do won't harm other people and if would cause harm they wouldn't do it. But social media companies and ad networks aren't run by decent people. They're run by people who believe their business is entitled to infinite scale regardless of how many people are harmed along the way.
you say sarcasm, but i think this is literally true.
this isn't a defense of facebook, i think that their scale makes it actually impossible (while remaining a going concern). the result should be that they arent allowed to operate at a scale that they cant handle, instead of being able to brush it under the rug every ~6 months when an incident hits the news cycle.
it would require millions on millions of employees, spread across ~every country. between the payroll, buildings and property, equipment, etc. i just dont think its possible at that scale.
(again, emphasizing that im not saying this as an excuse for facebook, but that i dont really think facebook/instagram should exist at all)
Certainly it’s not unreasonable to have them disprove that
And the scope could be further reduced by looking at posts with more then a few views.
the comment that started this thread says:
"these technologies have proven ineffective to moderate content. User posted and otherwise"
which is what i (and i assumed the parent to my comment) was replying to. i agree that paid ad campaigns alone is more tractable.
Well, tough. Maybe they should have to find a way. If that means requiring everybody to have to pay to afford the moderators then so be it. All the other companies would have to as well.
right, that was my point.
Who ever said that companies should have the right to exploit network effects to dominate online communications?
One of the more perverse aspects of risk prevention is that riskier customers are often way more lucrative. It's kind of inherent to the notion that markets price risk into transactions. The thing is, illegal behavior is also just a particular kind of risk: if someone wants to sell nudify apps or scam old people, Facebook could conceivably be on the hook[0] for damages if they're caught. And in a sense, a risk premium is just a fancy kind of bribe: if Facebook won't take my ads because they think they're too risky, then I'll just pay more and more until Facebook accepts them.
With illegal behavior, we hope that we can make the punishment high enough that Facebook refuses any conceivable risk premium the perpetrators of that behavior would be willing to pay. The problem is that Facebook is really desperate for any increasing growth story, and when you're too big to fail, your growth story is to drip-feed enshittify your stack. Increasing tolerance for illegal behavior is downstream of this: you cut enforcement, tell them to automate more, they become easier to bypass... and you make more money. Because it turns out all that risky behavior... is only risky for normal people. Facebook can launder[1] the risk away and make a tidy profit.
[0] Do not tell me about CDA 230, I was there when the old magic was written.
[1] See also, HSBC turning themselves into a literal money laundering operation.
Make that the policy, and I'd bet my life savings that Facebook, miraculously, will figure out how to detect this shit with bulletproof accuracy.
When people started using Grok to make CSAM the platform's response was to paywall image generation. If we don't start making the driver responsible for what the car does, the coder responsible for what the code does, the CEO responsible for what the company does, they will continue to exploit people in increasingly horiffic ways.
How on earth can they know?
This is why they pushed for the change from “child porn” to “child sexual assault material” because LOTS OF THINGS can be “materials”.
https://www.engadget.com/2231100/meta-apps-displayed-ads-tha...
That serves as an example, a deterrent. "Clean up the act, or you too can go from being a hyper-wealthy executive to the biohazard cleanup detail in a cell block at Leavenworth."
Income is for daily necessities and long term investment.
Are there reasons why Brexit might have been popular? Yes, in the sense I've heard about them. Should we then be blaming Facebook?
The problem is consolidated power. Carole herself said in her talk that it's not about Trump vs no Trump (sorry. It's been a bit since I've seen the talk. I shouldn't just paraphrase), it's about citizens' right to meaningfully choose in an information landscape
This is the problem with Facebook. It becomes an Everything App. Who cares about fraud (say, on marketplace, needless to say the site itself, the way it's screwed over businesses) on the platform when you can grow big? Let's say in this case, the actual case I'm commenting on - "Facebook didn't know". Well then that's the problem, isn't it? It's a company set up by someone of low moral reasoning (https://news.ycombinator.com/item?id=1692122) that doesn't set out to make a good product, something people will actually like. It's about dominating an industry and ads can be totally unvetted or scummy or scammy if it enables them to do this