denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)
Denise ([staff profile] denise) wrote in [site community profile] dw_maintenance2023-09-24 04:49 pm

A heads up on spam prevention measures

Due to recent increases in spam account registration (over and above the already-high baseline levels of spam account registration!) and the amount of our administrative time that dealing with spam is costing us, it's highly likely we will need to start playing around with more aggressive measures to block spammers in the next few weeks. We already use quite a few spam account creation prevention techniques, but there's been a worldwide increase in the amount of abusive/spam traffic over the last six months or so, and we're at the point where we need to start getting much more aggressive about filtering it.

Generally speaking, we try to use the least restrictive measures of spam blocking that we can, because any form of spam blocking can impact legitimate use of the site. If you start getting 403 errors when accessing the site, or you are asked to solve a captcha from our hosting provider (the graphical captcha that shows on a separate page, not the text-based one that shows on the same page) before proceeding to the page you're trying to load, and you are not using a VPN service, please email support@dreamwidth.org with your IP address and let us know. If you don't know your IP address, you can look it up at whatismyip.com.

If you are using a VPN provider and you get these errors, I am incredibly sorry, but we probably won't be able to help. We know that many of our actual-person users use VPNs for privacy and security reasons or to circumvent government restrictions on accessing the site, and we are trying our very best to keep those services able to access Dreamwidth. Unfortunately, VPN services are also a major source of our abusive traffic, especially the free ones, and it's impossible for us to distinguish legitimate traffic from abusive traffic automatically. You are less likely to have problems with paid VPN services, but even those are the source of a lot of spam: our two main VPN sources of abusive traffic are NordVPN and Proton VPN. We're trying very, very hard to not have to block VPN services entirely, but the problem is getting much worse. If you subscribe to either, you may want to contact them and tell them that you've been having problems accessing sites you regularly use because of the amount of abusive traffic that comes from their network.

We will continue to tweak our spam prevention measures as much as we can to avoid interfering with legitimate traffic, and I apologize in advance if we wind up temporarily interfering with your use of the site as we try to stop the garbage we're drowning in.
the_broken_tower: (Default)

[personal profile] the_broken_tower 2023-09-24 09:00 pm (UTC)(link)
Completely understandable and unfortunate the abusive traffic is becoming such a problem. Thanks for the heads up!

- Ellie (she/her)
(reply from suspended user)
havocthecat: the lady of shalott (Default)

[personal profile] havocthecat 2023-09-24 09:04 pm (UTC)(link)
Can you give us a heads up if you plan on blocking any of the VPN services? I use a paid VPN for my own reasons and I totally support your spam-blocking measures! But I would like to know if I need to alter my Dreamwidth access processes if I have to. Which I will do in order to keep supporting you.

And I'll try letting them know, but uh, you know. Idk how much it'll work.
havocthecat: the lady of shalott (Default)

[personal profile] havocthecat 2023-09-25 07:51 pm (UTC)(link)
You folks are way better at knowing what to do than I!
ninetydegrees: Art & Text: heart with aroace colors, "you are loved" (Default)

[personal profile] ninetydegrees 2023-09-24 10:09 pm (UTC)(link)

Thanks for the heads-up! That explains the captcha I get :)

vesper_evensong: (Expressions - Thank You 2)

[personal profile] vesper_evensong 2023-09-24 10:46 pm (UTC)(link)
Thank you for your efforts in these areas. It has made DW a very decent place to be. I migrated from LJ because it's hard to use for Americans now, and as I've used DW I have appreciated the regular updates on things, and how hard you all work to keep things up and running smoothly.
(reply from suspended user)
nerakrose: drawing of balfour from havemercy (Default)

[personal profile] nerakrose 2023-09-24 11:06 pm (UTC)(link)
Ah that confirms why I was getting 403 error messages when I had my VPN on the other day (I use NordVPN). I did figure it was a VPN thing as I’ve run into similar on other sites so didn’t log an error message. It’s not a big deal for me, though I understand it might be more of an issue for others.

I was wondering, and this may not be viable at all, is it possible to flag and exempt logged in accounts that use VPNs so this doesn’t happen for them? As in, my user account at fanlore has that kind of account flag (I reached out to them about it) so that I can access and edit entries even when my VPN is on, that was something they were able to do. The infrastructure here may be completely different though so this may not be a helpful suggestion at all!
devilc: Go Like Hell (Default)

[personal profile] devilc 2023-09-25 02:46 am (UTC)(link)
I would just like to echo this suggestion.
twoeleven: Hans Zarkov from Flash Gordon (Default)

[personal profile] twoeleven 2023-09-25 04:21 am (UTC)(link)
I support this as well, since I'm another VPN user.
innitmarvelous_og: (Default)

[personal profile] innitmarvelous_og 2023-09-25 04:48 am (UTC)(link)
Me as well as I also use a VPN.
thesaltinstitute: A brook bordered by moss-covered rocks. (Default)

[personal profile] thesaltinstitute 2023-09-25 07:40 am (UTC)(link)

Also in support of this!

amalthia: (Default)

[personal profile] amalthia 2023-09-25 06:23 pm (UTC)(link)
As a VPN user I second this suggestion as well.
Edited 2023-09-25 18:23 (UTC)

[personal profile] pinterface 2023-09-26 12:44 am (UTC)(link)

Hrm... since the hosting provider MITMs at the HTTP level, (and without being at all familiar with the methods they provide) my first pass idea would be something like the following:

DW sets a "probably-human" cookie for logged in users that amounts to something like v1:nonce:expiration-timestamp:hmac(v1:nonce:expiration-timestamp:secret). The host service could look for that cookie, validate it (either by the secret being shared, or by a callback which lets you process it), and allow or deny the user based on that validation.

Now, that only works after a user has authenticated at least once, doesn't help at all with signups, would happily allow through an attack using Selenium or whatever (absent any other bot detection prior to setting the cookie, anyway), and probably has a few other drawbacks. So maybe not worthwhile even if technically possible.

(And now I spend ten minutes debating with myself whether this is worth posting, both because it's not a full solution and because y'all are technical enough you'd probably have done it already if it was an option and made sense.)

[personal profile] pinterface 2023-09-26 02:48 pm (UTC)(link)
Oh, Cloudfront? In that case you could do a Lambda @ Edge, which looks for the cookie and verifies the signature ...

... But even if you could bear the additional cost, that still only helps if Cloudfront lets it get that far before DDOS-style filtering. Which it probably doesn't, because the whole point is to drop bad traffic as early as possible.

Gah. The fact capitalism effectively encourages exploiting negative externalities for profit really ruins a lot of otherwise nice things.
morrow: (💋)

[personal profile] morrow 2023-09-24 11:09 pm (UTC)(link)
Fair enough!
watersword: Keira Knightley, in Pride and Prejudice (2007), turning her head away from the viewer, the word "elizabeth" written near (Default)

[personal profile] watersword 2023-09-24 11:15 pm (UTC)(link)
Thanks, I hate it! (I don't hate you, D. I hate that spam is still a problem.)

[personal profile] corbiecore 2023-09-26 01:12 pm (UTC)(link)
I was blearily looking for the like button before I realized which platform I was on, lol.
house_wren: glass birdie (Default)

[personal profile] house_wren 2023-09-24 11:58 pm (UTC)(link)
Thank you for all your work!
scissorsevered: (Default)

[personal profile] scissorsevered 2023-09-25 12:22 am (UTC)(link)
Maybe some sort of invitation system would work for curbing spam accounts, similar to how AO3 runs their signups? I know it would place a damper on the number of people signing up at a time but it would seriously reduce the number of accounts being made just to spam.

This isn't me trying to say what you're doing isn't good, because we all really do appreciate the hard work you put into running this site! I'm sure trying to block spam and ensure user privacy at the same time is a pain in the ass lol. But we have faith in you :D
medusahealing: (Default)

[personal profile] medusahealing 2023-09-25 02:08 am (UTC)(link)
Funny enough, DW actually started with an invitation system. You had to have an invite to set up your account.
jeweledeyes: Pretty Guardian Sailor Moon (Default)

[personal profile] jeweledeyes 2023-09-25 05:35 am (UTC)(link)
I totally forgot about that. I got my account through an invite code!
the_broken_tower: (Default)

[personal profile] the_broken_tower 2023-09-25 05:24 pm (UTC)(link)
Oh wow, how long ago was that? :0 Was there a limited number of times you could send invites?

- Izar (he/him)
jeweledeyes: "'Popular Science'? More like Nerdular Nerdence." (Nerdular nerdence)

[personal profile] jeweledeyes 2023-09-25 05:42 pm (UTC)(link)
I thought it might have been 2009, but my profile page says it was 2010. 13 years ago, dang!

As for how many codes, I don't remember that much, so I tried searching. I found some posts with people with multiple codes, so it wasn't limited to just one, but I don't remember beyond that 😅 And it looks like they opened registration in December 2011, based on this post and this post.
elderwitty: (art judith and her maidservant)

Dam spam!

[personal profile] elderwitty 2023-09-25 02:22 am (UTC)(link)
Thank you for fighting the scourge that is spam!

Is this why I've needed to login two days in a row? It's usually only a couple of times a month or so.

(I'm not upset, just curious.)
elderwitty: (ow)

Re: Dam spam!

[personal profile] elderwitty 2023-09-26 02:28 am (UTC)(link)
Thanks for the info!

It kept me logged in today, so maybe it was just an anomaly. I hope it's not an extension, because I only have six of them. :D
kore: (Default)

[personal profile] kore 2023-09-25 05:29 am (UTC)(link)
BOO SPAM. I was followed by at least twenty empty pornbots on Tumblr last week. I've given up playing whack-a-mole with them. I am so glad DW fights spam with a fury!
innitmarvelous_og: (Default)

[personal profile] innitmarvelous_og 2023-09-25 05:42 am (UTC)(link)
Aren't the p*rnbots on Tumblr awful? I am soooooooooo sick of them too, especially the ones that are not an empty account!
kore: (Default)

[personal profile] kore 2023-09-25 05:44 am (UTC)(link)
The only thing I am more sick of than the non-empty pornbots are the Only Fans-type "Tumblr Live" accounts which have shown me dick picks more than once! Which you can't turn off!
innitmarvelous_og: (Default)

[personal profile] innitmarvelous_og 2023-09-25 06:09 am (UTC)(link)
Yeah those would be the non-empty ones I hate! I've learned to be super cautious when seeing what the accounts are!
scissorsevered: (Default)

[personal profile] scissorsevered 2023-09-25 01:15 pm (UTC)(link)
The big wave of pornbots is probably the one bad thing about Tumblr allowing NSFW again.
innitmarvelous_og: (Default)

[personal profile] innitmarvelous_og 2023-09-25 04:41 pm (UTC)(link)
Yeah, things will always be abused in some way. *sighs*
profiterole_reads: (Default)

[personal profile] profiterole_reads 2023-09-25 11:50 am (UTC)(link)
I usually report them, but when I don't, they usually disappear in a few days from other people reporting them. Fortunately, it's not as bad on DW.
profiterole_reads: (The Old Guard - Joe and Nicky)

[personal profile] profiterole_reads 2023-09-26 12:32 pm (UTC)(link)
It's all in your honour that I don't notice it's as bad from my side of things. I hope you'll find a way to save yourselves some time.
ganimede: keys (Default)

[personal profile] ganimede 2023-09-26 06:25 pm (UTC)(link)
I had no idea you checked every new account, that has got to be going above and beyond! Four hours is a lot of time that could probably be better spent elsewhere on the site. Is there any way some of that workload could be taken off you by a small select group of volunteers?
ganimede: keys (Default)

[personal profile] ganimede 2023-09-27 05:55 pm (UTC)(link)
I didn't realise that some of the spam accounts had got so clever as to make that access necessary. Eugh, that does make it harder. And it must be such a pain when you don't have the time to create a system to fight spam accounts because you're so busy fighting spam accounts but also not so busy fighting spam accounts to require the system... I think that just broke my brain.
vriddy: Dreamwidth sheep with a red wing (dreamsheep)

[personal profile] vriddy 2023-09-25 05:36 am (UTC)(link)
Sorry to hear spam is becoming an even worse problem. Thank you for all the good work!
ex_flameandsong751: An androgynous-looking guy: short grey hair under rainbow cat ears hat, wearing silver Magen David and black t-shirt, making a peace sign, background rainbow bokeh. (reactions: down with this sort of thing)

[personal profile] ex_flameandsong751 2023-09-25 07:09 am (UTC)(link)
Thank you for staying on top of the spam, which sounds super annoying to deal with.



Since other people brought up that DW used to have invite codes [and Ao3 still does], might it be possible to re-implement this? Would it have at least some impact on the amount of spam account registrations?
tessitura: iconriot @ dw (Default)

[personal profile] tessitura 2023-09-25 01:58 pm (UTC)(link)
While I am not trying to speak for them, my best guess as to why they don't use invite codes now is the large amount of roleplayers on the site.
ex_flameandsong751: An androgynous-looking guy: short grey hair under rainbow cat ears hat, wearing silver Magen David and black t-shirt, making a peace sign, background rainbow bokeh. (!The Squad: Sören: hrmm)

[personal profile] ex_flameandsong751 2023-09-25 06:14 pm (UTC)(link)
Hmmmm. RPers could still get invite codes though, yes? Ao3 used to generate X amount of invite codes per person, I forget the exact number, but if DW gave each user X amount of invite codes, conceivably someone who had alts for RP purposes and/or had friends wanting to RP could grab one of those and if they ran out they could sign up and wait 1-2 weeks for more, or there might be an invite code sharing comm where people could post their unused invite codes for others?

Like I said, I don't know how much of an impact this would make with spam, and Denise would probably know the answer to this.
morrow: (Default)

[personal profile] morrow 2023-09-25 08:36 pm (UTC)(link)
What about “hiring” volunteers who, with a bit of training, do the detecting? I’d do it!
pauamma: Cartooney crab wearing hot pink and acid green facemask holding drink with straw (Default)

[personal profile] pauamma 2023-09-25 09:00 pm (UTC)(link)
Dreaamwidth already does that, although I don't know what the application and training process is these days. (I started in 2010 or so.)
ex_flameandsong751: An androgynous-looking guy: short grey hair under rainbow cat ears hat, wearing silver Magen David and black t-shirt, making a peace sign, background rainbow bokeh. (reactions: Kermit scrunch face)

[personal profile] ex_flameandsong751 2023-09-25 08:56 pm (UTC)(link)
Thank you for explaining this, and that makes sense. You guys deserve free coffee and cookies for life for dealing with the annoying spam.
murphys_lawyer: The avatar for Mozilla Firefox (Default)

[personal profile] murphys_lawyer 2023-09-25 12:02 pm (UTC)(link)
Another vote for some sort of other check if you have a VPN. I use one of the ones you've mentioned, and while I'm resigned to always being "randomly selected" to take a Captcha every time I visit here, I absolutely loathe them, especially when I'm one pixel out on selecting something.
murphys_lawyer: The avatar for Mozilla Firefox (Default)

[personal profile] murphys_lawyer 2023-09-25 09:22 pm (UTC)(link)
Thanks for replying, and I appreciate your work on this. Truly.
groovesinorbit: (Default)

[personal profile] groovesinorbit 2023-09-25 01:26 pm (UTC)(link)
Thank you for all your hard work!
filialucis: (Default)

[personal profile] filialucis 2023-09-25 03:45 pm (UTC)(link)
Hmm, thanks for this detailed explanation of the issues. I use a different VPN and have been considering switching to either NordVPN or ProtonVPN when my subscription expires later this year. I'm less likely to do so now that I know that they're known sources of spam!
chestnut_pod: A close-up photograph of my auburn hair in a French braid (Default)

[personal profile] chestnut_pod 2023-09-27 02:00 am (UTC)(link)
Thank you for all the detailed responses to this post! It's inspired me to go look up some of those economics of spam: grim.

If you don't mind, could you name some of those bad-but-not-as-bad ones? Are there any paid VPNs that are solidly neutral or good in terms of not attracting spammers?
chestnut_pod: A close-up photograph of my auburn hair in a French braid (Default)

[personal profile] chestnut_pod 2023-09-27 03:19 am (UTC)(link)
Thank you for the Krebs recommendation. Perverse incentives are so often perversely interesting, even when they make you want to run into the mountains and live as a hermit.

I won't take your statements about Tunnelbear as a red-letter stamp of approval, but it's definitely helpful information to squirrel away, so thanks for that also!
mdlbear: blue fractal bear with text "since 2002" (Default)

[personal profile] mdlbear 2023-09-25 05:59 pm (UTC)(link)

Thanks for the heads-up, and for your good work. I'm not having any problems so far, but it probably explains the persistent CAPTCHAs I've been seeing on other sites.

chicklet_chatter: (Castle)

[personal profile] chicklet_chatter 2023-09-26 01:24 am (UTC)(link)
Thank you for the update. I was seriously considering going to VPN soon. This is a major point against that option. Thank you very much for informing us!

Chicklet - They/Them
arkessian: (Default)

[personal profile] arkessian 2023-09-26 01:54 pm (UTC)(link)
Can I steal some of these words for a site I moderate where VPN users are getting annoyed (nay, abusive) because they're being blocked by our spam filtering service.
arkessian: (Default)

[personal profile] arkessian 2023-09-27 07:12 am (UTC)(link)
Thanks.
lovingboth: (Default)

[personal profile] lovingboth 2023-09-26 03:20 pm (UTC)(link)
Yep, sympathy. I do consultancy for a message board and what used to be a problem with Tor exit nodes is now a problem with VPNs... as well.

albedinous: A cross-stitched owl on blue fabric, partially complete. (Default)

[personal profile] albedinous 2023-09-28 12:14 am (UTC)(link)
Thank you, Denise! I'm not affected by VPN issues, but appreciate the heads up; four hours is SO much spam-detection, my goodness.

I'm going to go renew my paid account, because you guys seriously deserve a coffee after all this.
pritkiy_kaban: (Default)

[personal profile] pritkiy_kaban 2023-09-28 12:12 pm (UTC)(link)
Yup, browser plugins and Proton tend to trigger (almost) blanket 403 when using free plans.

Knowing how deeply spam and ad industries metastased into current Web economy, I hate them filters much like I hate lying in dentist's chair for costly treatment of acute pulpitis.
Edited 2023-09-28 12:16 (UTC)
omnicat: (Default)

[personal profile] omnicat 2023-09-28 08:53 pm (UTC)(link)
I remember you mentioned an unusually steep, internet-wide uptick in spam this year in an earlier Maintenance post too. Do you peeps in the business have any indication of the reason this is happening?
cellio: (Default)

[personal profile] cellio 2023-09-29 12:55 am (UTC)(link)

Thank you, as always, for your thoughtful and transparent communication, and for the great service. I was wondering why I was getting those captchas (I just started using AdBlock VPN). I can disconnect when using DW, and don't mind that minor hassle to help the spam monster from expanding even more. Grr, spammers ruining things for all the rest of us...

cellio: (Default)

[personal profile] cellio 2023-09-29 01:48 am (UTC)(link)

It sure is. Thank you for continuing to fight the good fight for your users! Locking everything down thoroughly would be easier but less friendly, and I appreciate your ongoing attempts to place as few barriers as you can in front of legitimate users.

redwolf: (Default)

[personal profile] redwolf 2023-09-29 08:11 am (UTC)(link)
Huh. I wonder if this is the same bullshit I'm being inundated with on a corporate mailing list.

Page 1 of 2