denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)
Denise ([staff profile] denise) wrote in [site community profile] dw_maintenance2026-04-11 11:58 pm

The case of the missing notifications

I keep forgetting to post about this: we've been troubleshooting the "missing notifications" problem for the past few days. (Well, I say "we", really I mean Mark and Robby; I'm just the amanuensis.) It's been one of those annoying loops of "find a logical explanation for what could be causing the problem, fix that thing, observe that the problem gets better for some people but doesn't go away completely, go back to step one and start again", sigh.

Mark is hauling out the heavy debugging ordinance to try to find the root cause. Once he's done building all the extra logging tools he needs, he'll comment to this entry. After he does, if you find a comment that should have gone to your inbox and sent an email notification but didn't, leave him a link to the comment that should have sent the notification, as long as the comment itself was made after Mark says he's collecting them. (I'd wait and post this after he gets the debug code in but I need to go to sleep and he's not sure how long it will take!)

We're sorry about the hassle! Irregular/sporadic issues like this are really hard to troubleshoot because it's impossible to know if they're fixed or if they're just not happening while you're looking. With luck, this will give us enough information to figure out the root cause for real this time.

mark: A photo of Mark kneeling on top of the Taal Volcano in the Philippines. It was a long hike. (Default)

[staff profile] mark 2026-04-12 05:33 am (UTC)(link)

I've added a bunch of debugging -- if someone can share a link to a comment that should have shown up in your inbox or email and didn't, please comment here and share it! Thank you.

damnedest: (Default)

[personal profile] damnedest 2026-04-12 06:18 am (UTC)(link)
https://damnedest.dreamwidth.org/371.html?thread=1583219#cmt1583219

just did a bunch of replying to myself and produced this one that didn't send a notification!

(no subject)

[staff profile] mark - 2026-04-12 06:21 (UTC) - Expand

(no subject)

[personal profile] damnedest - 2026-04-12 06:23 (UTC) - Expand

(no subject)

[staff profile] mark - 2026-04-12 06:32 (UTC) - Expand

(no subject)

[personal profile] damnedest - 2026-04-12 06:33 (UTC) - Expand

(no subject)

[staff profile] mark - 2026-04-12 06:42 (UTC) - Expand

(no subject)

[personal profile] damnedest - 2026-04-12 06:43 (UTC) - Expand

(no subject)

[staff profile] mark - 2026-04-12 06:54 (UTC) - Expand

(no subject)

[personal profile] damnedest - 2026-04-12 06:58 (UTC) - Expand

(no subject)

[personal profile] damnedest - 2026-04-12 07:02 (UTC) - Expand

(no subject)

[staff profile] mark - 2026-04-12 07:08 (UTC) - Expand

(no subject)

[personal profile] damnedest - 2026-04-12 07:36 (UTC) - Expand

(no subject)

[staff profile] mark - 2026-04-12 07:43 (UTC) - Expand

(no subject)

[personal profile] slukh - 2026-04-12 20:44 (UTC) - Expand
graveling: (backache)

[personal profile] graveling 2026-04-12 07:04 am (UTC)(link)
Would it be helpful to tell you about threads where notifs are arriving late, or is this just for completely missing ones?

(Someone posted a link to this post on RPAnons, so the RP community is here to support you!)

(no subject)

[staff profile] mark - 2026-04-12 07:07 (UTC) - Expand

(no subject)

[personal profile] graveling - 2026-04-12 07:09 (UTC) - Expand

(no subject)

[staff profile] mark - 2026-04-12 07:10 (UTC) - Expand

(no subject)

[personal profile] kore - 2026-04-12 08:35 (UTC) - Expand
kalloway: A close-up of Rocbouquet from Romacing SaGa 2 (Default)

[personal profile] kalloway 2026-04-12 10:02 am (UTC)(link)
https://spring-renewal.dreamwidth.org/51244.html?thread=52012#cmt52012 - part of a comment chain where I received inbox/email replies from the same account.

https://kalloway.dreamwidth.org/2039132.html?thread=17682268#cmt17682268 - own journal.

https://communal-creators.dreamwidth.org/41892.html?thread=556452#cmt556452 - first one I realized I hadn't gotten (because I went to reply to others).
veronyxk84: Clipart: OpenClipart-Vectors (Default)

[personal profile] veronyxk84 2026-04-12 01:32 pm (UTC)(link)
https://su-editors.dreamwidth.org/521858.html?thread=1901442#cmt1901442

Hi!
I didn’t get an inbox or email notif for this reply to my comment.
Not sure if there's anything you can do since the community access is restricted to members, but I thought I'd let you know anyway.

I was expecting an inbox to [personal profile] veronyxk84 but it’s not there.


ETA: maybe these are more helpful.
I sent a comment + comment reply to my own journal and so far I got no inbox or email notifications.

https://veronyxk84.dreamwidth.org/2026/04/11/bjkcup-qualifiers-2026-italy-finals.html?thread=292093#cmt292093
Edited (Info added) 2026-04-12 13:44 (UTC)

(no subject)

[staff profile] mark - 2026-04-12 17:05 (UTC) - Expand

(no subject)

[personal profile] veronyxk84 - 2026-04-12 17:59 (UTC) - Expand
vixenish: (Default)

[personal profile] vixenish 2026-04-12 03:57 pm (UTC)(link)
Is it alright if it's a few days old? I can definitely recall a specific one that never showed up to either my email or my DW inbox and I can definitely track it down; it should have shown up for this journal in specific!

(no subject)

[staff profile] mark - 2026-04-12 17:12 (UTC) - Expand

(no subject)

[personal profile] vixenish - 2026-04-12 17:15 (UTC) - Expand

(no subject)

[personal profile] vixenish - 2026-04-13 00:33 (UTC) - Expand
sovay: (Rotwang)

[personal profile] sovay 2026-04-12 04:39 pm (UTC)(link)
if someone can share a link to a comment that should have shown up in your inbox or email and didn't, please comment here and share it!

The problem seems to have resolved itself since your debugging efforts, but between April 4th and 11th I had a ton of notifications go missing. Would it be useful to link any of those comments?

(no subject)

[staff profile] mark - 2026-04-12 17:13 (UTC) - Expand

(no subject)

[personal profile] sovay - 2026-04-12 17:14 (UTC) - Expand

(no subject)

[personal profile] sovay - 2026-04-13 02:00 (UTC) - Expand
aperturesubject0001: (Default)

[personal profile] aperturesubject0001 2026-04-12 05:14 pm (UTC)(link)
https://getclustered.dreamwidth.org/1575.html?thread=59175&style=site#cmt59175

[personal profile] sindarking's comment at 12:20pm UTC, replying to [personal profile] aperturesubject0001's comment, didn't appear in my DW inbox or in my email notifications.

It may be worth noting that I've been getting inconsistent email notifs for this journal, [personal profile] aperturesubject0001, for a while, well before the current issues.

Thank you!
strifeborne: (Default)

[personal profile] strifeborne 2026-04-12 06:34 pm (UTC)(link)
https://strifeborne.dreamwidth.org/1268.html?thread=155636#cmt155636

i didn't receive a notification for this in email or my dw inbox!
restitui: (Default)

[personal profile] restitui 2026-04-12 07:54 pm (UTC)(link)
https://gouttelette.dreamwidth.org/1195.html?thread=24491#cmt24491


i didn't get a notif for this and maybe it's a case of slowness but just in case!
allgotrabies: (Default)

[personal profile] allgotrabies 2026-04-12 08:25 pm (UTC)(link)
https://allgotrabies.dreamwidth.org/25208.html?thread=1038456#cmt1038456 this one never showed up in my inbox (DW or gmail)!
opheliac: ✖ malagraphic (Default)

[personal profile] opheliac 2026-04-12 08:31 pm (UTC)(link)
https://cultmirror.dreamwidth.org/16203.html?thread=3362123#cmt3362123

Didn't receive this comment in my gmail or dw inbox.
littlemushroom: (mush265)

[personal profile] littlemushroom 2026-04-12 08:48 pm (UTC)(link)
Hello!

https://diademlogs.dreamwidth.org/31684.html?thread=11573444#cmt11573444
This reply from headhunt has not appeared in littlemushroom's inbox OR my e-mail.

Thanks for all your efforts, I'm sorry you've been handed such an annoying headache to try and sort out. I'll be back if I notice more ghosts /sad thumbs up
lotusflower: (a-010)

[personal profile] lotusflower 2026-04-12 09:13 pm (UTC)(link)
This one didn't show up in my inbox, however, the EDIT of the comment did. https://sticksandbones.dreamwidth.org/102629.html?thread=18418405#cmt18418405
(Should be the comment that has the subject "it's art, kanda. at least they didn't dress you up like tiedoll" from the user [personal profile] inkandhammer and the notification should go to this journal [ [personal profile] lotusflower ]!)

(no subject)

[personal profile] brokenboar - 2026-04-12 21:26 (UTC) - Expand

(no subject)

[personal profile] racingheart - 2026-04-12 21:30 (UTC) - Expand

(no subject)

[personal profile] pauraque - 2026-04-12 21:50 (UTC) - Expand

(no subject)

[personal profile] merged - 2026-04-12 21:54 (UTC) - Expand

(no subject)

[personal profile] placation - 2026-04-12 21:55 (UTC) - Expand

(no subject)

[personal profile] kureijii - 2026-04-12 23:58 (UTC) - Expand

(no subject)

[personal profile] rogueinladysclothing - 2026-04-13 00:18 (UTC) - Expand

(no subject)

[personal profile] fatalis - 2026-04-13 02:32 (UTC) - Expand

(no subject)

[personal profile] withoutvanity - 2026-04-13 02:41 (UTC) - Expand

(no subject)

[personal profile] cheapdivorce - 2026-04-13 10:53 (UTC) - Expand

(no subject)

[personal profile] bowtiedbones - 2026-04-13 11:29 (UTC) - Expand

(no subject)

[personal profile] chimericalclaw - 2026-04-13 15:41 (UTC) - Expand

(no subject)

[personal profile] topaytheprice - 2026-04-13 15:49 (UTC) - Expand

(no subject)

[personal profile] robust - 2026-04-13 16:16 (UTC) - Expand

(no subject)

[personal profile] savante - 2026-04-14 01:31 (UTC) - Expand

(no subject)

[personal profile] heroicdream - 2026-04-14 14:45 (UTC) - Expand

(no subject)

[personal profile] crossover_chick - 2026-04-15 03:53 (UTC) - Expand

(no subject)

[personal profile] crossover_chick - 2026-04-17 03:44 (UTC) - Expand

(no subject)

[personal profile] jesterlies - 2026-04-17 01:21 (UTC) - Expand

(no subject)

[personal profile] morganknight - 2026-04-17 01:44 (UTC) - Expand

(no subject)

[personal profile] garudas - 2026-04-17 03:28 (UTC) - Expand
moonhare: (carrots)

[personal profile] moonhare 2026-04-12 09:31 am (UTC)(link)
‘Real-time’ debugging :D Thank you for your diligence! I can’t say I’ve missed any notifications or not, my most frustrating issue is not being able to reach the site. “504 Gateway Time-out” has become a regular message here, though I got right in, albeit slowly, this morning.

Good luck with all, and know your work is appreciated. :o)
zavodilaterrarium: Shadow the Hedgehog with a serious expression. (Focused)

[personal profile] zavodilaterrarium 2026-04-12 10:40 am (UTC)(link)
Dunno about my notifs either, but I've also seen a few 504s and slow loading recently. Not with a particular consistency or frequency, but more than previously.

(no subject)

[personal profile] casket - 2026-04-15 08:37 (UTC) - Expand

(no subject)

[personal profile] rezni - 2026-04-12 19:48 (UTC) - Expand

(no subject)

[personal profile] ranunculus - 2026-04-12 20:12 (UTC) - Expand

(no subject)

[personal profile] selfburns - 2026-04-12 20:39 (UTC) - Expand

(no subject)

[personal profile] ingestion - 2026-04-12 19:56 (UTC) - Expand

(no subject)

[personal profile] sovay - 2026-04-12 21:06 (UTC) - Expand

(no subject)

[personal profile] treadswater - 2026-04-13 02:07 (UTC) - Expand

amanuensis

[personal profile] c_eagle - 2026-04-20 03:14 (UTC) - Expand

Re: amanuensis

[personal profile] moonhare - 2026-04-20 11:03 (UTC) - Expand
loganberrybunny: Drawing of my lapine character's face by Eliki (Default)

[personal profile] loganberrybunny 2026-04-12 09:33 am (UTC)(link)
Thank you for all the work you do! It's very much appreciated. That problem hasn't hit me, but coincidentally (or not, I don't know) an irritating issue I'd had for a few days whereby I haven't been able to switch cleanly between formatting types on the Create Entries page, eg Casual HTML to Rich Text Editor, has also gone away as of today. So thank you for that, whatever you did to fix it! :)
anneapocalypse: A blonde-haired Elezen character wearing a flower crown and glasses, grinning at a bluebird on her shoulder, with a tiny bluebird earring in the opposite ear. (Default)

[personal profile] anneapocalypse 2026-04-12 01:27 pm (UTC)(link)

Thanks for the update!

veronyxk84: Clipart: OpenClipart-Vectors (Default)

[personal profile] veronyxk84 2026-04-12 01:31 pm (UTC)(link)
EDIT: now posted correctly as a reply to the top comment. Sorry!
Edited 2026-04-12 13:33 (UTC)
thistleingrey: (Default)

[personal profile] thistleingrey 2026-04-12 03:14 pm (UTC)(link)
Thank you! (All my notifications have been fine so far.)
pronker: tala the sorceress from phantom stranger comics (Default)

[personal profile] pronker 2026-04-12 04:42 pm (UTC)(link)
Thanks for your tireless work on this splendid site - no problems here thus far, but I'll notify if any crop up.
dreamtigress: Rainbow Tiger Icon, made by Tiger Torre (Default)

[personal profile] dreamtigress 2026-04-12 05:48 pm (UTC)(link)
Sinceriously, thanks for all that y'all do to keep Dreamwidth working and wonderful!
kcmamu: (Default)

[personal profile] kcmamu 2026-04-12 11:47 pm (UTC)(link)
Hi! I keep trying to import the latest comments from my LJ, but so far without success. Could you please look into this? (And also add an option to limit the import to a specific timeframe—say, the last couple of months—rather than importing the entire LJ.) Thanks!
catinasock: A tabby kitten in a purple sock. (Default)

[personal profile] catinasock 2026-04-13 03:11 am (UTC)(link)
Thank you for keeping us posted!

I encountered a suggestion the other week that the DWRP community should retire [community profile] bakerstreet and start a fresh meme comm to mitigate the 504 errors and comment loading issues. Basically, IIRC, the idea was its massive accumulated post and comment count was getting to be too much for the site infrastructure to handle or something like that. Is that actually true? What about [community profile] fail_fandomanon and its (in)famously chonky backend?
Edited 2026-04-13 03:15 (UTC)
decembri: mine (Default)

[personal profile] decembri 2026-04-13 01:08 pm (UTC)(link)
I've been getting inconsistent inbox notifs all week, but this is the first time I've gotten neither the email notification (which I went through and double checked) nor the inbox notification.

Here is the specific comment: https://decadianetwork.dreamwidth.org/4316.html?thread=1331420#cmt1331420
barbaratp: https://sheliak.dreamwidth.org/125518.html (Default)

[personal profile] barbaratp 2026-04-17 06:32 am (UTC)(link)
Eu tenho tido é problemas com o carregamento das páginas em geral do site que às vezes não abrem e eu já fiz pedido de suporte e recebi mensagem dizendo que o problema era do meu lado e não do lado do site no entanto outras pessoas do meu convívio online do Brasil e de fora dele também tem tido instabilidade e até mesmo erros mais graves como página indisponível ou inexistente