denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (me, standing outside a broken phone booth)Denise ([staff profile] denise) wrote in [site community profile] dw_maintenance,
@ 2012-04-23 11:16 pm UTC
  • Previous Entry
  • Add to Memories
  • Tell someone about this!
  • Next Entry
We've got a disk that looks like it's about to fail in the machine we use to power site and journal search. We've turned off search indexing temporarily to reduce the number of writes to the disk (which will hopefully let us baby it along for a little while longer), and will be taking search entirely offline for a four-hour maintenance window with our hosting provider as soon as we can schedule a convenient time for the replacement -- either later this evening, or early tomorrow morning.

Indexing being disabled means that no new posts will show up in site search until after the replacement, and when the machine is entirely offline, visiting site or journal search will return a message saying that the feature is temporarily offline. Once the disk is replaced, it may take a day or two for the indexing to catch up with the stuff that was posted while indexing was off; we've been hovering around the point where it takes longer to run the script than the frequency with which we run the script, so it may take us a little while to catch up.

The data on the disk is completely backed up (and in a worst case scenario could be re-indexed anyway), so there won't be any risk. The only thing you should notice will be no new posts appearing in the search results until the replacement, and then a period of downtime while the replacement is performed.

(EDIT, 24 April 5AM EDT: The disk has now been replaced, the data is copied back over, and the indexing is running again and catching up on what was missed. And, for bonus points, [staff profile] mark found a place to optimize a bunch of database queries.)


(23 comments) - (Post a new comment)
(Threaded) (Top-level comments only)

dragondancer5150: (DragonDancer5150)


[personal profile] dragondancer5150
2012-04-24 03:47 am UTC (link)
Noted. =3 o7

(Reply to this


marahmarie: Sheep go to heaven, goats go to hell (sheep)


[personal profile] marahmarie
2012-04-24 04:01 am UTC (link)
Thanks for letting us know...

(Reply to this


kiaxet: (Brilliant!)


[personal profile] kiaxet
2012-04-24 04:25 am UTC (link)
I am continually impressed with just how well you guys communicate with your users and keep us informed. Thank you for being on top of it.

(Reply to this


automaticdoor: the <user name="dreamsheep"> rendered in glowing electric blue (dreamwidth electric sheep)


[personal profile] automaticdoor
2012-04-24 04:45 am UTC (link)
Thank you for telling us!! ♥

(Reply to this


azurelunatic: cameo-like portrait of <user name="azurelunatic"> in short blue hair.  (_support, cameo)


[personal profile] azurelunatic
2012-04-24 05:31 am UTC (link)
Thanks for the heads-up!

(Reply to this


sharpest_asp: the DW logo 'D' surrounded by words (General: Dreamwidth)


[personal profile] sharpest_asp
2012-04-24 05:57 am UTC (link)
Y'all are the bee's knees!

(Reply to this


msilverstar: (corset)


[personal profile] msilverstar
2012-04-24 06:21 am UTC (link)
How much traffic are you getting on search these days? And what are the top queries?

(Reply to this


denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (me, standing outside a broken phone booth)


[staff profile] denise
2012-04-24 06:29 am UTC (link)
I don't believe we record the queries being searched on, since it's not relevant information and wouldn't be useful for anybody to know! Site search is restricted to logged-in accounts (for performance reasons) and journal search is restricted to paid accounts (ditto) so I don't think the traffic is too overwhelming; I'm not sure if it's possible to separate out the traffic that goes to the search db from the traffic that goes to the search machine in general, and I think that machine is still dual-use as a webserver and the search db, which would mean the load balancer sending it traffic that was not purely search-related.

(Reply to this)  (Thread from start)  (Parent


kore: (Barbara Cooney - Persephone)


[personal profile] kore
2012-04-24 07:11 am UTC (link)
Thank you so much for letting us know! It's very reassuring.

(Reply to this


kore: (Dreamwidth on the xkcd map)


[personal profile] kore
2012-04-24 07:11 am UTC (link)
I am continually impressed with just how well you guys communicate with your users and keep us informed. Thank you for being on top of it.

Yes, exactly.

(Reply to this)  (Thread from start)  (Parent


sharpiefan: Ballet dancer (Dancer)


[personal profile] sharpiefan
2012-04-24 09:01 am UTC (link)
You guys are awesome at letting us know stuff! *hugs all the DW staff and volunteers*

(Reply to this


sparowe: (See)


[personal profile] sparowe
2012-04-24 09:03 am UTC (link)
^ This. :)

(Reply to this)  (Thread from start)  (Parent


slayedaking: (smirk)


[personal profile] slayedaking
2012-04-24 09:55 am UTC (link)
I would like to take a moment to tell you all that you are studs of the highest caliber. Seriously. You find places to make the site better at every turn and since there's no evidence that you're not superheroes, I am forced to assume that you are. Someone make an HBO show about you guys.

(Reply to this


denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (me, standing outside a broken phone booth)


[staff profile] denise
2012-04-24 09:56 am UTC (link)
Shhhh, you're going to break my cover.

(Reply to this)  (Thread from start)  (Parent


lannamichaels: Matt Smith holds two thumbs up, before heading into Certain Danger. Cap from season 5 promo trailers. (yay)


[personal profile] lannamichaels
2012-04-24 11:26 am UTC (link)
I don't believe we record the queries being searched on, since it's not relevant information and wouldn't be useful for anybody to know!

This is an actual relief, in the Google world. *has used journal search to find very weird things*

(Reply to this)  (Thread from start)  (Parent


montuos: boy with lightbulb over head (bright idea)


[personal profile] montuos
2012-04-24 02:55 pm UTC (link)
Huzzah for bonus database query optimizations! :)

(Reply to this


silmaril: Two little blue flowers, with the word "whee!" (Happy Flowers)


[personal profile] silmaril
2012-04-24 03:20 pm UTC (link)
I clicked on "comment" to say exactly this.

(Reply to this)  (Thread from start)  (Parent


februaryfour: (ai!bear, chinese married bear)


[personal profile] februaryfour
2012-04-24 04:46 pm UTC (link)
This. I have never regretted paying for my account here--the DW team makes me WANT to throw money at them!

(Reply to this)  (Thread from start)  (Parent


subluxate: Sophia Bush leaning against a piano (Corlionis: Teresa)


[personal profile] subluxate
2012-04-24 09:17 pm UTC (link)
Very much this.

(Reply to this)  (Thread from start)  (Parent


archangelbeth: An anthropomorphic feline face, with feathered wing ears, and glasses, in shades of gray. (Glaseah Me!)


[personal profile] archangelbeth
2012-04-25 01:59 am UTC (link)
Bonus points, yay! Yay, Mark!

(Reply to this


archangelbeth: An anthropomorphic feline face, with feathered wing ears, and glasses, in shades of gray. (Glaseah Me!)


[personal profile] archangelbeth
2012-04-25 02:01 am UTC (link)
I just wanted you to know that Journal Search has helped, more than once, when I've had to do things like "date of kid's X surgery" for medical records. My own memory goes, "Um, I dunno, it was in grade school..." And I've turned off "index in search engines" for my journal. (Edit: 'Cause I don't want my mother-in-law's weird friends doing a Google on me and pulling up random stuff out of context. Been there, seen that, got very, very annoyed.)

Thank you very much for having Journal Search.

Last edited 2012-04-25 02:02 am UTC

(Reply to this)  (Thread from start)  (Parent


vickyblueeyez: (suicon)

OT


[personal profile] vickyblueeyez
2012-05-29 02:32 am UTC (link)
Does the FAQ not state the accounts are free to make? There was a post about a major LJ comm moving to DW and it was telling everyone you still needed an invite. http://fandomsecrets.livejournal.com/897522.html

(Reply to this


denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (me, standing outside a broken phone booth)

Re: OT


[staff profile] denise
2012-05-29 03:22 am UTC (link)
No, everything says that account creation is currently open.

(Reply to this)  (Thread from start)  (Parent



(23 comments) - (Post a new comment)
(Threaded) (Top-level comments only)