denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (me, standing outside a broken phone booth)Denise ([staff profile] denise) wrote in [site community profile] dw_maintenance,
@ 2012-04-23 11:16 pm UTC
  • Previous Entry
  • Add to Memories
  • Tell someone about this!
  • Next Entry
We've got a disk that looks like it's about to fail in the machine we use to power site and journal search. We've turned off search indexing temporarily to reduce the number of writes to the disk (which will hopefully let us baby it along for a little while longer), and will be taking search entirely offline for a four-hour maintenance window with our hosting provider as soon as we can schedule a convenient time for the replacement -- either later this evening, or early tomorrow morning.

Indexing being disabled means that no new posts will show up in site search until after the replacement, and when the machine is entirely offline, visiting site or journal search will return a message saying that the feature is temporarily offline. Once the disk is replaced, it may take a day or two for the indexing to catch up with the stuff that was posted while indexing was off; we've been hovering around the point where it takes longer to run the script than the frequency with which we run the script, so it may take us a little while to catch up.

The data on the disk is completely backed up (and in a worst case scenario could be re-indexed anyway), so there won't be any risk. The only thing you should notice will be no new posts appearing in the search results until the replacement, and then a period of downtime while the replacement is performed.

(EDIT, 24 April 5AM EDT: The disk has now been replaced, the data is copied back over, and the indexing is running again and catching up on what was missed. And, for bonus points, [staff profile] mark found a place to optimize a bunch of database queries.)


(Read 23 comments) - (Post a new comment)
(Flat) (Top-level comments only)

msilverstar: (corset)


[personal profile] msilverstar
2012-04-24 06:21 am UTC (link)
How much traffic are you getting on search these days? And what are the top queries?

(Reply to this)  (Thread


denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (me, standing outside a broken phone booth)


[staff profile] denise
2012-04-24 06:29 am UTC (link)
I don't believe we record the queries being searched on, since it's not relevant information and wouldn't be useful for anybody to know! Site search is restricted to logged-in accounts (for performance reasons) and journal search is restricted to paid accounts (ditto) so I don't think the traffic is too overwhelming; I'm not sure if it's possible to separate out the traffic that goes to the search db from the traffic that goes to the search machine in general, and I think that machine is still dual-use as a webserver and the search db, which would mean the load balancer sending it traffic that was not purely search-related.

(Reply to this)  (Thread from start)  (Parent)  (Thread


lannamichaels: Matt Smith holds two thumbs up, before heading into Certain Danger. Cap from season 5 promo trailers. (yay)


[personal profile] lannamichaels
2012-04-24 11:26 am UTC (link)
I don't believe we record the queries being searched on, since it's not relevant information and wouldn't be useful for anybody to know!

This is an actual relief, in the Google world. *has used journal search to find very weird things*

(Reply to this)  (Thread from start)  (Parent


archangelbeth: An anthropomorphic feline face, with feathered wing ears, and glasses, in shades of gray. (Glaseah Me!)


[personal profile] archangelbeth
2012-04-25 02:01 am UTC (link)
I just wanted you to know that Journal Search has helped, more than once, when I've had to do things like "date of kid's X surgery" for medical records. My own memory goes, "Um, I dunno, it was in grade school..." And I've turned off "index in search engines" for my journal. (Edit: 'Cause I don't want my mother-in-law's weird friends doing a Google on me and pulling up random stuff out of context. Been there, seen that, got very, very annoyed.)

Thank you very much for having Journal Search.

Last edited 2012-04-25 02:02 am UTC

(Reply to this)  (Thread from start)  (Parent



(Read 23 comments) - (Post a new comment)
(Flat) (Top-level comments only)