denise: Image: Me, facing away from camera, on top of the Castel Sant'Angelo in Rome (Default)
Denise ([staff profile] denise) wrote in [site community profile] dw_maintenance2012-11-29 03:57 am

Search indexing not currently updating

After some investigation, [staff profile] mark has realized that our little website has grown up to the point where our site search setup is no longer sufficient for the amount of data y'all have generated. This is an exciting problem to have, but it also means that new posts and newly-imported posts won't be indexed into the search database until we can fix it! (And by 'we', I mean 'Mark'.)

We've got a plan that involves a new search database server (to go along with the two new webservers we ordered today), a new database schema that will make indexing, storing, and accessing search data much faster, and a method of storing and retrieving search data that makes more sense for the way usage has developed now that we have more information on what actual usage looks like. (And by 'we', I once again mean 'Mark'. There is a theme here.)

The plan is going to take a week or two to implement, though, and until then, search results will continue to be out of date. Anything that is already in the search database (as of about 10 days ago) will still be searchable, but newly-made posts and newly-imported posts won't show up until after we can fix it.

We'll let you know when the problem is fixed. Until then, continue on being awesome and making stuff: we'll catch up to you as soon as possible.
ozqueen: (Default)

[personal profile] ozqueen 2012-11-29 09:40 am (UTC)(link)
Until then, continue on being awesome and making stuff...

Same to you, DW staffers! ♥
sharpiefan: Pulllings and Jack, text 'Huzzah!' (Huzzah!)

[personal profile] sharpiefan 2012-11-29 12:06 pm (UTC)(link)
I feel sorry for [staff profile] mark, sorting issues like that single-handed. *cheers him on and offers virtual coffee and cookies*

(I'd offer The Real Thing but it'd look stalkerish. And I don't know where to send 'em anyway. *g*)
zarhooie: A little blue monster dude holding up a cookie. Text: Have a cookie! (Random: Have a cookie)

[personal profile] zarhooie 2012-11-29 05:48 pm (UTC)(link)
Related: back before LJ was sold to 6A, I used to send the LJ staff cookies. Trufax.
cyrano: (Yay!)

[personal profile] cyrano 2012-11-29 01:51 pm (UTC)(link)
I closed the ticket before I could respond, so I'll say "Awesome!" and "Thank you!" here. (:
azurelunatic: Azz and best friend grabbing each other's noses.  (Default)

[personal profile] azurelunatic 2012-11-29 02:19 pm (UTC)(link)
And thank you very much for reporting it!

There are no few organizations that have a general loathing of help tickets, because <moan> that means something's wrong and needs to be fixed </moan> -- but the general Dreamwidth support philosophy is, there are only so many of us, and sometimes we just sort of expect things to work instead of maintaining Constant Vigilance, so when someone else spots something, we are thrilled to be told about it so it can be fixed!
zarhooie: Text: Warning: participating in #dw may result in blacking out and discovering yourself as head of a project team. (DW: project team)

[personal profile] zarhooie 2012-11-29 05:48 pm (UTC)(link)
Yes, thanks for reporting! I was planning to respond, but I had to sleep instead. :)
bunny_m: (raven black)

[personal profile] bunny_m 2012-11-29 02:24 pm (UTC)(link)
Congrats! That's an awesome problem to have.


That said, a problem is still a problem that needs to be fixed. Poor Mark. ;)

And a message to *all* the DW staff and volunteers: Remember, thou art awesome!

Pretty certain you folks don't get told that nearly as much as you deserve. ^_^
amielleon: The three heroes of Tellius. (Default)

[personal profile] amielleon 2012-11-29 03:11 pm (UTC)(link)
I had no idea you could search posts on this site. Dreamwidth just got cooler, and it didn't even change.
sepdet: Samhain worshipping the veggies. Oooommm. (Okay, yes, catnip was involved.) (Default)

[personal profile] sepdet 2012-11-29 04:45 pm (UTC)(link)
Hopefully all the yearly renewals that just came due after last year's December influx of refugees will help cover those new server costs. :)

Thanks for keeping us updated!
bluiis: (red dress by musicalpanties)

[personal profile] bluiis 2012-11-29 08:13 pm (UTC)(link)
That is really exciting! I'm so glad I joined dreamwidth, and I love how awesome all of you are. :D
subluxate: Sophia Bush leaning against a piano (Default)

[personal profile] subluxate 2012-11-29 09:38 pm (UTC)(link)
Thank you, staff, for all you do, and especially thanks to Mark for all his hard work on the knotty issues like this!
slay: btvs (2.13), with (angel) (i like seeing you at bedtime.)

[personal profile] slay 2012-11-30 01:55 am (UTC)(link)
I love you for posting this because I was wondering why search hadn't been updating (I use it to stalk activity on the site in my fandoms, because it's the most beautiful tool for that ever). So thank you for keeping us informed! And super happy to hear y'all are working on a fix. ♥ You guys are amazing.
dragondancer5150: (Default)

[personal profile] dragondancer5150 2012-11-30 02:38 am (UTC)(link)
Just commenting to say DITTO to all that's been said before! <3 You guys are AWESOME! And by 'you', I mean 'Mark'. (JUST KIDDING!!! You're ALL awesome! <333)
songfire: (TOS uhura-tribble)

[personal profile] songfire 2012-11-30 03:00 am (UTC)(link)
Thank you for keeping us up-to-date! You all deserve cookies! (and someone should donate an extra pizza + free coffee to [staff profile] mark! :D
zarhooie: Girl on a blueberry bramble looking happy. Text: Kat (Default)

[personal profile] zarhooie 2012-11-30 03:02 am (UTC)(link)
During Open Beta (when all of us were glued to our computers), the IRC team seriously considered ordering pizza for HQ. So what I'm saying is that it's kind of a tradition.
songfire: (TOS uhura-tribble)

[personal profile] songfire 2012-11-30 04:22 am (UTC)(link)
That's a great tradition! (Provided you actually follow through occasionally! XD)

I'd be happy to add a pizza/cookie/coffee bonus when I renew my paid account! :D
Edited 2012-11-30 04:29 (UTC)
azurelunatic: Azz and best friend grabbing each other's noses.  (Default)

[personal profile] azurelunatic 2012-11-30 08:07 am (UTC)(link)
Yes. (The fun starts around 18:00.)
azurelunatic: Azz and best friend grabbing each other's noses.  (Default)

[personal profile] azurelunatic 2012-11-30 07:47 am (UTC)(link)
...dude, do you not remember the drama with the Domino's calling the wrong cellphone number? And the IRC "hey [staff profile] denise, pizza's here"?
sagesaria: (zomgfangirlmoment)

[personal profile] sagesaria 2012-11-30 04:03 am (UTC)(link)
That is the sweetest thing I've heard today. No wonder I love having an account with you guys.
songfire: (zq xd)

[personal profile] songfire 2012-11-30 04:28 am (UTC)(link)
"The people at the pizza place were very puzzled when I tried to explain to them that I was in Baltimore, but no really, the pizza itself was going to inside their delivery radius."

*lol*

But seriously, I'll be renewing my paid account soon and would be happy to donate something extra to a pizza/cookies/coffee fund for you guys - you do so much for us!
I'll just add it to my payment! ;)
Edited 2012-11-30 04:28 (UTC)
mm_writes: So you said you wanted a cookie... (Default)

[personal profile] mm_writes 2012-11-30 06:13 am (UTC)(link)
as long as you stay happy with us

What an incredibly nice and graceful way to put it.
msilverstar: (corset)

[personal profile] msilverstar 2012-11-30 04:46 am (UTC)(link)
If you folks want any help testing it, my day job contract is up next week, but I'm still feeling the search engine love.
mm_writes: So you said you wanted a cookie... (Default)

[personal profile] mm_writes 2012-11-30 06:17 am (UTC)(link)
You know, I was wondering why when I did a search on [clucky] the other day it brought up just two titles after I'd already posted a third. I thought to myself "Is this a bug or a feature"? and stared at the result screen for the longest time. Then I went offline for two days straight. It was a nice vacation from the Internet. Then came back to see my question on this answered.

Looking forward to increased serving capacity and the "is this a bug or feature" bug getting fixed.