Search changes

[mark]

Hi all,

I just rolled out some search changes. The two main things you should notice: search indexing is much quicker now (it updates with new content every 15 minutes) and also now comments (on paid accounts) are indexed.

Thank you for all of your patience with search. We outgrew our old trusty search machine and it's now retired. The new one is much larger, has faster disks, and should hold us in good standing for a while as we grow.

I'll be around all day and watching this post. Please let me know if you see any problems!

Comments

[mark]

The exact matches only is because of stemming. It looks like I can set two stemming libraries -- although it prefers the English one. If that doesn't match, then it will try the Russian one.

Can you do some searches now and see if it's better? It should match things like "testing" when you search for "test" (except, the Russian equivalent).

[victor_sudakov]

There is no difference, sorry to say. It still finds only exact matches for Cyrillic text.

[mark]

Can you give me a word that should be stemmed (i.e., a non-plural, or present tense, etc)? Then I can experiment and, ideally, have a quicker test turnaround. :-)

[victor_sudakov]

OK, take the initial form (Nominative case, singular) of the word общение (meaning communication) and try to search for its different forms like общения общению общением общении

This word is present here: http://victor-sudakov.dreamwidth.org/162749.html in the prepositional case.

[mark]

Thank you -- found the problem. It appears to work for me, can you test and confirm?

[victor_sudakov]

Hurrah, it works! Thank you Mark!