2006-03-05
mysql's plugin parser looks neat
With the introduction of mysql 5.1, they have introduced "full text plugins":http://dev.mysql.com/doc/refman/5.1/en/plugin-full-text-plugins.html which allows people to write their own parsers.
Now I'm not an expert in "Lucene":http://lucene.apache.org or this new feature, but it seems that both of these products are heading for the same point,
One of the benefits I have often heard touted was that lucene had better relevancy, while mysql was faster. (no I don't have any numbers to back this up.. maybe when my "Sun Fire":http://sunfirefan.com comes I'll try loading this up as my 'benchmark'). So it will be interesting to actually do some experimentation to see if you could get the best of both worlds.
maybe someone can sponsor me to re-tool nutch to work with a pure mysql back-end (Brian/Zack ?? are you reading this? does MySQL want to give me a grant? :-)