How do I write my own Analyzer?

Created Sep 30, 2002

Otis Gospodnetic

Here is an example:

public class MyAnalyzer extends Analyzer
{
    private static final Analyzer STANDARD = new StandardAnalyzer();

    public TokenStream tokenStream(String field, final Reader reader) 
    {
        // do not tokenize field called 'element'
        if ("element".equals(field))
        {
            return new CharTokenizer(reader)
            {
                protected boolean isTokenChar(char c)
                {
                    return true;
                }
            };
        }
        else
        {
            // use standard analyzer
            return STANDARD.tokenStream(field, reader);
        }
    }
}