Class CharNormalizer

java.lang.Object
com.optimaize.langdetect.cybozu.util.CharNormalizer

public class CharNormalizer extends Object
Some character normalization (and exclusion) functionality. This functionality was previously embedded in the NGram class.
  • Field Details

    • LATIN1_EXCLUDED

      private static final String LATIN1_EXCLUDED
    • cjk_map

      private static final Map<Character,Character> cjk_map
    • CJK_CLASS

      private static final String[] CJK_CLASS
      CJK Kanji Normalization Mapping
  • Constructor Details

    • CharNormalizer

      public CharNormalizer()
  • Method Details

    • normalize

      public static char normalize(char ch)
      Character Normalization (and exclusion).
      Returns:
      Normalized character, the space to exclude the character.