Natural Language Processing (NLP)

Natural language processing enables computers to analyze and generate human language. Tokenization prepares language for computation, while named-entity recognition identifies meaningful names in text.

Japanese terms

1. Natural language processing — 自然言語処理しぜんげんごしょり: The field concerned with computational processing and generation of human language.
2. Tokenization — トークン化か: The process of dividing input into units that a language-processing system can handle.
3. Named-entity recognition — 固有表現抽出こゆうひょうげんちゅうしゅつ: The task of locating and categorizing names such as people, organizations, and places in text.

Related topics

Large language models and transformers now support many NLP applications.