Ask Your Question

When a language model like SyntaxNet tags parts of speech, is that a language model task?

asked 2017-01-06 11:15:49 -0500

20GT gravatar image

updated 2017-03-07 20:05:56 -0500

ksteimel gravatar image

When a language model like SyntaxNet tags parts of speech, is that a language model task? If so, I've heard the word feature thrown around, what is a language model feature?

edit retag flag offensive close merge delete

1 answer

Sort by » oldest newest most voted

answered 2017-03-07 20:13:41 -0500

ksteimel gravatar image

When you have something like SyntaxNet tagging part of speech tags, that would be a natural language processing task: you're using a model created from neural networks to DO something. Common tasks that you can do are part of speech tagging, syntactic parsing, word sense disambiguation etc. Something like part of speech tagging is not often the end goal. It is merely a preliminary step towards something else. As the documentation of SyntaxNet describes, SyntaxNet provides the basis for Natural Language Understanding systems. You typically use part of speech tags for some other purpose down the language processing pipeline.

As for features, when you build a model, you need features. Features are some sort of representation of the natural language text. For example, Bag-of-words approaches commonly use sequences of words (n-grams) as features and then get counts for each of these sequences or simply mark whether it occurs at all in a given section of text. You can extract features in very complex ways if you want to. For example, you could use your part of speech tag output from SyntaxNet as features for constructing a model that does word sense disambiguation.

If anything doesn't make sense, just let me know. I'll try to write up some examples.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2017-01-06 11:15:49 -0500

Seen: 398 times

Last updated: Mar 07 '17