Analyse the sentences and extract person name, organization and location with the help of NLP

点点圈 提交于 2019-12-21 04:38:11

问题


I need to solve the following using NLP, can you give me pointers on how to achieve this using OpenNLP API

a. How to find out if a sentence implies a certain action in the past, present or future.

(e.g.) I was very sad last week - past
       I feel like hitting my neighbor - present
       I am planning to go to New York next week - future

b. How to find the word which corresponds to a person or company or country

(e.g.) John is planning to specialize in Electrical Engineering in UC Berkley and pursue a career with IBM).

Person = John

Company = IBM

Location = Berkley

Thanks


回答1:


I can provide solution of

Solution of b.

Here is code :

    public class tikaOpenIntro {

    public String Tokens[];

    public static void main(String[] args) throws IOException, SAXException,
            TikaException {

        tikaOpenIntro toi = new tikaOpenIntro();


        String cnt;

        cnt="John is planning to specialize in Electrical Engineering in UC Berkley and pursue a career with IBM.";

                toi.tokenization(cnt);

        String names = toi.namefind(toi.Tokens);
        String org = toi.orgfind(toi.Tokens);

                System.out.println("person name is : "+names);
        System.out.println("organization name is: "+org);

    }
        public String namefind(String cnt[]) {
        InputStream is;
        TokenNameFinderModel tnf;
        NameFinderME nf;
        String sd = "";
        try {
            is = new FileInputStream(
                    "/home/rahul/opennlp/model/en-ner-person.bin");
            tnf = new TokenNameFinderModel(is);
            nf = new NameFinderME(tnf);

            Span sp[] = nf.find(cnt);

            String a[] = Span.spansToStrings(sp, cnt);
            StringBuilder fd = new StringBuilder();
            int l = a.length;

            for (int j = 0; j < l; j++) {
                fd = fd.append(a[j] + "\n");

            }
            sd = fd.toString();

        } catch (FileNotFoundException e) {

            e.printStackTrace();
        } catch (InvalidFormatException e) {

            e.printStackTrace();
        } catch (IOException e) {

            e.printStackTrace();
        }
        return sd;
    }

    public String orgfind(String cnt[]) {
        InputStream is;
        TokenNameFinderModel tnf;
        NameFinderME nf;
        String sd = "";
        try {
            is = new FileInputStream(
                    "/home/rahul/opennlp/model/en-ner-organization.bin");
            tnf = new TokenNameFinderModel(is);
            nf = new NameFinderME(tnf);
            Span sp[] = nf.find(cnt);
            String a[] = Span.spansToStrings(sp, cnt);
            StringBuilder fd = new StringBuilder();
            int l = a.length;

            for (int j = 0; j < l; j++) {
                fd = fd.append(a[j] + "\n");

            }

            sd = fd.toString();

        } catch (FileNotFoundException e) {

            e.printStackTrace();
        } catch (InvalidFormatException e) {

            e.printStackTrace();
        } catch (IOException e) {

            e.printStackTrace();
        }
        return sd;

    }


    public void tokenization(String tokens) {

        InputStream is;
        TokenizerModel tm;

        try {
            is = new FileInputStream("/home/rahul/opennlp/model/en-token.bin");
            tm = new TokenizerModel(is);
            Tokenizer tz = new TokenizerME(tm);
            Tokens = tz.tokenize(tokens);
            // System.out.println(Tokens[1]);
        } catch (IOException e) {
            e.printStackTrace();
        }
    }

}

and you want location also then import location model also that is available on openNLP source Forge. you can download and you can use them.

I am not sure about what will be probability of Name, Location, and Organization Extraction but almost it recognize all names,location,organization.

and if don't find openNLP sufficient then use Stanford Parser for Name Entity Recognization.




回答2:


Finding the literal tense of the sentence is not trivial, but doable in some cases. The OpenNLP parser will create a sentence structure from which you can attempt to extract the head verb, and a bit of morphological analysis will tell you whether the verb is present or past (in English), and a bit more mucking about for the model "will" will give you future tense in some circumstances. But it's not always that simple. For instance, in "Going to Paris drained my bank account", you have an embedded event (going to Paris) which happened in the past, but it's tricky to figure that out. And your future example ("I am planning...") requires some real-world understanding of what the word "plan" means, which is quite complicated. This sort of thing is a topic of ongoing research in natural language processing.



来源:https://stackoverflow.com/questions/17990673/analyse-the-sentences-and-extract-person-name-organization-and-location-with-th

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!