What can I do with inconsistent sentiment detection provided by cognitive services?

只谈情不闲聊 提交于 2019-12-13 16:17:19

问题


Using Text Analytics for sentiment detection I receive sometimes results I consider being inconsistent.

They can be demonstrated by one simple example:

I'm sad was marked as 1% (0% means very negative)

Hello I'm sad was marked as 85% (100% means very positive)


Is there a way to improve/contribute to Text Analytics service for sentiment detection? Or to use own model similar to LUIS to detect sentiment?

Alternatively is there some recommended service/library to use to change input text prior to sentiment detection attempt to get better results?


Please see the way I used to test given example at https://azure.microsoft.com/en-us/services/cognitive-services/text-analytics/

and the same result for via API using https://westeurope.api.cognitive.microsoft.com/text/analytics/v2.0/sentiment

Input:

{"documents": [{"id": "101","text": "I'm sad","language":"en"},
{"id": "111","text": "Hello I'm sad.","language":"en"}]}

Result:

{"documents":[{"score":0.0038561224937438965,"id":"101"},
{"score":0.84333503246307373,"id":"111"}],"errors":[]}

回答1:


To answer your original question: The best way to provide feedback for incorrect scores is to contact the text analytics team (mlapi@microsoft.com)

For the specific example provided, we'll look into what may be causing this issue. Somehow the machine learned that that was positive while of course we know it is not.

Luis Cabrera | Text Analytics Program Manager | Cloud AI Platform, Microsoft




回答2:


I didn't find exactly what I was looking for but I consider last of my steps satisfactory.

1) No response when I tried :-) and :-( inside Azure Portal

2) No response whet I tried 1) and checked "Microsoft can email you about your feedback"

3) I received advice to post to Stackoverflow When I tried Twitter and have put @Azure #CognitiveServices into my tweet. The response came in less than 20 minutes.

4) Here I received an advice to ask the same question at mlapi@microsoft.com

5) After short email exchange I received following advice that answers my question in the most exhaustive manner so far:

One possible solution would be to use the MS Spell check API to correct the text grammar before sending it to sentiment analysis, and also considering breaking the text to smaller sentence segments if possible.

For example, if this is part of a chat conversation or a letter, and there’s a new line or a comma after the greeting.

We would also be adding a few enhancements in the near future that will enable you to influence the model by providing dictionary hints. So you’ll be able to tell the model to ignore words like: “hello” or “hi” if you see they affect your specific scenario quite often.

Please let us know if you have any additional feedback, and feel free to suggest features in our UserVoice.



来源:https://stackoverflow.com/questions/48428284/what-can-i-do-with-inconsistent-sentiment-detection-provided-by-cognitive-servic

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!