Unsupervised automatic tagging algorithms?

Question

I want to build a web application that lets users upload documents, videos, images, music, and then give them an ability to search them. Thin

Answer 1

I posted a blog article today to answer your question.

http://scottge.net/2015/06/30/automatic-image-and-video-tagging/

There are basically two approaches to automatically extract keywords from images and videos.

1. Multiple Instance Learning (MIL)
2. Deep Neural Networks (DNN), Recurrent Neural Networks (RNN), and the variants

In the above blog article, I list the latest research papers to illustrate the solutions. Some of them even include demo site and source code.

Thanks, Scott

Answer 2

You want Doc-Tags (https://www.Doc-Tags.com) which is a commercial product that automatically and Unsupervised - generates Contextually Accurate Document Tags. The built-in Reporting functionality makes the product a light-weight document management system.

For Developers wanting to customize their own approach - the source code is available (very cheap) and the back-end service xAIgent (https://xAIgent.com) is very inexpensive to use.

Answer 3

These guys propose an alternative to LDA.

Automatic Tag Recommendation Algorithms for Social Recommender Systems http://research.microsoft.com/pubs/79896/tagging.pdf

Haven't read thru the whole paper but they have two algorithms:

1. Supervised learning version. This isn't that bad. You can use Wikipedia to train the algorithm
2. "Prototype" version. Haven't had a chance to go thru this but this is what they recommend

UPDATE: I've researched this some more and I've found another approach. Basically, it's a two-stage approach that's very simple to understand and implement. While too slow for 100,000s of documents, it (probably) has good performance for 1000s of docs (so it's perfect for tagging a single user's documents). I'm going to try this approach and will report back on performance/usability.

In the mean time, here's the approach:

1. Use TextRank as per http://qr.ae/36RAP to generate a tag list for a single document. This generates a tag list for a single document independent of other documents.
2. Use the algorithm from "Using Machine Learning to Support Continuous Ontology Development" (https://www.researchgate.net/publication/221630712_Using_Machine_Learning_to_Support_Continuous_Ontology_Development) to integrate the tag list (from step 1) into the existing tag list.

Answer 4

The most common unsupervised machine learning model for this type of task is Latent Dirichlet Allocation (LDA). This model automatically infers a collection of topics over a corpus of documents based on the words in those documents. Running LDA on your set of documents would assign words with probability to certain topics when you search for them, and then you could retrieve the documents with the highest probabilities to be relevant to that word.

There have been some extensions to images and music as well, see http://cseweb.ucsd.edu/~dhu/docs/research_exam09.pdf.

LDA has several efficient implementations in several languages:

• many implementations from the original researchers
• http://mallet.cs.umass.edu/, written in Java and recommended by others on SO
• PLDA: a fast, parallelized C++ implementation

Answer 5

Text documents can be tagged using this keyphrase extraction algorithm/package. http://www.nzdl.org/Kea/ Currently it supports limited type of documents (Agricultural and medical I guess) but you can train it according to your requirements.

I'm not sure how would the image/video part work out, unless you're doing very accurate object detection (which has it's own shortcomings). How are you planning to do it ?