Find cosine similarity between two arrays

Question

I\'m wondering if there is a built in function in R that can find the cosine similarity (or cosine distance) between two arrays?

Currently, I implemented my own func

Answer 1

These sort of questions come up all the time (for me--and as evidenced by the r-tagged SO question list--others as well):

is there a function, either in R core or in any R Package, that does x? and if so,

where can i find it among the +2000 R Packages in CRAN?

short answer: give the sos package a try when these sort of questions come up

One of the earlier answers gave cosine along with a link to its help page. This is probably exactly what the OP wants. When you look at the linked-to page you see that this function is in the lsa package.

But how would you find this function if you didn't already know which Package to look for it in?

you can always try the standard R help functions (">" below just means the R command line):

> ?<some_name>

> ??<some_name>

> *apropos*<some_name>

if these fail, then install & load the sos package, then

***findFn***

findFn is also aliased to "???", though i don't often use that because i don't think you can pass in arguments other than the function name

for the question here, try this:

> library(sos)

> findFn("cosine", maxPages=2, sortby="MaxScore")

The additional arguments passed in ("maxPages=2" and "sortby="MaxScore") just limits the number of results returned, and specifies how the results are ranked, respectively--ie, "find a function named 'cosine' or that has the term 'cosine' in the function description, only return two pages of results, and order them by descending relevance score"

The findFn call above returns a data frame with nine columns and the results as rows--rendered as HTML.

Scanning the last column, Description and Link, item (row) 21 you find:

Cosine Measures (Matrices)

this text is also a link; clicking on it takes you to the help page for that function in the Package which contains that function--in other words

using findFn, you can pretty quickly find the function you want even though you have no idea which Package it's in

Answer 2

Check these functions lsa::cosine(), clv::dot_product() and arules::dissimilarity()

Answer 3

You can also check the vegan package: http://cran.r-project.org/web/packages/vegan//index.html

The function vegdist in this package has a variety of dissimilarity (distance) functions, such as manhattan, euclidean, canberra, bray, kulczynski, jaccard, gower, altGower, morisita, horn,mountford, raup , binomial, chao or cao. Please check the .pdf in the package for a definition or consult references https://stats.stackexchange.com/a/33001/12733.

Answer 4

Taking the comment from Jonathan Chang I wrote this function to mimic dist. No extra packages to load.

cosineDist <- function(x){
  as.dist(1 - x%*%t(x)/(sqrt(rowSums(x^2) %*% t(rowSums(x^2))))) 
}

Answer 5

It looks like a few options are already available, but I just stumbled across an idiomatic solution I like so I thought I'd add it to the list.

install.packages('proxy') # Let's be honest, you've never heard of this before.
library('proxy') # Library of similarity/dissimilarity measures for 'dist()'
dist(m, method="cosine")

Answer 6

If you have a dot product matrix, you can use this function to compute the cosine similarity matrix:

get_cos = function(S){
  doc_norm = apply(as.matrix(dt),1,function(x) norm(as.matrix(x),"f")) 
  divide_one_norm = S/doc_norm 
  cosine = t(divide_one_norm)/doc_norm
  return (cosine)
}

Input S is the matrix of dot product. Simply, S = dt %*% t(dt), where dt is your dataset.

This function is basically to divide the dot product by the norms of vectors.