I find I'm often unsatisfied with the ordering and expressiveness of searches on https://www.npmjs.com/. I guess there should be a way to programmatically query the server using https://api.npmjs.org/ or http://registry.npmjs.org/. But how? Where is the documentation?
(Or are there node packages to faciliate that? I know SO isn't about tool or package recommendations, so perhaps I shouldn't be asking about this as well, but if there were some tool, I could likely read the API from that as well.)
Of course there is at least one tool designed to talk to that registry, and that is the npm
command line tool itself. Its search for example starts by updating a local cached copy of the index, filtering that. In update-index one can read that the URL ending in /-/all
is apparently special. And indeed, appending that to registry.npmjs.org
(deliberately not formatted as a link) will fetch a 125M file which might be too much for your browser. Luckily the cached version is stored available in ~/.npm/registry.npmjs.org/-/all/.cache.json
. From there one can read a list of all nown packages. One could then continue to query each such package in more detail.
The fact that npm search
apparently uses no more elaborate scheme suggests that there is not much of a server-side api here.
Searching the web for pages mentioning api.npmjs.org
I found that the download counts can be retrieved from there. All other documents I found make use of that single facility.
Looking for alternatives, I also stumbled upon npmsearch.com which offers some more versatile searching facilities and has a somewhat documented API.
Recently found a really good npm query site https://npms.io. They also have quality point systems for each package based on various data.
They will also have a scoring system for each package using the collected information about the project. The final score is calculated based on four different aspects of Quality, Maintenance, Popularity, and Personalities.
API Doc: https://api-docs.npms.io
You can always use the NPM registry client: https://github.com/npm/npm-registry-client.
If you look through this you can get the endpoints for the API. e.g to get the dist-tags for a package then you can go to /-/package/packageName/dist-tags'
So to get the babel-core dist tags you would go to http://registry.npmjs.org/-/package/babel-core/dist-tags
https://skimdb.npmjs.com/registry/_all_docs
This is a current method to pull all the package names.
The URL search is http://registry.npmjs.com/-/v1/search?text=<searchstring>&size=20
Take a look at sinopia registry interface: https://github.com/rlidwka/sinopia/blob/master/lib/index-api.js. The default registry for npm client is https://registry.npmjs.org (try it out on console: npm config ls -l). So you can try the following (referencing the sinopia API) to fetch data about react 15.0.2
If you can't find a package or are just hacking together a shell script the Registry API Docs in the registry's git repository include detailed information on Search API and search qualifiers.
If you're looking for the most popular insecure package in the public registry run:
wget -qO - "http://registry.npmjs.com/-/v1/search?text=is:insecure&popularity=1.0&size=1"
The above uses the is:insecure
search qualifier without any additional text criteria and grabs size=1
results where popularity=1.0
(the most popular).
Check in the docs
directory in the repo for a number of other useful things such as:
- Detailed list of response Package Metadata.
- Replicate API for scoped and unscoped packages.
- Information on getting download counts.
- Walkthrough on how to create a registry "follower".
I know that this answer is old but some can still find it relevant so:
After a lot of searching, I finally found something, The solution doesn’t use NPM API because of its bad documentation and many more disadvantages that it has
(This will be helpful for other usages other than searching like getting a list of popular packages (what I needed))
The solution is to use Libraries.io
Libraries.io indexes data from 4,273,741 packages from 36 package managers. (Including NPM) From Libraries.io page
It has great API and good documentation, also it has some API wrapper in several languages
You can take a look at my CLI program that uses that library here
You can use api-npm node module it directly queries the NPM registry and you can get all attributes of a module and download stat of any module of any time range https://www.npmjs.com/package/api-npm
The docs are here now: https://github.com/npm/registry/blob/master/docs/download-counts.md
Downloads endpoint
Gets the total downloads for a given period, for all packages or a specific package.
GET https://api.npmjs.org/downloads/point/{period}[/{package}]
Examples
- All packages, last day:
- /downloads/point/last-day
- All packages, specific date:
- /downloads/point/2014-02-01
- Package "express", last week:
- /downloads/point/last-week/express
- Package "express", given 7-day period:
- /downloads/point/2014-02-01:2014-02-08/express
- Package "@slack/client", last 30 days:
- /downloads/point/last-month/@slack/client
- Package "jquery", specific month:
- /downloads/point/2014-01-01:2014-01-31/jquery
来源:https://stackoverflow.com/questions/34071621/query-npmjs-registry-via-api