ckan

Is CKAN capable of dealing with 100k+ files and TB of data?

久未见 提交于 2020-01-01 05:15:12
问题 What we are wanting to do is create a local data repository for our lab memebers to organize, search upon, access, catalog, reference our data, etc. I feel that CKAN can do all of these things; however, I'm not sure how it will handle these tasks for the data we actually have (I could be wrong, which is why I'm asking). Our lab is procuring a lot of data for internal use. We would like to be able to catalog and organize this data within our group (maybe CKAN?) so people can push data to the

Is data in solr backed by postgres in ckan

老子叫甜甜 提交于 2019-12-24 21:54:03
问题 I would like to create a high availability ckan in Azure. I know I can have a postgres as a service and rediss as a service, I can have ckan run behind a load balancer, only thing that bothers me is solr. Since there is no Solr as a service in Azure, how can I make sure my solr instance is highly available. Does ckan keeps data in postgres and a duplicate of that data in solr for indexing? If yes then, that will help me as if anytime my solr instance goes does in a VM (rarely) I will create

Everything works fine with CKAN through VPN, but when accessed from the public, CSS cannot not be loaded

偶尔善良 提交于 2019-12-24 11:40:55
问题 I have installed ckan 2.7.1 on ubuntu 14.04 through package by following the official tutorial (http://docs.ckan.org/en/ckan-2.7.0/maintaining/installing/install-from-package.html). This VM is in our own cloud platform. I have attached a public IP, opened port 8080 and 80 for it. When I accessed the VM through VPN using both private and public IP, everything works well. However, if I type the public IP (http://199.26.254.157/) into the browser with the VPN shut down, I can still see the html

Update resource in CKAN using python

吃可爱长大的小学妹 提交于 2019-12-24 05:45:13
问题 I'm trying to update a resource in one instace of CKAN. I'm using demo.ckan.org to make some test. I'm able to create and update a resource for a dataset using curl , but using python I'm not be able to do this. My start point is this link: http://docs.ckan.org/en/latest/maintaining/filestore.html#filestore-api This is the code: import requests requests.post('http://0.0.0.0:5000/api/action/resource_create', data={"package_id":"my_dataset"}, headers={"X-CKAN-API-Key": "21a47217-6d7b-49c5-88f9

Deleting rows in datastore by time range

喜夏-厌秋 提交于 2019-12-24 00:56:47
问题 I have a CKAN datastore with a column named "recvTime" of type timestamp (i.e. using "timestamp" as type at datastore_create time, as shown in this link). Example value for this column is "2014-06-12T16:08:39.542000". I have a large numbers of records in the datastore (thousands) and I would like to delete the rows before a given date in "recvTime". My first thought was doing it using the REST API with the datastore_delete operation using a range filter, but it is not possible as described in

Why do we need Redis for running CKAN?

与世无争的帅哥 提交于 2019-12-23 17:53:08
问题 I was wondering why do we need Redis server for running CKAN. If needed, why? And How do I configure it with CKAN? p.s I am running my ckan instance in RHEL7. 回答1: Update: Redis has been a requirement since CKAN 2.7, when a new system for asynchronous background jobs was introduced which relies on Redis. You can configure the Redis connection using the ckan.redis.url option. Redis is not required for the current version of CKAN (2.6.2 at the time of this writing), it's not even mentioned in

CKAN error: Server Error 500

人盡茶涼 提交于 2019-12-19 10:29:33
问题 When I visit a page of a CKAN site, I get an error: "Server Error" with status 500: How do I work out what went wrong? And how do I get help? 回答1: This error could mean lots of things. (Technically, there was an exception during the server's handling of your request.) Your server log will tell you what happened. In most cases you can see it in this file: /var/log/apache2/ckan_default.error.log The details of one error look like this: [Sat Sep 28 10:50:14 2013] [error] [client 81.102.118.195]

Create CKAN dataset using CKAN API and Python Requests library

我与影子孤独终老i 提交于 2019-12-18 17:33:28
问题 I am using CKAN version 2.2 and am trying to automate dataset creation and resource upload. I seem to be unable to create a dataset using the python requests library. I am receiving 400 error code. Code: import requests, json dataset_dict = { 'name': 'testdataset', 'notes': 'A long description of my dataset', } d_url = 'https://mywebsite.ca/api/action/package_create' auth = {'Authorization': 'myKeyHere'} f = [('upload', file('PathToMyFile'))] r = requests.post(d_url, data=dataset_dict,

Revision History in CKAN

霸气de小男生 提交于 2019-12-13 19:00:25
问题 Does CKAN provide revision history for datasets? I see a table and an API call, but I don't see anything in the UI and/or the database when making a modification to a dataset or the metadata fields. 回答1: Edit a dataset's title and you'll see a row with the new value added to package_revision table. However 'revisions' is a deprecated feature in CKAN since a few years ago. Along with the patchy REST API, there is a 'history' page for datasets for the purpose of an admin to audit changes.

ckan 2.9.0 iroute before_map not invoking custom controller

跟風遠走 提交于 2019-12-13 04:18:31
问题 I recently updated ckan to 2.9.0. After the update, my custom controller for dataset.search will not be invoked from the plugin anymore. I can see that the templates of the plugins are still working, however, the customer controller is not invoked. def before_map(self, map): # Hook in our custom user controller at the points of creation map.connect('dataset',controller='ckanext.facet.controller:CustomPakcageController', action='search') It was working fine before the update. Any clue what