- Updates and cleans up dependencies
- Standardization of the
test.ini
file
- Removes support for old CKAN versions prior 2.9 and Python 2
- Adds support for CKAN 2.10.0
- Removes version strings from the development dependencies
isort
andhttpretty
- Updates pylint configuration to latest version and fixes several warnings
- Internal release: Switches Python environment from Python 3.6 to Python 3.8 and updating deployment scripts
- Support for Python 3
- Updates Jinja2 to match version in ckan requirements
- Fix loading of old values from redis
- Adds support for Redis 3.x
- Fixes dev-requirements.txt: Broken version 1.7.0 of lazy-object-proxy was banned
- Changes metadata export from daily to weekly
- Removed deprecated OGD schemachecker completely
- Fix dataset URLs in link checker reports and remove deprecated OGD schema check reporting
- Removed the deprecated code for the OGD harvesters
- Removed the deprecated
groupadder
command for OGD categories
- Linkchecker: Avoid re-using context when calling CKAN-Action multiple
- Linkchecker: Add additional debug logging
- Rename environment names for internal ci/cd pipeline
- Remove the restriction to a specific version of CKAN
- Added
delete
paster command for deleting datasets by package_search filter params
- Improve filter query in
cleanupdb
command - Moved supervisor config for harvesting
gather_consumer
andfetch_consumer
to ckanext-dcatde - Moved cronjob scripts to run and clear harvest jobs to ckanext-dcatde
- Remove patches and requirements subfolder
- Allow more than 200 rows in the link checker report
- Re-activate Link-Checker by adding paster commands again
- Use dct:identifier (extras.identifier) instead of adms:identfier (extras.alternate_identifier) for
- the mapping from OGD to DCAT-AP.de
- the duplicate detection
- The OGD harvester is adding a guid in package extras
- The dependency to ckanext-harvest was removed
- Added hint about the new dependency to ckanext-dcatde (since version 3.0.1) in the README file
- Harvests OGD source portals to DCAT-AP.de CKAN fields now
- Deactivated schema and link checker (removed paster commands in setup file)
- Added
cleanupdb
paster command for deleting activities of user 'harvest' in the CKAN database - Added shell script for purging OGD CKAN groups
- Preserve character 'ß' in tags
- Added new Creative Commons 3.0 licence bundle
- Upgraded dependency of the library ckanext-harvest from branch "release-v2.0" to release "v0.0.5"
- Improved deletion of deprecated datasets from remote
- Improved error handling in purge command
- Added automated synchronization of datasets with the remote endpoints while harvesting.
- Fixed schema checker:
- Deleted datasets will be removed now from report data source, if the dataset contains schema validation errors and not available links
- Cast field "temporal_granularity_factor" to number before validating them
- Little imrovements/fixes for the harvesters of Hamburg, Berlin and Open.NRW
- Added automated clearing harvest source job history without deleting all harvested/related datasets.
- Support for CKAN 2.5.x
- Added licences "geonutz-be-2013-10-01" and "cc-pdm-1.0" to JSON file for schema validation
- Initial commit "Regelbetrieb" (Version 2.3.0)