ODArchive – Creating an archive for structured data from Open Data Portals

Type Research Project

Duration March 1, 2020 - July 21, 2020

  • Institute for Data, Process and Knowledge Management IN (Details)


Press 'enter' for creating the tag
  • Mitlöhner, Johann (Details) Project Head
  • Neumaier, Sebastian (Details) Project Head
  • Polleres, Axel (Details) Project Head
  • Weber, Thomas (Former researcher) Project Head

Abstract (English)

We present ODArchive, a large corpus of structured data collected from over 260 Open Data portals worldwide, alongside with curated, integrated metadata. Furthermore we enrich the harvested datasets by heuristic annotations using the type hierarchies in existing Knowledge Graphs. We both (i) present the underlying distributed architecture to scale up regular harvesting and monitoring changes on these portals, and(ii) make the corpus available via different APIs. Moreover, we (iii) analyse the characteristics of tabular data within the corpus. Our APIs can be used to regularly run such analyses or to reproduce experiments from the literature that have worked on static, not publicly available corpora.



  • 1105 Computer software (Details)
  • 1109 Information and data processing (Details)
  • 1140 Software engineering (Details)