DB-Indexing service
The indexing service takes a collection of Dataset CIDs (e.g. all CIDs which are considered part of HALO-DB) and creates (or usually updates) the DB-Index. As part of the indexing process, the indexing service uses the extract_metadata function (see Dataset) to gather all required metadata.
The indexing service can augment the index with other information. E.g. DOIs issued by the DOI Service, relations between datasets (like updates).
prior art¶
scanMetadata.ts, the script which builds the index of the ORCESTRA data browser
WPs¶
- implement a service which does this indexing for HALO-DB
- optimize the implementation to allow efficient updates