Advanced Usage and Publication Tools¶
esgadd_facetvalues¶
This is a command-line utility that allows for the addition of supplemental faceted metadata beyond the values in the dataset_id and global attributes. The command runs with similar options as esgpublish and is intended to run as a repeat of the –thredds catalog generation step.
Requirements¶
A “dataset metadata” mapfile must be produced to call the utility. The mapfile takes the form:
<dataset_id> | <key>=<value> | ...
Where the <dataset_id>s are the same as those found in the mapfile produced by esgmapfile and used with esgpublish. The subsequent columns store the key=value pairs for the supplementary facets. Unlike the mapfile generated by esgmapfiles this one does not contain any references to the data files or file metadata. For a corresponding publishing job, there should be one line corresponding to each dataset-specific mapfile generated by esgmapfile.
Note
<value> (above) can contain spaces but not quotation marks, as they are not properly interprered by Solr for searches.
Usage¶
$ esgadd_facetvalues --project <project> --map <dataset_mapfile> --noscan --thredds --service fileservice
This step above will re-generate your thredds catalogs with the additional facets. Finally, you will need to republish those catalogs to the Index Node / Solr. For that you may use either your new or previously generated mapfiles, as long as they have the same list of dataset_ids.
$ esgpublish --project <project> --map <dataset_mapfile> --noscan --publish
Note that if you have published “new” facets for the first time to the Index Node, they will not be searchable on Solr and moreover, will cause a an erroneous response. The solution is to restart the Index Node right after publication and then attempt your search.
esgtest_publish¶
The seemingly simple testing utility has some additional features not performed by default.
skip-unpublish¶
The --skip-unpublish
or -x
option should be used if desired to have the published test dataset remain on the node after test publication.
test-download¶
The esgtest_publish
utility can test the unrestricted download of the test file from the default thredds root (assumed to be the same file system) with --test-download
or -d
option added to command line.