Uploaded image for project: 'DSpace'
  1. DSpace
  2. DS-615

Ability to perform maintenance on SOLR with solr.optimize

    Details

    • Type: Improvement
    • Status: Closed (View Workflow)
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.8.0
    • Component/s: Solr
    • Labels:
      None
    • Environment:
      solr
    • Attachments:
      3
    • Comments:
      10
    • Documentation Status:
      In Description

      Description

      By adding all historical log data to a SOLR index, as well as the constant addition of new records, it might be good for the efficient performance of a SOLR index to periodically run solr.optimize.

      Therefore I've created a patch which allows you to run solr.optimize on your solr instance from the command line. This could allow you to add a cron task that runs this periodic maintenance. It also spits out the amount of time taken to run the optimize task.

      Once you patch your instance. You can execute this with
      /dspace/bin/dspace stats-util --optimize
      or
      /dspace/bin/dspace stats-util -o

      Output looks like:
      SOLR Optimize – Process Started:1277486321673
      SOLR Optimize – Process Finished:1277486321738
      SOLR Optimize – Total time taken:65 (ms).

      It would be useful to profile the amount of time taken for solr operations add/update/query before running this optimize task, and then afterwards.

        Attachments

        1. search-solr-optimize-quick-and-dirty.patch
          3 kB
          Peter Dietz
        2. solr-optimize.patch
          2 kB
          Peter Dietz
        3. SolrOptimizeAndAutoCommit.patch
          3 kB
          Claudia Jürgen

          Activity

            People

            • Assignee:
              benbosman Ben Bosman
              Reporter:
              peterdietz Peter Dietz
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: