Uploaded image for project: 'Fedora Repository Project'
  1. Fedora Repository Project
  2. FCREPO-2105

Retrieving the description of an object with many reference properties is slow

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: Fedora 4.5.1
    • Fix Version/s: Fedora 4.7.4
    • Component/s: f4-core
    • Labels:
    • Sprint:
      Sprint 2017 - 19

      Description

      I have been testing the performance of Fedora objects that link to many other repository objects (for example a collection with many members, or a book that contains many pages).

      I've written up some of my findings in the Fedora wiki[1]. But the TL;DR version is that it's reasonably fast for small numbers of members, but gets progressively slower for larger numbers of members. And the move from LevelDB to a relational database for storing metadata looks like it's adding to this issue. So a book with 500+ pages or a collection that contains thousands of objects slows down to 30+ seconds to read the RDF from Fedora.

      I mostly wanted to let people know about this issue so it can be a factor in discussions about modeling, performance, etc.

      -Esmé

      1. https://wiki.duraspace.org/display/FF/Real+World+Performance#RealWorldPerformance-many_members

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                dbernstein Danny Bernstein
                Reporter:
                esc Esmé Cowles
                Reviewer:
                Andrew Woods
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: