Uploaded image for project: 'Islandora'
  1. Islandora
  2. ISLANDORA-1475

Limit the use of Inline datastreams.

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Ready for Test
    • Fix Version/s: 7.x-1.7
    • Component/s: Tuque API
    • Labels:
      None

      Description

      Due to the cyclical efficiency gains in ingest scripts coupled with broad and aging hardware platforms we are experiencing degenerative processing capability that results in break scenarios for rapid batch ingests (commonly known as 409 errors). This is causing operation adversity that can be alleviated by moving from inline to managed datastreams.

      This is a continuation of https://jira.duraspace.org/browse/ISLANDORA-675 .
      Instead of just targeting metadata datastreams we should target all inline datastreams.

      The specific trouble is that Fedora runs into write locks with the FOXML and 409s under heavy load. Heavy load is determined both by how much work Fedora is being asked to do (both on a FOXML and system level) and the hardware it has available to do it. This most often has catastrophic consequences for rapid batch ingests but in some cases impacts front end single object ingests.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              willtp87 William Panting
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: