Uploaded image for project: 'Fedora Repository Project'
  1. Fedora Repository Project
  2. FCREPO-2005

Default activemq configuration results in dropped messages to fcrepo-camel-indexing-triplestore under load.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: Fedora 4.5.0
    • Fix Version/s: Fedora 4.7.1
    • Component/s: f4-camel
    • Labels:
    • Roadmap Theme:
      Scalability/Performance
    • Sprint:
      Sprint 2015 - 14, Sprint 2016 - 17

      Description

      In the default activemq configuration a ConstantPendingMessageLimitStrategy is used to limit messages on the topic to 1000.

      http://activemq.apache.org/slow-consumer-handling.html

      In the camel toolbox the fcrepo-camel-indexing-triplestore connects to that topic and in my case at least, is slower to process those messages than fedora is generating them and for large batch ingests a bunch get dropped leaving the triplestore in a worthless state.

        Attachments

          Activity

            People

            • Assignee:
              acoburn Aaron Coburn
              Reporter:
              mdurbin Michael Durbin
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: