Uploaded image for project: 'DSpace'
  1. DSpace
  2. DS-1936

Robots.txt should include a SiteMap entry

    XMLWordPrintable

    Details

    • Attachments:
      0
    • Comments:
      9
    • Documentation Status:
      Not Required

      Description

      The current DSpace 'robots.txt' fails to include a reference to the SiteMaps generated by DSpace, as recommended both by sitemaps.org and Google:

      http://www.sitemaps.org/protocol.html#submit_robots
      https://support.google.com/webmasters/answer/183669?hl=en

      This may make the DSpace SiteMaps harder to "auto-discover" even when they are enabled.

      I'd propose adding such an entry to both XMLUI and JSPUI which points to [dspace.url]/htmlmap

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                tdonohue Tim Donohue
                Reporter:
                tdonohue Tim Donohue
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: