Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18521 ABFS ReadBufferManager buffer sharing across concurrent HTTP requests
  3. HADOOP-18546

disable purging list of in progress reads in abfs stream closed

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      turn off the prune of in progress reads in ReadBufferManager::purgeBuffersForStream

      this will ensure active prefetches for a closed stream complete. they wiill then get to the completed list and hang around until evicted by timeout, but at least prefetching will be safe.

      When backporting

      Attachments

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            pranavsaxena Pranav Saxena
            stevel@apache.org Steve Loughran
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment