Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-23154

Fix race condition in Utilities::mvFileToFinalPath

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • HiveServer2
    • None

    Description

      Utilities::mvFileToFinalPath is used for moving files from "/_tmp.-ext to "/-ext" folder. Tasks write data to "_tmp" . Before writing to final destination, they are moved to "-ext" folder. As part of it, it has checks to ensure that run-away task outputs are not copied to "-ext" folder.

      Currently, there is a race condition between computing the snapshot of files to be copied and the rename operation. Same issue persists in "insert into" case as well.

      Attachments

        1. HIVE-23154.3.patch
          9 kB
          Rajesh Balamohan
        2. HIVE-23154.1.patch
          5 kB
          Rajesh Balamohan

        Activity

          People

            rajesh.balamohan Rajesh Balamohan
            rajesh.balamohan Rajesh Balamohan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: