Uploaded image for project: 'DMC - Development'
  1. DMC - Development
  2. DMC-353

HTTP plugin does not clean up destination on failure

    XMLWordPrintable

Details

    • Task
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • gfal 2.5
    • gfal 2.6
    • gfal 2
    • None

    Description

      Hi,

      Ah, I see your point now. In any case, I refer to my previous mail: that wasn't a third party transfer (which makes me think maybe neither was the previous one that did succeed), but a local one.

      Please, remember me next week if I forget, or even better, create a ticket and assign it to me

      Regards.
      ________________________________________
      From: Michail Salichos
      Sent: 02 March 2014 17:49
      To: Alejandro Alvarez Ayllon; Mario Lassnig
      Subject: RE: one more http problem

      Hello Ale,

      The problem I asked Mario to report related to overwrite is the following:

      The first attempt failed with "Multi-part write is not supported by Http". When the transfer was retried failed with "overwrite error" because the destination file was not cleaned up/deleted properly after the first attempt and the second found it in the storage as a corrupted existing file.

      Michail
      ________________________________________
      From: Alejandro Alvarez Ayllon
      Sent: 28 February 2014 20:02
      To: Mario Lassnig; Michail Salichos
      Subject: RE: one more http problem

      Local transfer error on DST davs://f01-060-114-e.gridka.de:2880/pnfs/gridka.de/atlas/disk-only/atlasscratchdisk/rucio01/mock/2d/a4/file-c8af06a6780f46daa986414eaca5cfd5 : [gfal_plugin_writeG] Multi-part write is not supported by Http !

      ???

      Does that machine have the http plugin enabled? Because it is falling back to local copy (i.e. downloading and then uploading)

      And what's the issue with overwrite? The log says:

      Overwrite enabled:0

      ________________________________________
      From: Mario Lassnig
      Sent: 28 February 2014 10:54
      To: Alejandro Alvarez Ayllon; Michail Salichos
      Subject: one more http problem

      See below.

      Also, Michail told me to mention: "http gfal2 plug-in is not deleting
      the destination file "Destination file already exists and overwrite is
      not enabled""

      Cheers,
      Mario

      https://fts3-pilot.cern.ch:8449/fts3/ftsmon/#/job/73daf944-a05c-11e3-937b-02163e00a1a3

      2014-02-28T09:42:32
      [gfalt_copy_file]Local transfer error on DST
      davs://f01-060-114-e.gridka.de:2880/pnfs/gridka.de/atlas/disk-only/atlasscratchdisk/rucio01/mock/2d/a4/file-c8af06a6780f46daa986414eaca5cfd5
      : [gfal_plugin_writeG] Multi-part write is not supported by Http !


      Mario Lassnig
      CERN PH-ADP-CO 1/R22
      1211 Geneva 23
      Switzerland
      +41 22 76 71268
      mario.lassnig@cern.ch

      Attachments

        Activity

          People

            aalvarez Alejandro Alvarez Ayllon (Inactive)
            msalicho Michail Salichos (Inactive)
            Mihai Patrascoiu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: