Uploaded image for project: 'DMC - Development'
  1. DMC - Development
  2. DMC-958

Resume on xfer with metalinks creates file with a wrong filesize



    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: davix 0.6.6
    • Fix Version/s: davix 0.6.7
    • Component/s: Davix
    • Security Level: Public Data (This ticket is visible to anyone on the internet and will be indexed by search engines)
    • Labels:


      It seems that davix restarts the xfer just appending to the previous failed file.

      From M.Ebert:


      In dynafed I setup 2 different S3 storage elements, both at the same endpoint. In both S3 storage elements I have the same file.
      Now when I go to the dynafed web page, I can see in the metalink for the file that both locations are correctly added and visible as resources.

      In a first test, I tried to copy the file from dynafed to a local disk. That worked fine and the file was on local disk with the correct file size of 1.2 GB, as expected.

      In a second test, I started the transfer again but halt the S3 storage server that was used for the transfer while the copy process was ongoing. Within a short time (between less than a second and up to about 5 seconds), the copy process continued using the second server. That was what I expected, however the file in the end was about double the correct size (2.1GB).

      So far I used only davix-get to get the file out of dynafed, not sure if the same happens when using other tools. Trying to download using a browser (chrome) results in a stale download without a redirection to the second server.

      Has anyone seen this before? What is expect to happen if a server/site/network to a site goes down while file access through dynafed is ongoing and multiple copies of a file exist within dynafed?




            gbitzes Georgios Bitzes
            furano Fabrizio Furano
            Component Watchers:
            0 Vote for this issue
            1 Start watching this issue