Uploaded image for project: 'FTS'
  1. FTS
  2. FTS-669

Write logging messages without overlaps

    Details

    • Type: Task
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: fts 3.5.1
    • Component/s: Server
    • Security Level: Public Data (This ticket is visible to anyone on the internet and will be indexed by search engines)
    • Labels:
      None

      Description

      Caused by multi-threading writes when logging fts url copy operations.

      Example of an event log where an atlas and a lhcb submissions are overlapped:

      "INFO Mon Aug 15 08:28:02 2016 ;Transfer params: INFO Mon Aug 15 08:28:02 2016 ;Transfer params: fts_url_copy --overwrite --monitoring --active 38 --alias fts3.cern.ch --checksum ADLER32:7cae661b --compare-checksum c --debug 0 --dest-token-desc ATLASDATADISK --destination srm://atlassrm-fzk.gridka.de:8443/srm/managerv2?SFN=/pnfs/gridka.de/atlas/disk-only/atlasdatadisk/rucio/data16_13TeV/18/79/RAW.09236670._000680.pool.root.1 --file-id 953882145 --file-metadata

      {\\\"adler32\\\":?\\\"7cae661b\\\",?\\\"src_type\\\":?\\\"DISK\\\",?\\\"src_rse\\\":?\\\"BNL-OSG2_DATADISK\\\",?\\\"request_id\\\":?\\\"9f60c88ce8b64cb3a16ea293bae8987a\\\",?\\\"src_rse_id\\\":?\\\"b64daf80eed64d5aabb02a6c457edc44\\\",?\\\"name\\\":?\\\"RAW.09236670._000680.pool.root.1\\\",?\\\"request_type\\\":?\\\"transfer\\\",?\\\"filesize\\\":?308969196,?\\\"dest_rse_id\\\":?\\\"a9dd4f46935d46ffa0962a9150235a67\\\",?\\\"activity\\\":?\\\"Express\\\",?\\\"dst_rse\\\":?\\\"FZK-LCG2_DATADISK\\\",?\\\"dst_type\\\":?\\\"DISK\\\",?\\\"scope\\\":?\\\"data16_13TeV\\\",?\\\"md5\\\":?null}

      --infosystem lcg-bdii.cern.ch:2170 --job-id 6a8d7ffa-62b1-11e6-995e-02163e019034 --job-metadata

      {\\\"multi_sources\\\":?true,?\\\"issuer\\\":?\\\"rucio\\\"}

      --job_m_replica true --last_replica false --logDir /var/log/fts3/transfers --nstreams 4 --proxy /tmp/x509up_h8194396766793549070XdcXchXdcXcernXouXorganicXunitsXouXusersXcnXddmadminXcnX531497XcnXrobotXXatlasXdataXmanagement --retry 0 --retry_max 0 --source srm://dcsrm.usatlas.bnl.gov:8443/srm/managerv2?SFN=/pnfs/usatlas.bnl.gov/BNLT0D1/rucio/data16_13TeV/18/79/RAW.09236670._000680.pool.root.1 --tcp-buffersize 0 --timeout 4000 --user-dn /DC=ch/DC=cern/OU=Organic?Units/OU=Users/CN=ddmadmin/CN=531497/CN=Robot:?ATLAS?Data?Management --user-filesize 308969196 --vo atlasfts_url_copy --overwrite --monitoring --active 3 --alias fts3.cern.ch --checksum 1be406e5 --compare-checksum c --debug 0 --dest-token-desc LHCb-Tape --destination srm://srm-lhcb.cern.ch:8443/srm/managerv2?SFN=/castor/cern.ch/grid/lhcb/LHCb/Collision16/RDST/00051872/0033/00051872_00339949_1.rdst --file-id 953882046 --file-metadata null --infosystem lcg-bdii.cern.ch:2170 --job-id 6a0f97ca-62b1-11e6-9d18-02163e0182a7 --job-metadata null --last_replica false --logDir /var/log/fts3/transfers --nstreams 4 --proxy /tmp/x509up_h17622373576439270605XdcXchXdcXcernXouXorganicXunitsXouXusersXcnXcharpentXcnX381668XcnXphilippeXcharpentier --retry 0 --retry_max 3 --source srm://srm-eoslhcb.cern.ch:8443/srm/v2/server?SFN=/eos/lhcb/grid/prod/lhcb/buffer/lhcb/LHCb/Collision16/RDST/00051872/0033/00051872_00339949_1.rdst --source-token-desc LHCb-EOS --tcp-buffersize 0 --timeout 4000 --user-dn /DC=ch/DC=cern/OU=Organic?Units/OU=Users/CN=charpent/CN=381668/CN=Philippe?Charpentier --user-filesize 2447521971 --vo lhcb"

        Attachments

          Activity

            People

            • Assignee:
              aalvarez Alejandro Alvarez Ayllon
              Reporter:
              marsuaga Maria Arsuaga Rios
              Component Watchers:
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: