Hi Fabio,
On 4/6/22 12:01, Fabio Andrijauskas wrote:
> Hi all,
>
> On Xrootd G-stream, can I use the detach_time, attach_time, and size to
> calculate the bandwidth of a transfer?
Yes, you could estimate the average bandwidth. Note that there is also
access_count -- this tells you how many clients were connected through this
attach/detach period to this specific file -- and there is no information in
g-stream about how much data each of them requested. There might also be
prefetching going on.
Cheers,
Matevz
> { "_index": "xrd-cache-ilm-000007", "_type": "_doc", "_id":
> "luIaAIABOTrVvgqCHVBo", "_score": 1, "_source": { "sid":
> "1649176624#145.146.100.30#36346", "access_count": 212, "server_ip":
> "145.146.100.30", "block_hit_cache": 25165824, "numbers_blocks": 484,
> "file_path":
> "/user/ligo/frames/O3/V1Online/V-V1Online-12381/V-V1Online-1238172000-2000.gwf",
> "numbers_blocks_done": 287, "vo": "osg", "size": 253252790, "remotes_origin": [
> "red-gridftp12.unl.edu:1094
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__red-2Dgridftp12.unl.edu-3A1094&d=DwMFaQ&c=-35OiAkTchMrZOngvJPOeA&r=f2PhPg2_OoVvPAKGXfp4WG1YcdhQC9qsy2uMHw3Z_6k&m=QY4zyoQfTLHwlVGzXgjL9KM9GOalKehce9P1qhaUg7t5QQGgbI8jfCw2FpQaoEu7&s=TGzcN50jBHx8Q6nzEfmHeXRV1mAI4Ym08Twt7DvizBc&e=>"
> ], "numbers_checksum_errors": 0, "server_hostname":
> "fiona-r-uva.vlan7.uvalight.net
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__fiona-2Dr-2Duva.vlan7.uvalight.net&d=DwMFaQ&c=-35OiAkTchMrZOngvJPOeA&r=f2PhPg2_OoVvPAKGXfp4WG1YcdhQC9qsy2uMHw3Z_6k&m=QY4zyoQfTLHwlVGzXgjL9KM9GOalKehce9P1qhaUg7t5QQGgbI8jfCw2FpQaoEu7&s=8qDyNW7Z7ANvNygirGGKKwiS4W-lSFE9mCwUkCuFNng&e=>",
> "detach_time": 1649269101, "block_size": 524288, "event": "file_close",
> "block_bypass_cache": 0, "cache_request": "partial", "block_miss_cache": 0,
> "@version": "1", "attach_time": 1649269071, "site": "Amsterdam-Kubernetes-PRP",
> "@timestamp": "2022-04-06T18:19:13.027Z" }, "fields": { "file_path": [
> "/user/ligo/frames/O3/V1Online/V-V1Online-12381/V-V1Online-1238172000-2000.gwf"
> ], "vo.keyword": [ "osg" ], "block_hit_cache": [ 25165824 ],
> "numbers_checksum_errors": [ 0 ], "access_count": [ 212 ], "sid.keyword": [
> "1649176624#145.146.100.30#36346" ], "site.keyword": [
> "Amsterdam-Kubernetes-PRP" ], "sid": [ "1649176624#145.146.100.30#36346" ],
> "file_path.keyword": [
> "/user/ligo/frames/O3/V1Online/V-V1Online-12381/V-V1Online-1238172000-2000.gwf"
> ], "numbers_blocks": [ 484 ], "@version": [ "1" ], "server_ip": [
> "145.146.100.30" ], "event": [ "file_close" ], "block_size": [ 524288 ],
> "event.keyword": [ "file_close" ], "server_hostname.keyword": [
> "fiona-r-uva.vlan7.uvalight.net
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__fiona-2Dr-2Duva.vlan7.uvalight.net&d=DwMFaQ&c=-35OiAkTchMrZOngvJPOeA&r=f2PhPg2_OoVvPAKGXfp4WG1YcdhQC9qsy2uMHw3Z_6k&m=QY4zyoQfTLHwlVGzXgjL9KM9GOalKehce9P1qhaUg7t5QQGgbI8jfCw2FpQaoEu7&s=8qDyNW7Z7ANvNygirGGKKwiS4W-lSFE9mCwUkCuFNng&e=>"
> ], "remotes_origin.keyword": [ "red-gridftp12.unl.edu:1094
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__red-2Dgridftp12.unl.edu-3A1094&d=DwMFaQ&c=-35OiAkTchMrZOngvJPOeA&r=f2PhPg2_OoVvPAKGXfp4WG1YcdhQC9qsy2uMHw3Z_6k&m=QY4zyoQfTLHwlVGzXgjL9KM9GOalKehce9P1qhaUg7t5QQGgbI8jfCw2FpQaoEu7&s=TGzcN50jBHx8Q6nzEfmHeXRV1mAI4Ym08Twt7DvizBc&e=>"
> ], "cache_request.keyword": [ "partial" ], "@version.keyword": [ "1" ],
> "server_ip.keyword": [ "145.146.100.30" ], "detach_time": [ 1649269101 ],
> "server_hostname": [ "fiona-r-uva.vlan7.uvalight.net
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__fiona-2Dr-2Duva.vlan7.uvalight.net&d=DwMFaQ&c=-35OiAkTchMrZOngvJPOeA&r=f2PhPg2_OoVvPAKGXfp4WG1YcdhQC9qsy2uMHw3Z_6k&m=QY4zyoQfTLHwlVGzXgjL9KM9GOalKehce9P1qhaUg7t5QQGgbI8jfCw2FpQaoEu7&s=8qDyNW7Z7ANvNygirGGKKwiS4W-lSFE9mCwUkCuFNng&e=>"
> ], "cache_request": [ "partial" ], "numbers_blocks_done": [ 287 ],
> "block_miss_cache": [ 0 ], "attach_time": [ 1649269071 ], "site": [
> "Amsterdam-Kubernetes-PRP" ], "@timestamp": [ "2022-04-06T18:19:13.027Z" ],
> "size": [ 253252790 ], "block_bypass_cache": [ 0 ], "vo": [ "osg" ],
> "remotes_origin": [ "red-gridftp12.unl.edu:1094
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__red-2Dgridftp12.unl.edu-3A1094&d=DwMFaQ&c=-35OiAkTchMrZOngvJPOeA&r=f2PhPg2_OoVvPAKGXfp4WG1YcdhQC9qsy2uMHw3Z_6k&m=QY4zyoQfTLHwlVGzXgjL9KM9GOalKehce9P1qhaUg7t5QQGgbI8jfCw2FpQaoEu7&s=TGzcN50jBHx8Q6nzEfmHeXRV1mAI4Ym08Twt7DvizBc&e=>"
> ] } }
> *
> *
> *--
> Fábio Andrijauskas*
>
> --------------------------------------------------------------------------------
>
> Use REPLY-ALL to reply to list
>
> To unsubscribe from the XROOTD-L list, click the following link:
> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DXROOTD-2DL-26A-3D1&d=DwMFaQ&c=-35OiAkTchMrZOngvJPOeA&r=f2PhPg2_OoVvPAKGXfp4WG1YcdhQC9qsy2uMHw3Z_6k&m=QY4zyoQfTLHwlVGzXgjL9KM9GOalKehce9P1qhaUg7t5QQGgbI8jfCw2FpQaoEu7&s=uf7pQmrYvgkVwyEcQmnVhqAfQWJsiJn3G3aidGPL-o8&e=>
>
>
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-L list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-L&A=1
