Hi Andy,
I modified the configuration of the xrootd dataserver and removed the io
parameter from xrood.monitor:
xrootd.monitor all flush 30s window 15s dest files info user
pcardaab.cern.ch:9930
Now it seems that the window is ok and the flush rule works, but it
works only once! I get a single trace datagram, no matter how many
xdrcp's I run afterwards - I will get only the map datagrams. I will get
another trace datagram only after restarting xrootd.
As a remark, about the documentation, you say there that the datagrams
are self-consistent. This is true in regard to the time from windows;
however, this is not true for dictid mappings. If for instance a map
datagram is lost, you can do nothing with the trace that refers to it.
Catalin.
Andy Hanushevsky wrote:
> Hi Catalin,
>
>> I modified a little the configuration so that the flush is done after
>> 30s and the window is 15s to show better the points 1) and 2).
>
> OK, Now, I see your point. The flush applies only to non-I/O monitoring
> data (i.e., everything but actual read/write calls). A stream that
> includes I/O events automatically bdsables the flush feature as well.
> Typically, people will segeragate the streams using the summary data for
> real-time reporting and I/O event data for application analysis. We did
> this because we cannot provide a flush feature for detailed I/O
> information. To do so would bog down the server to the point of making
> not only the flushing useless but also the server. We tried, it doesn't
> scale. Well, at leaat now I know that the documentation is not clear on
> this point.
>
>> I also attached the logs and binary dumps I obtained from my ML module.
>
> Thanks, I'll look at them.
>
> Andy
received packet of size 34 from monalisa.cern.ch [192.91.244.18] at Thu Apr 28 11:26:41 CEST 2005
117[u]0 0 0 66[B]112[p]-84 64[@]0 0 0 1 99[c]97[a]116[t]97[a]99[c]46[.]54[6]55[7]53[5]49[1]58[:]49[1]54[6]64[@]112[p]99[c]97[a]114[r]100[d]97[a]97[a]98[b]
--------------------------
Reading Header
code = u -> Follows dictid mapping to the user login name
pseq = 0
plen = 0
stod = 1114680384 = Thu Apr 28 11:26:24 CEST 2005
--------------------------
Wrote binary packet in /tmp/monXrootd.0
Reading Map Message
dictID = 1 Info = catac.6751:16@pcardaab
==========================
received packet of size 49 from monalisa.cern.ch [192.91.244.18] at Thu Apr 28 11:26:41 CEST 2005
100[d]1 0 0 66[B]112[p]-84 64[@]0 0 0 2 99[c]97[a]116[t]97[a]99[c]46[.]54[6]55[7]53[5]49[1]58[:]49[1]54[6]64[@]112[p]99[c]97[a]114[r]100[d]97[a]97[a]98[b]10 47[/]116[t]109[m]112[p]47[/]102[f]105[i]108[l]101[e]45[-]49[1]46[.]109[m]108[l]
--------------------------
Reading Header
code = d -> Follows dictid mapping to a user/path combination
pseq = 1
plen = 0
stod = 1114680384 = Thu Apr 28 11:26:24 CEST 2005
--------------------------
Wrote binary packet in /tmp/monXrootd.1
Reading Map Message
dictID = 2 Info = catac.6751:16@pcardaab /tmp/file-1.ml
==========================
received packet of size 88 from monalisa.cern.ch [192.91.244.18] at Thu Apr 28 11:26:54 CEST 2005
116[t]2 0 0 66[B]112[p]-84 64[@]-32 0 0 0 0 0 0 0 0 0 0 0 66[B]112[p]-84 79[O]-128 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2 -64 0 0 0 0 13 120[x]-98 0 0 0 0 0 0 0 2 -48 0 0 0 0 0 0 0 0 0 0 1 0 0 0 1 -32 0 0 0 0 0 0 0 66[B]112[p]-84 94[^]66[B]112[p]-84 94[^]
--------------------------
Reading Header
code = t -> Follows a file or I/O request trace
pseq = 2
plen = 0
stod = 1114680384 = Thu Apr 28 11:26:24 CEST 2005
--------------------------
Wrote binary packet in /tmp/monXrootd.2
Reading Trace Message
WINDOW: lastEND: Thu Jan 01 01:00:00 CET 1970 thisSTART: Thu Apr 28 11:26:39 CEST 2005
Reading Trace Message
OPEN: dictID=2 ref=catac.6751:16@pcardaab /tmp/file-1.ml
Reading Trace Message
CLOSE: rShift=0 wShift=0 rTot=882846 wTot=0 dictID=2 ref=catac.6751:16@pcardaab /tmp/file-1.ml
Reading Trace Message
DISCONNECT: after 1 sec dictID=1 ref=catac.6751:16@pcardaab
Reading Trace Message
WINDOW: lastEND: Thu Apr 28 11:26:54 CEST 2005 thisSTART: Thu Apr 28 11:26:54 CEST 2005
==========================
received packet of size 34 from monalisa.cern.ch [192.91.244.18] at Thu Apr 28 11:27:05 CEST 2005
117[u]3 0 0 66[B]112[p]-84 64[@]0 0 0 3 99[c]97[a]116[t]97[a]99[c]46[.]54[6]55[7]55[7]48[0]58[:]49[1]54[6]64[@]112[p]99[c]97[a]114[r]100[d]97[a]97[a]98[b]
--------------------------
Reading Header
code = u -> Follows dictid mapping to the user login name
pseq = 3
plen = 0
stod = 1114680384 = Thu Apr 28 11:26:24 CEST 2005
--------------------------
Wrote binary packet in /tmp/monXrootd.3
Reading Map Message
dictID = 3 Info = catac.6770:16@pcardaab
==========================
received packet of size 49 from monalisa.cern.ch [192.91.244.18] at Thu Apr 28 11:27:05 CEST 2005
100[d]4 0 0 66[B]112[p]-84 64[@]0 0 0 4 99[c]97[a]116[t]97[a]99[c]46[.]54[6]55[7]55[7]48[0]58[:]49[1]54[6]64[@]112[p]99[c]97[a]114[r]100[d]97[a]97[a]98[b]10 47[/]116[t]109[m]112[p]47[/]102[f]105[i]108[l]101[e]45[-]49[1]46[.]109[m]108[l]
--------------------------
Reading Header
code = d -> Follows dictid mapping to a user/path combination
pseq = 4
plen = 0
stod = 1114680384 = Thu Apr 28 11:26:24 CEST 2005
--------------------------
Wrote binary packet in /tmp/monXrootd.4
Reading Map Message
dictID = 4 Info = catac.6770:16@pcardaab /tmp/file-1.ml
==========================
received packet of size 34 from monalisa.cern.ch [192.91.244.18] at Thu Apr 28 11:28:56 CEST 2005
117[u]5 0 0 66[B]112[p]-84 64[@]0 0 0 5 99[c]97[a]116[t]97[a]99[c]46[.]54[6]56[8]50[2]55[7]58[:]49[1]54[6]64[@]112[p]99[c]97[a]114[r]100[d]97[a]97[a]98[b]
--------------------------
Reading Header
code = u -> Follows dictid mapping to the user login name
pseq = 5
plen = 0
stod = 1114680384 = Thu Apr 28 11:26:24 CEST 2005
--------------------------
Wrote binary packet in /tmp/monXrootd.5
Reading Map Message
dictID = 5 Info = catac.6827:16@pcardaab
==========================
received packet of size 49 from monalisa.cern.ch [192.91.244.18] at Thu Apr 28 11:28:56 CEST 2005
100[d]6 0 0 66[B]112[p]-84 64[@]0 0 0 6 99[c]97[a]116[t]97[a]99[c]46[.]54[6]56[8]50[2]55[7]58[:]49[1]54[6]64[@]112[p]99[c]97[a]114[r]100[d]97[a]97[a]98[b]10 47[/]116[t]109[m]112[p]47[/]102[f]105[i]108[l]101[e]45[-]49[1]46[.]109[m]108[l]
--------------------------
Reading Header
code = d -> Follows dictid mapping to a user/path combination
pseq = 6
plen = 0
stod = 1114680384 = Thu Apr 28 11:26:24 CEST 2005
--------------------------
Wrote binary packet in /tmp/monXrootd.6
Reading Map Message
dictID = 6 Info = catac.6827:16@pcardaab /tmp/file-1.ml
==========================
received packet of size 34 from monalisa.cern.ch [192.91.244.18] at Thu Apr 28 11:30:48 CEST 2005
117[u]7 0 0 66[B]112[p]-84 64[@]0 0 0 7 99[c]97[a]116[t]97[a]99[c]46[.]54[6]56[8]57[9]56[8]58[:]49[1]54[6]64[@]112[p]99[c]97[a]114[r]100[d]97[a]97[a]98[b]
--------------------------
Reading Header
code = u -> Follows dictid mapping to the user login name
pseq = 7
plen = 0
stod = 1114680384 = Thu Apr 28 11:26:24 CEST 2005
--------------------------
Wrote binary packet in /tmp/monXrootd.7
Reading Map Message
dictID = 7 Info = catac.6898:16@pcardaab
==========================
received packet of size 49 from monalisa.cern.ch [192.91.244.18] at Thu Apr 28 11:30:48 CEST 2005
100[d]8 0 0 66[B]112[p]-84 64[@]0 0 0 8 99[c]97[a]116[t]97[a]99[c]46[.]54[6]56[8]57[9]56[8]58[:]49[1]54[6]64[@]112[p]99[c]97[a]114[r]100[d]97[a]97[a]98[b]10 47[/]116[t]109[m]112[p]47[/]102[f]105[i]108[l]101[e]45[-]50[2]46[.]109[m]108[l]
--------------------------
Reading Header
code = d -> Follows dictid mapping to a user/path combination
pseq = 8
plen = 0
stod = 1114680384 = Thu Apr 28 11:26:24 CEST 2005
--------------------------
Wrote binary packet in /tmp/monXrootd.8
Reading Map Message
dictID = 8 Info = catac.6898:16@pcardaab /tmp/file-2.ml
==========================
|