Print

Print


Hi Brian,

OK, seems to me that it's have responses that are bunching up. Did you turn 
on the rate limiting? If so, what is the "cms.dfs" directive look like?

Andy

P.S I will soon remove the offending code that you pointed out.

-----Original Message----- 
From: Brian Bockelman
Sent: Thursday, March 03, 2011 6:02 PM
To: Andrew Hanushevsky
Cc: xrootd-dev
Subject: Re: Delay for SelPrep


On Mar 3, 2011, at 7:54 PM, Andrew Hanushevsky wrote:

> Hi Brian,
>
> Could you produce similar stats for how many state requests each server 
> got?

One server is below (*).  However, I don't know if the log message occurs 
when it gets the query, or when it responds to the query.

> All that should be in the log. As for the 10 second variations that could 
> happen if the clients are being told to hold for one or two periods or the 
> not-available time of 10 seconds. That should be in the log as well.
>

I also included below when the selects were performed.  I don't know the 
best logging line to look for, so I included two different views.

I should mention: these servers are running the latest git sources; they 
ought to include the late limiting code.  The manager is running a release 
prior to 3.0.0; just upgraded that to the latest pre-release, which is how I 
found the bug in the other email.

Brian

(*)
[root@red-gridftp10 ~]# grep '18:3' /var/log/xrootd/cmsd.log | grep do_State 
| awk '{print $2;}' | uniq -c
      1 18:30:34
      1 18:30:52
      8 18:31:11
     43 18:31:12
     56 18:31:13
     43 18:31:14
     48 18:31:15
     48 18:31:16
     11 18:31:17
      1 18:31:22
      1 18:31:32
    120 18:31:52
     45 18:31:53
      9 18:31:54
      9 18:31:55
     10 18:31:56
      5 18:31:58
     10 18:32:01
     10 18:32:02
      1 18:32:08
     15 18:32:12
      2 18:32:13
      2 18:32:22
      2 18:32:23
    101 18:32:32
     51 18:32:33
      9 18:32:34
      2 18:32:35
      8 18:32:37
      7 18:32:41
      7 18:32:42
      2 18:32:43
      1 18:32:46
     13 18:32:52
      7 18:32:53
      1 18:32:54
      1 18:32:55
      2 18:32:58
      7 18:33:02
      3 18:33:03
      1 18:33:04
     13 18:33:06
      1 18:33:08
     13 18:33:10
     69 18:33:12
     50 18:33:13
      4 18:33:14
      1 18:33:24
      2 18:33:29
      2 18:33:30
      3 18:33:32
      5 18:33:33
      5 18:33:34
      8 18:33:35
      6 18:33:36
      2 18:33:37
      2 18:33:38
      2 18:33:40
      1 18:33:42
      1 18:33:43
      1 18:33:48
      1 18:34:07
      1 18:35:34
      1 18:35:52
      1 18:35:56
      1 18:36:00
      1 18:36:13
      1 18:36:21
      1 18:36:28
      1 18:36:41
      1 18:38:09
      1 18:38:34

(**)
[root@xrootd-itb ~]# grep 'Select seeking' /var/log/xrootd/cmsd.log | grep 
'18:3' | awk '{print $2;}' | uniq -c
      1 12:18:33
      8 18:31:11
     43 18:31:12
     55 18:31:13
     43 18:31:14
     48 18:31:15
     48 18:31:16
     31 18:31:17
     12 18:31:18
     21 18:31:19
     16 18:31:20
     45 18:31:21
     44 18:31:22
     34 18:31:23
     50 18:31:24
     50 18:31:25
     45 18:31:26
     52 18:31:27
     50 18:31:28
     72 18:31:29
     52 18:31:30
     47 18:31:31
      1 18:31:32
      1 18:31:41
      1 18:32:02
      1 18:33:10
      1 18:33:11
      1 18:33:24
      2 18:33:29
      2 18:33:30
      3 18:33:32
      5 18:33:33
      4 18:33:34
      8 18:33:35
      6 18:33:36
      2 18:33:37
      2 18:33:38
      2 18:33:40
      1 18:33:42
      1 18:33:43
      1 18:33:48
      1 18:34:07
      1 18:35:56
      1 18:36:00
      1 18:36:21
      1 18:36:28
      1 18:36:41
      1 18:38:09
      1 19:18:39
[root@xrootd-itb ~]# grep 'do_Select' /var/log/xrootd/cmsd.log | grep '18:3' 
| awk '{print $2;}' | uniq -c
      1 12:18:33
      1 18:31:11
     15 18:31:12
     20 18:31:13
     14 18:31:14
     14 18:31:15
     14 18:31:16
     19 18:31:17
      6 18:31:18
     10 18:31:19
      8 18:31:20
     11 18:31:21
     18 18:31:22
     14 18:31:23
     15 18:31:24
     26 18:31:25
     11 18:31:26
     22 18:31:27
     23 18:31:28
     24 18:31:29
     24 18:31:30
     25 18:31:31
      3 18:31:32
      1 18:31:41
      1 18:31:52
      1 18:32:02
      2 18:32:11
      2 18:32:13
     28 18:32:14
     38 18:32:15
     24 18:32:16
     30 18:32:17
     24 18:32:18
     20 18:32:19
     16 18:32:20
     12 18:32:21
     32 18:32:22
     28 18:32:23
     36 18:32:24
     30 18:32:25
     42 18:32:26
     20 18:32:27
     42 18:32:28
     46 18:32:29
     46 18:32:30
     46 18:32:31
     28 18:32:32
      2 18:32:45
      2 18:33:00
      1 18:33:10
      1 18:33:11
      2 18:33:16
      1 18:33:24
      1 18:33:29
      1 18:33:31
      1 18:33:32
      5 18:33:33
      2 18:33:34
      3 18:33:35
      8 18:33:36
      1 18:33:37
      3 18:33:38
      1 18:33:40
      2 18:33:43
      1 18:33:48
      2 18:33:58
      1 18:34:07
      2 18:34:10
      2 18:34:24
      2 18:34:30
      2 18:34:31
      2 18:34:32
      2 18:34:34
      4 18:34:35
      6 18:34:36
      6 18:34:37
      2 18:34:38
      4 18:34:39
      2 18:34:41
      2 18:34:48
      2 18:35:06
      2 18:35:42
      2 18:35:43
      1 18:35:56
      1 18:36:00
      1 18:36:21
      1 18:36:28
      3 18:36:41
      2 18:37:02
      2 18:37:46
      2 18:38:00
      1 18:38:09
      2 18:38:11
      2 18:38:12
      2 18:38:35
      2 19:18:30
      1 19:18:39
      2 19:43:11