Branch: refs/heads/xrdR5
Home: https://github.com/xrootd/xrootd
Commit: 9b6d58252f37e27f5f1d66a1f8822f9c7519f904
https://github.com/xrootd/xrootd/commit/9b6d58252f37e27f5f1d66a1f8822f9c7519f904
Author: Matevz Tadel <[log in to unmask]>
Date: 2018-12-10 (Mon, 10 Dec 2018)
Changed paths:
M src/XrdFileCache/XrdFileCache.cc
M src/XrdFileCache/XrdFileCache.hh
M src/XrdFileCache/XrdFileCacheCommand.cc
M src/XrdFileCache/XrdFileCacheConfiguration.cc
M src/XrdFileCache/XrdFileCacheFile.cc
M src/XrdFileCache/XrdFileCacheFile.hh
M src/XrdFileCache/XrdFileCacheIOEntireFile.cc
M src/XrdFileCache/XrdFileCacheInfo.cc
M src/XrdFileCache/XrdFileCacheInfo.hh
M src/XrdFileCache/XrdFileCachePrint.cc
M src/XrdFileCache/XrdFileCachePurge.cc
M src/XrdFileCache/XrdFileCacheStats.hh
M src/XrdFileCache/XrdFileCacheVRead.cc
Log Message:
-----------
Extend cinfo to format to include number of accesses and allow record merging.
Also includes:
* Rename stat variables to match regular cache nomenclature.
* Some preliminary structs for per directory statistics collection.
Commit: 077e35258274785a50ab70c41787bb371e819ed4
https://github.com/xrootd/xrootd/commit/077e35258274785a50ab70c41787bb371e819ed4
Author: Matevz Tadel <[log in to unmask]>
Date: 2018-12-10 (Mon, 10 Dec 2018)
Changed paths:
M src/XrdFileCache/XrdFileCacheConfiguration.cc
Log Message:
-----------
Check data space size during configuration processing.
Commit: 80ec171e67a627dbe9d002a98cb9c94e21ac2239
https://github.com/xrootd/xrootd/commit/80ec171e67a627dbe9d002a98cb9c94e21ac2239
Author: Matevz Tadel <[log in to unmask]>
Date: 2018-12-14 (Fri, 14 Dec 2018)
Changed paths:
M src/XrdFileCache/XrdFileCache.cc
M src/XrdFileCache/XrdFileCache.hh
M src/XrdFileCache/XrdFileCacheCommand.cc
M src/XrdFileCache/XrdFileCacheConfiguration.cc
M src/XrdFileCache/XrdFileCacheFile.cc
M src/XrdFileCache/XrdFileCacheFile.hh
M src/XrdFileCache/XrdFileCachePurge.cc
M src/XrdFileCache/XrdFileCacheStats.hh
Log Message:
-----------
Per directory stat processing.
First version, not fully tested. Prints out report into log file during every purge cycle, e.g. (edited for readability):
```
DataFsState::dump_recursively epoch = 1544824366 delta_t = 300 max_depth = 4
0 root usage=26157253632 usage_extra=14831391356 usage_total=40988644988 num_ios=4 duration=357 b_hit=20378665723 b_miss=7415529472 b_byps=0 b_wrtn=14831391356
1 store usage=26157253632 usage_extra=14831391356 usage_total=40988644988 num_ios=4 duration=357 b_hit=20378665723 b_miss=7415529472 b_byps=0 b_wrtn=14831391356
2 user usage=26157253632 usage_extra=14831391356 usage_total=40988644988 num_ios=4 duration=357 b_hit=20378665723 b_miss=7415529472 b_byps=0 b_wrtn=14831391356
3 matevz usage=26157253632 usage_extra=14831391356 usage_total=40988644988 num_ios=4 duration=357 b_hit=20378665723 b_miss=7415529472 b_byps=0 b_wrtn=14831391356
4 xrdmon-far usage= 2558525440 usage_extra= 5705110140 usage_total= 8263635580 num_ios=2 duration=143 b_hit= 5410980421 b_miss=2852388864 b_byps=0 b_wrtn= 5705110140
4 xrdmon-xxx usage=17871405056 usage_extra= 9126281216 usage_total=26997686272 num_ios=2 duration=214 b_hit=14967685302 b_miss=4563140608 b_byps=0 b_wrtn= 9126281216
usage - usage as "measured" during purge scan
usage_extra - collected from write queue and accumulated between purge scans
note, purge scan does not happen every purge cycle!
usage_total - sum of above two
b_wrtn - number of bytes written in this directory during this cycle
others should be clear
```
pfc.dirstats maxdepth is supported.
pfc.dirstats dir is converted to maxdepth so it sort of works ... but
prints out all the directories down to maxdepth, not only the selected ones.
Commit: 694f15b3056b9cabf2954387bd5f2d8fd9d0d425
https://github.com/xrootd/xrootd/commit/694f15b3056b9cabf2954387bd5f2d8fd9d0d425
Author: Matevz Tadel <[log in to unmask]>
Date: 2019-07-01 (Mon, 01 Jul 2019)
Changed paths:
M src/XrdFileCache/XrdFileCache.cc
M src/XrdFileCache/XrdFileCache.hh
M src/XrdFileCache/XrdFileCacheCommand.cc
M src/XrdFileCache/XrdFileCacheConfiguration.cc
M src/XrdFileCache/XrdFileCacheFile.cc
M src/XrdFileCache/XrdFileCacheFile.hh
M src/XrdFileCache/XrdFileCacheIOEntireFile.cc
M src/XrdFileCache/XrdFileCacheInfo.cc
M src/XrdFileCache/XrdFileCacheInfo.hh
M src/XrdFileCache/XrdFileCachePrint.cc
M src/XrdFileCache/XrdFileCachePurge.cc
M src/XrdFileCache/XrdFileCacheStats.hh
M src/XrdFileCache/XrdFileCacheVRead.cc
Log Message:
-----------
Merge remote-tracking branch 'oss/pfc-dirstats' into xrd-5-mon
Commit: 92228ed5aa49e1b74d246b75158a6c84ea36a5f9
https://github.com/xrootd/xrootd/commit/92228ed5aa49e1b74d246b75158a6c84ea36a5f9
Author: Matevz Tadel <[log in to unmask]>
Date: 2019-07-01 (Mon, 01 Jul 2019)
Changed paths:
M src/XrdFileCache/XrdFileCache.cc
M src/XrdFileCache/XrdFileCacheFile.cc
M src/XrdFileCache/XrdFileCachePrint.cc
M src/XrdFileCache/XrdFileCachePurge.cc
Log Message:
-----------
Merge follow-up changes.
Commit: 39f4e74ee44dc2b6abd3480bcc7f48089dfcae88
https://github.com/xrootd/xrootd/commit/39f4e74ee44dc2b6abd3480bcc7f48089dfcae88
Author: Matevž Tadel <[log in to unmask]>
Date: 2019-07-01 (Mon, 01 Jul 2019)
Changed paths:
M src/XrdFileCache/XrdFileCache.cc
M src/XrdFileCache/XrdFileCache.hh
M src/XrdFileCache/XrdFileCacheCommand.cc
M src/XrdFileCache/XrdFileCacheConfiguration.cc
M src/XrdFileCache/XrdFileCacheFile.cc
M src/XrdFileCache/XrdFileCacheFile.hh
M src/XrdFileCache/XrdFileCacheIOEntireFile.cc
M src/XrdFileCache/XrdFileCacheInfo.cc
M src/XrdFileCache/XrdFileCacheInfo.hh
M src/XrdFileCache/XrdFileCachePrint.cc
M src/XrdFileCache/XrdFileCachePurge.cc
M src/XrdFileCache/XrdFileCacheStats.hh
M src/XrdFileCache/XrdFileCacheVRead.cc
Log Message:
-----------
Merge pull request #1014 from osschar/xrd-5-mon
[XCache] merge development branch osschar/pfc-dirstats with per directory stats collection
Compare: https://github.com/xrootd/xrootd/compare/8eaf39fb6224...39f4e74ee44d
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1
|
