Branch: refs/heads/xrdR5 Home: https://github.com/xrootd/xrootd Commit: 9b6d58252f37e27f5f1d66a1f8822f9c7519f904 https://github.com/xrootd/xrootd/commit/9b6d58252f37e27f5f1d66a1f8822f9c7519f904 Author: Matevz Tadel <[log in to unmask]> Date: 2018-12-10 (Mon, 10 Dec 2018) Changed paths: M src/XrdFileCache/XrdFileCache.cc M src/XrdFileCache/XrdFileCache.hh M src/XrdFileCache/XrdFileCacheCommand.cc M src/XrdFileCache/XrdFileCacheConfiguration.cc M src/XrdFileCache/XrdFileCacheFile.cc M src/XrdFileCache/XrdFileCacheFile.hh M src/XrdFileCache/XrdFileCacheIOEntireFile.cc M src/XrdFileCache/XrdFileCacheInfo.cc M src/XrdFileCache/XrdFileCacheInfo.hh M src/XrdFileCache/XrdFileCachePrint.cc M src/XrdFileCache/XrdFileCachePurge.cc M src/XrdFileCache/XrdFileCacheStats.hh M src/XrdFileCache/XrdFileCacheVRead.cc Log Message: ----------- Extend cinfo to format to include number of accesses and allow record merging. Also includes: * Rename stat variables to match regular cache nomenclature. * Some preliminary structs for per directory statistics collection. Commit: 077e35258274785a50ab70c41787bb371e819ed4 https://github.com/xrootd/xrootd/commit/077e35258274785a50ab70c41787bb371e819ed4 Author: Matevz Tadel <[log in to unmask]> Date: 2018-12-10 (Mon, 10 Dec 2018) Changed paths: M src/XrdFileCache/XrdFileCacheConfiguration.cc Log Message: ----------- Check data space size during configuration processing. Commit: 80ec171e67a627dbe9d002a98cb9c94e21ac2239 https://github.com/xrootd/xrootd/commit/80ec171e67a627dbe9d002a98cb9c94e21ac2239 Author: Matevz Tadel <[log in to unmask]> Date: 2018-12-14 (Fri, 14 Dec 2018) Changed paths: M src/XrdFileCache/XrdFileCache.cc M src/XrdFileCache/XrdFileCache.hh M src/XrdFileCache/XrdFileCacheCommand.cc M src/XrdFileCache/XrdFileCacheConfiguration.cc M src/XrdFileCache/XrdFileCacheFile.cc M src/XrdFileCache/XrdFileCacheFile.hh M src/XrdFileCache/XrdFileCachePurge.cc M src/XrdFileCache/XrdFileCacheStats.hh Log Message: ----------- Per directory stat processing. First version, not fully tested. Prints out report into log file during every purge cycle, e.g. (edited for readability): ``` DataFsState::dump_recursively epoch = 1544824366 delta_t = 300 max_depth = 4 0 root usage=26157253632 usage_extra=14831391356 usage_total=40988644988 num_ios=4 duration=357 b_hit=20378665723 b_miss=7415529472 b_byps=0 b_wrtn=14831391356 1 store usage=26157253632 usage_extra=14831391356 usage_total=40988644988 num_ios=4 duration=357 b_hit=20378665723 b_miss=7415529472 b_byps=0 b_wrtn=14831391356 2 user usage=26157253632 usage_extra=14831391356 usage_total=40988644988 num_ios=4 duration=357 b_hit=20378665723 b_miss=7415529472 b_byps=0 b_wrtn=14831391356 3 matevz usage=26157253632 usage_extra=14831391356 usage_total=40988644988 num_ios=4 duration=357 b_hit=20378665723 b_miss=7415529472 b_byps=0 b_wrtn=14831391356 4 xrdmon-far usage= 2558525440 usage_extra= 5705110140 usage_total= 8263635580 num_ios=2 duration=143 b_hit= 5410980421 b_miss=2852388864 b_byps=0 b_wrtn= 5705110140 4 xrdmon-xxx usage=17871405056 usage_extra= 9126281216 usage_total=26997686272 num_ios=2 duration=214 b_hit=14967685302 b_miss=4563140608 b_byps=0 b_wrtn= 9126281216 usage - usage as "measured" during purge scan usage_extra - collected from write queue and accumulated between purge scans note, purge scan does not happen every purge cycle! usage_total - sum of above two b_wrtn - number of bytes written in this directory during this cycle others should be clear ``` pfc.dirstats maxdepth is supported. pfc.dirstats dir is converted to maxdepth so it sort of works ... but prints out all the directories down to maxdepth, not only the selected ones. Commit: 694f15b3056b9cabf2954387bd5f2d8fd9d0d425 https://github.com/xrootd/xrootd/commit/694f15b3056b9cabf2954387bd5f2d8fd9d0d425 Author: Matevz Tadel <[log in to unmask]> Date: 2019-07-01 (Mon, 01 Jul 2019) Changed paths: M src/XrdFileCache/XrdFileCache.cc M src/XrdFileCache/XrdFileCache.hh M src/XrdFileCache/XrdFileCacheCommand.cc M src/XrdFileCache/XrdFileCacheConfiguration.cc M src/XrdFileCache/XrdFileCacheFile.cc M src/XrdFileCache/XrdFileCacheFile.hh M src/XrdFileCache/XrdFileCacheIOEntireFile.cc M src/XrdFileCache/XrdFileCacheInfo.cc M src/XrdFileCache/XrdFileCacheInfo.hh M src/XrdFileCache/XrdFileCachePrint.cc M src/XrdFileCache/XrdFileCachePurge.cc M src/XrdFileCache/XrdFileCacheStats.hh M src/XrdFileCache/XrdFileCacheVRead.cc Log Message: ----------- Merge remote-tracking branch 'oss/pfc-dirstats' into xrd-5-mon Commit: 92228ed5aa49e1b74d246b75158a6c84ea36a5f9 https://github.com/xrootd/xrootd/commit/92228ed5aa49e1b74d246b75158a6c84ea36a5f9 Author: Matevz Tadel <[log in to unmask]> Date: 2019-07-01 (Mon, 01 Jul 2019) Changed paths: M src/XrdFileCache/XrdFileCache.cc M src/XrdFileCache/XrdFileCacheFile.cc M src/XrdFileCache/XrdFileCachePrint.cc M src/XrdFileCache/XrdFileCachePurge.cc Log Message: ----------- Merge follow-up changes. Commit: 39f4e74ee44dc2b6abd3480bcc7f48089dfcae88 https://github.com/xrootd/xrootd/commit/39f4e74ee44dc2b6abd3480bcc7f48089dfcae88 Author: Matevž Tadel <[log in to unmask]> Date: 2019-07-01 (Mon, 01 Jul 2019) Changed paths: M src/XrdFileCache/XrdFileCache.cc M src/XrdFileCache/XrdFileCache.hh M src/XrdFileCache/XrdFileCacheCommand.cc M src/XrdFileCache/XrdFileCacheConfiguration.cc M src/XrdFileCache/XrdFileCacheFile.cc M src/XrdFileCache/XrdFileCacheFile.hh M src/XrdFileCache/XrdFileCacheIOEntireFile.cc M src/XrdFileCache/XrdFileCacheInfo.cc M src/XrdFileCache/XrdFileCacheInfo.hh M src/XrdFileCache/XrdFileCachePrint.cc M src/XrdFileCache/XrdFileCachePurge.cc M src/XrdFileCache/XrdFileCacheStats.hh M src/XrdFileCache/XrdFileCacheVRead.cc Log Message: ----------- Merge pull request #1014 from osschar/xrd-5-mon [XCache] merge development branch osschar/pfc-dirstats with per directory stats collection Compare: https://github.com/xrootd/xrootd/compare/8eaf39fb6224...39f4e74ee44d ######################################################################## Use REPLY-ALL to reply to list To unsubscribe from the XROOTD-DEV list, click the following link: https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1