Hi Nikolai,<br>
<br>
Just for completeness, which version are you running?<br>
<br>
Andy<br>
<br>
<br>
On Fri, 21 Jun 2019, Nikolai Hartmann wrote:<br>
<br>
&gt; Hi again,<br>
&gt;<br>
&gt; I still don&#39;t have any further information on the crashes unfortunately as we currently have the production queue that processed files via xcache taken offline.<br>
&gt; However, i can provide 2 new pieces of feedback:<br>
&gt;<br>
&gt; - The `ciosync` workaround seems to partially solve the problem. However, not 100% - sometimes we still observed that the number of files started again to rise steadily as seen in this plot [plot_openfiles_05-11_05_18.pdf](https://github.com/xrootd/xrootd/files/3314664/plot_openfiles_05-11_05_18.pdf)<br>
&gt;<br>
&gt; - This might be a different issue, but i suspect it happens as well when the file limit is reached: We see some files that end up corrupted in the cache (wrong checksum). These files are marked as &quot;complete&quot; in the `.cinfo` files and when downloading them via the xcache server, the client receives the corrupted file. Out of 200k &quot;complete&quot; files in our cache we saw 91 such cases. From a quick check of 2 of these files they seem to have these things in common:<br>
&gt;    - number of bytes is correct<br>
&gt;    - the `.cinfo` file contains a certain number of `bytesMissed`, but not matching the size of the empty block<br>
&gt;    - the wrong checksum originates from missing parts in the file (blocks of 1 MiB size filled with zeros)<br>
&gt;<br>
&gt; Cheers,<br>
&gt; Nikolai<br>
&gt;<br>
&gt; -- <br>
&gt; You are receiving this because you were mentioned.<br>
&gt; Reply to this email directly or view it on GitHub:<br>
&gt; https://github.com/xrootd/xrootd/issues/975#issuecomment-504429287<br>


<p style="font-size:small;-webkit-text-size-adjust:none;color:#666;">&mdash;<br />You are receiving this because you are subscribed to this thread.<br />Reply to this email directly, <a href="https://github.com/xrootd/xrootd/issues/975?email_source=notifications&amp;email_token=AA7NRDVR2RJ6UKFECF3AWRDP3UYZHA5CNFSM4HLGWH72YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYJPFDA#issuecomment-504558220">view it on GitHub</a>, or <a href="https://github.com/notifications/unsubscribe-auth/AA7NRDRNKBOZBKHBTIDKRN3P3UYZHANCNFSM4HLGWH7Q">mute the thread</a>.<img src="https://github.com/notifications/beacon/AA7NRDV6C6QVOXE74PYELEDP3UYZHA5CNFSM4HLGWH72YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYJPFDA.gif" height="1" width="1" alt="" /></p>
<!cript type="application/ld+json">[
{
"@context": "http://schema.org",
"@type": "EmailMessage",
"potentialAction": {
"@type": "ViewAction",
"target": "https://github.com/xrootd/xrootd/issues/975?email_source=notifications\u0026email_token=AA7NRDVR2RJ6UKFECF3AWRDP3UYZHA5CNFSM4HLGWH72YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYJPFDA#issuecomment-504558220",
"url": "https://github.com/xrootd/xrootd/issues/975?email_source=notifications\u0026email_token=AA7NRDVR2RJ6UKFECF3AWRDP3UYZHA5CNFSM4HLGWH72YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYJPFDA#issuecomment-504558220",
"name": "View Issue"
},
"description": "View this Issue on GitHub",
"publisher": {
"@type": "Organization",
"name": "GitHub",
"url": "https://github.com"
}
}
]</script>
<br>
<hr>
<p align="left">
Use REPLY-ALL to reply to list</p>
<p align="center">To unsubscribe from the XROOTD-DEV list, click the following link:<br>
<a href="https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1" target="_blank">https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1</a>
</p>