Hi Andy,
The caching proxy cluster works with proposed configuration.
I have not completed the implementation of the custom stat function. For
now I call a system stat function and have cachdir path hardcoded:
https://github.com/alja/xrootd/blob/9bdf905f750ca8479e913b8b0d40fd7de316aa36/src/XrdFileCache/XrdFileCacheFactory.cc#L100
I have two questions.
* How should I invoke stat in cachedir for non posix file systems. E.g.
hdfs file system?
* I was thinking to get cachedir path by parsing oss.space directive. Is
there any meaningful use case where there is more than one oss.space
defined in the caching proxy?
Alja
On 12/11/14 12:59, Andrew Hanushevsky wrote:
> Hi Alja,
>
> Here is the problem, the space directive is incorrect. See
>
> http://xrootd.org/doc/dev41/ofs_config.htm#_Toc401930733
>
> where you need "oss.space <name> <path>" -- you are missing the name.
> The name should be "public".
>
> Also, do not load libXrdPss.so for the cmsd portion of the config only
> the xrootd portion on the virtual data servers (i.e. actual proxies).
>
> Andy
>
> On Thu, 11 Dec 2014, Alja Mrak-Tadel wrote:
>
>> Hi Andy,
>>
>> I have put the log files and the configuration at
>> http://uaf-2.t2.ucsd.edu/~alja/cluster/. Where cabinet-10-10-10 is
>> redirector and cabinet-10-10-6 is proxy server.
>>
>> From the log files you can see objects failed to instantiate from file
>> cache library. There is nothing wrong with the xrootd pacakge. I made
>> test where cluster is setup from non-caching/default proxies and this
>> test works OK. Also I made test that a standalone proxy server works
>> OK too.
>>
>> I then tried to move oss.space directive to if/else block. I don't
>> have the plugin errors anymore, but problem with loading cmsd protocol:
>> http://uaf-2.t2.ucsd.edu/~alja/cluster2
>>
>>
>> Thanks,
>> Alja
>>
>>
>> On 12/10/14 23:54, Andrew Hanushevsky wrote:
>>> Hi Alja,
>>>
>>> Well, the config file looks fine. Though, there is no space directive. I
>>> still need the log file. If you look into the cmsd log file you should
>>> see the statlib being called. That is the only place where the statlib
>>> will be called. It won't be called from the xrootd servers at alll.
>>>
>>> Andy
>>>
>>> On Wed, 10 Dec 2014, Alja Mrak-Tadel wrote:
>>>
>>>> Hi Andy,
>>>>
>>>> This is the config file:
>>>> https://github.com/alja/vaya/blob/master/proxy-cluster.cfg
>>>>
>>>> Alja
>>>>
>>>> On 12/10/14 4:41 PM, Andrew Hanushevsky wrote:
>>>>> Hi Alja,
>>>>>
>>>>> OK, I misunderstood. Could you send me the config file you use for
>>>>> the redirector that is randomly sending people around?
>>>>>
>>>>> Andy
>>>>>
>>>>> -----Original Message----- From: Alja Mrak-Tadel
>>>>> Sent: Wednesday, December 10, 2014 2:16 PM
>>>>> To: Andrew Hanushevsky ; Matevz Tadel
>>>>> Cc: [log in to unmask]
>>>>> Subject: Re: Cluster of pure proxy caches
>>>>>
>>>>> Hi Andy,
>>>>>
>>>>>>
>>>>>> I don't know why the oss.space would cause a failure. Could you
>>>>>> give me
>>>>>> the logfile during initialization?
>>>>> The proxy server log file is here:
>>>>> http://uaf-2.t2.ucsd.edu/~alja/xrootd.log
>>>>>
>>>>>
>>>>>> Indeed, the special stat() is only
>>>>>> called by the oss layer. So, I wouldn't expect the proxy plugin to do
>>>>>> that.
>>>>>
>>>>> I expected XrdOssStatInfo to be called and to see this info in proxy
>>>>> logs:
>>>>> https://github.com/alja/xrootd/compare/stat#diff-ab2bb16ef01f8ebf77b4f32a79c9fdcbR102
>>>>>
>>>>>
>>>>>
>>>>> Good that it works now. I assume that all we need to document is
>>>>>>
>>>>>> oss.statlib <name of FileCache.so>
>>>>>>
>>>>>> Yes?
>>>>>
>>>>> I don't know if oss.space is necessary. The custom stat function is
>>>>> never called. I don't know why. The redirector goes to random proxy
>>>>> server even though requested file is already cached on a specific one.
>>>>>
>>>>> Alja
>>>>>
>>>>> ########################################################################
>>>>>
>>>>> Use REPLY-ALL to reply to list
>>>>>
>>>>> To unsubscribe from the XROOTD-DEV list, click the following link:
>>>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1
>>>>>
>>>>
>>>> ########################################################################
>>>>
>>>> Use REPLY-ALL to reply to list
>>>>
>>>> To unsubscribe from the XROOTD-DEV list, click the following link:
>>>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1
>>>>
>>
>> ########################################################################
>> Use REPLY-ALL to reply to list
>>
>> To unsubscribe from the XROOTD-DEV list, click the following link:
>> https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1
>>
########################################################################
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1
|