Hi Jan,
I know this is going to be irksome, but could you install the debug RPM so that we can get some statement numbers in the backtrace? It’s near impossible to setup a context on which this occurs without statement numbers. Thanks.
Andy
P.S. If you still have the core file, just install the debug rpm and rerun the back trace.
From: Jan Iven
Sent: Thursday, May 31, 2018 12:37 AM
To: xrootd/xrootd
Cc: Subscribed
Subject: Re: [xrootd/xrootd] segfault in XrdOucHash<XrdCryptoX509Chain>::Find (#661)
(backtrace is slightly different from #681, so posting here)
Saw another one of these (aaain from inside EOS code, but the backtrace is in the xrootd library):
:Core was generated by `/usr//bin/eosd /eos/atlas -obig_writes,max_readahead=131072,max_write=4194304,f'.
:Program terminated with signal 11, Segmentation fault.
:#0 0x00007fd7c4fec704 in XrdOucHash<XrdSutCacheEntry>::Find(char const*, long*) () from /usr/lib64/libXrdSecgsi-4.so
:#0 0x00007fd7c4fec704 in XrdOucHash<XrdSutCacheEntry>::Find(char const*, long*) () from /usr/lib64/libXrdSecgsi-4.so
:#1 0x00007fd7c4fdf3cc in XrdSecProtocolgsi::GetCA(char const*, XrdCryptoFactory*, gsiHSVars*) () from /usr/lib64/libXrdSecgsi-4.so
:#2 0x00007fd7c4fe032b in XrdSecProtocolgsi::ParseCAlist(XrdOucString) () from /usr/lib64/libXrdSecgsi-4.so
:#3 0x00007fd7c4fe7ffa in XrdSecProtocolgsi::ClientDoInit(XrdSutBuffer*, XrdSutBuffer**, XrdOucString&) () from /usr/lib64/libXrdSecgsi-4.so
:#4 0x00007fd7c4fe855d in XrdSecProtocolgsi::ParseClientInput(XrdSutBuffer*, XrdSutBuffer**, XrdOucString&) () from /usr/lib64/libXrdSecgsi-4.so
:#5 0x00007fd7c4fe892e in XrdSecProtocolgsi::getCredentials(XrdSecBuffer*, XrdOucErrInfo*) () from /usr/lib64/libXrdSecgsi-4.so
:#6 0x00007fd7da988c31 in XrdCl::XRootDTransport::GetCredentials(XrdSecBuffer*&, XrdCl::HandShakeData*, XrdCl::XRootDChannelInfo*) () from /usr/lib64/libXrdCl.so.2
:#7 0x00007fd7da9897e9 in XrdCl::XRootDTransport::DoAuthentication(XrdCl::HandShakeData*, XrdCl::XRootDChannelInfo*) () from /usr/lib64/libXrdCl.so.2
:#8 0x00007fd7da98a176 in XrdCl::XRootDTransport::HandShakeMain(XrdCl::HandShakeData*, XrdCl::AnyObject&) () from /usr/lib64/libXrdCl.so.2
:#9 0x00007fd7da98a343 in XrdCl::XRootDTransport::HandShake(XrdCl::HandShakeData*, XrdCl::AnyObject&) () from /usr/lib64/libXrdCl.so.2
:#10 0x00007fd7da9d129b in XrdCl::AsyncSocketHandler::OnReadWhileHandshaking() () from /usr/lib64/libXrdCl.so.2
:#11 0x00007fd7da9d1618 in XrdCl::AsyncSocketHandler::Event(unsigned char, XrdCl::Socket*) () from /usr/lib64/libXrdCl.so.2
:#12 0x00007fd7da97c143 in ?? () from /usr/lib64/libXrdCl.so.2
:#13 0x00007fd7da6cabb8 in XrdSys::IOEvents::Poller::CbkXeq(XrdSys::IOEvents::Channel*, int, int, char const*) () from /usr/lib64/libXrdUtils.so.2
:#14 0x00007fd7da6cad89 in XrdSys::IOEvents::PollE::Dispatch(XrdSys::IOEvents::Channel*, unsigned int) () from /usr/lib64/libXrdUtils.so.2
:#15 0x00007fd7da6cb013 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /usr/lib64/libXrdUtils.so.2
:#16 0x00007fd7da6c97cd in XrdSys::IOEvents::BootStrap::Start(void*) () from /usr/lib64/libXrdUtils.so.2
:#17 0x00007fd7da6c6a6f in XrdSysThread_Xeq () from /usr/lib64/libXrdUtils.so.2
:#18 0x00007fd7da485aa1 in start_thread () from /lib64/libpthread.so.0
:#19 0x00007fd7d7e00bcd in clone () from /lib64/libc.so.6
Version:
~$ rpm -qf /usr/lib64/libXrdSecgsi-4.so /usr/bin/eosd
1:xrootd-libs-4.8.3-1.el6.x86_64
(none):eos-fuse-core-4.2.22-1.el6.x86_64
~$ hostname
lxplus040.cern.ch
GDB (machine does not have full debuginfo, but looks like a NULL pointer being dereferenced?):
(gdb) f 0
#0 0x00007fd7c4fec704 in XrdOucHash<XrdSutCacheEntry>::Find(char const*, long*) () from /usr/lib64/libXrdSecgsi-4.so
(gdb) x/i $rip
=> 0x7fd7c4fec704 <_ZN10XrdOucHashI16XrdSutCacheEntryE4FindEPKcPl+52>: mov (%rax,%rdx,8),%r13
(gdb) print $rax
$1 = 0
(gdb) print $rdx
$2 = 126
(gdb) print $r13
$3 = 140564704194912
(gdb) x/x $r13
0x7fd7c542f160: 0x00000001
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.
{"@context":"http://schema.org","@type":"EmailMessage","potentialAction":{"@type":"ViewAction","target":"https://github.com/xrootd/xrootd/issues/661#issuecomment-394509557","url":"https://github.com/xrootd/xrootd/issues/661#issuecomment-394509557","name":"View Issue"},"description":"View this Issue on GitHub","publisher":{"@type":"Organization","name":"GitHub","url":"https://github.com"}}
{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/xrootd/xrootd","title":"xrootd/xrootd","subtitle":"GitHub repository","main_image_url":"https://assets-cdn.github.com/images/email/message_cards/header.png","avatar_image_url":"https://assets-cdn.github.com/images/email/message_cards/avatar.png","action":{"name":"Open in GitHub","url":"https://github.com/xrootd/xrootd"}},"updates":{"snippets":[{"icon":"PERSON","message":"@abh3 in #661: Hi Jan,\n\nI know this is going to be irksome, but could you install the debug RPM so that we can get some statement numbers in the backtrace? It’s near impossible to setup a context on which this occurs without statement numbers. Thanks.\n\nAndy\n\nP.S. If you still have the core file, just install the debug rpm and rerun the back trace.\n\nFrom: Jan Iven \nSent: Thursday, May 31, 2018 12:37 AM\nTo: xrootd/xrootd \nCc: Subscribed \nSubject: Re: [xrootd/xrootd] segfault in XrdOucHash\u003cXrdCryptoX509Chain\u003e::Find (#661)\n\n(backtrace is slightly different from #681, so posting here)\nSaw another one of these (aaain from inside EOS code, but the backtrace is in the xrootd library):\n\n:Core was generated by `/usr//bin/eosd /eos/atlas -obig_writes,max_readahead=131072,max_write=4194304,f'.\n:Program terminated with signal 11, Segmentation fault.\n:#0 0x00007fd7c4fec704 in XrdOucHash\u003cXrdSutCacheEntry\u003e::Find(char const*, long*) () from /usr/lib64/libXrdSecgsi-4.so\n:#0 0x00007fd7c4fec704 in XrdOucHash\u003cXrdSutCacheEntry\u003e::Find(char const*, long*) () from /usr/lib64/libXrdSecgsi-4.so\n:#1 0x00007fd7c4fdf3cc in XrdSecProtocolgsi::GetCA(char const*, XrdCryptoFactory*, gsiHSVars*) () from /usr/lib64/libXrdSecgsi-4.so\n:#2 0x00007fd7c4fe032b in XrdSecProtocolgsi::ParseCAlist(XrdOucString) () from /usr/lib64/libXrdSecgsi-4.so\n:#3 0x00007fd7c4fe7ffa in XrdSecProtocolgsi::ClientDoInit(XrdSutBuffer*, XrdSutBuffer**, XrdOucString\u0026) () from /usr/lib64/libXrdSecgsi-4.so\n:#4 0x00007fd7c4fe855d in XrdSecProtocolgsi::ParseClientInput(XrdSutBuffer*, XrdSutBuffer**, XrdOucString\u0026) () from /usr/lib64/libXrdSecgsi-4.so\n:#5 0x00007fd7c4fe892e in XrdSecProtocolgsi::getCredentials(XrdSecBuffer*, XrdOucErrInfo*) () from /usr/lib64/libXrdSecgsi-4.so\n:#6 0x00007fd7da988c31 in XrdCl::XRootDTransport::GetCredentials(XrdSecBuffer*\u0026, XrdCl::HandShakeData*, XrdCl::XRootDChannelInfo*) () from /usr/lib64/libXrdCl.so.2\n:#7 0x00007fd7da9897e9 in XrdCl::XRootDTransport::DoAuthentication(XrdCl::HandShakeData*, XrdCl::XRootDChannelInfo*) () from /usr/lib64/libXrdCl.so.2\n:#8 0x00007fd7da98a176 in XrdCl::XRootDTransport::HandShakeMain(XrdCl::HandShakeData*, XrdCl::AnyObject\u0026) () from /usr/lib64/libXrdCl.so.2\n:#9 0x00007fd7da98a343 in XrdCl::XRootDTransport::HandShake(XrdCl::HandShakeData*, XrdCl::AnyObject\u0026) () from /usr/lib64/libXrdCl.so.2\n:#10 0x00007fd7da9d129b in XrdCl::AsyncSocketHandler::OnReadWhileHandshaking() () from /usr/lib64/libXrdCl.so.2\n:#11 0x00007fd7da9d1618 in XrdCl::AsyncSocketHandler::Event(unsigned char, XrdCl::Socket*) () from /usr/lib64/libXrdCl.so.2\n:#12 0x00007fd7da97c143 in ?? () from /usr/lib64/libXrdCl.so.2\n:#13 0x00007fd7da6cabb8 in XrdSys::IOEvents::Poller::CbkXeq(XrdSys::IOEvents::Channel*, int, int, char const*) () from /usr/lib64/libXrdUtils.so.2\n:#14 0x00007fd7da6cad89 in XrdSys::IOEvents::PollE::Dispatch(XrdSys::IOEvents::Channel*, unsigned int) () from /usr/lib64/libXrdUtils.so.2\n:#15 0x00007fd7da6cb013 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int\u0026, char const**) () from /usr/lib64/libXrdUtils.so.2\n:#16 0x00007fd7da6c97cd in XrdSys::IOEvents::BootStrap::Start(void*) () from /usr/lib64/libXrdUtils.so.2\n:#17 0x00007fd7da6c6a6f in XrdSysThread_Xeq () from /usr/lib64/libXrdUtils.so.2\n:#18 0x00007fd7da485aa1 in start_thread () from /lib64/libpthread.so.0\n:#19 0x00007fd7d7e00bcd in clone () from /lib64/libc.so.6\nVersion:\n\n~$ rpm -qf /usr/lib64/libXrdSecgsi-4.so /usr/bin/eosd\n1:xrootd-libs-4.8.3-1.el6.x86_64\n(none):eos-fuse-core-4.2.22-1.el6.x86_64\n~$ hostname\nlxplus040.cern.ch\nGDB (machine does not have full debuginfo, but looks like a NULL pointer being dereferenced?):\n\n(gdb) f 0\n#0 0x00007fd7c4fec704 in XrdOucHash\u003cXrdSutCacheEntry\u003e::Find(char const*, long*) () from /usr/lib64/libXrdSecgsi-4.so\n(gdb) x/i $rip\n=\u003e 0x7fd7c4fec704 \u003c_ZN10XrdOucHashI16XrdSutCacheEntryE4FindEPKcPl+52\u003e:\tmov (%rax,%rdx,8),%r13\n(gdb) print $rax\n$1 = 0\n(gdb) print $rdx\n$2 = 126\n(gdb) print $r13\n$3 = 140564704194912\n(gdb) x/x $r13\n0x7fd7c542f160:\t0x00000001\n—\nYou are receiving this because you are subscribed to this thread.\nReply to this email directly, view it on GitHub, or mute the thread.\n"}],"action":{"name":"View Issue","url":"https://github.com/xrootd/xrootd/issues/661#issuecomment-394509557"}}}
{
"@type": "MessageCard",
"@context": "http://schema.org/extensions",
"hideOriginalBody": "false",
"originator": "37567f93-e2a7-4e2a-ad37-a9160fc62647",
"title": "Re: [xrootd/xrootd] segfault in XrdOucHash\u003cXrdCryptoX509Chain\u003e::Find (#661)",
"sections": [
{
"text": "",
"activityTitle": "**Andrew Hanushevsky**",
"activityImage": "https://assets-cdn.github.com/images/email/message_cards/avatar.png",
"activitySubtitle": "@abh3",
"facts": [
]
}
],
"potentialAction": [
{
"name": "Add a comment",
"@type": "ActionCard",
"inputs": [
{
"isMultiLine": true,
"@type": "TextInput",
"id": "IssueComment",
"isRequired": false
}
],
"actions": [
{
"name": "Comment",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n\"commandName\": \"IssueComment\",\n\"repositoryFullName\": \"xrootd/xrootd\",\n\"issueId\": 661,\n\"IssueComment\": \"{{IssueComment.value}}\"\n}"
}
]
},
{
"name": "Close issue",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n\"commandName\": \"IssueClose\",\n\"repositoryFullName\": \"xrootd/xrootd\",\n\"issueId\": 661\n}"
},
{
"targets": [
{
"os": "default",
"uri": "https://github.com/xrootd/xrootd/issues/661#issuecomment-394509557"
}
],
"@type": "OpenUri",
"name": "View on GitHub"
},
{
"name": "Unsubscribe",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n\"commandName\": \"MuteNotification\",\n\"threadId\": 308717323\n}"
}
],
"themeColor": "26292E"
}
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1