Did this happen at start up or when it was running for a while. What was
the server doing at the time?
This looks like a new issue.
Andy
On Mon, 25 Jun 2018, Matev Tadel wrote:
> I got this on UCSD StashCache instance with xrootd-4.8.3-1.osg34.el6.x86_64:
> `Core was generated by `/usr/bin/xrootd -l /var/log/xrootd/xrootd.log -c /etc/xrootd/stashcache-server.'.
> Program terminated with signal 11, Segmentation fault.
> #0 XrdOucHash<XrdHttpProtocol::StaticPreloadInfo>::Find (this=0x0,
> KeyVal=0x7fb5a40071d0 "/static/help/content/admin/whats_new.htm", KeyTime=0x0)
> at /usr/src/debug/xrootd-4.8.3/src/XrdOuc/XrdOucHash.icc:173
> 173 if ((hip = hashtable[kent]))
> Missing separate debuginfos, use: debuginfo-install keyutils-libs-1.4-5.el6.x86_64 krb5-libs-1.10.3-65.el6.x86_64 libcom_err-1.41.12-23.el6.x86_64 libselinux-2.0.94-7.el6.x86_64 libxml2-2.7.6-21.el6_8.1.x86_64 openssl-1.0.1e-57.el6.x86_64 zlib-1.2.3-29.el6.x86_64
> (gdb) bt
> #0 XrdOucHash<XrdHttpProtocol::StaticPreloadInfo>::Find (this=0x0,
> KeyVal=0x7fb5a40071d0 "/static/help/content/admin/whats_new.htm", KeyTime=0x0)
> at /usr/src/debug/xrootd-4.8.3/src/XrdOuc/XrdOucHash.icc:173
> #1 0x00007fb5b61c6c34 in XrdHttpReq::ProcessHTTPReq (this=0x7fb5a4003ee0)
> at /usr/src/debug/xrootd-4.8.3/src/XrdHttp/XrdHttpReq.cc:892
> #2 0x00007fb5b61c0371 in XrdHttpProtocol::Process (this=0x7fb5a4003dc0, lp=<value optimized out>)
> at /usr/src/debug/xrootd-4.8.3/src/XrdHttp/XrdHttpProtocol.cc:951
> #3 0x00007fb5b74dbf80 in XrdXrootdTransit::Process (this=0x7fb56c005c00, lp=0x7fb56c002c28)
> at /usr/src/debug/xrootd-4.8.3/src/XrdXrootd/XrdXrootdTransit.cc:365
> #4 0x00007fb5b7261c49 in XrdLink::DoIt (this=0x7fb56c002c28) at /usr/src/debug/xrootd-4.8.3/src/Xrd/XrdLink.cc:435
> #5 0x00007fb5b7264ddb in XrdScheduler::Run (this=0x610758) at /usr/src/debug/xrootd-4.8.3/src/Xrd/XrdScheduler.cc:357
> #6 0x00007fb5b7264f29 in XrdStartWorking (carg=<value optimized out>)
> at /usr/src/debug/xrootd-4.8.3/src/Xrd/XrdScheduler.cc:87
> #7 0x00007fb5b7220a6f in XrdSysThread_Xeq (myargs=0x7fb5a4000b60)
> at /usr/src/debug/xrootd-4.8.3/src/XrdSys/XrdSysPthread.cc:86
> #8 0x00000030e7607aa1 in start_thread (arg=0x7fb5b43d5700) at pthread_create.c:301
> #9 0x00000030e6ee8bcd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:115'
>
> Apparently this happens during Qualys scan of the machine. These are the lines from the log prior to crash:
>
> `180622 20:10:47 2160139 XrootdXeq: unknown.7371:38@[::ffff:64.39.99.187] disc 0:00:05 (send failure)
> 180622 20:10:48 2316273 XrootdBridge: unknown.7377:36@[::ffff:64.39.99.187] login as nobody
> 180622 20:10:48 2316273 ofs_stat: unknown.7377:36@[::ffff:64.39.99.187] Unable to locate /wp-login.php; no such file or directory
> 180622 20:10:48 2316273 unknown.7377:36@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to locate /wp-login.php; no such file or directory
> 180622 20:10:48 2316273 ofs_open: unknown.7377:36@[::ffff:64.39.99.187] Unable to open /wp-login.php; no such file or directory
> 180622 20:10:48 2316273 unknown.7377:36@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to open /wp-login.php; no such file or directory
> 180622 20:10:48 2316273 XrootdXeq: unknown.7377:36@[::ffff:64.39.99.187] disc 0:00:00 (send failure)
> 180622 20:10:48 1469156 XrootdBridge: unknown.7378:38@[::ffff:64.39.99.187] login as nobody
> 180622 20:10:48 2316274 ofs_stat: unknown.7373:25@[::ffff:64.39.99.187] Unable to locate /login.action; no such file or directory
> 180622 20:10:48 2316284 ofs_stat: unknown.7372:37@[::ffff:64.39.99.187] Unable to locate /uddiexplorer/SearchPublicRegistries.jsp; no such file or directory
> 180622 20:10:48 2316274 unknown.7373:25@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to locate /login.action; no such file or directory
> 180622 20:10:48 2316284 unknown.7372:37@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to locate /uddiexplorer/SearchPublicRegistries.jsp; no such file or directory
> 180622 20:10:48 2316274 ofs_open: unknown.7373:25@[::ffff:64.39.99.187] Unable to open /login.action; no such file or directory
> 180622 20:10:48 2316274 unknown.7373:25@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to open /login.action; no such file or directory
> 180622 20:10:48 2316284 ofs_open: unknown.7372:37@[::ffff:64.39.99.187] Unable to open /uddiexplorer/SearchPublicRegistries.jsp; no such file or directory
> 180622 20:10:48 2316284 unknown.7372:37@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to open /uddiexplorer/SearchPublicRegistries.jsp; no such file or directory
> 180622 20:10:48 2316274 XrootdXeq: unknown.7373:25@[::ffff:64.39.99.187] disc 0:00:05 (send failure)
> 180622 20:10:48 2316284 XrootdXeq: unknown.7372:37@[::ffff:64.39.99.187] disc 0:00:05 (send failure)
> 180622 20:10:49 1470733 XrootdBridge: unknown.7379:25@[::ffff:64.39.99.187] login as nobody
> 180622 20:10:49 2164851 XrootdBridge: unknown.7380:36@[::ffff:64.39.99.187] login as nobody
> 180622 20:10:49 2164851 ofs_stat: unknown.7380:36@[::ffff:64.39.99.187] Unable to locate /index.htm; no such file or directory
> 180622 20:10:49 2164851 unknown.7380:36@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to locate /index.htm; no such file or directory
> 180622 20:10:49 2164851 ofs_open: unknown.7380:36@[::ffff:64.39.99.187] Unable to open /index.htm; no such file or directory
> 180622 20:10:49 2164851 unknown.7380:36@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to open /index.htm; no such file or directory
> 180622 20:10:49 2164851 XrootdXeq: unknown.7380:36@[::ffff:64.39.99.187] disc 0:00:00 (send failure)
> 180622 20:10:49 1469157 XrootdBridge: unknown.7381:37@[::ffff:64.39.99.187] login as nobody
> `
>
> --
> You are receiving this because you are subscribed to this thread.
> Reply to this email directly or view it on GitHub:
> https://github.com/xrootd/xrootd/issues/753
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.
{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/xrootd/xrootd","title":"xrootd/xrootd","subtitle":"GitHub repository","main_image_url":"https://assets-cdn.github.com/images/email/message_cards/header.png","avatar_image_url":"https://assets-cdn.github.com/images/email/message_cards/avatar.png","action":{"name":"Open in GitHub","url":"https://github.com/xrootd/xrootd"}},"updates":{"snippets":[{"icon":"PERSON","message":"@abh3 in #753: Did this happen at start up or when it was running for a while. What was \nthe server doing at the time?\n\nThis looks like a new issue.\n\nAndy\n\nOn Mon, 25 Jun 2018, Matev Tadel wrote:\n\n\u003e I got this on UCSD StashCache instance with xrootd-4.8.3-1.osg34.el6.x86_64:\n\u003e `Core was generated by `/usr/bin/xrootd -l /var/log/xrootd/xrootd.log -c /etc/xrootd/stashcache-server.'.\n\u003e Program terminated with signal 11, Segmentation fault.\n\u003e #0 XrdOucHash\u003cXrdHttpProtocol::StaticPreloadInfo\u003e::Find (this=0x0,\n\u003e KeyVal=0x7fb5a40071d0 \"/static/help/content/admin/whats_new.htm\", KeyTime=0x0)\n\u003e at /usr/src/debug/xrootd-4.8.3/src/XrdOuc/XrdOucHash.icc:173\n\u003e 173 if ((hip = hashtable[kent]))\n\u003e Missing separate debuginfos, use: debuginfo-install keyutils-libs-1.4-5.el6.x86_64 krb5-libs-1.10.3-65.el6.x86_64 libcom_err-1.41.12-23.el6.x86_64 libselinux-2.0.94-7.el6.x86_64 libxml2-2.7.6-21.el6_8.1.x86_64 openssl-1.0.1e-57.el6.x86_64 zlib-1.2.3-29.el6.x86_64\n\u003e (gdb) bt\n\u003e #0 XrdOucHash\u003cXrdHttpProtocol::StaticPreloadInfo\u003e::Find (this=0x0,\n\u003e KeyVal=0x7fb5a40071d0 \"/static/help/content/admin/whats_new.htm\", KeyTime=0x0)\n\u003e at /usr/src/debug/xrootd-4.8.3/src/XrdOuc/XrdOucHash.icc:173\n\u003e #1 0x00007fb5b61c6c34 in XrdHttpReq::ProcessHTTPReq (this=0x7fb5a4003ee0)\n\u003e at /usr/src/debug/xrootd-4.8.3/src/XrdHttp/XrdHttpReq.cc:892\n\u003e #2 0x00007fb5b61c0371 in XrdHttpProtocol::Process (this=0x7fb5a4003dc0, lp=\u003cvalue optimized out\u003e)\n\u003e at /usr/src/debug/xrootd-4.8.3/src/XrdHttp/XrdHttpProtocol.cc:951\n\u003e #3 0x00007fb5b74dbf80 in XrdXrootdTransit::Process (this=0x7fb56c005c00, lp=0x7fb56c002c28)\n\u003e at /usr/src/debug/xrootd-4.8.3/src/XrdXrootd/XrdXrootdTransit.cc:365\n\u003e #4 0x00007fb5b7261c49 in XrdLink::DoIt (this=0x7fb56c002c28) at /usr/src/debug/xrootd-4.8.3/src/Xrd/XrdLink.cc:435\n\u003e #5 0x00007fb5b7264ddb in XrdScheduler::Run (this=0x610758) at /usr/src/debug/xrootd-4.8.3/src/Xrd/XrdScheduler.cc:357\n\u003e #6 0x00007fb5b7264f29 in XrdStartWorking (carg=\u003cvalue optimized out\u003e)\n\u003e at /usr/src/debug/xrootd-4.8.3/src/Xrd/XrdScheduler.cc:87\n\u003e #7 0x00007fb5b7220a6f in XrdSysThread_Xeq (myargs=0x7fb5a4000b60)\n\u003e at /usr/src/debug/xrootd-4.8.3/src/XrdSys/XrdSysPthread.cc:86\n\u003e #8 0x00000030e7607aa1 in start_thread (arg=0x7fb5b43d5700) at pthread_create.c:301\n\u003e #9 0x00000030e6ee8bcd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:115'\n\u003e\n\u003e Apparently this happens during Qualys scan of the machine. These are the lines from the log prior to crash:\n\u003e\n\u003e `180622 20:10:47 2160139 XrootdXeq: unknown.7371:38@[::ffff:64.39.99.187] disc 0:00:05 (send failure)\n\u003e 180622 20:10:48 2316273 XrootdBridge: unknown.7377:36@[::ffff:64.39.99.187] login as nobody\n\u003e 180622 20:10:48 2316273 ofs_stat: unknown.7377:36@[::ffff:64.39.99.187] Unable to locate /wp-login.php; no such file or directory\n\u003e 180622 20:10:48 2316273 unknown.7377:36@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to locate /wp-login.php; no such file or directory\n\u003e 180622 20:10:48 2316273 ofs_open: unknown.7377:36@[::ffff:64.39.99.187] Unable to open /wp-login.php; no such file or directory\n\u003e 180622 20:10:48 2316273 unknown.7377:36@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to open /wp-login.php; no such file or directory\n\u003e 180622 20:10:48 2316273 XrootdXeq: unknown.7377:36@[::ffff:64.39.99.187] disc 0:00:00 (send failure)\n\u003e 180622 20:10:48 1469156 XrootdBridge: unknown.7378:38@[::ffff:64.39.99.187] login as nobody\n\u003e 180622 20:10:48 2316274 ofs_stat: unknown.7373:25@[::ffff:64.39.99.187] Unable to locate /login.action; no such file or directory\n\u003e 180622 20:10:48 2316284 ofs_stat: unknown.7372:37@[::ffff:64.39.99.187] Unable to locate /uddiexplorer/SearchPublicRegistries.jsp; no such file or directory\n\u003e 180622 20:10:48 2316274 unknown.7373:25@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to locate /login.action; no such file or directory\n\u003e 180622 20:10:48 2316284 unknown.7372:37@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to locate /uddiexplorer/SearchPublicRegistries.jsp; no such file or directory\n\u003e 180622 20:10:48 2316274 ofs_open: unknown.7373:25@[::ffff:64.39.99.187] Unable to open /login.action; no such file or directory\n\u003e 180622 20:10:48 2316274 unknown.7373:25@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to open /login.action; no such file or directory\n\u003e 180622 20:10:48 2316284 ofs_open: unknown.7372:37@[::ffff:64.39.99.187] Unable to open /uddiexplorer/SearchPublicRegistries.jsp; no such file or directory\n\u003e 180622 20:10:48 2316284 unknown.7372:37@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to open /uddiexplorer/SearchPublicRegistries.jsp; no such file or directory\n\u003e 180622 20:10:48 2316274 XrootdXeq: unknown.7373:25@[::ffff:64.39.99.187] disc 0:00:05 (send failure)\n\u003e 180622 20:10:48 2316284 XrootdXeq: unknown.7372:37@[::ffff:64.39.99.187] disc 0:00:05 (send failure)\n\u003e 180622 20:10:49 1470733 XrootdBridge: unknown.7379:25@[::ffff:64.39.99.187] login as nobody\n\u003e 180622 20:10:49 2164851 XrootdBridge: unknown.7380:36@[::ffff:64.39.99.187] login as nobody\n\u003e 180622 20:10:49 2164851 ofs_stat: unknown.7380:36@[::ffff:64.39.99.187] Unable to locate /index.htm; no such file or directory\n\u003e 180622 20:10:49 2164851 unknown.7380:36@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to locate /index.htm; no such file or directory\n\u003e 180622 20:10:49 2164851 ofs_open: unknown.7380:36@[::ffff:64.39.99.187] Unable to open /index.htm; no such file or directory\n\u003e 180622 20:10:49 2164851 unknown.7380:36@[::ffff:64.39.99.187] XrootdResponse: sending err 3011: Unable to open /index.htm; no such file or directory\n\u003e 180622 20:10:49 2164851 XrootdXeq: unknown.7380:36@[::ffff:64.39.99.187] disc 0:00:00 (send failure)\n\u003e 180622 20:10:49 1469157 XrootdBridge: unknown.7381:37@[::ffff:64.39.99.187] login as nobody\n\u003e `\n\u003e\n\u003e -- \n\u003e You are receiving this because you are subscribed to this thread.\n\u003e Reply to this email directly or view it on GitHub:\n\u003e https://github.com/xrootd/xrootd/issues/753\n"}],"action":{"name":"View Issue","url":"https://github.com/xrootd/xrootd/issues/753#issuecomment-400217698"}}}
[
{
"@context": "http://schema.org",
"@type": "EmailMessage",
"potentialAction": {
"@type": "ViewAction",
"target": "https://github.com/xrootd/xrootd/issues/753#issuecomment-400217698",
"url": "https://github.com/xrootd/xrootd/issues/753#issuecomment-400217698",
"name": "View Issue"
},
"description": "View this Issue on GitHub",
"publisher": {
"@type": "Organization",
"name": "GitHub",
"url": "https://github.com"
}
},
{
"@type": "MessageCard",
"@context": "http://schema.org/extensions",
"hideOriginalBody": "false",
"originator": "AF6C5A86-E920-430C-9C59-A73278B5EFEB",
"title": "Re: [xrootd/xrootd] Crash in XrdHttpReq::ProcessHTTPReq (#753)",
"sections": [
{
"text": "",
"activityTitle": "**Andrew Hanushevsky**",
"activityImage": "https://assets-cdn.github.com/images/email/message_cards/avatar.png",
"activitySubtitle": "@abh3",
"facts": [
]
}
],
"potentialAction": [
{
"name": "Add a comment",
"@type": "ActionCard",
"inputs": [
{
"isMultiLine": true,
"@type": "TextInput",
"id": "IssueComment",
"isRequired": false
}
],
"actions": [
{
"name": "Comment",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n\"commandName\": \"IssueComment\",\n\"repositoryFullName\": \"xrootd/xrootd\",\n\"issueId\": 753,\n\"IssueComment\": \"{{IssueComment.value}}\"\n}"
}
]
},
{
"name": "Close issue",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n\"commandName\": \"IssueClose\",\n\"repositoryFullName\": \"xrootd/xrootd\",\n\"issueId\": 753\n}"
},
{
"targets": [
{
"os": "default",
"uri": "https://github.com/xrootd/xrootd/issues/753#issuecomment-400217698"
}
],
"@type": "OpenUri",
"name": "View on GitHub"
},
{
"name": "Unsubscribe",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n\"commandName\": \"MuteNotification\",\n\"threadId\": 349833347\n}"
}
],
"themeColor": "26292E"
}
]
Use REPLY-ALL to reply to list
To unsubscribe from the XROOTD-DEV list, click the following link:
https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=XROOTD-DEV&A=1
