The cmssw from hqucms

Test of the OCCI workaround

Enrivoment:

LXPLUS
slc6_amd64_gcc630
CMSSW_9_4_4
Unit test code imported from cms-sw#22095

Running without the hack

> scram b runtests

===== Test "SiStripDAQ_O2O_test" ====
# Running import tool for conditions on release CMSSW_9_4_4
# Connecting to source database on frontier://FrontierProd/CMS_CONDITIONS
# Opening session on destination database...
# destination tag is SiStripBadChannel_FromOnline_GR10_v1_hlt
    Loading source iov...
    Iov size:805 timeType:0 payloadObjectType="SiStripBadStrip"
    Total of iov inserted: 1 payloads: 1
    Flushing changes...
# 1 iov(s) imported. 
[2018-02-07 11:34:23,263] INFO: Running O2O SiStripO2OBadStrip on machine [lxplus042.cern.ch]
[2018-02-07 11:34:23,264] INFO: Running O2O in /afs/cern.ch/work/h/hqu/Tracker/occi-test/CMSSW_9_4_4/308698/SiStripO2OBadStrip
[2018-02-07 11:34:23,265] INFO: Use template config file /afs/cern.ch/work/h/hqu/Tracker/occi-test/CMSSW_9_4_4/src/CondTools/SiStrip/python/SiStripO2O_cfg_template.py
[2018-02-07 11:34:23,271] INFO: Start running O2O...
[2018-02-07 11:34:38,507] INFO: 
[SiStripConfigDb::SiStripConfigDb] Constructing database service... (Class instance: 1)
[SiStripConfigDb::usingDatabase] Setting "user/passwd@path" to "cms_trk_r/1A3C5E7G:FIN@cms_omds_tunnel" using 'ConfDb' configurable read from .cfg file
[SiStripConfigDb::usingDatabase] TNS_ADMIN is set to: "/etc"
[SiStripConfigDb::usingDatabase] Overriding TNS_ADMIN value using cfg file!
  Original value : "/etc"!
  New value      : "/etc"!


A fatal system signal has occurred: segmentation violation
The following is the call stack containing the origin of the signal.

Thread 2 (Thread 0x7f9a8627f700 (LWP 23833)):
#0  0x00007f9aa36c137d in waitpid () from /lib64/libpthread.so.0
#1  0x00007f9a99b76667 in edm::service::cmssw_stacktrace_fork() () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/pluginFWCoreServicesPlugins.so
#2  0x00007f9a99b76c05 in edm::service::InitRootHandlers::stacktraceHelperThread() () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/pluginFWCoreServicesPlugins.so
#3  0x00007f9aa3c25c2f in std::execute_native_thread_routine (__p=0x7f9a87ac82f0) at ../../../../../libstdc++-v3/src/c++11/thread.cc:83
#4  0x00007f9aa36b9aa1 in start_thread () from /lib64/libpthread.so.0
#5  0x00007f9aa3406bcd in clone () from /lib64/libc.so.6
Thread 1 (Thread 0x7f9aa1afbc20 (LWP 23788)):
#0  0x00007f9aa33fd383 in poll () from /lib64/libc.so.6
#1  0x00007f9a99b76a54 in full_read.constprop () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/pluginFWCoreServicesPlugins.so
#2  0x00007f9a99b7722a in edm::service::InitRootHandlers::stacktraceFromThread() () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/pluginFWCoreServicesPlugins.so
#3  0x00007f9a99b78285 in sig_dostack_then_abort () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/pluginFWCoreServicesPlugins.so
#4  <signal handler called>
#5  0x00007f9aa33a794a in memcpy () from /lib64/libc.so.6
#6  0x00007f9aa3c8835b in std::char_traits<char>::copy (__n=16777215, __s2=0x7f9a878e104f "", __s1=<optimized out>) at /mnt/build/davidlt/gcc630/b/BUILD/slc6_amd64_gcc630/external/gcc/6.3.0/gcc-tags_gcc_6_3_0_release-243837/obj/x86_64-unknown-linux-gnu/libstdc++-v3/include/bits/char_traits.h:290
#7  std::basic_streambuf<char, std::char_traits<char> >::xsputn (this=0x7ffda242afc8, __s=0x7f9a878e104f "", __n=140301986333528) at /mnt/build/davidlt/gcc630/b/BUILD/slc6_amd64_gcc630/external/gcc/6.3.0/gcc-tags_gcc_6_3_0_release-243837/obj/x86_64-unknown-linux-gnu/libstdc++-v3/include/bits/streambuf.tcc:90
#8  0x00007f9aa3c7933e in std::basic_streambuf<char, std::char_traits<char> >::sputn (__n=140301986333528, __s=0x7f9a868e1098 "ORA-24960: the attribute  OCI_ATTR_USERNAME is greater than the maximum allowable length of 255", this=<optimized out>) at /mnt/build/davidlt/gcc630/b/BUILD/slc6_amd64_gcc630/external/gcc/6.3.0/gcc-tags_gcc_6_3_0_release-243837/obj/x86_64-unknown-linux-gnu/libstdc++-v3/include/streambuf:451
#9  std::__ostream_write<char, std::char_traits<char> > (__n=140301986333528, __s=0x7f9a868e1098 "ORA-24960: the attribute  OCI_ATTR_USERNAME is greater than the maximum allowable length of 255", __out=...) at /mnt/build/davidlt/gcc630/b/BUILD/slc6_amd64_gcc630/external/gcc/6.3.0/gcc-tags_gcc_6_3_0_release-243837/obj/x86_64-unknown-linux-gnu/libstdc++-v3/include/bits/ostream_insert.h:50
#10 std::__ostream_insert<char, std::char_traits<char> > (__out=..., __s=0x7f9a868e1098 "ORA-24960: the attribute  OCI_ATTR_USERNAME is greater than the maximum allowable length of 255", __n=140301986333528) at /mnt/build/davidlt/gcc630/b/BUILD/slc6_amd64_gcc630/external/gcc/6.3.0/gcc-tags_gcc_6_3_0_release-243837/obj/x86_64-unknown-linux-gnu/libstdc++-v3/include/bits/ostream_insert.h:101
#11 0x00007f9a995d7cba in SiStripConfigDb::handleException(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) const () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/libOnlineDBSiStripConfigDb.so
#12 0x00007f9a995e0b82 in SiStripConfigDb::usingDatabase() () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/libOnlineDBSiStripConfigDb.so
#13 0x00007f9a995e0d64 in SiStripConfigDb::openDbConnection() () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/libOnlineDBSiStripConfigDb.so
#14 0x00007f9a995e1dbb in SiStripConfigDb::SiStripConfigDb(edm::ParameterSet const&, edm::ActivityRegistry const&) () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/libOnlineDBSiStripConfigDb.so
#15 0x00007f9aa0c970b2 in edm::serviceregistry::ServiceMaker<SiStripConfigDb, edm::serviceregistry::AllArgsMaker<SiStripConfigDb, SiStripConfigDb> >::make(edm::ParameterSet const&, edm::ActivityRegistry&, edm::serviceregistry::ServicesManager&) const () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/pluginOnlineDBSiStripConfigDbPlugins.so
#16 0x00007f9aa6120031 in edm::serviceregistry::ServicesManager::MakerHolder::add(edm::serviceregistry::ServicesManager&) const () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/libFWCoreServiceRegistry.so
#17 0x00007f9aa61201d8 in edm::serviceregistry::ServicesManager::createServiceFor(edm::serviceregistry::ServicesManager::MakerHolder const&) () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/libFWCoreServiceRegistry.so
#18 0x00007f9aa612085f in edm::serviceregistry::ServicesManager::createServices() () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/libFWCoreServiceRegistry.so
#19 0x00007f9aa612300d in edm::serviceregistry::ServicesManager::ServicesManager(edm::ServiceToken, edm::serviceregistry::ServiceLegacy, std::vector<edm::ParameterSet, std::allocator<edm::ParameterSet> >&, bool) () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/libFWCoreServiceRegistry.so
#20 0x00007f9aa611f4ef in edm::ServiceRegistry::createSet(std::vector<edm::ParameterSet, std::allocator<edm::ParameterSet> >&, edm::ServiceToken, edm::serviceregistry::ServiceLegacy, bool) () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/libFWCoreServiceRegistry.so
#21 0x00007f9aa5dad592 in edm::ScheduleItems::initServices(std::vector<edm::ParameterSet, std::allocator<edm::ParameterSet> >&, edm::ParameterSet&, edm::ServiceToken const&, edm::serviceregistry::ServiceLegacy, bool) () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/libFWCoreFramework.so
#22 0x00007f9aa5e0224b in edm::EventProcessor::init(std::shared_ptr<edm::ProcessDesc>&, edm::ServiceToken const&, edm::serviceregistry::ServiceLegacy) () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/libFWCoreFramework.so
#23 0x00007f9aa5e04aff in edm::EventProcessor::EventProcessor(std::shared_ptr<edm::ProcessDesc>, edm::ServiceToken const&, edm::serviceregistry::ServiceLegacy) () from /cvmfs/cms.cern.ch/slc6_amd64_gcc630/cms/cmssw/CMSSW_9_4_4/lib/slc6_amd64_gcc630/libFWCoreFramework.so
#24 0x000000000040e729 in main::{lambda()#1}::operator()() const ()
#25 0x000000000040d19a in main ()

Current Modules:

Module: none (crashed)

A fatal system signal has occurred: segmentation violation


[2018-02-07 11:34:38,508] INFO: @@@CMSSW job return code = -11@@@
Traceback (most recent call last):
  File "/afs/cern.ch/work/h/hqu/Tracker/occi-test/CMSSW_9_4_4/bin/slc6_amd64_gcc630/SiStripDAQPopCon.py", line 181, in <module>
    main()
  File "/afs/cern.ch/work/h/hqu/Tracker/occi-test/CMSSW_9_4_4/bin/slc6_amd64_gcc630/SiStripDAQPopCon.py", line 174, in main
    runjob(args)
  File "/afs/cern.ch/work/h/hqu/Tracker/occi-test/CMSSW_9_4_4/bin/slc6_amd64_gcc630/SiStripDAQPopCon.py", line 89, in runjob
    raise RuntimeError('O2O job FAILED!')
RuntimeError: O2O job FAILED!
Failure running SiStripDAQPopCon.py: status 1

---> test SiStripDAQ_O2O_test had ERRORS
 
^^^^ End Test SiStripDAQ_O2O_test ^^^^
>> Tests for package CondTools/SiStrip ran.
>> Test sequence completed for CMSSW CMSSW_9_4_4

The test crashed due to the ABI incompatibility.

Running with the hack

This following piece of code is supposed to replace the length() function of std::string using strlen().

extern "C" {
#include <string.h>
int _ZNKSs6lengthEv (char **a)
{
  char *s = *a;
  return strlen (s);
}
}

We compiled it into a shared library:

g++ -shared -fPIC strlen.c -o libstrlen.so

Then load it with LD_PRELOAD:

> LD_PRELOAD=/afs/cern.ch/user/h/hqu/work/Tracker/occi-test/CMSSW_9_4_4/tmp/libstrlen.so scram b runtests

......
[2018-02-07 11:49:32,918] INFO: @@@CMSSW job return code = 0@@@
[2018-02-07 11:49:32,920] INFO: Will not run uploading as requested!
[2018-02-07 11:49:32,921] INFO: Done!
[2018-02-07 11:49:35,842] INFO: Connecting to SiStripBadChannel_FromOnline_GR10_v1_hlt_ref.db [sqlite:///SiStripBadChannel_FromOnline_GR10_v1_hlt_ref.db]
[2018-02-07 11:49:35,916] INFO: Connecting to /afs/cern.ch/work/h/hqu/Tracker/occi-test/CMSSW_9_4_4/308698/SiStripO2OBadStrip/SiStripO2OBadStrip_308698.db [sqlite:////afs/cern.ch/work/h/hqu/Tracker/occi-test/CMSSW_9_4_4/308698/SiStripO2OBadStrip/SiStripO2OBadStrip_308698.db]

---> test SiStripDAQ_O2O_test succeeded
 
^^^^ End Test SiStripDAQ_O2O_test ^^^^

The test runs successfully and the produced payload is validated against a reference payload.

The OCCI version used here is 12.1.0.2.0.

> scram tool info oracle
Tool info as configured in location /afs/cern.ch/work/h/hqu/Tracker/occi-test/CMSSW_9_4_4
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Name : oracle
Version : 12.1.0.2.0
++++++++++++++++++++
SCRAM_PROJECT=no
ORACLE_BASE=/cvmfs/cms.cern.ch/slc6_amd64_gcc630/external/oracle/12.1.0.2.0
ORACLE_ADMINDIR=/etc
BINDIR=/cvmfs/cms.cern.ch/slc6_amd64_gcc630/external/oracle/12.1.0.2.0/bin
LIB=clntsh
LIBDIR=/cvmfs/cms.cern.ch/slc6_amd64_gcc630/external/oracle/12.1.0.2.0/lib
INCLUDE=/cvmfs/cms.cern.ch/slc6_amd64_gcc630/external/oracle/12.1.0.2.0/include
USE=root_cxxdefaults sockets
TNS_ADMIN=/etc
PATH=/cvmfs/cms.cern.ch/slc6_amd64_gcc630/external/oracle/12.1.0.2.0/bin
ROOT_INCLUDE_PATH=/cvmfs/cms.cern.ch/slc6_amd64_gcc630/external/oracle/12.1.0.2.0/include

Note that the hack no longer works in OCCI 12.2.0.1.0, as reported in cms-sw#17147 (comment)

hqucms / cmssw Goto Github PK

cmssw's People

Contributors

Watchers

cmssw's Issues

Test of the OCCI workaround

Running without the hack

Running with the hack

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent