yahoojapan / k2hash Goto Github PK

View Code? Open in Web Editor NEW

36.0 9.0 11.0 1.24 MB

K2HASH - NoSQL Key Value Store(KVS) library

Home Page: https://k2hash.antpick.ax/

License: MIT License

Makefile 1.03% Shell 10.53% M4 0.74% C++ 82.57% C 4.30% Batchfile 0.83%

nosql kvs transaction database queue in-memory antpickax fullock k2hash

k2hash's People

Contributors

Stargazers

Watchers

Forkers

mochilic skyformat99 autopp ct1104 ggtakec daisuke-t-jp hiwakaba wahello antpickax tsuyopon yujnishi

k2hash's Issues

Consider support for aarch64, ppc64el and s390x.

Additional Information

Version of K2HASH being used (k2hlinetool -libversion)

[vagrant@localhost ~]$ k2hlinetool -libversion

K2HASH library Version 1.0.71 (commit: 3813fcd) with NSS

Copyright(C) 2013 Yahoo Japan Corporation.

K2HASH is key-valuew store base libraries. K2HASH is made for
the purpose of the construction of original KVS system and the
offer of the library. The characteristic is this KVS library
which Key can layer. And can support multi-processing and
multi-thread, and is provided safely as available KVS.


FULLOCK Version 1.0.36 (commit: unknown)

Copyright(C) 2015 Yahoo Japan Corporation.

FULLOCK is fast locking library on user level by Yahoo! JAPAN.
FULLOCK is following specifications.

System information (uname -a)
Please see:
https://koji.fedoraproject.org/koji/taskinfo?taskID=37491461
https://koji.fedoraproject.org/koji/taskinfo?taskID=37491462
https://koji.fedoraproject.org/koji/taskinfo?taskID=37491463
Distro (cat /etc/issue)
Please see:
https://koji.fedoraproject.org/koji/taskinfo?taskID=37491461
https://koji.fedoraproject.org/koji/taskinfo?taskID=37491462
https://koji.fedoraproject.org/koji/taskinfo?taskID=37491463

Details about issue

Build failures on each of aarch64, ppc64el and s390x platform. The exis code of test_linetool.sh is the main reason of failures. Here is diff between results and expected ones.

$ diff -c ${LOGSUBFILE} ${MASTERLOGSUBFILE} > /tmp/k2hash_test_linetool.diff 2>&1 
$ cat /tmp/k2hash_test_linetool.diff

    ***************
    *** 716,722 ****
      > ba mtime history expire=10 enc pass=test_encrypt_keys
      > set testkey testvalue
      > p testkey
    !   +"testkey" => value is not found
      > rm testkey
      > clanallattr
      > cleanallattr
    --- 716,722 ----
      > ba mtime history expire=10 enc pass=test_encrypt_keys
      > set testkey testvalue
      > p testkey
    !   +"testkey" => "testvalue"
      > rm testkey
      > clanallattr
      > cleanallattr
    ***************
    *** 1967,1973 ****
      > ba mtime history expire=10 enc pass=test_encrypt_keys
      > set testkey testvalue
      > p testkey
    !   +"testkey" => value is not found
      > rm testkey
      > clanallattr
      > cleanallattr
    --- 1967,1973 ----
      > ba mtime history expire=10 enc pass=test_encrypt_keys
      > set testkey testvalue
      > p testkey
    !   +"testkey" => "testvalue"
      > rm testkey
      > clanallattr
      > cleanallattr
    ***************
    *** 2667,2673 ****
      > ba mtime history expire=10 enc pass=test_encrypt_keys
      > set testkey testvalue
      > p testkey
    !   +"testkey" => value is not found
      > rm testkey
      > clanallattr
      > cleanallattr
    --- 2667,2673 ----
      > ba mtime history expire=10 enc pass=test_encrypt_keys
      > set testkey testvalue
      > p testkey
    !   +"testkey" => "testvalue"
      > rm testkey
      > clanallattr
      > cleanallattr

Please see:
http://koji.fedoraproject.org/koji/taskinfo?taskID=37491459

How to Reproduce a Bug

Requirement:
- Fedora31
- FAS account
  - https://admin.fedoraproject.org/accounts
- Koji settings
  - https://fedoraproject.org/wiki/Using_the_Koji_build_system#Scratch_Builds

Builds k2hash src.rpm

$ rpmdev-setuptree
$ vi k2hash.spec

k2hash.spec:

#
# K2HASH
#
# Copyright 2013 Yahoo Japan Corporation.
#
# K2HASH is key-valuew store base libraries.
# K2HASH is made for the purpose of the construction of
# original KVS system and the offer of the library.
# The characteristic is this KVS library which Key can
# layer. And can support multi-processing and multi-thread,
# and is provided safely as available KVS.
#
# For the full copyright and license information, please view
# the license file that was distributed with this source code.
#
# AUTHOR:   Takeshi Nakatani
# CREATE:   Fri 17 Jul 2016
# REVISION:
#

#
# Local macros/define
#
%if %{undefined package_revision}
%global package_revision 1
%endif

%if %{undefined make_build}
%global make_build %{__make} %{?_smp_mflags}
%endif

%if %{undefined autosetup}
%global autosetup %setup -q
%endif

%global gittag v1.0.71

%if %{undefined make_check}
%global make_check 1
%endif

#
# main package
#
Summary: NoSQL Key Value Store(KVS) library
Name: k2hash
Version: 1.0.71
Release: %{package_revision}%{?dist}
License: MIT

URL: https://github.com/yahoojapan/k2hash
Source0: https://github.com/yahoojapan/k2hash/archive/%{gittag}/%{name}-%{version}.tar.gz
Requires: libfullock%{?_isa} >= 1.0.36
BuildRequires: git-core gcc-c++ make libtool libfullock-devel >= 1.0.36 nss-devel
# k2hash does not support 32bit arch.
ExcludeArch: i686 armv7hl

%description
K2HASH is NoSQL(key value store) library and tools for this library.

%prep
%autosetup -n %{name}-%{version}

%build
%configure --disable-static --with-nss
%make_build

%install
%make_install
find %{buildroot} -name '*.la' -exec rm -f {} ';'

%if %{make_check}
%check
%{__make} check
find %{_builddir} -name '*.log' -exec echo {} ';'
find %{_builddir} -name '*.log' -exec cat {} ';'
%endif

%if %{defined ldconfig_scriptlets}
%ldconfig_scriptlets
%else
%post -p /sbin/ldconfig
%postun -p /sbin/ldconfig
%endif

%if 0%{?rhel} == 6
%clean
rm -rf %{buildroot}
%endif

%files
%if 0%{?rhel} == 6
%doc COPYING
%defattr(-,root,root)
%else
%license COPYING
%endif
%doc README AUTHORS ChangeLog
%{_libdir}/*.so.1*
%{_mandir}/man1/*
%{_bindir}/*

#
# devel package
#
%package devel
Summary: NoSQL Key Value Store(KVS) library (development)
Requires: %{name}%{?_isa} = %{version}-%{release}, libfullock-devel%{?_isa} >= 1.0.36

%description devel
Development package for building with k2hash shared library.
This package has header files and symbols for it.

%files devel
%if 0%{?rhel} == 6
%defattr(-,root,root)
%endif
%doc README AUTHORS ChangeLog
%{_includedir}/*
%{_libdir}/*.so
%{_libdir}/pkgconfig/*.pc

%changelog
* Fri Sep 06 2019 Takeshi Nakatani <[email protected]>   1.0.71-1
- First version of Fedora

Code changes are required to print test failure logs.

$ wget https://github.com/yahoojapan/k2hash/archive/v1.0.71/k2hash-1.0.71.tar.gz
$ tar xzf k2hash-1.0.71.tar.gz
$ cd k2hash-1.0.71
$ sh autogen.sh
$ vi tests/test_linetool.sh
$ cd ..
$ diff -r k2hash-1.0.71.orig/tests/test_linetool.sh k2hash-1.0.71/tests/test_linetool.sh
109c109
< 	diff ${LOGSUBFILE} ${MASTERLOGSUBFILE} >/dev/null 2>&1
---
> 	diff -c ${LOGSUBFILE} ${MASTERLOGSUBFILE} > /tmp/k2hash_test_linetool.diff 2>&1
118,120c118,120
< 		rm -f ${LOGFILE}
< 		rm -f ${LOGSUBFILE}
< 		rm -f ${MASTERLOGSUBFILE}
---
> 		#rm -f ${LOGFILE}
> 		#rm -f ${LOGSUBFILE}
> 		#rm -f ${MASTERLOGSUBFILE}

Then build a k2hash source rpm.

$ rpmbuild -bs k2hash.spec

Finally run a Koji scratch build.

$ koji build --scratch f31-candidate ~/rpmbuild/SRPMS/k2hash-1.0.71-1.fc31.src.rpm

After buiding a binary package, you will see the same log as the following log in the koji build.log.

$ cat /tmp/k2hash_test_linetool.diff

    ***************
    *** 716,722 ****
      > ba mtime history expire=10 enc pass=test_encrypt_keys
      > set testkey testvalue
      > p testkey
    !   +"testkey" => value is not found
      > rm testkey
      > clanallattr
      > cleanallattr
    --- 716,722 ----
      > ba mtime history expire=10 enc pass=test_encrypt_keys
      > set testkey testvalue
      > p testkey
    !   +"testkey" => "testvalue"
      > rm testkey
      > clanallattr
      > cleanallattr
    ***************
    *** 1967,1973 ****
      > ba mtime history expire=10 enc pass=test_encrypt_keys
      > set testkey testvalue
      > p testkey
    !   +"testkey" => value is not found
      > rm testkey
      > clanallattr
      > cleanallattr
    --- 1967,1973 ----
      > ba mtime history expire=10 enc pass=test_encrypt_keys
      > set testkey testvalue
      > p testkey
    !   +"testkey" => "testvalue"
      > rm testkey
      > clanallattr
      > cleanallattr
    ***************
    *** 2667,2673 ****
      > ba mtime history expire=10 enc pass=test_encrypt_keys
      > set testkey testvalue
      > p testkey
    !   +"testkey" => value is not found
      > rm testkey
      > clanallattr
      > cleanallattr
    --- 2667,2673 ----
      > ba mtime history expire=10 enc pass=test_encrypt_keys
      > set testkey testvalue
      > p testkey
    !   +"testkey" => "testvalue"
      > rm testkey
      > clanallattr
      > cleanallattr

Build error in Fedora 25

Additional Information

(The following information is very important in order to help us to help you. Omission of the following details may delay your support request or receive no attention at all.)

Version of K2HASH being used (k2hlinetool -libversion)

K2HASH library Version 1.0.52 (commit: bcd8209)

Copyright 2013 Yahoo! JAPAN corporation.

K2HASH is key-valuew store base libraries. K2HASH is made for
the purpose of the construction of original KVS system and the
offer of the library. The characteristic is this KVS library
which Key can layer. And can support multi-processing and
multi-thread, and is provided safely as available KVS.


FULLOCK Version 1.0.21 (commit: 9157151)

Copyright 2015 Yahoo! JAPAN corporation.

FULLOCK is fast locking library on user level by Yahoo! JAPAN.
FULLOCK is following specifications.

System information (uname -a)

Linux f844098a57bd 4.6.6-200.fc23.x86_64 #1 SMP Wed Aug 10 23:13:35 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux

Fedora 25 docker container on Fedora 23

Distro (cat /etc/issue)

\S
Kernel \r on an \m (\l)

Details about issue

Build error in Fedora 25

Fedora 25 / gcc version 6.2.1 20160916 (Red Hat 6.2.1-2) (GCC)

k2hmmapinfo.cc: In member function 'k2h_mmap_info** K2HMmapMan::GetMmapInfo(const K2HShm*, const char*, bool)':
k2hmmapinfo.cc:351:10: error: cannot convert 'bool' to 'k2h_mmap_info**' in return
   return false;

k2htouch.cc: In function 'bool AttrSet(K2HShm*)':
k2htouch.cc:291:26: error: cannot convert 'bool' to 'const bool*' in initialization
  const bool* is_defenc = false ;

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.