Giter VIP home page Giter VIP logo

4paradigm / openmldb Goto Github PK

View Code? Open in Web Editor NEW
1.6K 42.0 315.0 171.13 MB

OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.

Home Page: https://openmldb.ai

License: Apache License 2.0

CMake 0.41% Shell 0.70% Python 2.85% C++ 74.44% Java 18.11% SWIG 0.18% JavaScript 0.01% Scala 3.12% LLVM 0.04% Makefile 0.05% Dockerfile 0.02% HTML 0.01% Roff 0.01% Go 0.07% C 0.01%
feature-engineering machine-learning featurestore in-memory-database database-for-machine-learning machine-learning-database feature-store feature-extraction database-for-ai featureops

openmldb's People

Contributors

aceforeverd avatar cswjd avatar dependabot[bot] avatar dl239 avatar elasticlog avatar elliezza avatar frazie avatar github-actions[bot] avatar haseeb-xd avatar huilinwu2 avatar imotai avatar jingchen2222 avatar keyu813 avatar lumianph avatar mangogoforward avatar michelle-qinqin avatar nautaa avatar oh2024 avatar prajwalborkar avatar selenachenjingxin avatar tanziyen avatar tobegit3hub avatar vagetablechicken avatar wuyou10206 avatar yabg-shuai666 avatar yangwucheng avatar yjrobin avatar zekai427 avatar zhanghaohit avatar zhangziheng01233 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

openmldb's Issues

SQLBatchRequestResultSet needs design optimization

  • why SQLBatchRequestResultSet needs a brpc:Controller?
  • SQLBatchRequestResultSet can get common view & non common view directly. We don't need to get all cols, then check if constant, push to common or non common data resp. It's meaningless decode and encode.
  • SQLBatchRequestResultSet::GetSchema doesn't have the propery of constance. But we can't get common idx from SQLBatchRequestResultSet.

log_dir config dose not work

Issue tracker is ONLY used for reporting bugs. New features should be discussed on our discussion

Expected Behavior

Current Behavior

Possible Solution

Steps to Reproduce

Context (Environment)

Detailed Description

Possible Implementation

sql_sdk_test: high probability of failure

failed run: https://github.com/aceforeverd/fedb/runs/2600459768?check_suite_focus=true

complete log: logs_7.zip

typical log:

 /__w/fedb/fedb/src/sdk/sql_sdk_test.h:224: Failure
Value of: sp_info && status.code == 0
  Actual: false
Expected: true
procedure not found, msg: auto_sp8643233 does not exist in test_zw
/__w/fedb/fedb/src/sdk/sql_sdk_test.h:487: Failure
Failed
sql case expect success == true
[  FAILED  ] SQLSDKTestWindowRow/SQLSDKQueryTest.sql_sdk_request_procedure_test/4, where GetParam() = Case ID: 4, Desc:date为partition by (67 ms)

style: enforece cpp style convention in hybridse

Issue tracker is ONLY used for reporting bugs. New features should be discussed on our discussion

background
cpp code should follow our style guide: https://github.com/4paradigm/rfcs/blob/main/style-guide/code-convention.md

task
some api in hybridse::vm::EngineOptions do not follow Google Style
https://github.com/4paradigm/HybridSE/blob/main/include/vm/engine.h#L50

include and not limit to

  • SQLNode, PhysicalOpNode 's getter/setter name
  • EngineOptions

hint
you may give a summary of which part of code will tweaked first. And only focus on cpp code in hybridse subdirectory currently

Expected Behavior

Current Behavior

Fix Dependencies Warning

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

update readme

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

auto deploy package

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

reduce library (*.so) size

debug section may not useful in release. use strip --strip-unneeded to reduce library size, which can reduce package size for the hybridse java package.

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

cicd: build on push events to default branch. release on tag push, upload artifacts on other commit push

Is your feature request related to a problem? Please describe.
extra steps on commit pushed to default branch

  1. tag push: trigger a release build, with release note and asserts.
    • tag may not at main, SemVer tag only
  2. commit push to main: trigger a normal build, but upload build outputs as GitHub artifacts

Describe the solution you'd like
cicd
Describe alternatives you've considered
Nop
Additional context
Nop

TODO

  • auto release on tag push
  • get release note from CHANGELOG.md
  • 匹配代码中的 version
  • upload asserts
    • linux archive
    • mac archive, require 4paradigm/HybridSE#47
    • digest
    • digest.asc
  • upload artifacts on commit push
    • note: artifacts take up space quota for private repo

Add syntax op `&&`, `||`, `%`, `MOD`, `DIV`, `!`

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Improve Readme with vldb paper

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

compile with hybridse package

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

rm unused proto fields

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
is not compatible with the last version

Describe the solution you'd like
A clear and concise description of what you want to happen.
FEDB has some unused fields in protobuf files now. Developers and contributors may be confused with this. So we plan to remove these fields.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

update java repo

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Support CICD on arm

Is your feature request related to a problem? Please describe.
Help us to release hybridse package for arm platform

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

invitation link to slack

Hi guys,

Hope you are all well !

I was wondering where to find the slack invitation link ? I have some questions about your project.

Cheers,
Luc Michalski

delete cmake-modules

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Add API Server

HTTP interface is one of the most friendly interface and many developers like using http interface to develop their program. REST API also help us to show demo simply. So we want to support uing http api to access FEDB

Please refer rfc for more information

update readme

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Support CICD on macos

Is your feature request related to a problem? Please describe.
we want to offer a stable macos release package

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Add a test to compile all test binaries

Is your feature request related to a problem? Please describe.

Many test targets look like *_test, but no target to compile all those test at once.
Give more fine-grained control over make targets especially when coverage and example are enabled.

Describe the solution you'd like
change CMakeLists

Describe alternatives you've considered
Nop

delete catalog before store to zk

Issue tracker is ONLY used for reporting bugs. New features should be discussed on our discussion

Expected Behavior

add table to catalog after create table

Current Behavior

Before store table info to zk, tablet will delete catalog when receive zk notifaction

Possible Solution

Steps to Reproduce

Context (Environment)

Detailed Description

Possible Implementation

Support CICD on arm

Is your feature request related to a problem? Please describe.
We want to offer a stable package for arm

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

没完整开源?

请问一下是否在开源准备阶段?缺少hybridse模块,并且没有架构图和更多的介绍文档,不清楚如何使用。

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.