Comments (9)
xiaocai2333
commented on August 16, 2024
@elstic
Did you enable diskann when building the image?
from milvus.
elstic
commented on August 16, 2024
@elstic Did you enable diskann when building the image?
The image is automatically typed by pipeline, I looked for the log that typed the image.
from milvus.
yanliang567
commented on August 16, 2024
/assign @xiaocai2333
/unassign
from milvus.
wangting0128
commented on August 16, 2024
same error
argo task: multi-vector-corn-1-1719410400
test case name: test_hybrid_search_locust_dml_load_release_cluster
image:2.4-20240626-07a05db5-amd64
server:
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
multi-vector-corn-1-1719410400-3-etcd-0 1/1 Running 0 7m25s 10.104.34.252 4am-node37 <none> <none>
multi-vector-corn-1-1719410400-3-etcd-1 1/1 Running 0 7m24s 10.104.25.74 4am-node30 <none> <none>
multi-vector-corn-1-1719410400-3-etcd-2 1/1 Running 0 7m24s 10.104.20.117 4am-node22 <none> <none>
multi-vector-corn-1-1719410400-3-milvus-datacoord-674f9f45jtsqg 1/1 Running 4 (5m43s ago) 7m25s 10.104.13.115 4am-node16 <none> <none>
multi-vector-corn-1-1719410400-3-milvus-datanode-856995b7dhmcsz 1/1 Running 4 (5m49s ago) 7m25s 10.104.24.101 4am-node29 <none> <none>
multi-vector-corn-1-1719410400-3-milvus-datanode-856995b7dqvcfh 1/1 Running 4 7m25s 10.104.25.58 4am-node30 <none> <none>
multi-vector-corn-1-1719410400-3-milvus-indexcoord-564fddbngtvf 1/1 Running 0 7m25s 10.104.13.114 4am-node16 <none> <none>
multi-vector-corn-1-1719410400-3-milvus-indexnode-555c49d4jj7kr 1/1 Running 4 (6m1s ago) 7m25s 10.104.14.77 4am-node18 <none> <none>
multi-vector-corn-1-1719410400-3-milvus-proxy-6569f58fc4-4l6ff 1/1 Running 4 (5m59s ago) 7m25s 10.104.6.106 4am-node13 <none> <none>
multi-vector-corn-1-1719410400-3-milvus-querycoord-79f9f74mltjt 1/1 Running 4 (5m59s ago) 7m25s 10.104.6.109 4am-node13 <none> <none>
multi-vector-corn-1-1719410400-3-milvus-querynode-55db44b6bk2wk 1/1 Running 4 (5m45s ago) 7m25s 10.104.34.236 4am-node37 <none> <none>
multi-vector-corn-1-1719410400-3-milvus-querynode-55db44b6sh4mj 1/1 Running 4 (5m49s ago) 7m25s 10.104.18.224 4am-node25 <none> <none>
multi-vector-corn-1-1719410400-3-milvus-rootcoord-79749876pn2gr 1/1 Running 4 (6m ago) 7m25s 10.104.14.78 4am-node18 <none> <none>
multi-vector-corn-1-1719410400-3-minio-0 1/1 Running 0 7m25s 10.104.34.251 4am-node37 <none> <none>
multi-vector-corn-1-1719410400-3-minio-1 1/1 Running 0 7m24s 10.104.20.113 4am-node22 <none> <none>
multi-vector-corn-1-1719410400-3-minio-2 1/1 Running 0 7m24s 10.104.25.75 4am-node30 <none> <none>
multi-vector-corn-1-1719410400-3-minio-3 1/1 Running 0 7m23s 10.104.24.115 4am-node29 <none> <none>
multi-vector-corn-1-1719410400-3-pulsar-bookie-0 1/1 Running 0 7m24s 10.104.16.95 4am-node21 <none> <none>
multi-vector-corn-1-1719410400-3-pulsar-bookie-1 1/1 Running 0 7m23s 10.104.25.79 4am-node30 <none> <none>
multi-vector-corn-1-1719410400-3-pulsar-bookie-2 1/1 Running 0 7m23s 10.104.20.118 4am-node22 <none> <none>
multi-vector-corn-1-1719410400-3-pulsar-bookie-init-r2ggt 0/1 Completed 0 7m25s 10.104.5.246 4am-node12 <none> <none>
multi-vector-corn-1-1719410400-3-pulsar-broker-0 1/1 Running 0 7m25s 10.104.20.104 4am-node22 <none> <none>
multi-vector-corn-1-1719410400-3-pulsar-proxy-0 1/1 Running 0 7m24s 10.104.5.247 4am-node12 <none> <none>
multi-vector-corn-1-1719410400-3-pulsar-pulsar-init-2cbwc 0/1 Completed 0 7m25s 10.104.6.107 4am-node13 <none> <none>
multi-vector-corn-1-1719410400-3-pulsar-recovery-0 1/1 Running 0 7m25s 10.104.6.108 4am-node13 <none> <none>
multi-vector-corn-1-1719410400-3-pulsar-zookeeper-0 1/1 Running 0 7m25s 10.104.34.250 4am-node37 <none> <none>
multi-vector-corn-1-1719410400-3-pulsar-zookeeper-1 1/1 Running 0 5m55s 10.104.20.145 4am-node22 <none> <none>
multi-vector-corn-1-1719410400-3-pulsar-zookeeper-2 1/1 Running 0 4m20s 10.104.17.28 4am-node23 <none> <none>
client pod name: multi-vector-corn-1-1719410400-3362665307
client log:
test steps:
concurrent test and calculation of RT and QPS
:purpose: `DML & load -> release collection`
verify DML & load -> release collection scenario,
which has 4 vector fields(IVF_FLAT, HNSW, DISKANN, IVF_SQ8) and scalar fields: `int64_1`, `varchar_1`
:test steps:
1. create collection with fields:
'float_vector': 128dim,
'float_vector_1': 128dim,
'float_vector_2': 128dim,
'float_vector_3': 128dim,
scalar field: int64_1, varchar_1
2. build indexes:
IVF_FLAT: 'float_vector'
HNSW: 'float_vector_1',
DISKANN: 'float_vector_2'
IVF_SQ8: 'float_vector_3'
INVERTED: 'int64_1', 'varchar_1'
default scalar index: 'id'
3. insert 100k data
4. flush collection
5. build indexes again using the same params <- build diskann failed
from milvus.
xiaofan-luan
commented on August 16, 2024
on build.sh
UBUNTU system build diskann index
if [ "$OS_NAME" == "ubuntu20.04" ] ; then
BUILD_DISK_ANN=ON
fi
since we upgrade to 22.04, that might be issue
from milvus.
wangting0128
commented on August 16, 2024
on build.sh
UBUNTU system build diskann index
if [ "$OS_NAME" == "ubuntu20.04" ] ; then BUILD_DISK_ANN=ON fi
since we upgrade to 22.04, that might be issue
@samhuang-z
please help check it out～
from milvus.
xiaofan-luan
commented on August 16, 2024
OS_NAME=$(uname -s | tr '[:upper:]' '[:lower:]')
OS_VERSION="unknown"
DISTRO_NAME="unknown"
if [[ -f /etc/os-release ]]; then
. /etc/os-release
DISTRO_NAME=$ID
OS_VERSION=$VERSION_ID
fi
if [[ ("$DISTRO_NAME" == "ubuntu" && "$OS_VERSION" >= "20.04") || "$DISTRO_NAME" == "rocky" || "$DISTRO_NAME" == "amzn" ]]; then
BUILD_DISK_ANN=ON
fi
@samhuang-z can you help me to verify the code above work?
from milvus.
yellow-shine
commented on August 16, 2024
@xiaofan-luan It's quite crazy and challenging to handle float and complex if statement in shell. how about this? make it more easy
from milvus.
elstic
commented on August 16, 2024
The diskann build failure due to compilation parameters has been fixed, verify image: 2.4-20240630-fc6bd387-amd64
from milvus.
Related Issues (20)
- [Bug]: milvus crash after dropping a collection if compaction disabled HOT 1
- [Bug]: The decribe index api returns an incoherent response structure when using orm create index and milvusclient create index respectively HOT 1
- [Bug]: indices is empty when maping sparse float vector HOT 1
- [Bug]: pymilvus.exceptions.MilvusException: <MilvusException: (code=65535, message=unrecoverable error)> HOT 2
- [Bug]: Before exiting, make sure the goroutine has exited HOT 1
- [Bug]: err has degenerated into a new variable, which cannot be captured in defer. HOT 1
- [Bug]: Vector Search() bug HOT 7
- [Feature]: Partial load collection at field/column level
- [Bug]: querynode got restarted during test after indexcoord pod kill chaos test HOT 1
- [Bug]: Data race when clustering compaction HOT 1
- [Bug]: sparse column is sealed before append batch in mmap mode HOT 1
- [Bug]: Only one queryNode performs the loading job when the index_type is DISKANN. HOT 10
- [Bug]: Unable to load the collection HOT 9
- [Enhancement]: Enable to backup and restore rbac meta info HOT 1
- [Bug]: err cannot be captured in defer in data_sync_service HOT 1
- [Bug]: The password can contain`: `separators, which may cause errors when parsing the token as user+password. HOT 4
- [Bug]: panic in internal/flushcommon/util/timetick_sender.go HOT 2
- [Enhancement]: Add index task number for standalone milvus
- [Bug]: [benchmark][standalone] load collection raise error `collection not loaded` HOT 6
- [Feature]: Support Range Search Pagination Retain Order so No Duplication when using Different Offset HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from milvus.