Comments (3)
🚀 Here's the PR! #94
4725fe3daf
)Tip
I can email you next time I complete a pull request if you set up your email here!
Actions (click)
- ↻ Restart Sweep
Step 1: 🔎 Searching
I found the following snippets in your repository. I will now analyze these snippets and come up with a plan.
Some code snippets I think are relevant in decreasing order of relevance (click to expand). If some file is missing from here, you can mention the path in the ticket description.
vector-io/src/vdf_io/import_vdf/qdrant_import.py
Lines 1 to 469 in ad971da
Step 2: ⌨️ Coding
Modify src/vdf_io/import_vdf/qdrant_import.py with contents: Update the `vectors_config` dictionary in the `upsert_data` method to correctly structure the vector configuration.<original_code>
vectors_config = {
vector_column_name: VectorParams(
size=dims,
distance=distance,
on_disk=on_disk,
)
for vector_column_name in vector_column_names
}
</original_code><new_code>
vectors_config = {
vector_column_name: VectorParams(
size=dims,
distance=distance,
)
for vector_column_name in vector_column_names
}
</new_code>Remove the nested "vector" key and specify the vector configuration directly under the "vectors" key, with the vector column name as the key and the
VectorParams
object as the value. Also remove theon_disk
parameter as it is not part of theVectorParams
configuration.
Step 3: 🔁 Code Review
I have finished reviewing the code for completeness. I did not find errors for sweep/qdrant_import_collection_not_working
.
🎉 Latest improvements to Sweep:
- New dashboard launched for real-time tracking of Sweep issues, covering all stages from search to coding.
- Integration of OpenAI's latest Assistant API for more efficient and reliable code planning and editing, improving speed by 3x.
- Use the GitHub issues extension for creating Sweep issues directly from your editor.
💡 To recreate the pull request edit the issue title or description.
Something wrong? Let us know.
This is an automated message generated by Sweep AI.
from vector-io.
The issue seems to stem from the collection configuration format used during the import process. Specifically, the vectors_config
setup in the upsert_data
method of qdrant_import.py
expects a dictionary with keys corresponding to vector column names and their configurations. However, your collection's config.json indicates a mismatch in expected structure, particularly under the params
-> vectors
section. To resolve this, ensure the collection configuration passed to self.client.create_collection
within upsert_data
matches Qdrant's expected format. This involves adjusting the vectors_config
dictionary construction to align with your collection's actual vector dimension and distance metric, ensuring it accurately reflects the structure shown in your issue description.
References
/src/vdf_io/import_vdf/qdrant_import.py
from vector-io.
The
"params": {
"vectors": {
"vector": {
"size": 1536,
"distance": "Cosine"
}
},
...
is matching the format for named vectors.
I want to better understand the sequence of your operations. Did you first import a vdf dataset into your qdrant instance, and then try to do a search via the REST API?
from vector-io.
Related Issues (20)
- Script to convert vdf dir into tsv files for usage in Tensorflow Viz
- Export from pinecone seems to be a little bit hacky HOT 2
- Is it possible to skip namespaces with errors and move on to next ones? HOT 4
- Add support for pgvector
- Error: 'str' object has no attribute 'starts_with' while importing to Pinecone serverless HOT 3
- "keep-alive" script for each cloud VDB HOT 2
- KDB insert problem HOT 1
- Integrate latentscope library for visualization
- Use sphinx-argparse to generate documentation
- Export VDF to DataMapPlot
- Switch Pinecone export random search approach to new list_points method HOT 4
- Pinecone Import: Multiple matches for FieldRef.Name(__filename) in id: string HOT 3
- Support int8 and binary embedding in reembed script
- Add Support for Weaviate HOT 13
- Complete CQL version of AstraDB import implementation
- Create LanceDB index after table is created in import HOT 1
- Sweep: Add Support for Turbopuffer HOT 1
- Refactoring removed critical / necessary code HOT 5
- All Contributors addition HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from vector-io.