Comments (2)
montanalow
commented on May 21, 2024
I'm guessing you would like listwise ranking objective, rather than the pointwise objective which basically degrades to ordering by regression. listwise ranking needs a batch prediction interface, since it takes an entire set of candidates into consideration, and it needs the additional query set size argument. We'll need to add a "ranking" objective in addition to classification and regression, for projects to support the additional API and data requirements. This seems like a pretty reasonable thing to support.
Do you have some benchmarks for the differences in quality you see between pointwise/pairwise/listwise ranking on your dataset so we have more context around the metrics you're looking at for this problem?
from postgresml.
klvnptr
commented on May 21, 2024
Thank you for your feedback. No real-world experience yet, we are just getting into this space. We are implementing pairwise right now.
from postgresml.
Related Issues (20)
- Train Error HOT 2
- ImportError: cannot import name 'Tensor' from 'torch' (unknown location) HOT 3
- open a new issue since the Train Error #1296 problem has been closed. HOT 1
- Documentation never states the extension name HOT 2
- After using pgml.dump_all and pgml.load_all for data backup and migration, an error occurs when trying to train on the new database.
- Error occurs during pgml.train with passive_aggressive algorithm
- rust-xgboost doesn't build on Mac OS HOT 1
- Improvement Suggestion for predictor_proba Function in sklearn.py HOT 1
- pgml.train does not properly escape relation_name HOT 2
- pgvector missing in Docker image ghcr.io/postgresml/postgresml:2.8.2 HOT 2
- wrong SQL SELECT in readme
- wrong SQL CREATE INDEX in readme
- Error in "pgml.transform" with "text2text-generation" and "bigscience/T0" HOT 2
- Docker build process fails because postgresml version 2.7.13 is no longer found at apt.postgresml.org HOT 2
- Question answering on a table HOT 1
- Support for `mixedbread-ai/mxbai-embed-large-v1`
- Split transformers.py into multiple python files HOT 1
- Potential performance issue: Unreliable performance of .loc in pandas 2.0.3
- Issues with Docker container on port 5432
- Transaction leak in transform_stream
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from postgresml.