Comments (2)
Makes sense, if anything, I would move the matplotlib assumption above the choosing any single dimension, since that one is more arbitrary and kind of a last ditch naive approach.
from trulens.
I would move the matplotlib assumption above the choosing any single dimension, since that one is more arbitrary and kind of a last ditch naive approach.
My thinking was that this ordering would lead to the greatest convenience. Basically, I like to use the Tiler
class as a convenient for visualizing training data, even if I'm not using other TruLens features.
If we use the matplotlib assumption, then we will always pick (I think) the last dimension as the channel dimension (so we'll never reach any other cases in our "switch statement" suggested above). This is standard in tensorflow, but not pytorch. So if the user is using pytorch, or keras with 'channels_first'
, they may have some data that they would like to visualize that is naturally in NCHW format. In that case, they would have to transpose the dimensions before sending it to the tiler. On the other hand, this data would probably have a shape of something like (n, 3, x, y), in which case we could infer that dimension 1 is the channel dimension, as long as y doesn't happen to be 3. This would make it so that NCHW users could use the tiler with their preferred format without having to "know" that matplotlib wants NHWC format, and also without having to specify the backend to TruLens.
If it happens to be ambiguous for some reason we could warn them that we're using the default of NHWC.
from trulens.
Related Issues (20)
- Rag evaluation with TruLens and bedrock not working using query engine retriever HOT 1
- ArrowInvalid: ('cannot mix struct and non-struct, non-null values', 'Conversion failed for column statement with type object')
- TruLlama with query engine argument not working HOT 4
- Exception in LangChain causes TruLens evaluation to halt HOT 2
- Custom Retriever Class for AWS Bedrock + Retriever Class HOT 9
- Unhandled Exception in feedback function HOT 2
- please change the import of PromptTemplate from langchain.prompts HOT 1
- Custom Feedback Provider HOT 1
- TypeError in trulens: issubclass() Argument Must Be a Class When Wrapping RAG with TruCustomApp HOT 4
- Issue with Trulens Evaluation and TruChain(using LangChain) HOT 1
- OpenAI account Terminated after using trulens library HOT 3
- Consistent format expectations for all Bedrock models HOT 10
- LiteLLM required when it shouldn't be
- Arbitrary LLM endpoint as Provider
- AttributeError: module 'openai' has no attribute 'OpenAI' HOT 1
- Error when using Ground Truth HOT 2
- Improve docs for litellm usage with local models HOT 1
- Add docs for running evals on pre-logged data HOT 10
- AssertionError using LangChain's ChatOpenAI with `streaming=true` HOT 3
- error "name 'Bedrock' is not defined" when groundedness is calculated HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from trulens.