Comments (11)
vruusmann
commented on August 18, 2024
Your PMML document contains a SimplePredicate element, which attempts to apply a comparison operator (<=, <, > and >=) to a categorical field value:
<SimplePredicate field="fruit" operator="lessThan" value="orange"/>
This is NOT permitted according to the PMML specification, so the following EvaluationException is perfectly "correct" (sure, this exception should have a proper message):
Exception in thread "main" org.jpmml.evaluator.EvaluationException
at org.jpmml.evaluator.CategoricalValue.compareToString(CategoricalValue.java:39)
at org.jpmml.evaluator.FieldValue.compareTo(FieldValue.java:139)
at org.jpmml.evaluator.PredicateUtil.evaluateSimplePredicate(PredicateUtil.java:131)
What is your sklearn2pmml/JPMML-SkLearn library version? It can be found on the PMML/Header/Application section of your PMML document. If it's anything less than "JPMML-SkLearn 1.1.0", then please upgrade first.
I don't think that sklearn2pmml is generating such SimplePredicate elements. Have you manually modified the PMML document yourself? Can you send it to me?
from jpmml-evaluator.
vruusmann
commented on August 18, 2024
Looking at your Java code, I think that the following line is where those categorical field values creep in:
activeValue = FieldValueUtil.create(this.data[i]);
The utility method FieldUtil#create(Object) attempts to guess the data type and operational type based on the Java class. In this case, it is assigning a categorical optype to a field value that should have a continuous optype according to the PMML document.
You should ALWAYS do InputField#prepare(Object). And in order to be future-proof, you should replace Evaluator#getActiveFields() with Evaluator#getInputFields().
This is the correct way of preparing inputs in your use case:
List<InputField> inputFields = evaluator.getInputFields();
for(int i = 0; i < inputFields.size(); i++){
InputField inputField = inputFields.get(i);
arguments.put(inputField.getName(), inputField.prepare(data[i]));
}
from jpmml-evaluator.
Alexkevin
commented on August 18, 2024
@vruusmann readlly really thank you ~
My codes work
from jpmml-evaluator.
sbourzai
commented on August 18, 2024
Hi Sir,
I have exported my model to pmml 4.3 and i try to import it into java project and i get this errors :
i think it is beacause of the :
InputSource source = new InputSource(is);
SAXSource transformedSource = ImportFilter.apply(source);
return JAXBUtil.unmarshalPMML(transformedSource);
and i tried with the IOUtil but i have the same error :
java.lang.IllegalArgumentException: http://www.dmg.org/PMML-4_3
at org.jpmml.schema.Version.forNamespaceURI(Version.java:47)
at org.jpmml.model.PMMLFilter.updateSource(PMMLFilter.java:92)
at org.jpmml.model.PMMLFilter.startPrefixMapping(PMMLFilter.java:41)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.startNamespaceMapping(Unknown Source)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.startElement(Unknown Source)
at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.scanStartElement(Unknown Source)
at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl$NSContentDriver.scanRootElementHook(Unknown Source)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(Unknown Source)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$PrologDriver.next(Unknown Source)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(Unknown Source)
at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(Unknown Source)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(Unknown Source)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Unknown Source)
at org.xml.sax.helpers.XMLFilterImpl.parse(Unknown Source)
at com.sun.xml.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal0(UnmarshallerImpl.java:258)
at com.sun.xml.bind.v2.runtime.unmarshaller.UnmarshallerImpl.unmarshal(UnmarshallerImpl.java:229)
at javax.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(Unknown Source)
at javax.xml.bind.helpers.AbstractUnmarshallerImpl.unmarshal(Unknown Source)
at IOUtil.unmarshal(IOUtil.java:54)
at IOUtil.unmarshal(IOUtil.java:47)
at IOUtil.unmarshal(IOUtil.java:42)
at IOUtil.unmarshal(IOUtil.java:34)
at ConnectTry.main(ConnectTry.java:24)
Exception in thread "main" java.lang.NullPointerException
at org.jpmml.evaluator.TreeModelEvaluator.<init>(TreeModelEvaluator.java:48)
at ConnectTry.main(ConnectTry.java:33)
from jpmml-evaluator.
bachsh
commented on August 18, 2024
@sbourzai I'm having the same issue. Did you solve it eventually?
from jpmml-evaluator.
sbourzai
commented on August 18, 2024
Hello @bachsh
Yes, try to add this to your pom file :
**<groupId>com.test.LinRegPMML</groupId>
<artifactId>test-LinRegPMML</artifactId>
<version>0.0.1-SNAPSHOT</version>
<packaging>jar</packaging>
<name>test-LinRegPMML</name>
<url>http://maven.apache.org</url>
<properties>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
</properties>
<dependencies>
<dependency>
<groupId>org.jpmml</groupId>
<artifactId>pmml-evaluator</artifactId>
<version>1.3.6</version>
</dependency>
<dependency>
<groupId>org.jpmml</groupId>
<artifactId>pmml-manager</artifactId>
<version>1.1.20</version>
</dependency>
<dependency>
<groupId>org.slf4j</groupId>
<artifactId>slf4j-api</artifactId>
<version>1.7.25</version>
</dependency>
<dependency>
<groupId>com.beust</groupId>
<artifactId>jcommander</artifactId>
<version>1.72</version>
</dependency>
<dependency>
<groupId>com.codahale.metrics</groupId>
<artifactId>metrics-core</artifactId>
<version>3.0.2</version>
</dependency>
<dependency>
<groupId>junit</groupId>
<artifactId>junit</artifactId>
<version>4.12</version>
<scope>test</scope>
</dependency>
</dependencies>**
from jpmml-evaluator.
sbourzai
commented on August 18, 2024
and I was able to read import my model by using this :
@Test
public void predicExample() throws Exception {
// Loading a PMML schema version 4.X document into an org.dmg.pmml.PMML instance:
InputStream is = new FileInputStream("LinReg_PMML.xml");
PMML pmml = PMMLUtil.unmarshal(is);
// if the model type is known (here: "LinearRegression",
Evaluator evaluator = new RegressionModelEvaluator(pmml);
// if the model type is unknown
Evaluator evaluator2 = ModelEvaluatorFactory.newInstance().newModelEvaluator(pmml);
from jpmml-evaluator.
bachsh
commented on August 18, 2024
@sbourzai Thank you for the answer! The reason I got my error was the conflict between an old JPMML-Model version which is included in SparkML. The full solution, as recommended by Villu (the creator of JPMML) is to shade the package
https://github.com/jpmml/jpmml-sparkml#library
For me, importing the JPMML-Model dependency before importing the SparkML dependency solved the issue. I'm using jupyter-scala so it looks like this
import $ivy.`org.jpmml:pmml-model:1.3.9`
import $ivy.`org.apache.spark::spark-mllib:2.1.0`
from jpmml-evaluator.
sbourzai
commented on August 18, 2024
Great !
Thanks for the information 👍
Good Luck
from jpmml-evaluator.
diogofernandes63
commented on August 18, 2024
I get the error:
Exception in thread "main" org.jpmml.evaluator.EvaluationException (at or around line 156 of the PMML document): Collection value cannot be used in comparison operations
at org.jpmml.evaluator.CollectionValue.compareToValue(CollectionValue.java:62)
at org.jpmml.evaluator.FieldValue.compareTo(FieldValue.java:127)
at org.jpmml.evaluator.PredicateUtil.evaluateSimplePredicate(PredicateUtil.java:162)
at org.jpmml.evaluator.PredicateUtil.evaluatePredicate(PredicateUtil.java:83)
at org.jpmml.evaluator.PredicateUtil.evaluate(PredicateUtil.java:73)
at org.jpmml.evaluator.tree.TreeModelEvaluator.evaluateNode(TreeModelEvaluator.java:200)
at org.jpmml.evaluator.tree.TreeModelEvaluator.handleTrue(TreeModelEvaluator.java:217)
at org.jpmml.evaluator.tree.TreeModelEvaluator.evaluateTree(TreeModelEvaluator.java:164)
at org.jpmml.evaluator.tree.TreeModelEvaluator.evaluateRegression(TreeModelEvaluator.java:111)
at org.jpmml.evaluator.ModelEvaluator.evaluateInternal(ModelEvaluator.java:645)
at org.jpmml.evaluator.mining.MiningModelEvaluator.evaluateSegmentation(MiningModelEvaluator.java:508)
at org.jpmml.evaluator.mining.MiningModelEvaluator.evaluateRegression(MiningModelEvaluator.java:214)
at org.jpmml.evaluator.ModelEvaluator.evaluateInternal(ModelEvaluator.java:645)
at org.jpmml.evaluator.mining.MiningModelEvaluator.evaluateInternal(MiningModelEvaluator.java:207)
at org.jpmml.evaluator.ModelEvaluator.evaluate(ModelEvaluator.java:557)
at javaapplication3.ola.run(ola.java:118)
And the code is:
public void run(String [] args) throws Exception {
this.modelEvaluator=null;
try{
modelEvaluator=loadModel("/Users/diogoduarte/Desktop/2ºdataset/model.pmml");
} catch(Exception e){
e.printStackTrace();
}
modelEvaluator.verify();
List<? extends InputField> inputFields = modelEvaluator.getInputFields();
System.out.println("Input fields: " + inputFields);
Map<FieldName,FieldValue>arguments=new LinkedHashMap<>();
List<InputField>inputfields=modelEvaluator.getInputFields();
analogs=addvalue();
System.out.println("line " + analogs);
for(InputField inputfield: inputfields){
FieldName inputfieldName=inputfield.getName();
Object rawValue=analogs;
FieldValue inputfieldValue=inputfield.prepare(rawValue);
arguments.put(inputfieldName, inputfieldValue);
}
Map<FieldName,?> results=modelEvaluator.evaluate(arguments);
List<TargetField> targetFields=modelEvaluator.getTargetFields();
System.out.println("Target field(s): " + targetFields);
for(TargetField targetField: targetFields){
FieldName targetFieldName=targetField.getName();
Object targetFieldValue=results.get(targetFieldName);
}
List<org.jpmml.evaluator.OutputField> outputFields = modelEvaluator.getOutputFields();
System.out.println("Output fields: " + outputFields);
}
private static ModelEvaluator<?> loadModel(final String file) throws Exception {
ModelEvaluator<?>modelEvaluator=null;
File inputFilePath=new File(file);
try(InputStream is=new FileInputStream(inputFilePath)){
PMML pmml=org.jpmml.model.PMMLUtil.unmarshal(is);
ModelEvaluatorFactory mef= ModelEvaluatorFactory.newInstance();
modelEvaluator=mef.newModelEvaluator(pmml);
} catch (Exception e) {
throw e;
}
return modelEvaluator;
}
private static List<Float> addvalue() throws FileNotFoundException, IOException {
List<Float>records1=new ArrayList<>();
records1.add(1.0f);
records1.add(1.0f);
records1.add(0.0023f);
records1.add(0.003f);
records1.add(100.0f);
records1.add(518.67f);
records1.add(643.02f);
records1.add(1585.29f);
records1.add(1398.21f);
records1.add(14.62f);
records1.add(21.61f);
records1.add(553.90f);
records1.add(2388.04f);
records1.add(9050.17f);
records1.add(1.30f);
records1.add(47.20f);
records1.add(521.72f);
records1.add(2388.03f);
records1.add(8125.55f);
records1.add(8.4052f);
records1.add(0.03f);
records1.add(392.0f);
records1.add(2388.0f);
records1.add(100.00f);
records1.add(38.86f);
records1.add(23.3735f);
return records1;
}from jpmml-evaluator.
vruusmann
commented on August 18, 2024
@diogofernandes63 It's not a good style to add comments to already closed issues. Especially if your issue is different.
The exception message is very clear here - "Collection value cannot be used in comparison operations"
For example, the following code snippet [0, 1.5, 1] <= 1 is not a valid/sensible Python code, and it's also not a valid PMML code/markup.
from jpmml-evaluator.
Related Issues (20)
- API for Shapley value estimation HOT 2
- How to work with an association rules model (`AssociationModel` element)? HOT 8
- JPMML is enforcing the definition of target fields while the spec says it is optional HOT 6
- jpmml-evaluator does not handle null values when used in java? HOT 1
- Ability to run multiple JPMML-Evaluator versions in parallel (inside the same JVM) HOT 1
- NumberFormatException for evaluate "Random Survival Forest Model" generated by "SoftwareAG PMML Generator" HOT 3
- Compatibility with GraalVM HOT 12
- Not happy with XGBoost evaluation performance HOT 3
- How to load pre-transpiled PMML service provider JAR files? HOT 2
- Model verification fails for XGBoost models HOT 1
- No class def found for jakarta/xml/bind/JAXBContext HOT 3
- java.lang.IllegalArgumentException: Name cannot be empty HOT 1
- java.lang.NoClassDefFoundError: Could not initialize class org.jpmml.evaluator.FieldUtil HOT 4
- If the version 1.6.4 could work on java 8? HOT 1
- Field pmml(pred) is not defined. HOT 5
- DuplicatedFieldValueException after loading PMML in Java generated by Nyoka HOT 8
- 1.6.4 cannot run on java 8
- Exception: Required attribute `Segmentation@multipleModelMethod` is not defined HOT 3
- Updating Guava dependency to latest HOT 4
- why create jar file create error HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jpmml-evaluator.