Comments (11)
It should be in either src/main/resources or src/test/resources.
This page might help: https://github.com/gflewis/sndml3/wiki/Log4j2
from sndml3.
Same is the case for sync as well. I can confirm the table is present and has sys_id as first column in target MSSQL database.
from sndml3.
This is strange. SNDML must be having difficulty reading the table schema. My recommendation is to modify the log4j configuration file and set the threshold level to "trace". This should cause SNDML to dump the table schema as it is processed.
SNDML will put sys_id in the first column when it creates the table. There must always be a sys_id column. However, to the best of my recollection, there is no real reason (other than the code that is aborting) that sys_id has to be in the first column. If the schema is read correctly, but the columns are in the wrong order, then you could try commenting out lines 65 through 69 of ColumnDefinitions.java. Then rebuild the package, and see if it works.
from sndml3.
Thanks @gflewis looking at the error, it seems like SNDML is able to read the schema ( observe it says PRIORITY is the first column or contract and its first column in below case) but the column order is not correct.
Exception in thread "DPRUN0001012" java.lang.RuntimeException: expected 'sys_id', found 'contract' in first column of table 'customerservice_case'
at sndml.datamart.ColumnDefinitions.(ColumnDefinitions.java:67)
at sndml.datamart.DatabaseTableWriter.open(DatabaseTableWriter.java:51)
where is the configuration file for log4j, sorry I can't find it
from sndml3.
Here is another thought: I see that we are using mssql-jdbc version 8.2.2 (pom.xml line 122). I wonder if this issue would be fixed by upgrading the JDBC driver to 8.4.1?
from sndml3.
Here is an issue with a column order in the 8.2.2 driver:
microsoft/mssql-jdbc#1332
from sndml3.
I would try upgrading the JDBC driver first. I think it looks like our issue. Do you have Maven installed, such that you can rebuild the JAR and see if it fixes the problem?
from sndml3.
sorry I do not have. facing issues to rebuild the package after changing the version to 8.4.1.jre8.
can you please point me to instructions to rebuild
from sndml3.
First you need to install Apache Maven. If you are on a Mac, then I recommend you install it using HomeBrew. If you are on Windows or Linux then you may want to Google "install maven".
Then you go into the directory where you have cloned the repo. The file pom.xml should be in that directory. Then type this command:
mvn package
This should cause it to download all the necessary libraries and rebuild the JAR files in the target directory.
from sndml3.
Thank you @gflewis after updating the jdbc driver, the column sys_id issue is gone. Thank you so much for unblocking me.
from sndml3.
Thank you @jonathangull for identifying this issue and testing the fix.
mssql-jdbc has been upgraded to 8.4.1 in v3.4.5
from sndml3.
Related Issues (20)
- sync keeps updating records on wm_order HOT 3
- Partition data by Minute HOT 4
- sndml3 support for SQLite Database/Datasource HOT 9
- MinRows not working HOT 1
- Log4J exploit HOT 4
- Database Views are not replicated HOT 2
- Config validation fails when there is a number in the source table name HOT 2
- DatabaseInsertWriter Process: Failed/Skipped HOT 2
- DatabaseUpdateStatement bindField time_in_seconds java.lang.NumberFormatException HOT 4
- JsonParseException Unexpected character ('}' (code 125)): was expecting a colon to separate field name and value HOT 4
- Transaction cancelled: maximum execution time exceeded HOT 2
- MSSQL time zone change HOT 1
- Action sync does not respect pagesize HOT 1
- Long load times HOT 1
- Error Unexpected character ('}' (code 125)) HOT 4
- PROCESS: Expected X rows but processed Y rows HOT 2
- Setting Partitions in Data Pump Results in Critical Error HOT 6
- --daemon not closing database connections HOT 1
- ERROR AgentScanner [scanner] main ERROR: sndml.datamart.ConfigParseException: Unrecognized field "status" HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sndml3.