Comments (3)
I am having the same issue. When using the standard "|" as the delimiter, the "visit_details.csv" and "page_details.csv" are failing to import using the Viya based /SASDataExplorer and the error leads me to believe that some of the fields have a | int he field.
One way to get around this is as marcosarmas mentioned, which is to encapsulate the text fields in " so that, in this example, "b|ar" is not parsed into two fields:
|"foo"|"b|ar"|
Otherwise, unless I am missing something, the options are to use a multi-character delimiter such as |^|
or find a character that's unique enough to be a delimiter.
Do you have other advice?
from ci360-download-client-python.
Hi Marcos, I figured out a workaround yesterday. It seemed that every single special character that was a standard ASCII character was also in my dataset, so we used a multi-character delimiter to ensure we had good field boundaries (using the -cd parameter):
$ python discover.py -m detail -svn 4 -a yes -cd "|;|" -cf yes -st 2020-08-15T00 -et 2020-09-01T00
We later learned of a limitation in the application we were using to import the data, so we used sed to replace |;|
with the CTRL-A special character equivalent of \x01
--- Request to the developers --- please include a parameter(s) to allow for quoting the field boundaries to account for the situation where a delimiter could exist inside the field value ... as I understand it, the you can pass an option (quote full or quote partial) to the standard:
csv.writer(…… quoting=csv.QUOTE_ALL)
from ci360-download-client-python.
Hi Andy,
Great solution! I go to try it!
Cheers.
from ci360-download-client-python.
Related Issues (2)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ci360-download-client-python.