Comments (6)
@ruanqizhen can you show me the full stacktrace? The one that is after Caused by: java.lang.NullPointerException
?
from sedona.
@ruanqizhen can you show me the full stacktrace? The one that is after
Caused by: java.lang.NullPointerException
?
This is the entire stacktrace it returned. Caused by: java.lang.NullPointerException
is the last line.
from sedona.
@ruanqizhen I think the GeometryType might have indeterministic behavior over invalid geometries. We need to further investigate this issue.
Can you run ST_IsValid
on your geometry column? Is there any invalid geometries? If you remove those and run GeometryType
again, do you still have the same problem?
from sedona.
@ruanqizhen I think the GeometryType might have indeterministic behavior over invalid geometries. We need to further investigate this issue.
Can you run
ST_IsValid
on your geometry column? Is there any invalid geometries? If you remove those and runGeometryType
again, do you still have the same problem?
It is not likely caused by the invalid geometry, because I've called the ST_MakeValid() for all of the geometries.
from sedona.
@ruanqizhen ST_MakeValid
might not work for all cases. Any way to fix geometries is ST_Buffer(geom, 0)
.
If both of the method still cannot fix the issue, I think you can stick to ST_GeometryType. If you don't want the ST_
in the result, you can easily write a PySpark UDF to split the string by _
and only keep the second half.
from sedona.
@ruanqizhen
ST_MakeValid
might not work for all cases. Any way to fix geometries isST_Buffer(geom, 0)
.If both of the method still cannot fix the issue, I think you can stick to ST_GeometryType. If you don't want the
ST_
in the result, you can easily write a PySpark UDF to split the string by_
and only keep the second half.
I'm using ST_GeometryType now. But I'm wondering if there is a way to find out which row caused the problem. Is there a way that I can "try", or skip the error, to let the query continue process other rows, so that I can then check which row was skipped.
from sedona.
Related Issues (20)
- Support of 3D?
- Feature request: ST_Snap HOT 1
- Microsoft Fabric HOT 32
- Apache Sedona backend for Ibis project?
- Save / Load indexed spatial & partitioned Rdd HOT 2
- Clarify SedonaUtils documentation HOT 1
- Write a geotiff raster , but just found _SUCCESS file in output HDFS dir HOT 3
- Noisy warnings on optional imports
- Map RDD and GeometryType (not an instance of type GeometryType()) HOT 2
- When I resample a raster to very width*height raster , Serde.serialize is limited in 2GB HOT 2
- When I use Bicubic alg to resample a raster with no data pixel , the output raster would be filled unexpected data in no data pixel HOT 3
- fieldNames - AttributeError: Not available before 1.0.0 sedona version HOT 4
- Undeclared IPython dependency HOT 1
- ST_Difference function crashes while working on some geometries HOT 3
- executor logs : WARN factory: Can't load a service for category "Operation"
- Preserve Spatial Partitioning From RDD to Dataframe HOT 2
- issue about function RS_SetBandNoDataValue HOT 1
- ST_Pixelize small polygon error HOT 6
- ST_Pixelize drawing polygon perimeter rather than all pixels in polygon HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sedona.