An error occurred while trying to read the S3 bucket lifecycle configuration about spark-redshift HOT 5 CLOSED

The bucket is in US standard region and redshift cluster is in us east region.

from spark-redshift.

Based on some of the line numbers in your exceptions, it looks like you might be using an older version of this library. Which version are you using? Can you try using version 0.5.2 (the newest version) first to see whether that happens to fix this problem?

from spark-redshift.

Yes the above exception is absent now, but having issue with jackson liberary.
Exception in thread "main" com.fasterxml.jackson.databind.JsonMappingException: Could not find creator property with name 'id' (in class org.apache.spark.rdd.RDDOperationScope)
at [Source: {"id":"0","name":"newAPIHadoopFile"}; line: 1, column: 1]

I am using spark 1.4.0 which version should i use for jackson?

from spark-redshift.

Thanks Josh!

I am using spark 1.4.1 version with aws-java-sdk-s3 and aws-java-sdk-code
having version 1.10.22, this combination is creating conflict for jackson
library spark has 2.4.4 and aws-java-sdk-core has 2.5.3. So i am facing
this issue

com.fasterxml.jackson.databind.JsonMappingException: Could not find
creator property with name 'id' (in class
org.apache.spark.rdd.RDDOperationScope)

Any guidance?

On Thu, Nov 12, 2015 at 7:45 PM, Josh Rosen [email protected]
wrote:

Based on some of the line numbers in your exceptions, it looks like you
might be using an older version of this library. Which version are you
using? Can you try using version 0.5.2 (the newest version) first to see
whether that happens to fix this problem?

—
Reply to this email directly or view it on GitHub
#121 (comment)
.

Regards: HAFIZ MUJADID

from spark-redshift.

resolved issue by adding jackson library with latest 2.6 version

from spark-redshift.