emcecs / ecs-samples Goto Github PK

Getting below exception while uploading large file

com.sun.jersey.api.client.ClientHandlerException: java.net.UnknownHostException:
at com.sun.jersey.client.apache4.ApacheHttpClient4Handler.handle(ApacheHttpClient4Handler.java:187)
at com.emc.object.s3.jersey.ErrorFilter.handle(ErrorFilter.java:51)
at com.emc.object.s3.jersey.RetryFilter.handle(RetryFilter.java:65)
at com.emc.object.s3.jersey.AuthorizationFilter.handle(AuthorizationFilter.java:72)
at com.emc.object.s3.jersey.BucketFilter.handle(BucketFilter.java:80)
at com.emc.object.s3.jersey.NamespaceFilter.handle(NamespaceFilter.java:78)
at com.sun.jersey.api.client.Client.handle(Client.java:652)
at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682)
at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74)
at com.sun.jersey.api.client.WebResource$Builder.method(WebResource.java:634)
at com.emc.object.AbstractJerseyClient.executeRequest(AbstractJerseyClient.java:98)
at com.emc.object.s3.jersey.S3JerseyClient.executeRequest(S3JerseyClient.java:824)
at com.emc.object.s3.jersey.S3JerseyClient.initiateMultipartUpload(S3JerseyClient.java:718)
at com.emc.object.s3.LargeFileUploader.initMpu(LargeFileUploader.java:197)
at com.emc.object.s3.LargeFileUploader.doMultipartUpload(LargeFileUploader.java:389)
at com.emc.object.s3.LargeFileUploaderTest.testLargeFileUploader(LargeFileUploaderTest.java:118)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.UnknownHostException:
at java.net.InetAddress.getAllByName0(InetAddress.java:1280)
at java.net.InetAddress.getAllByName(InetAddress.java:1192)
at java.net.InetAddress.getAllByName(InetAddress.java:1126)
at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.resolveHostname(DefaultClientConnectionOperator.java:263)
at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:162)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:326)
at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:605)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:440)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:835)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:118)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at com.sun.jersey.client.apache4.ApacheHttpClient4Handler.handle(ApacheHttpClient4Handler.java:173)
... 34 more

Hello,

We see examples of few things we can do with Boto on ECS. Do you guys have any examples on how one can modify the ACLs for a bucket or an object?

Any python sample code on ACLs would be greatly appreciated.

Thank you

Below issues are getting when used multipart upload feature testcase

largeFileUploader.doMultipartUpload();

SEVERE: Not able to connect S3 javax.xml.bind.UnmarshalException: unexpected element (uri:"", local:"InitiateMultipartUploadResult"). Expected elements are <{http://s3.amazonaws.com/doc/2006-03-01/}InitiateMultipartUploadResult>
Exception in thread "main" com.dell.ecs.cloud.exception.ApiException

Hi,

We are trying to access file stored on ECS in Python using Boto3. It is very slow and taking more time then normal file read. Is Boto3 supported by ECS? We are using Python 3.6.

Also What is the fastest way of accessing files from ECS in Python? We want to read file size of 3 to 5 gb into panda data frame.

Thanks a lot in advance
Parag

Hi, does ECS also support creating temporary security credentials with AWS STS and Assume Role?
What i want to do is address the storage from a web app running in the browser on the client side. But i don't want to share the longterm credentials for that. Instead i want to use AWS STS to create temporary credentials on server side and pass those to the client. And since it is not so easy to do a multipart upload using presigned urls i think using STS is the best way. Or do you reccomend another way to do so without sharing longterm credentials?

Loading the project into IntelliJ 2017.2 fails with the error:

Error: Could not determine the class-path for interface com.android.builder.model.NativeAndroidProject.

This isn't even an Android project. Appears to be a conflict with an old version of Gradle.