regen100 / lfs-dal Goto Github PK

Hi ! Developer of https://github.com/nicolas-graves/lfs-s3 here.

I find this initiative very interesting because of the sheer options it allows for git large files management. I'm having some issues when trying to use it though, I will put each in a separate issue.

I'm testing s3 configuration, basically the same that I use in https://github.com/nicolas-graves/lfs-s3

First, I'm having a very slow upload speed. It probably on OpenDAL's side, which seem to use an http process while I use the AWS SDK on my side, but my upload speed is not better than 30Ko/s (compared to more than 1Mo/s with the AWS SDK).

I don't see any entity_size option in https://opendal.apache.org/docs/services/s3 but I can't upload a file that would be OK using the AWS SDK with the same configuration.
=> S3Error { code: "EntityTooSmall", message: "Your proposed upload is smaller than the minimum allowed object size.", resource: "", request_id: "" }

Also, if the error has to happen, it would be great if it would happen before trying to upload the file on the client side rather than after trying to upload the file on the server side.

Hi again,

As I said, I'm pretty satisfied by the project and I think it's worth recommending it further, and migrating to it. Before recommending it instead of my own project, after the brief experience I had with other LFS custom agents, I know that they tend to be loosely maintained. I want to know if you indeed intend to support it for some time.

I'll probably keep my project open because of a contribution that adds support for CDN download speedup, which doesn't seem to be possible yet in yours, but will probably add a section to invite users to migrate there.

WDYT?