Comments (3)
This is something I really want to do. Here's a plan of attack:
We keep a running list of layers that we're currently operating on. Then, we manage a single mount using overlayfs stacking to mount them. we write to the top layer. Once the build has successfully completed, we tar the layers.
As for a build cache, if we were to specify a dir and rename each new mount with the SHA of the contents of the directory, as long as we don't rely on it at tar time we should have plenty to key off of for dirs to manage. This would also make the cache local and retargettable offering some additional options.
I don't see runc being used for more than the run
statement, we have the OCI and docker image manipulation code available to us so we can use that for the rest. Managing the overlayfs mounts will be key.
A key problem with runc is that it doesn't have any networking, which is fine for many situations but certainly not optimal. Something to consider if we're going to go all-in on this.
The builder has been broken out into a building context and an execution context, so you could do this work on the side if you wanted.
from box.
Is there any value in leveraging some of the "multi container build-strategy" technology found in this project? https://github.com/haconiwa/haconiwa
from box.
@diclophis I'm on vacation; sorry about the late reply!
Since this is a C-based project it would be especially hard to cherry-pick this functionality.
You may or may not also be aware of GitHub.com/docker/libcontainer which is what powers docker and is written in go (which is what box uses). It is very mature software at this point. If I were to go down this road I would probably do that.
from box.
Related Issues (20)
- Optimising rebuild conditions beyond layer cache HOT 3
- `reset` repl keyword to reset the build
- bug: image configuration is lost in an after clause if there's no commit
- bug: Box may not clear the entrypoint after run statements
- import & skip statements combined leads to multiple repeated image edits
- allow `from` to pull fresh images
- Report on cached layers that are over a certain age HOT 1
- Declarative Language Syntax
- Variable declarations
- Bug: terminal output not reset after some debug sessions
- Bug: box is incompatible with older builds of docker HOT 1
- box portable: not removing its own containers
- in some situations symlinks could be rewritten improperly when relative HOT 1
- Ability to push image HOT 3
- bug: stacked `inside` statements cause relative path escape
- `inside` statements should invalidate cache when changed
- bug: box reports "unexpected EOF" when permission errors are encountered in copy statement
- https://box-builder.github.io is broken HOT 1
- after and skip do not work well together
- The repl recording in README.md is archived HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from box.