Comments (6)
Some random thoughts related to the question: how good is LNS compared to ALNS?
-
Christiaens and Vanden Berghe (2020) show that an LNS using a 1) slack-inducing string removal destroy operator and 2) greedy insert with blinks repair operator obtains state-of-the-art results on many variants of VRP.
-
In the scheduling literature, LNS goes under the name of Iterated Greedy, see Stützle and Ruiz (2018). It is currently the state-of-the-art for the permutation flow shop problem and parallel machine scheduling.
-
In Stützle and Ruiz (2018), two interesting conclusions are drawn in Chapter 4 where they perform numerical experiments with IG on the permutation flow shop problem:
As a conclusion from this study, the most significant factor is the local search and the NEH reconstruction. Most other factors have less importance.
- Here, the NEH reconstruction refers to greedy insertion using a specific ordering of the unassigned jobs (in short, largest total processing time first). Morever, many iterated greedy papers also show that the local search seems to be the most important aspects of IG in order to obtain SOTA scheduling results.
- Local-search post-optimization seems to not play such an important role in VRPs. E.g., Christiaens and Vanden Berghe (2020) do not use local search and François et al. (2019) mentions that the local search procedure only yields tiny improvements. Also the original ALNS papers by Ropke and Pisinger don't use local search.
-
There's little to no research on adaptive IG/ALNS in the literature. Even when multiple repair/destroy operators are considered, studies often test all possible combinations of a single destroy and repair operator.
from alns.
There's also this paper about the A in ALNS: Turkes et al. 2021 (not sure if we've linked to this thing before). I read this as "it's probably not that beneficial in general, since it also adds complexity".
from alns.
We now have SISR as part of the CVRP example. We can add another example doing LNS with
Another good direction might be to offer more diagnostics. Can we, for example, help users somehow with tuning parameters/providing tools to efficiently tune an ALNS instance?
from alns.
There's 3 "parameter groups" that we might want to tune in ALNS:
- ALNS itself (the parameters such as destroy rate, which destroy and repair operators)
- The operator selection scheme
- The acceptance criterion
It would be nice to have a tune
module that does some of the following:
- Given the space of parameters, return a sampled instance/configuration.
- E.g., suppose we have ALNS with 2 destroy operators and 2 repair operators.
tune.alns
should return the$n$ configurations of ALNS with a sampled combination of those destroy/repair operators. - E.g., suppose we use RecordToRecordTravel.
tune.accept
should return$n$ sampled configurations/instances of RRT.
- E.g., suppose we have ALNS with 2 destroy operators and 2 repair operators.
A simple workflow for tuning the acceptance criteria would look as follows:
alns = make_alns(...)
init = ...
select = ...
stop = ...
data = []
for idx, accept in tune.accept(RecordToRecordTravel, parameter_space, sampling_method):
res = alns.iterate(init, select, accept, stop)
data[idx] = res.best_state.objective()
# Best configuration
print(np.argmin(data))
This could be extended to tuning ALNS and operator selection schemes as well. I don't have much experience tuning so I don't know exactly how the tuning interface should look like.
from alns.
We probably shouldn't invent our own half-baked solution for this. The ML community has a lot of this already, with e.g. keras-tuner
, ray.tune
, etc. Those are used by a lot of people, apparently with some success. At some later point it could pay off to see how they work, and whether we can do something similar in terms of interface for our code.
from alns.
I'm closing this issue because tuning is now in #109, and the other ideas from last summer have (for the most part) already been implemented.
from alns.
Related Issues (20)
- Some quetions for using ALNS HOT 5
- Adaptive simulated annealing temperature and step-size HOT 4
- what's your alns.weights HOT 1
- Update docs
- Tasklist for next release HOT 2
- About other VRP destroy and repair operators HOT 3
- Bug in `examples/resource_constrained_project_scheduling_problem.ipynb:random_insert`?
- Circle bin packing with ALNS HOT 21
- Run example notebooks in CI HOT 1
- Deprecate AlphaUCB?
- How to solve vehicle routing problem with multiple capacities? HOT 5
- Documentation improvements HOT 2
- RCPSP示例中的“instance = ProblemData.read_instance('data/j9041_6.sm')”的数据在哪里 HOT 1
- Where is the data for "instance = ProblemData.read_instance('data/j9041_6.sm')" in the RCPSP example HOT 3
- Run w/o MABwiser in the CI
- Rename RandomWalk and WorseAccept? HOT 2
- Replace `RandomState` with `Generator` HOT 2
- Python 3.12 release
- Require help in understanding and coding the ALNS algorithm using alns package HOT 2
- ALNS parameter optimization HOT 9
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from alns.