Default configuration file about datafusion-archive HOT 3 CLOSED

@mgxm I think this is a great idea. Let's do this for 0.4.0

from datafusion-archive.

I would almost vote that -c (filename) should be the requirement for this. Having -c by itself stand to reason that this is a flag/toggle, and not a parameter. I think this is a good idea as well.

from datafusion-archive.

I would like to see a system where no configuration files are used. Typically this is a fairly major issue with current systems like Hadoop/Spark - the configuration files are updated on one host and not on another, and then they need to be distributed anyway because all nodes in the cluster are not the same.

Preferably, all configuration would live in a configuration service - etcd seems up for the task I think :) So the only parameter that datafusion needs would be the etcd hosts, and this could be provided via environment variable.

from datafusion-archive.