testing / following examples online of data science stuff
to do (cityworksupervised.ipynb):
- Clean bad data
- if NAN, blank, empty string then remove that row
- Map results/outliers in ArcGIS Pro / ArcGIS Online
- Have a confidence value, if that is not reached, re-run analysis until it is reached, or notify of failure
- Pull live data from Cityworks EURL into Pandas Nice to haves:
- Morans I
Reference List: https://machinelearningmastery.com/clustering-algorithms-with-python/ https://scikit-learn.org/stable/tutorial/statistical_inference/unsupervised_learning.html https://www.youtube.com/watch?v=D8T1epVAx-4 https://towardsdatascience.com/data-handling-using-pandas-machine-learning-in-real-life-be76a697418c https://builtin.com/data-science/unsupervised-learning-python https://stackoverflow.com/questions/54440507/encoding-ordinal-values-in-python https://towardsdatascience.com/categorical-encoding-using-label-encoding-and-one-hot-encoder-911ef77fb5bd https://jakevdp.github.io/PythonDataScienceHandbook/05.13-kernel-density-estimation.html https://towardsdatascience.com/how-to-perform-exploratory-data-analysis-with-seaborn-97e3413e841d https://builtin.com/data-science/step-step-explanation-principal-component-analysis Supervised/Predictive Modeling: https://machinelearningmastery.com/machine-learning-in-python-step-by-step/
ArcGIS Pro: https://developers.arcgis.com/python/guide/introduction-to-the-spatial-dataframe/ https://www.youtube.com/watch?v=h1Lnz-rfWQo
test2
How-to setup conda environment on ubuntu: 303 anaconda -h 304 anaconda-navigator 305 conda install -c esri ArcGIS 306 jupyter notebook 307 pip install seaborn 308 pip install scikit-learn