
In some software environments, my kernel was crashing when calling import coiled.Dask’s memory usage was blowing up when importing a small (.I encountered three issues and would like to share my solutions for them as I can imagine others might be running into this as well: import coiled from dask import Client import dask.dataframe as dd cluster = coiled.Cluster() client = Client(cluster) ddf = dd.read_parquet("") ddf = ddf.persist()//]]> Specific issues when running Dask, Coiled and XGBoostīelow are some further notes on issues I encountered while trying to run a workload using Dask and XGBoost on Coiled: You can, for example, begin by rebuilding your software environments using conda env create -f. Use other shell flags as needed.Īfter restarting your terminal, you should now be able to use conda as you always have. Note the zsh is only if you’re working with the zsh shell. If for some reason it doesn’t do so (which happened in my case), you will have to run conda init yourself using /path/to/mambaforge/bin/conda init zsh.This should ask you if you want it to run conda init for you.You can, of course, also opt for one of the other deployment versions listed on that page.


The Apple M1 silicon chip is a fantastic innovation: it’s low-power, high-efficiency, has great battery life, and is inexpensive. I still find that mambaforge builds environments and installs packages faster and recommend trying it out.

Some of the issues with conda described below have since been resolved. Note: this article was first published in August 2021.
