Tuesday, March 26, 2019

"Something is wrong with the numpy installation. While importing we detected an older version of numpy" error on azure databricks

"Something is wrong with the numpy installation. While importing we detected an older version of numpy"

I was doing the lab below and experienced the issue today.

https://cloudworkshop.blob.core.windows.net/cognitive-deep-learning/Hands-on%20lab/HOL%20step-by%20step%20-%20Cognitive%20services%20and%20deep%20learning.html

the problem seems to be related to azureml-sdk[databricks] because if I uninstall it some part of code can still run.
after spending quite some time scratching my hair, I looked up the azureml-sdk release page and found out that a new version 1.0.21 released just today (26 March 2019), I uninstall the default version and installed the prior version by using the format azureml-sdk[databricks]==1.0.18.1

alternatively if you choose runtime version 5.2 when creating the cluster then the problem doesn't occur.