The path X cannot be loaded, because existing classpath entries conflict - spark-shell

Question

I was trying to use avro support for spark-2.4.0, as mentioned here. However, since I\'m behind a proxy, I wasn\'t able to download through maven