I used to have cuda-7.0 installed on my machine and later un-installed cuda-7.0 and installed cuda-8.0. When I go to my /usr/local folder I see the following folders:
Solution as suggested in the comments:
export PATH=/usr/local/cuda-8.0/bin:$PATH
The problem was the ordering of $PATH, that my previous command had the =$PATH:/usr/local... instead of =/usr/local....:$PATH
$PATH
=$PATH:/usr/local...
=/usr/local....:$PATH