Using atomic arithmetic operations in CUDA Unified Memory multi-GPU or multi-processor

Question

I am trying to implement a CUDA program that uses Unified Memory. I have two unified arrays and sometimes they need to be updated atomically.

The question below has an

Answer 1

To summarize comments into an answer:

• You can perform this sort of address space wide atomic operation using atomicAdd_system
• However, you can only do this on compute capability 6.x or newer devices (7.2 or newer if using Tegra)
• specifically this means you have to compile for the correct compute capability such as -arch=sm_60 or similar
• You state in the question you are using Telsa K20 cards -- these are compute capability 3.5 and do not support any of the system wide atomic functions.

As always, this information is neatly summarized in the relevant section of the Programming Guide.