问题
I have written a CUDA code to solve an NP-Complete problem, but the performance was not as I suspected.
I know about "some" optimization techniques (using shared memroy, textures, zerocopy...)
What are the most important optimization techniques CUDA programmers should know about?
回答1:
You should read NVIDIA's CUDA Programming Best Practices guide: http://developer.download.nvidia.com/compute/cuda/3_0/toolkit/docs/NVIDIA_CUDA_BestPracticesGuide.pdf
This has multiple different performance tips with associated "priorities". Here are some of the top priority tips:
- Use the effective bandwidth of your device to work out what the upper bound on performance ought to be for your kernel
- Minimize memory transfers between host and device - even if that means doing calculations on the device which are not efficient there
- Coalesce all memory accesses
- Prefer shared memory access to global memory access
- Avoid code execution branching within a single warp as this serializes the threads
回答2:
The new NVIDIA Visual Profiler (v4.1) supports automated performance analysis to identify performance improvement opportunities in your application. It also links directly to the most useful sections of the Best Practices Guide for the issues it detects. And the Visual Profiler is available for free as part of the CUDA Toolkit on NVIDIA's developer web site: http://www.nvidia.com/getcuda.
来源：https://stackoverflow.com/questions/3090493/cuda-optimization-techniques