Learn

CUDA Parallel Programming

Write CUDA kernels chapter by chapter: from turning a loop into your first kernel to convolution, reduction, prefix sums, sorting and faster matrix multiplication.

4 of 20 stages openCUDANVIDIA TESLA T4

Start stage 1 →

Part 1 GPU Programming Foundations

Part 2 Classic Parallel Algorithms

Coming soon

  • Convolution Filters122D Convolution
  • Stencils on Grids133D Stencil
  • Histograms and Atomics14Histogram
  • Reducing an Array to One Value15Sum Reduction
  • Prefix Sums16Inclusive Scan
  • Filtering and Stream Compaction17Simple Filter
  • Merging Sorted Arrays18Parallel Merge
  • Sorting on the GPU19Radix Sort
  • Faster Matrix Multiplication20Register Tiling