CUDA RUNTIME API vRelease Version | July 2019 API Reference Manual TABLE OF CONTENTS Chapter 1. Difference between the driver and runtime APIs...........................................1 Chapter 2. API synchronization behavior................................................................... 3 Chapter 3. Stream synchronization behavior.............................................................. 5 Chapter 4. Graph object thread safety......................................................................7 Chapter 5. Modules.............................................................................................. 8 5.1. Device Management...................................................................................... 9 cudaChooseDevice........................................................................................... 9 cudaDeviceGetAttribute................................................................................... 10 cudaDeviceGetByPCIBusId................................................................................. 15 cudaDeviceGetCacheConfig............................................................................... 16 cudaDeviceGetLimit........................................................................................17 cudaDeviceGetP2PAttribute...............................................................................18 cudaDeviceGetPCIBusId....................................................................................19 cudaDeviceGetSharedMemConfig........................................................................ 20 cudaDeviceGetStreamPriorityRange..................................................................... 21 cudaDeviceReset............................................................................................ 22 cudaDeviceSetCacheConfig................................................................................23 cudaDeviceSetLimit........................................................................................ 24 cudaDeviceSetSharedMemConfig......................................................................... 26 cudaDeviceSynchronize.................................................................................... 27 cudaGetDevice.............................................................................................. 28 cudaGetDeviceCount....................................................................................... 28 cudaGetDeviceFlags........................................................................................ 29 cudaGetDeviceProperties..................................................................................30 cudaIpcCloseMemHandle.................................................................................. 35 cudaIpcGetEventHandle................................................................................... 36 cudaIpcGetMemHandle.................................................................................... 37 cudaIpcOpenEventHandle................................................................................. 38 cudaIpcOpenMemHandle.................................................................................. 39 cudaSetDevice...............................................................................................41 cudaSetDeviceFlags.........................................................................................42 cudaSetValidDevices........................................................................................43 5.2. Thread Management [DEPRECATED].................................................................. 44 cudaThreadExit............................................................................................. 44 cudaThreadGetCacheConfig...............................................................................45 cudaThreadGetLimit....................................................................................... 46 cudaThreadSetCacheConfig............................................................................... 47 cudaThreadSetLimit........................................................................................ 48 cudaThreadSynchronize....................................................................................50 5.3. Error Handling........................................................................................... 50 www.nvidia.com CUDA Runtime API vRelease Version | ii cudaGetErrorName......................................................................................... 51 cudaGetErrorString......................................................................................... 51 cudaGetLastError........................................................................................... 52 cudaPeekAtLastError....................................................................................... 53 5.4. Stream Management.................................................................................... 54 cudaStreamCallback_t..................................................................................... 54 cudaStreamAddCallback................................................................................... 54 cudaStreamAttachMemAsync............................................................................. 56 cudaStreamBeginCapture..................................................................................58 cudaStreamCreate..........................................................................................59 cudaStreamCreateWithFlags.............................................................................. 60 cudaStreamCreateWithPriority........................................................................... 61 cudaStreamDestroy.........................................................................................62 cudaStreamEndCapture....................................................................................63 cudaStreamGetCaptureInfo............................................................................... 64 cudaStreamGetFlags....................................................................................... 65 cudaStreamGetPriority.....................................................................................66 cudaStreamIsCapturing.................................................................................... 67 cudaStreamQuery...........................................................................................68 cudaStreamSynchronize................................................................................... 69 cudaStreamWaitEvent......................................................................................70 cudaThreadExchangeStreamCaptureMode.............................................................. 71 5.5. Event Management...................................................................................... 72 cudaEventCreate............................................................................................72 cudaEventCreateWithFlags................................................................................73 cudaEventDestroy...........................................................................................74 cudaEventElapsedTime.................................................................................... 75 cudaEventQuery.............................................................................................76 cudaEventRecord........................................................................................... 77 cudaEventSynchronize..................................................................................... 78 5.6. External Resource Interoperability................................................................... 79 cudaDestroyExternalMemory..............................................................................79 cudaDestroyExternalSemaphore..........................................................................80 cudaExternalMemoryGetMappedBuffer..................................................................81 cudaExternalMemoryGetMappedMipmappedArray.....................................................82 cudaImportExternalMemory...............................................................................84 cudaImportExternalSemaphore...........................................................................86 cudaSignalExternalSemaphoresAsync....................................................................88 cudaWaitExternalSemaphoresAsync......................................................................89 5.7. Execution Control....................................................................................... 91 cudaFuncGetAttributes.................................................................................... 91 cudaFuncSetAttribute......................................................................................92 cudaFuncSetCacheConfig.................................................................................. 93 www.nvidia.com CUDA Runtime API vRelease Version | iii cudaFuncSetSharedMemConfig........................................................................... 95 cudaGetParameterBuffer.................................................................................. 96 cudaGetParameterBufferV2............................................................................... 97 cudaLaunchCooperativeKernel........................................................................... 98 cudaLaunchCooperativeKernelMultiDevice............................................................