There is an increasing industrial and academic interest towards a more predictable characterization of real-time tasks on high-performance heterogeneous embedded platforms, where a host system offloads parallel workloads to an integrated accelerator, such as General Purpose-Graphic Processing Units (GP-GPUs). In this paper, we analyze an important aspect that has not yet been considered in the real-time literature, and that may significantly affect real-time performance if not properly treated, i.e., the time spent by the CPU for submitting GP-GPU operations. We will show that the impact of CPU-to-GPU kernel submissions may be indeed relevant for typical real-time workloads, and that it should be properly factored in when deriving an integrated schedulability analysis for the considered platforms. This is the case when an application is composed of many small and consecutive GPU compute/copy operations. While existing techniques mitigate this issue by batching kernel calls into a reduced number of persistent kernel invocations, in this work we present and evaluate three other approaches that are made possible by recently released versions of the NVIDIA CUDA GP-GPU API, and by Vulkan, a novel open standard GPU API that allows an improved control of GPU command submissions. We will show that this added control may significantly improve the application performance and predictability due to a substantial reduction in CPU-to-GPU driver interactions, making Vulkan an interesting candidate for becoming the state-of-the-art API for heterogeneous Real-Time systems. Our findings are evaluated on a latest generation NVIDIA Jetson AGX Xavier embedded board, executing typical workloads involving Deep Neural Networks of parameterized complexity.
Novel methodologies for predictable CPU-to-GPU command offloading / Cavicchioli, R.; Capodieci, N.; Solieri, Marco; Bertogna, M.. - 133:(2019). ((Intervento presentato al convegno 31st Euromicro Conference on Real-Time Systems, ECRTS 2019 tenutosi a deu nel 2019 [10.4230/LIPIcs.ECRTS.2019.22].
|Data di pubblicazione:||2019|
|Titolo:||Novel methodologies for predictable CPU-to-GPU command offloading|
|Autore/i:||Cavicchioli, R.; Capodieci, N.; Solieri, Marco; Bertogna, M.|
|Digital Object Identifier (DOI):||http://dx.doi.org/10.4230/LIPIcs.ECRTS.2019.22|
|Codice identificativo Scopus:||2-s2.0-85069183878|
|Nome del convegno:||31st Euromicro Conference on Real-Time Systems, ECRTS 2019|
|Luogo del convegno:||deu|
|Data del convegno:||2019|
|Citazione:||Novel methodologies for predictable CPU-to-GPU command offloading / Cavicchioli, R.; Capodieci, N.; Solieri, Marco; Bertogna, M.. - 133:(2019). ((Intervento presentato al convegno 31st Euromicro Conference on Real-Time Systems, ECRTS 2019 tenutosi a deu nel 2019 [10.4230/LIPIcs.ECRTS.2019.22].|
|Tipologia||Relazione in Atti di Convegno|
File in questo prodotto:
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris