sensors Article Application of Crowd Simulations in the Evaluation of Tracking Algorithms Michał Staniszewski 1,∗ , Paweł Foszner 1, Karol Kostorz 1, Agnieszka Michalczuk 1, Kamil Wereszczy ´nski 1, Michał Cogiel 1, Dominik Golba 1, Konrad Wojciechowski 2 and Andrzej Pola ´nski 1 1 Department of Computer Graphics, Vision and Digital Systems, Faculty of Automatic Control, Electronics and Computer Science, Silesian University of Technology, Akademicka 2A, 44-100 Gliwice, Poland;
[email protected] (P.F.);
[email protected] (K.K.);
[email protected] (A.M.);
[email protected] (K.W.);
[email protected] (M.C.);
[email protected] (D.G.);
[email protected] (A.P.) 2 Polish-Japanese Academy of Information Technology, Koszykowa 86, 02-008 Warszawa, Poland;
[email protected] * Correspondence:
[email protected]; Tel.: +48-32-237-26-69 Received: 28 July 2020; Accepted: 1 September 2020; Published: 2 September 2020 Abstract: Tracking and action-recognition algorithms are currently widely used in video surveillance, monitoring urban activities and in many other areas. Their development highly relies on benchmarking scenarios, which enable reliable evaluations/improvements of their efficiencies. Presently, benchmarking methods for tracking and action-recognition algorithms rely on manual annotation of video databases, prone to human errors, limited in size and time-consuming. Here, using gained experiences, an alternative benchmarking solution is presented, which employs methods and tools obtained from the computer-game domain to create simulated video data with automatic annotations. Presented approach highly outperforms existing solutions in the size of the data and variety of annotations possible to create.