Zbornik radova Fakulteta tehničkih nauka u Novom Sadu

Elektrotehničko i računarsko inženjerstvo

God. 38 Br. 01 (2023): Zbornik radova Fakulteta tehničkih nauka

PARALELIZACIJA DFA ALGORITMA ZA OBUKU DUBOKIH NEURONSKIH MREŽA

  • Aleksandar Grahovac
DOI:
https://doi.org/10.24867/21BE04Grahovac
Predato
January 7, 2023
Objavljeno
2023-01-07

Apstrakt

U ovom radu predstavljena je paralelizacija DFA algoritma obuke neuronskih mreža na multiprocesorskom sistemu. Paralelizacija je implemen­tirana za duboku neuronsku mrežu proizvoljnih dimenzija.

Reference

[1] Nøkland A., “Direct Feedback Alignment Provides Learning in Deep Neural Networks”, 30th Conference on Neural Information Processing Systems (NIPS 2016), Barcelona, Spain.
[2] OpenAI, “Language Models are Few-Shot Learners”, Advances in Neural Information Processing Systems 33 (NeurIPS 2020).
[3] Grother P. J., “MNIST Special Database 19”, National Institute of Standards and Technology, 1995.
[4] Launay J., Poli I., Boniface F., Krzakala F., “Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures”, 34th Conference on Neural Information Processing Systems (NeurIPS 2020), Vancouver, Canada.