PARALELIZACIJA DFA ALGORITMA ZA OBUKU DUBOKIH NEURONSKIH MREŽA

Autori

  • Aleksandar Grahovac Autor

DOI:

https://doi.org/10.24867/21BE04Grahovac

Ključne reči:

DFA, duboke neuronske mreže, multiprocesori

Apstrakt

U ovom radu predstavljena je paralelizacija DFA algoritma obuke neuronskih mreža na multiprocesorskom sistemu. Paralelizacija je implemen­tirana za duboku neuronsku mrežu proizvoljnih dimenzija.

Reference

[1] Nøkland A., “Direct Feedback Alignment Provides Learning in Deep Neural Networks”, 30th Conference on Neural Information Processing Systems (NIPS 2016), Barcelona, Spain.
[2] OpenAI, “Language Models are Few-Shot Learners”, Advances in Neural Information Processing Systems 33 (NeurIPS 2020).
[3] Grother P. J., “MNIST Special Database 19”, National Institute of Standards and Technology, 1995.
[4] Launay J., Poli I., Boniface F., Krzakala F., “Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures”, 34th Conference on Neural Information Processing Systems (NeurIPS 2020), Vancouver, Canada.

##submission.downloads##

Objavljeno

2023-01-07

Broj časopisa

Rubrika

Elektrotehničko i računarsko inženjerstvo