PARALELIZACIJA DFA ALGORITMA ZA OBUKU DUBOKIH NEURONSKIH MREŽA
DOI:
https://doi.org/10.24867/21BE04GrahovacKljučne reči:
DFA, duboke neuronske mreže, multiprocesoriApstrakt
U ovom radu predstavljena je paralelizacija DFA algoritma obuke neuronskih mreža na multiprocesorskom sistemu. Paralelizacija je implementirana za duboku neuronsku mrežu proizvoljnih dimenzija.
Reference
[1] Nøkland A., “Direct Feedback Alignment Provides Learning in Deep Neural Networks”, 30th Conference on Neural Information Processing Systems (NIPS 2016), Barcelona, Spain.
[2] OpenAI, “Language Models are Few-Shot Learners”, Advances in Neural Information Processing Systems 33 (NeurIPS 2020).
[3] Grother P. J., “MNIST Special Database 19”, National Institute of Standards and Technology, 1995.
[4] Launay J., Poli I., Boniface F., Krzakala F., “Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures”, 34th Conference on Neural Information Processing Systems (NeurIPS 2020), Vancouver, Canada.
[2] OpenAI, “Language Models are Few-Shot Learners”, Advances in Neural Information Processing Systems 33 (NeurIPS 2020).
[3] Grother P. J., “MNIST Special Database 19”, National Institute of Standards and Technology, 1995.
[4] Launay J., Poli I., Boniface F., Krzakala F., “Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures”, 34th Conference on Neural Information Processing Systems (NeurIPS 2020), Vancouver, Canada.
##submission.downloads##
Objavljeno
2023-01-07
Broj časopisa
Rubrika
Elektrotehničko i računarsko inženjerstvo