1. A Neural-Based Text Generation System
- Author
-
Kuculo, Tin and Šnajder, Jan
- Subjects
differentiable neural computers ,TECHNICAL SCIENCES. Computing ,neuronski turing-strojevi ,TEHNIČKE ZNANOSTI. Računarstvo ,text generation ,deep Q-networks ,Deep learning ,diferencijabilna neuronska računala ,Duboko učenje ,generiranje teksta ,LSTM ,duboke Q-mreže ,neural turing machines - Abstract
U ovom radu istražuju se novije arhitekture umjetnih neuronskih mreža te se testiraju na zadatku generiranja teksta, uz fokus na neuronskim mrežama s proširenim pamćenjem. Generirani tekst uspoređuje se s trenutačno često korištenim dubokim modelima poput LSTM mreža, ponavljajućim mrežama s dugim kratkoročnim pamćenjem. Razmatraju se tri vrste novijih arhitektura: neuronski Turingovi strojevi, diferencijabilna neuronska računala i duboke Q-mreže. This work explores newer artificial neural network architectures and tests them on the task of text generation, with a focus on memory augmented neural networks. Generated texts are compared with currently often-used deep models like LSTM networks–recurrent networks with long short-term memory. Three new types of architectures are observed: neural Turing machines, differentiable neural computers, and deep Q-networks.
- Published
- 2018