profile
viewpoint
If you are wondering where the data of this site comes from, please visit https://api.github.com/users/rabaur/events. GitMemory does not store any data, but only uses NGINX to cache data for a period of time. The idea behind GitMemory is simply to give users a better reading experience.

rabaur/minimal 0

Minimal is a Jekyll theme for GitHub Pages

fork rabaur/minimal

Minimal is a Jekyll theme for GitHub Pages

https://pages-themes.github.io/minimal/

fork in a month

create barnchrabaur/rabaur.github.io

branch : master

created branch time in a month

created repositoryrabaur/rabaur.github.io

created time in a month

created repositoryrabaur/rabaur.github.io

Test for EBD website

created time in a month

issue closedworldmodels/worldmodels.github.io

Replacing RNN with Self-Attention Mechanism

Dear David Ha, dear Jürgen Schmidhuber

Thank for this inspirational blog-post. I have stumbled upon your paper while researching for my BSc thesis. It is concerned with training agents to navigate in complex buildings. As you know, navigation is a very complex task where memory is great importance.

Given the complexity of the task and the promising results of self-attention, I was wondering if you have considered exchanging the RNN with self-attention mechanism. I reckon that this would make the memory model more powerful while being computationally less expensive.

Thank you for your considerations, Raphaël Baur, BSc Student ETH Zürich

closed time in a month

rabaur

issue commentworldmodels/worldmodels.github.io

Replacing RNN with Self-Attention Mechanism

This is very insightful, thank you so much for your answer!

rabaur

comment created time in a month