Loading README.md +15 −0 Original line number Diff line number Diff line Loading @@ -215,6 +215,21 @@ Here we can see that the attention reacts on specific words and if it does not r ## Bad visualisation  The attention can't be maped correctly because we do not know the dimensions the pictures have and how the CNN changed the data during the learning. We see here that "surfer" and "riding" is in the same area but we do not know how to correctly map it on the surfer in the picture. * **Problems:** - Hard to understand with zero experience. Also setup is not easy to grasp. - early information on how to use attention after a two model approach with CNN and LSTM is hard to understand - Mapping of attention and picture data ### Example captionresult  singlelabel: “A man is holding a toothbrush in his mouth with his mouth open . <END>” multilabel: “A woman holding a video game controller in a living room . <END>” ## Demo Loading Loading
README.md +15 −0 Original line number Diff line number Diff line Loading @@ -215,6 +215,21 @@ Here we can see that the attention reacts on specific words and if it does not r ## Bad visualisation  The attention can't be maped correctly because we do not know the dimensions the pictures have and how the CNN changed the data during the learning. We see here that "surfer" and "riding" is in the same area but we do not know how to correctly map it on the surfer in the picture. * **Problems:** - Hard to understand with zero experience. Also setup is not easy to grasp. - early information on how to use attention after a two model approach with CNN and LSTM is hard to understand - Mapping of attention and picture data ### Example captionresult  singlelabel: “A man is holding a toothbrush in his mouth with his mouth open . <END>” multilabel: “A woman holding a video game controller in a living room . <END>” ## Demo Loading
