Data Science Incubator - Computer Vision & Finance
Finance
The team for this project implemented a Long Short Term Memory (LSTM) model to forecast the Ethereum exchange rate (ETHEUR)
- Tensorflow Tutorial on LSTMs (for weather):
https://www.tensorflow.org/tutorials/structured_data/time_series
Computer Vision
The Computer Vision team independently researched and learnt about more about deep learning techniques:
- Computer Vision, the InceptionV3 model with ImageNet weights for feature extraction
- The Attention mechanism to identify the relevant portion of the image to caption
- RNNs / Language Models for the generation of the caption.
The end goal was to produce a simple flask server that would take in an image and generate a caption.
-
Tensorflow Tutorial on Image Captioning with Visual Attention:
https://www.tensorflow.org/tutorials/text/image_captioning -
The Original Paper : "Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł. & Polosukhin, I. (2017) Attention is all you need" - https://arxiv.org/abs/1706.03762
-
Quick Primer on Attention: Lilian Weng (2018):
https://lilianweng.github.io/lil-log/2018/06/24/attention-attention.html