Engineering insight

https://limitsinx.tistory.com/293 [NIPS-2017] Attention is all you need논문 전문 : https://arxiv.org/abs/1706.03762 [출처] https://doi.org/10.48550/arXiv.1706.03762 ※ The picture and content of this article are from the original paper. This article is more of an intuitive understanding than academic analysis. [논문limitsinx.tistory.com이전에 한번 디테일하게 다룬적이 있지만, 구관이 명관이라 다시한번 재정리해보았습니다.Attention Is All You N..

논문 전문 : https://arxiv.org/abs/1908.07442 [출처] https://doi.org/10.1609/aaai.v35i8.16826 ※ The picture and content of this article are from the original paper. This article is more of an intuitive understanding than academic analysis. [논문 요약] TabNet : Attentive Interpretable Tabular Learning Tabular Data를 다루는 분들에게는 꽤나 유명한(Citation 800이상) 구글에서 나온 TabNet 논문입니다. 당시에는 Tab Data 기준으로는 SOTA 성능이였습니다만, Tab..

논문 전문 : https://arxiv.org/abs/1706.03762 [출처] https://doi.org/10.48550/arXiv.1706.03762 ※ The picture and content of this article are from the original paper. This article is more of an intuitive understanding than academic analysis. [논문 정리] Attention is all you need Attention is all you need라는 제목만으로도 오금이 저릴정도로 슈퍼 논문입니다. 제가 생각하기에는, GAN과 더불어 2000년대 나온 최고의 논문이 아닐까 합니다. 후대에는 이 시점을 AGI(Artificial Ge..

논문 전문 : https://arxiv.org/pdf/2209.05253.pdf [출처] https://doi.org/10.48550/arXiv.2209.05253 ※ The picture and content of this article are from the original paper. [논문 요약] Transfer Learning and Vision Transformer based State-of-Health prediction of Lithium-Ion Batteries 재미있게도 이 논문은 Vision에 관한것이 아닌데도 CVPR에 투고된 논문입니다. Vision Transformer를 쓴다는 이유때문인것같은데.. 혹은 Pattern Recognition이라서인가... 사실 Pattern Rec..

논문 전문 : https://www.mdpi.com/2313-0105/9/11/539 [출처] Fan, Y.; Li, Y.; Zhao, J.; Wang, L.; Yan, C.; Wu, X.; Zhang, P.; Wang, J.; Gao, G.; Wei, L. Online State-of-Health Estimation for Fast-Charging Lithium-Ion Batteries Based on a Transformer–Long Short-Term Memory Neural Network. Batteries 2023, 9, 539. https://doi.org/10.3390/batteries9110539 ※ The picture and content of this article are from t..