[딥러닝을이용한 자연어 처리 입문] 1703 셀프 어텐션을 이용한 텍스트 분류(Multi-head Self Attention for Text Classification)

 [ 이미지 출처 : Step flow of calculating outputs of self-attention layer ]



- 목표 : 트랜스포머의 인코더(셀프 어텐션이라는 메커니즘을 통해 문장을 이해)를 사용하여 텍스트 분류를 수행



1. 멀티 헤드 어텐션



2. 인코더 설계하기



3. 포지션 임베딩



4. 데이터 로드 및 전처리



5. 트랜스포머를 이용한 IMDB 리뷰 분류





nlp_1703_Multi_head_Self_Attention_for_Text_Classification.ipynb

0.01MB


- 출처 : [딥러닝을이용한 자연어 처리 입문] 1703 셀프 어텐션을 이용한 텍스트 분류(Multi-head Self Attention for Text Classification)

댓글

댓글 쓰기

이 블로그의 인기 게시물

[Programming with Mosh] Python Tutorial for Beginners | Full Python Programming Course [2019]

이미지
Watch this Python tutorial for beginners to learn Python programming from scratch. Includes exercises and projects. 👍Subscribe for more Python tutorials like this: https://goo.gl/6PYaGF 📕Get My FREE Python Cheat Sheet: http://bit.ly/2Gp80s6 🔥Get My Complete Python Programming Course with a 90% Discount (LIMITED to the first 200 students): https://goo.gl/P64rZ8 #Python , #MachineLearning , #WebDevelopment 🔗Supplementary Materials (Spreadsheet): https://goo.gl/x77mLc 📔Python Exercises for Beginners https://goo.gl/1XnQB1 ⭐My Favorite Python Books - Python Crash Course: https://amzn.to/2GqMdjG - Automate the Boring Stuff with Python: https://amzn.to/2N71d6S - A Smarter Way to Learn Python: https://amzn.to/2UZa6lE - Machine Learning for Absolute Beginners: https://amzn.to/2Gs0koL - Hands-on Machine Learning with scikit-learn and TensorFlow: https://amzn.to/2IdUuJy TABLE OF CONTENT 00:00:00 Introduction 00:01:49 Installing Python 3 00:06:10 Your First Pyt...
계속 읽기