├── Chapter03 ├── .ipynb_checkpoints │ ├── 3.01. Pre-trained BERT model-checkpoint.ipynb │ ├── 3.02. Extracting embeddings from pre-trained BERT -checkpoint.ipynb │ ├── 3.03. Generating BERT embedding -checkpoint.ipynb │ ├── 3.04. Extracting embeddings from all encoder layers of BERT-checkpoint.ipynb │ ├── 3.05. Finetuning BERT for downstream tasks-checkpoint.ipynb │ ├── 3.06. Text classification -checkpoint.ipynb │ ├── 3.06. Text classification-checkpoint.ipynb │ ├── 3.07. Natural language inference -checkpoint.ipynb │ ├── 3.08. Question-Answering Task -checkpoint.ipynb │ ├── 3.09. Q&A with finetuned BERT -checkpoint.ipynb │ └── 3.10. Named-entity recognition -checkpoint.ipynb ├── 3.03. Generating BERT embedding .ipynb ├── 3.04. Extracting embeddings from all encoder layers of BERT.ipynb ├── 3.06. Text classification.ipynb └── 3.09. Q&A with finetuned BERT .ipynb ├── Chapter04 ├── .ipynb_checkpoints │ ├── 4.03. Extracting embeddings with ALBERT-checkpoint.ipynb │ └── 4.05. Exploring the RoBERTa tokenizer -checkpoint.ipynb ├── 4.03. Extracting embeddings with ALBERT.ipynb └── 4.05. Exploring the RoBERTa tokenizer .ipynb ├── Chapter06 ├── .ipynb_checkpoints │ └── 6.07. Training the BERTSUM model -checkpoint.ipynb └── 6.07. Training the BERTSUM model .ipynb ├── Chapter07 ├── .ipynb_checkpoints │ ├── 7.01. Understanding multilingual BERT -checkpoint.ipynb │ ├── 7.07. Getting representation of French sentence with FlauBERT -checkpoint.ipynb │ ├── 7.09.Predicting masked word using BETO -checkpoint.ipynb │ └── 7.11. Next sentence prediction with BERTje-checkpoint.ipynb ├── 7.01. Understanding multilingual BERT .ipynb ├── 7.07. Getting representation of French sentence with FlauBERT .ipynb ├── 7.09.Predicting masked word using BETO .ipynb └── 7.11. Next sentence prediction with BERTje.ipynb ├── Chapter08 ├── .ipynb_checkpoints │ ├── 8.03. Exploring sentence-transformers library -checkpoint.ipynb │ ├── 8.05. Computing sentence similarity -checkpoint.ipynb │ └── 8.07. Finding a similar sentence with Sentence-BERT -checkpoint.ipynb ├── 8.01. Learning sentence representation with Sentence-BERT.ipynb ├── 8.03. Exploring sentence-transformers library .ipynb ├── 8.05. Computing sentence similarity .ipynb └── 8.07. Finding a similar sentence with Sentence-BERT .ipynb ├── Chapter09 ├── .ipynb_checkpoints │ ├── 9.05. Performing text summarization with BART -checkpoint.ipynb │ ├── 9.07. Sentiment analysis using Ktrain-checkpoint.ipynb │ ├── 9.08. Building a document answering model -checkpoint.ipynb │ ├── 9.09. Document summarization-checkpoint.ipynb │ ├── 9.10. Computing sentence representation using BERT as service-checkpoint.ipynb │ └── 9.11. Computing contextual word representation -checkpoint.ipynb ├── 9.05. Performing text summarization with BART .ipynb ├── 9.07. Sentiment analysis using Ktrain.ipynb ├── 9.08. Building a document answering model .ipynb ├── 9.09. Document summarization.ipynb ├── 9.10. Computing sentence representation using BERT as service.ipynb └── 9.11. Computing contextual word representation .ipynb ├── Errata_images ├── chapter1_1000.png └── chapter1_10000.PNG ├── LICENSE └── README.md /Chapter03/.ipynb_checkpoints/3.01. Pre-trained BERT model-checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter03/.ipynb_checkpoints/3.01. Pre-trained BERT model-checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter03/.ipynb_checkpoints/3.02. Extracting embeddings from pre-trained BERT -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter03/.ipynb_checkpoints/3.02. Extracting embeddings from pre-trained BERT -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter03/.ipynb_checkpoints/3.03. Generating BERT embedding -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter03/.ipynb_checkpoints/3.03. Generating BERT embedding -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter03/.ipynb_checkpoints/3.04. Extracting embeddings from all encoder layers of BERT-checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter03/.ipynb_checkpoints/3.04. Extracting embeddings from all encoder layers of BERT-checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter03/.ipynb_checkpoints/3.05. Finetuning BERT for downstream tasks-checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter03/.ipynb_checkpoints/3.05. Finetuning BERT for downstream tasks-checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter03/.ipynb_checkpoints/3.06. Text classification -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter03/.ipynb_checkpoints/3.06. Text classification -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter03/.ipynb_checkpoints/3.06. Text classification-checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter03/.ipynb_checkpoints/3.06. Text classification-checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter03/.ipynb_checkpoints/3.07. Natural language inference -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter03/.ipynb_checkpoints/3.07. Natural language inference -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter03/.ipynb_checkpoints/3.08. Question-Answering Task -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter03/.ipynb_checkpoints/3.08. Question-Answering Task -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter03/.ipynb_checkpoints/3.09. Q&A with finetuned BERT -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter03/.ipynb_checkpoints/3.09. Q&A with finetuned BERT -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter03/.ipynb_checkpoints/3.10. Named-entity recognition -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter03/.ipynb_checkpoints/3.10. Named-entity recognition -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter03/3.03. Generating BERT embedding .ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter03/3.03. Generating BERT embedding .ipynb -------------------------------------------------------------------------------- /Chapter03/3.04. Extracting embeddings from all encoder layers of BERT.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter03/3.04. Extracting embeddings from all encoder layers of BERT.ipynb -------------------------------------------------------------------------------- /Chapter03/3.06. Text classification.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter03/3.06. Text classification.ipynb -------------------------------------------------------------------------------- /Chapter03/3.09. Q&A with finetuned BERT .ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter03/3.09. Q&A with finetuned BERT .ipynb -------------------------------------------------------------------------------- /Chapter04/.ipynb_checkpoints/4.03. Extracting embeddings with ALBERT-checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter04/.ipynb_checkpoints/4.03. Extracting embeddings with ALBERT-checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter04/.ipynb_checkpoints/4.05. Exploring the RoBERTa tokenizer -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter04/.ipynb_checkpoints/4.05. Exploring the RoBERTa tokenizer -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter04/4.03. Extracting embeddings with ALBERT.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter04/4.03. Extracting embeddings with ALBERT.ipynb -------------------------------------------------------------------------------- /Chapter04/4.05. Exploring the RoBERTa tokenizer .ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter04/4.05. Exploring the RoBERTa tokenizer .ipynb -------------------------------------------------------------------------------- /Chapter06/.ipynb_checkpoints/6.07. Training the BERTSUM model -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter06/.ipynb_checkpoints/6.07. Training the BERTSUM model -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter06/6.07. Training the BERTSUM model .ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter06/6.07. Training the BERTSUM model .ipynb -------------------------------------------------------------------------------- /Chapter07/.ipynb_checkpoints/7.01. Understanding multilingual BERT -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter07/.ipynb_checkpoints/7.01. Understanding multilingual BERT -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter07/.ipynb_checkpoints/7.07. Getting representation of French sentence with FlauBERT -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter07/.ipynb_checkpoints/7.07. Getting representation of French sentence with FlauBERT -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter07/.ipynb_checkpoints/7.09.Predicting masked word using BETO -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter07/.ipynb_checkpoints/7.09.Predicting masked word using BETO -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter07/.ipynb_checkpoints/7.11. Next sentence prediction with BERTje-checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter07/.ipynb_checkpoints/7.11. Next sentence prediction with BERTje-checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter07/7.01. Understanding multilingual BERT .ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter07/7.01. Understanding multilingual BERT .ipynb -------------------------------------------------------------------------------- /Chapter07/7.07. Getting representation of French sentence with FlauBERT .ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter07/7.07. Getting representation of French sentence with FlauBERT .ipynb -------------------------------------------------------------------------------- /Chapter07/7.09.Predicting masked word using BETO .ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter07/7.09.Predicting masked word using BETO .ipynb -------------------------------------------------------------------------------- /Chapter07/7.11. Next sentence prediction with BERTje.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter07/7.11. Next sentence prediction with BERTje.ipynb -------------------------------------------------------------------------------- /Chapter08/.ipynb_checkpoints/8.03. Exploring sentence-transformers library -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter08/.ipynb_checkpoints/8.03. Exploring sentence-transformers library -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter08/.ipynb_checkpoints/8.05. Computing sentence similarity -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter08/.ipynb_checkpoints/8.05. Computing sentence similarity -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter08/.ipynb_checkpoints/8.07. Finding a similar sentence with Sentence-BERT -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter08/.ipynb_checkpoints/8.07. Finding a similar sentence with Sentence-BERT -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter08/8.01. Learning sentence representation with Sentence-BERT.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter08/8.01. Learning sentence representation with Sentence-BERT.ipynb -------------------------------------------------------------------------------- /Chapter08/8.03. Exploring sentence-transformers library .ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter08/8.03. Exploring sentence-transformers library .ipynb -------------------------------------------------------------------------------- /Chapter08/8.05. Computing sentence similarity .ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter08/8.05. Computing sentence similarity .ipynb -------------------------------------------------------------------------------- /Chapter08/8.07. Finding a similar sentence with Sentence-BERT .ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter08/8.07. Finding a similar sentence with Sentence-BERT .ipynb -------------------------------------------------------------------------------- /Chapter09/.ipynb_checkpoints/9.05. Performing text summarization with BART -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter09/.ipynb_checkpoints/9.05. Performing text summarization with BART -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter09/.ipynb_checkpoints/9.07. Sentiment analysis using Ktrain-checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter09/.ipynb_checkpoints/9.07. Sentiment analysis using Ktrain-checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter09/.ipynb_checkpoints/9.08. Building a document answering model -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter09/.ipynb_checkpoints/9.08. Building a document answering model -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter09/.ipynb_checkpoints/9.09. Document summarization-checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter09/.ipynb_checkpoints/9.09. Document summarization-checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter09/.ipynb_checkpoints/9.10. Computing sentence representation using BERT as service-checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter09/.ipynb_checkpoints/9.10. Computing sentence representation using BERT as service-checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter09/.ipynb_checkpoints/9.11. Computing contextual word representation -checkpoint.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter09/.ipynb_checkpoints/9.11. Computing contextual word representation -checkpoint.ipynb -------------------------------------------------------------------------------- /Chapter09/9.05. Performing text summarization with BART .ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter09/9.05. Performing text summarization with BART .ipynb -------------------------------------------------------------------------------- /Chapter09/9.07. Sentiment analysis using Ktrain.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter09/9.07. Sentiment analysis using Ktrain.ipynb -------------------------------------------------------------------------------- /Chapter09/9.08. Building a document answering model .ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter09/9.08. Building a document answering model .ipynb -------------------------------------------------------------------------------- /Chapter09/9.09. Document summarization.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter09/9.09. Document summarization.ipynb -------------------------------------------------------------------------------- /Chapter09/9.10. Computing sentence representation using BERT as service.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter09/9.10. Computing sentence representation using BERT as service.ipynb -------------------------------------------------------------------------------- /Chapter09/9.11. Computing contextual word representation .ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Chapter09/9.11. Computing contextual word representation .ipynb -------------------------------------------------------------------------------- /Errata_images/chapter1_1000.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Errata_images/chapter1_1000.png -------------------------------------------------------------------------------- /Errata_images/chapter1_10000.PNG: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/Errata_images/chapter1_10000.PNG -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/PacktPublishing/Getting-Started-with-Google-BERT/HEAD/README.md --------------------------------------------------------------------------------