BertViz is an interactive tool for visualizing attention in Transformer language models such as BERT, GPT2, or T5. It provides insight into the model’s decision-making process and how it allocates attention to different parts of the input.
BertViz is an interactive tool for visualizing attention in Transformer language models such as BERT, GPT2, or T5. It provides insight into the model’s decision-making process and how it allocates attention to different parts of the input.