Google¤Ï¤½¤ÎÁĶȤθ¡º÷¥¨¥ó¥¸¥ó¤Ë¤ª¤¤¤Æ¡¢¿·¤·¤¤¸À¸ì½èÍýµ»½Ñ¡ÖBERT¡×¤òƳÆþ¤·¸¡º÷·ë²Ì¤ò²þÁ±¤·¤Þ¤¹¡£BERTƳÆþ¤ÏƱ¼Ò¤¤¤ï¤¯¡Ö²áµî5ǯ´Ö¤ÇºÇÂç¤ÎÈôÌö¤ò¼Â¸½¤·¡¢¸¡º÷¤ÎÎò»Ë¤ÇºÇÂç¤ÎÈôÌö¤ò¿ë¤²¤ë¡×²þÎɤȤʤë¤â¤Î¤Ç¡¢¤Þ¤º¤Ï±Ñ¸ìÈǤÎGoogle¸¡º÷¤«¤éƳÆþ¤·¡¢Â¾¸À¸ì¤Ø¤âŸ³«¤·¤Æ¤¤¤¯·×²è¤Ç¤¹¡£¡ÖBERT¡ÊBidirectional Encoder Representations from Transformers¡Ë¡×¤Ïµ¡³£³Ø½¬¥Ù¡¼¥¹¤Î¿·¤·¤¤¸À¸ì½èÍý¥â¥Ç¥ë¡£¤³¤ì¤Þ¤Ç¤Î¸¡º÷¥¨¥ó¥¸¥ó¤¬¶ì