Åìµþ¹©¶ÈÂç³Ø(Å칩Âç)¤È»º¶Èµ»½ÑÁí¹ç¸¦µæ½ê(»ºÁí¸¦)¤Î¸¦µæ¥Á¡¼¥à¤¬ÆüËܸì¤Ë¶¯¤¤Â絬ÌϸÀ¸ì¥â¥Ç¥ë¡ÖSwallow¡×¤ò¸ø³«¤·¤Þ¤·¤¿¡£LLAMA 2 Community License¤ÇÄ󶡤µ¤ì¤Æ¤ª¤ê¡¢·î´Ö¥¢¥¯¥Æ¥£¥Ö¥æ¡¼¥¶¡¼¤¬7²¯¿Í̤Ëþ¤Î¾ì¹ç¤Ï¾¦ÍÑÍøÍѤâ²Äǽ¤È¤Ê¤Ã¤Æ¤¤¤Þ¤¹¡£

Swallow

https://tokyotech-llm.github.io/swallow-llama



ÆüËܸì¤Ë¶¯¤¤Â絬ÌϸÀ¸ì¥â¥Ç¥ë¡ÖSwallow¡×¤ò¸ø³« ±Ñ¸ì¤¬ÆÀ°Õ¤ÊÂ絬ÌϸÀ¸ì¥â¥Ç¥ë¤ËÆüËܸì¤ò¶µ¤¨¤ë | Å칩Âç¥Ë¥å¡¼¥¹ | Åìµþ¹©¶ÈÂç³Ø

https://www.titech.ac.jp/news/2023/068089

Å칩Âç¤È»ºÁí¸¦¤Î¸¦µæ¥Á¡¼¥à¤Ï¡¢±Ñ¸ì¤Ç¤Î¸À¸ìÍý²ò¤äÂÐÏÃǽÎϤι⤤Â絬ÌϸÀ¸ì¥â¥Ç¥ë¤Ç¤¢¤ëMeta¼Ò¤ÎLlama 2¤ò¥Ù¡¼¥¹¤ËÆüËܸìǽÎϤò³ÈÄ¥¤·¤¿¤È¤Î¤³¤È¡£Llama 2¤ÏÆüËܸì¤Ë¤âÂбþ¤·¤Æ¤¤¤Þ¤¹¤¬¡¢Llama 2¤Î»öÁ°³Ø½¬¤Î¥Ç¡¼¥¿¤Î90¡ó¤Ï±Ñ¸ì¤Ç¤¢¤ê¡¢ÆüËܸì¥Ç¡¼¥¿¤Î³ä¹ç¤ÏÁ´ÂΤÎÌó0.1¡ó¤È¤Ê¤Ã¤Æ¤¤¤Þ¤¹¡£¤½¤Î¤¿¤á¡¢Llama 2¤Ï±Ñ¸ì¤Ç¤Ï¹â¤¤À­Ç½¤òȯ´ø¤¹¤ë¤Ë¤â¤«¤«¤ï¤é¤ºÆüËܸì¤ÎÆɤ߽ñ¤­¤Ï¶ì¼ê¤È¤Ê¤Ã¤Æ¤¤¤Þ¤·¤¿¡£

¤Þ¤¿¡¢Llama 2¤Ç¤Ï¸À¸ì¥Ç¡¼¥¿¤Îʸ»ú¤äʸ»úÎó¤ÎÅý·×¾ðÊó¤Ë´ð¤Å¤¤¤Æ»ØÄꤵ¤ì¤¿¥Ü¥­¥ã¥Ö¥é¥ê¡¼¤ÎÈÏ°ÏÆâ¤ÇºÇŬ¤Ê¸ì×Ã(¤´¤¤)¤òµá¤á¤ë¥¢¥ë¥´¥ê¥º¥à¡Ö¥Ð¥¤¥ÈÂÐÉä¹æ²½¡×¤ò»ÈÍѤ·¤Æ¥Æ¥­¥¹¥È¤¬¥È¡¼¥¯¥ó²½¤µ¤ì¤Æ¤¤¤Þ¤¹¤¬¡¢¸µ¤È¤Ê¤ë¸À¸ì¥Ç¡¼¥¿Æâ¤ÎÆüËܸì¤ÎÎ̤¬¾¯¤Ê¤¤¤¿¤á¡¢ÆüËܸì¤Î¼çÍפÊñ¸ì¤äʸ»ú¤¬´Þ¤Þ¤ì¤º¡¢¥Æ¥­¥¹¥È¤¬ÉÔ¼«Á³¤Êñ°Ì¤Ç¥È¡¼¥¯¥ó²½¤µ¤ì¤Æ¤·¤Þ¤Ã¤Æ¤¤¤Þ¤·¤¿¡£

¸¦µæ¥Á¡¼¥à¤Ï¸À¸ì¥â¥Ç¥ë¤ËÆüËܸì¤Îʸ»ú¤äñ¸ì¤Ê¤É¤Î¸ì×äò1Ëü6000·ïÄɲä·¤¿¤¦¤¨¤Ç¡¢¥È¥ì¡¼¥Ë¥ó¥°¤ËÍѤ¤¤ëÆüËܸì¥Ç¡¼¥¿¤ò¿·¤¿¤ËºîÀ®¤·¤Æ·Ñ³»öÁ°³Ø½¬¤ò¹Ô¤Ã¤Æ¡¢Llama 2¤Î¹â¤¤¸À¸ì½èÍýǽÎϤò°Ý»ý¤·¤Ä¤ÄÆüËܸìǽÎϤò¶¯²½¤¹¤ë¤³¤È¤ËÀ®¸ù¤·¤¿¤È¤Î¤³¤È¡£¸ì×ä¬Áý²Ã¤·¤¿¤³¤È¤ÇÆüËܸì¤Î¥Æ¥­¥¹¥È¤ò¤è¤ê¾¯¤Ê¤¤¥È¡¼¥¯¥ó¿ô¤Çɽ¸½¤¹¤ë¤³¤È¤¬¤Ç¤­¡¢¥È¥ì¡¼¥Ë¥ó¥°¤ä¥Æ¥­¥¹¥ÈÀ¸À®¤Ë¤ª¤±¤ë·×»»¥³¥¹¥È¤ò¸º¾¯¤µ¤»¤¿¤ê¡¢Æþ½ÐÎÏ»þ¤Ë°·¤¨¤ë¥Æ¥­¥¹¥ÈÎ̤ξå¸Â¤¬Áý²Ã¤·¤¿¤ê¤¹¤ë¤Ê¤É¤Î¥á¥ê¥Ã¥È¤¬À¸¤¸¤Æ¤¤¤Þ¤¹¡£

º£²ó¸ø³«¤µ¤ì¤¿¥â¥Ç¥ë¤Ï¥Ñ¥é¥á¡¼¥¿¡¼¿ô¤¬70²¯¤Î¡ÖSwallow 7B¡×¥â¥Ç¥ë¡¢¥Ñ¥é¥á¡¼¥¿¡¼¿ô¤¬130²¯¤Î¡ÖSwallow 13B¡×¥â¥Ç¥ë¡¢¥Ñ¥é¥á¡¼¥¿¡¼¿ô¤¬700²¯¤Î¡ÖSwallow 70B¡×¥â¥Ç¥ë¤Î3¤Ä¡£³Æ¼ï¤ÎÆüËܸìǽÎϤò¥Æ¥¹¥È¤¹¤ë¥Ù¥ó¥Á¥Þ¡¼¥¯¤ÎÊ¿¶Ñ¤Ë¤ª¤¤¤Æ¤½¤ì¤¾¤ì¥Ù¡¼¥¹¤È¤Ê¤Ã¤¿Llama 2¤Î¥â¥Ç¥ë¤Î¥¹¥³¥¢¤ò²þÁ±¤·¤Æ¤¤¤Þ¤¹¡£



¤½¤ì¤¾¤ì¤Î¥â¥Ç¥ë¤ÏHugging Face¾å¤Ç¥Û¥¹¥È¤µ¤ì¤Æ¤ª¤ê¡¢¾¦ÍÑÍøÍѲÄǽ¤ÊLLAMA 2 Community License¤ÇÄ󶡤µ¤ì¤Æ¤¤¤Þ¤¹¡£

¤Þ¤¿¡¢¥×¥í¥¸¥§¥¯¥È¥á¥ó¥Ð¡¼¤Î1¿Í¤Ç¤¢¤ëÆ£°æ°ì´î»á¤Ë¤è¤ë²òÀ⤬¥¨¥ó¥¸¥Ë¥¢¸þ¤±¾ðÊó¶¦Í­¥³¥ß¥å¥Ë¥Æ¥£¡¦Zenn¤Ë¤Æ¸ø³«¤µ¤ì¤Æ¤¤¤Þ¤¹¡£µ¤¤Ë¤Ê¤ë¿Í¤Ï³Îǧ¤·¤Æ¤ß¤Æ¤¯¤À¤µ¤¤¡£