Microsoft¤¬¥³¥¹¥È¸úΨ¤Î¹â¤¤¾®¤µ¤á¤Î¸À¸ì¥â¥Ç¥ë¡ÖPhi-3¡×¤ò¥ê¥ê¡¼¥¹¡¢¥ª¡¼¥×¥ó¥â¥Ç¥ë¤Ç¾¦ÍÑÍøÍѲÄǽ
Microsoft¤¬¾®¤µ¤¤µ¬ÌϤÇÂ礤ÊÀǽ¤òȯ´ø¤¹¤ë¸À¸ì¥â¥Ç¥ë¤È¤·¤Æ¡ÖPhi-3¡×¥Õ¥¡¥ß¥ê¡¼¤ò¥ê¥ê¡¼¥¹¤·¤Þ¤·¤¿¡£¥Õ¥¡¥ß¥ê¡¼¤ÎÃæ¤Ç¤â°ìÈÖ¾®¤µ¤Ê¥µ¥¤¥º¤Î¥â¥Ç¥ë¤Ç¤¢¤ëPhi-3-mini¤Ï¥ª¡¼¥×¥ó¥â¥Ç¥ë¤È¤Ê¤Ã¤Æ¤ª¤ê¡¢ÌµÎÁ¤Ç¾¦ÍÑÍøÍѤ¬²Äǽ¤Ç¤¹¡£
Introducing Phi-3: Redefining what's possible with SLMs | Microsoft Azure Blog
Tiny but mighty: The Phi-3 small language models with big potential - Source
https://news.microsoft.com/source/features/ai/the-phi-3-small-language-models-with-big-potential/
[2404.14219] Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
https://arxiv.org/abs/2404.14219
2023ǯ12·î¤ËÁ°¤Î¥â¥Ç¥ë¡ÖPhi-2¡×¤ò¥ê¥ê¡¼¥¹¤·¤¿»þ¤Îµ»ö¤Ï²¼µ¤ÎÄ̤ꡣPhi-2¤Î»þÅÀ¤ÇºÇÂç25ÇÜ¥µ¥¤¥º¤Î¥â¥Ç¥ë¤ÈƱÅù°Ê¾å¤ÎÀǽ¤òȯ´ø¤Ç¤¤ë¤È¤µ¤ì¤Æ¤¤¤Þ¤·¤¿¡£
Microsoft¤¬¾®µ¬ÌϸÀ¸ì¥â¥Ç¥ë¡ÖPhi-2¡×¤ò¥ê¥ê¡¼¥¹¡¢¾®µ¬ÌϤʤΤ˺ÇÂç25ÇÜ¥µ¥¤¥º¤Î¥â¥Ç¥ë¤ÈƱÅù°Ê¾å¤ÎÀǽ - GIGAZINE
º£²ó¤Ï¡ÖPhi-3¡×¥â¥Ç¥ë¥Õ¥¡¥ß¥ê¡¼¤Îȯɽ¤ÈƱ»þ¤ËPhi-3¥Õ¥¡¥ß¥ê¡¼¤Î¤¦¤Á°ìÈÖ¾®¤µ¤Ê¥µ¥¤¥º¤Î¥â¥Ç¥ë¤Ç¤¢¤ë38²¯(3.8B)¥Ñ¥é¥á¡¼¥¿¡¼¤Î¡ÖPhi-3-mini¡×¤¬¥ê¥ê¡¼¥¹¤µ¤ì¡¢Azure AI¥â¥Ç¥ë¥«¥¿¥í¥°¤ÇÍøÍѲÄǽ¤Ë¤Ê¤ê¤Þ¤·¤¿¡£Phi-3¥Õ¥¡¥ß¥ê¡¼¤Ë¤Ï¾¤Ë70²¯(7B)¥Ñ¥é¥á¡¼¥¿¡¼¤Î¡ÖPhi-3-small¡×¤È140²¯(14B)¥Ñ¥é¥á¡¼¥¿¡¼¤Î¡ÖPhi-3-medium¡×¤¬Â¸ºß¤·¤Æ¤ª¤ê¡¢¤³¤Î2¤Ä¤Î¥â¥Ç¥ë¤Ë¤Ä¤¤¤Æ¤Ï¶á¤¤¤¦¤Á¤ËAzure AI¥â¥Ç¥ë¥«¥¿¥í¥°¤Ë¤ÆÍøÍѲÄǽ¤Ë¤Ê¤ëͽÄê¤È¤µ¤ì¤Æ¤¤¤Þ¤¹¡£
¸À¸ì¥â¥Ç¥ë¤Ï¥Ñ¥é¥á¡¼¥¿¡¼¤Î¿ô¤¬Â¿¤¤Â絬ÌϤʥâ¥Ç¥ë¤Û¤É¹âÅ٤ʿäÏÀ¤ä¥Ç¡¼¥¿Ê¬ÀÏ¡¢¥³¥ó¥Æ¥¥¹¥È¤ÎÍý²ò¤Ê¤ÉÊ£»¨¤Ê¥¿¥¹¥¯¤ò¤¦¤Þ¤¯¤³¤Ê¤»¤ë·¹¸þ¤Ë¤¢¤ê¤Þ¤¹¤¬¡¢°ìÊý¤Ç¥â¥Ç¥ë¤Î¥Ñ¥é¥á¡¼¥¿¡¼¿ô¤¬Â¿¤¯¤Ê¤ë¤Û¤É¥È¥ì¡¼¥Ë¥ó¥°¤È¿äÏÀ¤ÎξÊý¤Ë¤ª¤¤¤ÆɬÍפʥ³¥ó¥Ô¥å¡¼¥Æ¥£¥ó¥°¥Ñ¥ï¡¼¤¬Áý²Ã¤·¤Æ¤¤¤¤Þ¤¹¡£
Phi-3¤Î¤è¤¦¤Ê¾®¤µ¤á¤Î¥â¥Ç¥ë¤Ç¤ÏɬÍפʥ³¥ó¥Ô¥å¡¼¥Æ¥£¥ó¥°¥Ñ¥ï¡¼¤¬¾¯¤Ê¤¤¤¿¤á¥³¥¹¥È¤òÄ㤯ÍÞ¤¨¤é¤ì¤ë¤Û¤«¡¢¥Õ¥¡¥¤¥ó¥Á¥å¡¼¥Ë¥ó¥°¤Ê¤É¤Ë¤è¤ë¥«¥¹¥¿¥Þ¥¤¥º¤òÍưפ˹Ԥ¨¤¿¤ê¡¢¥Ç¥Ð¥¤¥¹¾å¤Ç¥í¡¼¥«¥ë¤Ë¼Â¹Ô¤·¤¿¤êÁÇÁᤤ±þÅú¤ò¼Â¸½¤·¤¿¤ê¤¹¤ë¤³¤È¤¬²Äǽ¡£¥Ñ¥é¥á¡¼¥¿¡¼¿ô¤ò¸º¤é¤·¤Ä¤Ä¤¤¤«¤ËÀǽ¤ò°Ý»ý¤¹¤ë¤«¤¬ÂçÀڤȤ¤¤¦¤ï¤±¤Ç¤¹¡£
Mixtral 8x7B¤äLlama 3 8B¡¢Gemma 7B¡¢Mistral 7B¤Ê¤É¥ª¡¼¥×¥ó¤Ê¥â¥Ç¥ë¤È¤ÎÈæ³Ó¤Ï²¼¿Þ¤ÎÄ̤ꡣ½Ä¼´¤¬Àǽ¡¢²£¼´¤¬¥µ¥¤¥º¤òɽ¤·¤Æ¤ª¤ê¡¢º¸¾å¤Ë¹Ô¤¯¤Û¤É¾®¤µ¤¤¥µ¥¤¥º¤Ç¹â¤¤¥Ñ¥Õ¥©¡¼¥Þ¥ó¥¹¤ò½Ð¤»¤ëÍ¥¤ì¤¿¥â¥Ç¥ë¤È¤¤¤¦¤³¤È¤ò¼¨¤·¤Æ¤¤¤Þ¤¹¡£Phi-3¥Õ¥¡¥ß¥ê¡¼¤Î¥â¥Ç¥ë¤Ï¡ÖÉʼÁ¤È¥³¥¹¥È¤Î¥È¥ì¡¼¥É¥ª¥Õ¶ÊÀþ¡×¤ò¿·¤¿¤Ê°ÌÃ֤ޤDz¡¤·¾å¤²¤ë¤³¤È¤ËÀ®¸ù¤·¤¿¤È¸À¤¨¤½¤¦¤Ç¤¹¡£
¤½¤ì¤¾¤ì¤Î¥â¥Ç¥ë¤Î¶ñÂÎŪ¤Ê¥Ù¥ó¥Á¥Þ¡¼¥¯¤Î·ë²Ì¤Ï²¼¿Þ¤ÎÄ̤ꡣPhi-3¤Î¤¤¤º¤ì¤Î¥â¥Ç¥ë¤â¼«¿È¤è¤êÂ礤¤¥µ¥¤¥º¤Î¥â¥Ç¥ë¤Ë¾¡¤Æ¤ëÀǽ¤òȯ´ø¤·¤Æ¤¤¤ë¤È¸À¤¨¤Þ¤¹¤¬¡¢¥â¥Ç¥ë¥µ¥¤¥º¤¬¾®¤µ¤¤¤³¤È¤Ç»ö¼Â¤òµ²±¤Ç¤¤ëÍÆÎ̤¬¸º¤ê¡¢TriviaQA¤Ê¤É»ö¼ÂÃ챤ò·×¬¤¹¤ë¥Ù¥ó¥Á¥Þ¡¼¥¯¤Ç¤Ï¤¢¤Þ¤ê·ë²Ì¤¬Îɤ¯¤¢¤ê¤Þ¤»¤ó¡£
ȯɽ¤ÈƱ»þ¤Ë¥ê¥ê¡¼¥¹¤µ¤ì¤¿¡ÖPhi-3-mini¡×¤ÏMIT¥é¥¤¥»¥ó¥¹¤ÇÄ󶡤µ¤ì¤Æ¤ª¤ê¡¢Azure AI¥â¥Ç¥ë¥«¥¿¥í¥°¤Î¤Û¤«¡¢Hugging Face¤ÈOllama¤ÇÍøÍѲÄǽ¤Ë¤Ê¤Ã¤Æ¤¤¤Þ¤¹¡£
Azure AI¥â¥Ç¥ë¥«¥¿¥í¥°¤Ç¤ÏPhi-3-mini¤ÎÆ°ºî¤ò¼ÂºÝ¤Ë³Îǧ¤Ç¤¤Þ¤¹¡£¥µ¥¤¥È¤Ë¥¢¥¯¥»¥¹¤¹¤ë¤È²¼Éô¤ËAI¥â¥Ç¥ë¤¬É½¼¨¤µ¤ì¤ë¤Î¤Ç¡¢¡ÖPhi-3-mini-128k-instruct¡×¤ò¥¯¥ê¥Ã¥¯¡£
±¦²¼¤Î¥Á¥ã¥Ã¥ÈÍó¤Ë¥×¥í¥ó¥×¥È¤òÆþÎϤ·¤Æ»æÈô¹Ôµ¡¤Î¥Þ¡¼¥¯¤ò¥¯¥ê¥Ã¥¯¤¹¤ì¤ÐPhi-3-mini¤¬±þÅú¤·¤Æ¤¯¤ì¤Þ¤¹¡£¡ÖÆüËܸìǽÎϤϤɤ줯¤é¤¤¤¢¤ê¤Þ¤¹¤«¡©¡×¤Èʹ¤¤¤Æ¤ß¤ë¤È¤ä¤äÉÔ¼«Á³¤Ê¤¬¤é¤âÆüËܸì¤Ç²óÅú¤·¤Æ¤¯¤ì¤Þ¤·¤¿¡£