Llama 3¤äMistral-7B¤È¤¤¤Ã¤¿¥ª¡¼¥×¥ó¥½¡¼¥¹¤ÎÂ絬ÌϸÀ¸ì¥â¥Ç¥ë(LLM)¤ò¥µ¥Ý¡¼¥È¤·¡¢WebGPU¤ò»È¤Ã¤Æ¥Ö¥é¥¦¥¶¾å¤Ç´°Á´¤ËÆ°ºî¤¹¤ë¥Á¥ã¥Ã¥È¥Ü¥Ã¥È¡ÖSecret Llama¡×¤¬¸ø³«¤µ¤ì¤Æ¤¤¤Þ¤¹¡£

Secret Llama

https://secretllama.com/

GitHub - abi/secret-llama: Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.

https://github.com/abi/secret-llama

¼ÂºÝ¤ËSecret Llama¤Î¥Ç¥â¥µ¥¤¥È¤ÇLlama 3¤òÆ°ºî¤µ¤»¤Æ²ñÏ䷤Ƥߤ¿¤È¤³¤í¤¬°Ê²¼¤Î¥à¡¼¥Ó¡¼¡£

Â絬ÌϸÀ¸ì¥â¥Ç¥ë¤ò´°Á´¤Ë¥Ö¥é¥¦¥¶¤ÇÆ°ºî¤Ç¤­¤ë¡ÖSecret Llama¡×¤ÇLlama 3¤È²ñÏ䷤Ƥߤ¿ - YouTube

Secret Llama¤Î¥Ç¥â¥µ¥¤¥È¤Ë¥¢¥¯¥»¥¹¤¹¤ë¤È¤³¤ó¤Ê´¶¤¸¡£



º¸¾å¤«¤é¥â¥Ç¥ë¤òÁª¤Ö¤³¤È¤¬½ÐÍè¤Þ¤¹¡£ÁªÂò²Äǽ¤Ê¥â¥Ç¥ë¤ÏMistral-7B¡¢Llama 3¡¢TinyLlama¡¢Phi1.5¤Î4¼ïÎà¡£



¥×¥í¥ó¥×¥È¤ÏÃæ±û²¼Éô¤Ë¤¢¤ëÆþÎÏÍó¤ËÆþÎϤ·¤Þ¤¹¡£



ºÇ½é¤ËÆþÎϤ¹¤ë¤È¡¢¤Þ¤º¥â¥Ç¥ë¤ò¥í¡¼¥É¤·¤Þ¤¹¡£º£²ó¤ÏºÇ¤â·ÚÎ̤«¤Ä¹â®¤ÊTinyLlama¤òÁª¤ó¤Ç¤ß¤Þ¤·¤¿¡£



¥â¥Ç¥ë¤Î¥í¡¼¥É¤¬½ª¤ï¤ë¤È¡¢º£ÅÙ¤ÏGPU¥·¥§¡¼¥À¡¼¥â¥¸¥å¡¼¥ë¤Î¥í¡¼¥É¤¬»Ï¤Þ¤ê¤Þ¤¹¡£



Á´¤Æ¤Î¥í¡¼¥É¤¬½ªÎ»¡£º£²ó¤Ï¥Î¡¼¥ÈPC¤ÇSecret Llama¤Ë¥¢¥¯¥»¥¹¤·¤Æ¤¤¤ë¤Î¤Ç¡¢»ÈÍѤ·¤Æ¤¤¤ëGPU¤ÏiGPU¤ÎIntel UHD¥°¥é¥Õ¥£¥Ã¥¯¥¹¤Ç¤¹¡£



¡Ö¤³¤ó¤Ë¤Á¤Ï¡×¤È¤¤¤¦ÆüËܸì¤ÎÆþÎϤËÂФ·¡¢TinyLlama¤Ï±Ñ¸ì¤Ç²óÅú¡£



TinyLlama¤¬ÆüËܸì¤ËÀµ¼°¤ËÂбþ¤·¤Æ¤¤¤Ê¤¤¤«¤é¤«¡¢²óÅú¤ÎÆüËܸì¤Ï¤á¤Á¤ã¤¯¤Á¤ã¤Ë¤Ê¤Ã¤Æ¤¤¤Þ¤¹¡£



¤·¤«¤·¡¢±Ñ¸ì¤Ç¼ÁÌ䤷¤Æ¤ß¤ë¤È¡¢º£Å٤ϲóÅú¤¬Ê֤äƤ³¤Ê¤¯¤Ê¤ê¡¢¥¹¥È¥Ã¥×¤·¤Æ¤·¤Þ¤¤¤Þ¤·¤¿¡£¤µ¤¹¤¬¤Ë¥â¥Ç¥ë¤¬·ÚÎ̤Ȥ¤¤¨¤É¤â¡¢¥Î¡¼¥ÈPC¤ÎiGPU¤Ç¤ÏLLM¤òÆ°¤«¤¹¤Î¤Ï¸·¤·¤¤ÌÏÍÍ¡£



¤½¤³¤Ç¡¢º£ÅÙ¤ÏNVIDIA GeForce GTX 3060 12GB¤òÅëºÜ¤·¤¿ÊÔ½¸Éô¤ÎPC¤«¤éSecret Llama¤Ë¥¢¥¯¥»¥¹¡£¥â¥Ç¥ë¤òLlama 3¤ËÀÚ¤êÂؤ¨¤Æ¼ÁÌ䤷¤Æ¤ß¤Þ¤·¤¿¡£



ÆüËܸì¤ÏÍý²ò¤·¤Æ¤¤¤ë¤â¤Î¤Î²óÅú¤Ï±Ñ¸ì¤Î¤ß¡£¤½¤ì¤Ç¤âÈó¾ï¤Ë±þÅú¤¬Á᤯¡¢²óÅú¤ÎÀºÅÙ¤â¹â¤¤¤³¤È¤¬¤ï¤«¤ê¤Þ¤¹¡£



Secret Llama¤Ï²ñÏåǡ¼¥¿¤¬PC¤«¤éή½Ð¤¹¤ë¤³¤È¤Ï¤Ê¤¯¡¢´°Á´¤Ë¥×¥é¥¤¥Ù¡¼¥È¡£¥Ö¥é¥¦¥¶¤Ç¼Â¹Ô¤¹¤ë¤Î¤Ç¥µ¡¼¥Ð¡¼¤â¥¤¥ó¥¹¥È¡¼¥ë¤âɬÍפ¢¤ê¤Þ¤»¤ó¤Þ¤¿¡¢¥â¥Ç¥ë¤ò¥í¡¼¥É¤·¤¿¸å¤Ï¥ª¥Õ¥é¥¤¥ó¤Ç¤âÆ°ºî¤·¡¢ChatGPT¥é¥¤¥¯¤Ê»È¤¤¤ä¤¹¤¤¥¤¥ó¥¿¡¼¥Õ¥§¥¤¥¹¤È¤Ê¤Ã¤Æ¤¤¤Þ¤¹¡£¿äÏÀ¥¨¥ó¥¸¥ó¤Ë¤ÏWeb-LLM¤ò»È¤Ã¤Æ¤¤¤ë¤È¤Î¤³¤È¡£



¤Ê¤ª¡¢Secret Llama¤ÏWebGPU¤ò»È¤¦»ÅÍ;塢¥Ç¥Õ¥©¥ë¥È¤ÇWebGPU¤¬Í­¸ú²½¤µ¤ì¤Æ¤¤¤ëGoogle Chrome¤Þ¤¿¤ÏMicrosoft Edge¤Ç¤Î»ÈÍѤ¬¿ä¾©¤µ¤ì¤Æ¤¤¤Þ¤¹¡£Mozilla Firefox¤Î¾ì¹ç¤Ï¼êÆ°¤ÇWebGPU¤òÍ­¸ú²½¤¹¤ëɬÍפ¬¤¢¤ê¡¢ Safari¤Î¾ì¹ç¤Ï¡Ö¼Â¸³Åª¤ÊWebKit¤Îµ¡Ç½¡×¤ÎÀßÄ꤫¤éWebGPU¤òÍ­¸ú²½¤¹¤ëɬÍפ¬¤¢¤ê¤Þ¤¹¡£¤Þ¤¿¡¢Secret Llama¤ÎReact¥³¡¼¥É¤ò¼«Ê¬¤Ç¥³¥ó¥Ñ¥¤¥ë¤·¤Æ»È¤¦¤³¤È¤â²Äǽ¤Ç¤¹¡£