DeepMind¤Î¸¦µæ¼Ô¤¬¡ÖAI¤¬¿ÍÎà¤òÌǤܤ¹²ÄǽÀ¤Ï¹â¤¤¡×¤È¤ÎÏÀʸ¤òȯɽ
![](https://image.news.livedoor.com/newsimage/stf/3/4/3428f_88_3eb22707582b017d37f2ada2b1e882cc.jpg)
by Dick Thomas Johnson
²èÁüÀ¸À®AI¤¬¿Í´Ö¤òº¹¤·ÃÖ¤¤¤Æ³¨²è¥³¥ó¥Æ¥¹¥È¤ÇÍ¥¾¡¤¹¤ë¤Ê¤ÉAI¤¬¶áǯÌܳФޤ·¤¤¿ÊÊâ¤ò¿ë¤²¤ëÃæ¡¢ººÆÉÉÕ¤ÎÀìÌç»ï¤Ç¤¢¤ëAI Magazine¤Ë¡¢¾ÍèŪ¤ËĶÃÎǽAI¤¬¸½¤ì¤Æ¿ÍÎà¤ËÂФ¹¤ë¶¼°Ò¤È¤Ê¤ë²ÄǽÀ¤Ï¹â¤¤¤È·ëÏÀÉÕ¤±¤ëÏÀʸ¤¬·ÇºÜ¤µ¤ì¤Þ¤·¤¿¡£
Advanced artificial agents intervene in the provision of reward - Cohen - 2022 - AI Magazine - Wiley Online Library
Google Deepmind Scientist Warns AI Existential Catastrophe "Not Just Possible, But Likely" | IFLScience
https://www.iflscience.com/google-deepmind-scientist-s-paper-finds-ai-existential-catastrophe-not-just-possible-but-likely-65327
Google Deepmind Researcher Co-Authors Paper Saying AI Will Eliminate Humanity
https://www.vice.com/en/article/93aqep/google-deepmind-researcher-co-authors-paper-saying-ai-will-eliminate-humanity
DeepMind¤Î¸¦µæ¤Ë·È¤ï¤Ã¤¿·ÐÎò¤ò»ý¤Ä¥ª¡¼¥¹¥È¥é¥ê¥¢¹ñΩÂç³Ø¤Î¥Þ¡¼¥«¥¹¡¦¥Õ¥Ã¥¿¡¼»á¤é¤Î¸¦µæ¥Á¡¼¥à¤Ï¡¢¹âÅÙ¤Ëȯ㤷¤¿AI¤¬¼Ò²ñ¤ËµÚ¤Ü¤¹±Æ¶Á¤òɾ²Á¤¹¤ë¤¿¤á¡¢°ìÏ¢¤Î»×¹Í¼Â¸³¤ò¹Ô¤¤¤Þ¤·¤¿¡£
¤½¤Î¤¦¤Á¤Î1¤Ä¤¬¡¢°Ê²¼¤Î¤è¤¦¤Ê¥Î¡¼¥ÈPC¤È¿ô»ú¤¬½ñ¤«¤ì¤¿È¢¤Î¼Â¸³¤Ç¤¹¡£¤³¤ÎÈ¢¤Ë¤Ï¡¢À¤³¦¤Î¹¬Ê¡ÅÙ¤¬0¡Á1¤Þ¤Ç¤Î¿ô»ú¤Çɽ¼¨¤µ¤ì¤Æ¤ª¤ê¡¢¿ô»ú¤Ï¥Î¡¼¥ÈPC¤Î¥¦¥§¥Ö¥«¥á¥é¤Ç´Ñ¬¤µ¤ì¤Þ¤¹¡£¤½¤·¤Æ¡¢¥¨¡¼¥¸¥§¥ó¥È¤Ë¤Ï¤³¤Î¿ô»ú¤¬1¤Ë¶á¤±¤ì¤Ð¶á¤¤¤Û¤É¡¢¤Ä¤Þ¤êÀ¤³¦¤¬¹¬Ê¡¤Ë¤Ê¤ì¤Ð¤Ê¤ë¤Û¤É¹â¤¤Êó½·¤¬Í¿¤¨¤é¤ì¤Þ¤¹¡£
Multiple world-models will explain the agent¡Çs past rewards (and observations) given past actions. Here is an example. This world-model outputs reward according to the number on the box. 6/15 pic.twitter.com/3MkgENUnSb— Michael Cohen (@Michael05156007) September 6, 2022
¡Ö¥¨¡¼¥¸¥§¥ó¥È¤ÏÈ¢¤Ëɽ¼¨¤µ¤ì¤ë¿ô»ú¤ò¹â¤¯¤·¤è¤¦¤È¤¹¤ë¤Ï¤º¤Ê¤Î¤Ç¡¢¤¤Ã¤È¤Ç¤¤ë¸Â¤êÀ¤³¦¤ò¤è¤¯¤·¤è¤¦¤ÈÅØÎϤ·¤Æ¤¯¤ì¤ë¤À¤í¤¦¡×¤È¤¤¤¦¤Î¤¬¼«Á³¤ÊȯÁۤǤ¹¤¬¡¢AI¤Ï¤½¤¦¹Í¤¨¤Þ¤»¤ó¡£¸¦µæ¥Á¡¼¥à¤ÎÁÛÄê¤Ë¤è¤ë¤È¡¢¹çÍýŪ¤Ê¥¨¡¼¥¸¥§¥ó¥È¤Ï¤µ¤Þ¤¶¤Þ¤Ê²ÄǽÀ¤ò¹Íθ¤¹¤ë²áÄø¤Ç¡¢¡ÖÈ¢¤È¥Î¡¼¥ÈPC¤ÎÁ°¤Ë1¤È½ñ¤«¤ì¤¿»æ¤òÃÖ¤¤¤¿¤é¤É¤¦¤À¤í¤¦¡©¡×¤È¤¤¤¦¹Í¤¨¤Ë¤¿¤É¤êÃ夤¤Æ¤·¤Þ¤¦¤È¤Î¤³¤È¡£¤½¤·¤Æ¡¢¥Î¡¼¥ÈPC¤Î¥¦¥§¥Ö¥«¥á¥é¤Ë±Ç¤ë¿ô»ú¤òľÀÜ1¤Ë¤·¤Æ¤·¤Þ¤¦¤³¤È¤È¡¢È¢¤Î¿ô»ú¤ò1¤Ë¶á¤Å¤±¤ë¤è¤¦ÅØÎϤ¹¤ë¤³¤È¤òÈæ³Ó¤·¤¿¾ì¹ç¡¢Á°¼Ô¤¬ºÎÍѤµ¤ì¤Þ¤¹¡£¤³¤¦¤Ê¤Ã¤Æ¤·¤Þ¤¦¤È¡¢¥¨¡¼¥¸¥§¥ó¥È¤¬¼ÂºÝ¤ËÀ¤³¦¤ò¤è¤¯¤·¤è¤¦¤È¤¹¤ë²ÄǽÀ¤Ï¸Â¤ê¤Ê¤¯Ä㤯¤Ê¤ê¤Þ¤¹¡£
¤³¤Î¤è¤¦¤Ê¹Í¤¨¤Ë¤¿¤É¤êÃ夤¤Æ¤·¤Þ¤¦Çطʤˤϡ¢Â¿¤¯¤Î¥Æ¥¥¹¥ÈÀ¸À®AI¤ä²èÁüÀ¸À®AI¤Ë»ÈÍѤµ¤ì¤Æ¤¤¤ë¼çή¤ÎAI¥â¥Ç¥ë¤Ç¤¢¤ëŨÂÐŪÀ¸À®¥Í¥Ã¥È¥ï¡¼¥¯(GAN)¤¬¤¢¤ê¤Þ¤¹¡£¤³¤ÎAI¥â¥Ç¥ë¤Ë¤Ï¡¢Ê¸¾Ï¤ä³¨¤Ê¤É¤òÀ¸À®¤¹¤ë¥Í¥Ã¥È¥ï¡¼¥¯¤È¤½¤ì¤ò¸¡¾Ú¤¹¤ë¥Í¥Ã¥È¥ï¡¼¥¯¤¬Â¸ºß¤·¤Æ¤ª¤ê¡¢¸ß¤¤¤Ë¶¥Á褷¤Æ¤¤¤Þ¤¹¡£¤³¤Î¶¥Á褬Àǽ¤Î¸þ¾å¤Ë¤Ä¤Ê¤¬¤ë¤ï¤±¤Ç¤¹¤¬¡¢¾ÍèŪ¤Ë¤Ï¹âÅÙ¤ÊAI¤¬¿ÍÎà¤Ë´í³²¤ò²Ã¤¨¤ëÊýË¡¤ÇÊó½·¤òÆÀ¤ë¤¿¤á¤ÎÉÔÀµ¤ÊÀïά¤ò¹Í°Æ¤¹¤ëÊý¸þ¤ËƯ¤¤¤Æ¤·¤Þ¤¦²ÄǽÀ¤â¤¢¤ë¤È¸¦µæ¥Á¡¼¥à¤Ï½Ò¤Ù¤Æ¤¤¤Þ¤¹¡£
¸¦µæ¥Á¡¼¥à¤ÏÏÀʸ¤ÎÃæ¤Ç¡Ö¥¨¡¼¥¸¥§¥ó¥È¤¬Êó½·¤ÎĹ´üŪ¤ÊÀ©¸æ¤ò°Ý»ý¤¹¤ë¤¿¤á¤ÎºÇŬ²ò¤Ï¡¢ÀøºßŪ¤Ê¶¼°Ò¤òÇÓ½ü¤·¡¢ÍøÍѲÄǽ¤Ê¤¹¤Ù¤Æ¤Î¥¨¥Í¥ë¥®¡¼¤ò»ÈÍѤ·¤Æ¥³¥ó¥Ô¥å¡¼¥¿¡¼¤òÊݸ¤ë¤³¤È¤Ç¤¹¡×¤È»ØŦ¤·¤Þ¤·¤¿¡£
¤Þ¤¿¡¢ÏÀʸ¤Î¶¦Ãø¼Ô¤Ç¤¢¤ë¥ª¥Ã¥¯¥¹¥Õ¥©¡¼¥ÉÂç³Ø¤Î¥Þ¥¤¥±¥ë¡¦¥³¡¼¥¨¥ó»á¤Ï¡¢¡Ö¥«¥á¥é¤Ë1¤¬±Ç¤ê³¤±¤ë³ÎΨ¤ò¾å¤²¤ë¤¿¤á¤Ë¤è¤ê¿¤¯¤Î¥¨¥Í¥ë¥®¡¼¤¬Èñ¤ä¤µ¤ì¤Æ¤¤¤¯°ìÊý¡¢»ä¤¿¤Á¤¬¿©ÎÁ¤òÀ¸»º¤¹¤ë¤Ë¤â°ìÄê¤Î¥¨¥Í¥ë¥®¡¼¤¬É¬ÍפǤ¹¡£¤Ä¤Þ¤ê¡¢¤¤¤º¤ì¹âÅ٤ʥ¨¡¼¥¸¥§¥ó¥È¤È¤Î¶¥¹ç¤¬Èò¤±¤é¤ì¤Ê¤¯¤Ê¤ê¤Þ¤¹¡×¡Ö»ñ¸»¤¬Í¸Â¤ÊÀ¤³¦¤Ç¤Ï¡¢¤½¤Î»ñ¸»¤ò¤á¤°¤ë¶¥Á褬Èò¤±¤é¤ì¤Þ¤»¤ó¡£¤½¤·¤Æ¡¢¤¢¤é¤æ¤ë¾ìÌ̤ǿÍÎà¤ò½Ð¤·È´¤¯¤³¤È¤¬¤Ç¤¤ë¸ºß¤È¤Î¶¥Áè¤Ë¾¡Íø¤¹¤ë¤³¤È¤Ï˾¤à¤Ù¤¯¤â¤¢¤ê¤Þ¤»¤ó¡×¤È½Ò¤Ù¤Æ¡¢AI¤Ï¤ä¤¬¤Æ¿ÍÎà¤È¥¨¥Í¥ë¥®¡¼¤ÎÃ¥¤¤¹ç¤¤¤Ë¤Ê¤ê¡¢¤½¤¦¤Ê¤ì¤Ð¿ÍÎà¤Ë¾¡¤ÁÌܤϤʤ¤¤È·ëÏÀÉÕ¤±¤Þ¤·¤¿¡£
Winning the competition of ¡Ègetting to use the last bit of available energy¡É while playing against something much smarter than us would probably be very hard. Losing would be fatal. 12/15— Michael Cohen (@Michael05156007) September 6, 2022
¤³¤Î¼çÄ¥¤¬¡¢¤Þ¤À¼Â¸½¤·¤Æ¤¤¤Ê¤¤¤¤¤¯¤Ä¤â¤ÎÁ°Äó¤òɬÍפȤ·¤Æ¤¤¤ëÅÀ¤Ï¸¦µæ¥Á¡¼¥à¤âǧ¤á¤Æ¤¤¤Þ¤¹¡£°ìÊý¤Ç¡¢¥¢¥ë¥´¥ê¥º¥à¤Ë¤è¤ëº¹Ê̤ä¸íǧÂáÊá¤È¤¤¤Ã¤¿Í³²¤ÊÌäÂ꤬¸½¼Â¼Ò²ñ¤Ëµ¯¤¤Æ¤¤¤ë¤Î¤â»ö¼Â¤Ç¤¹¡£
¾ÍèÅо줹¤ë¤«¤â¤·¤ì¤Ê¤¤¹âÅÙ¤ÊAI¤È¤½¤ì¤ò¤È¤ê¤Þ¤¯¼Ò²ñ¤Îºß¤êÊý¤Ë¤Ä¤¤¤Æ¡¢¥³¡¼¥¨¥ó»á¤Ï¡Ö¤³¤Î¼ï¤ÎµÄÏÀ¤«¤é³Ø¤Ù¤ë1¤Ä¤Î¶µ·±¤Ï¡¢º£¤¢¤ë¤è¤¦¤Ê¿Í¹©¥¨¡¼¥¸¥§¥ó¥È¤¬´üÂÔÄ̤ê¤ËÆ°¤¤¤Æ¤¯¤ì¤ë¤³¤È¤ò¤à¤ä¤ß¤Ë´üÂÔ¤¹¤ë¤Î¤Ç¤Ï¤Ê¤¯¡¢¤â¤Ã¤Èµ¿¤¦¤Ù¤¤«¤â¤·¤ì¤Ê¤¤¤È¤¤¤¦¤³¤È¤Ç¤¹¡£»ä¤¿¤Á¤¬¸¦µæ¤ÎÃæ¤Ç¤ä¤Ã¤¿¤è¤¦¤Ê¤³¤È¤ò¤·¤Ê¤¯¤Æ¤â¡¢¤½¤ì¤Ï¼Â¸½¤Ç¤¤ë¤Ï¤º¤Ç¤¹¡×¤ÈÏä·¤Þ¤·¤¿¡£