{"id":5655,"date":"2020-07-09T00:50:39","date_gmt":"2020-07-09T04:50:39","guid":{"rendered":"https:\/\/ckms.ca\/?p=5655"},"modified":"2020-07-09T02:05:24","modified_gmt":"2020-07-09T06:05:24","slug":"the-mathematics-of-neural-networks-explained-visually","status":"publish","type":"post","link":"https:\/\/blog.ckms.ca\/?p=5655","title":{"rendered":"The Mathematics of Neural Networks (Explained Visually)"},"content":{"rendered":"<p>I think I heard my brain crack when he introduced 3D perception spaces and then &#8220;hyperspaces&#8221; (<a href=\"https:\/\/youtu.be\/e5xKayCBOeU?t=185\">~3 mins<\/a>).\u00a0 BOOM!, mind blown.\u00a0 This guy had better have more videos.<\/p>\n<p>But then I had some ideas I thought (well, <a href=\"https:\/\/blog.ckms.ca\/?p=5659\">50% high me<\/a>) were mind-blowing at the time.<\/p>\n<p><iframe loading=\"lazy\" title=\"How Neural Networks Learn Concepts\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/e5xKayCBOeU?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<hr \/>\n<p>Below here be dragons&#8230;<\/p>\n<p>&#8212; posted to Boing Boing in this thread:<\/p>\n<p>I&#8217;m way out of my league here, but I had a couple of thoughts that might be of interest, or at least amusingly naive.<\/p>\n<p>Is it really &#8220;AI&#8221; when I could write a simple BASIC program to do the pressure\/temperature\/humidity controller.\u00a0 Probably nothing more than a bunch of nested IF\/THEN statements.\u00a0 Maybe even a .bat file if all my favorite utils are on the %PATH%. Or Fanuc PMC &#8220;ladder&#8221;, with or without Fanuc Macro B.\u00a0 A box full of NOR gates even.<\/p>\n<p>But this won&#8217;t scale well due to [ exponential | logarithmic | factorial ] growth.\u00a0 Better languages, better algorithms, clever hacks will allow larger and larger nets, but the problem grows faster than the solutions.<\/p>\n<p>But in principle, there&#8217;s nothing magic in &#8220;machine learning&#8221;, at least these self-learning neural nets.<\/p>\n<p>Also, I find it interesting that you can&#8217;t fold a piece of paper more than 7 times, and a neural network of 8 layers or more is required for anything useful.\u00a0 He didn&#8217;t mention 8, but it fits with my thought, so I&#8217;m going with it.<\/p>\n<p>Wonderful video.\u00a0 I hope he has more.\u00a0 I smashed the Like button and subscribed 90 seconds in.<\/p>\n<p>&#8212; first draft below, as orginally typed&#8230;<\/p>\n<p>Is the AI in software really any different than what could be done with a &#8220;normal&#8221; program; a procedural program could be made, but the vast numbr of connections makes it human-capable (# of IF\/THEN stateents grows too large, likely exponentially or logarithmically??).\u00a0 In principle, at least.<\/p>\n<p>Also, odd that the folding thing is limited to the same # of folds as real paper?\u00a0 Can&#8217;t do (more than?) 7 folds in real paper, and nuruel nets of depth 6 aren&#8217;t powerful enough.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I think I heard my brain crack when he introduced 3D perception&#8230;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[],"tags":[91,101,26],"class_list":["post-5655","post","type-post","status-publish","format-standard","hentry","tag-ai","tag-mindblow","tag-neurology"],"_links":{"self":[{"href":"https:\/\/blog.ckms.ca\/index.php?rest_route=\/wp\/v2\/posts\/5655","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.ckms.ca\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.ckms.ca\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.ckms.ca\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.ckms.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5655"}],"version-history":[{"count":0,"href":"https:\/\/blog.ckms.ca\/index.php?rest_route=\/wp\/v2\/posts\/5655\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.ckms.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5655"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.ckms.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5655"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.ckms.ca\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5655"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}