The Universe as a Bottom-Up Neural Net