megasilverfist

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by

We encourage readers to predict what we might find as an exercise in training your intuitions


Recording some thoughts about each hypothesis where I have anything to say, before I read on. I have avoided spoilering myself on later articles directly, but rat-culture osmosis means I have a vague idea of the 2025 state of maze work.  
Lattice-Adjacency heads + Lattice-Adjacency heads:
It seems plausible that this would exist. I do wonder if +2 two attention layers would lead to a concept of walls, I think it is unlikely <5% but worth flagging the possibility there is a way to incorporate graph structure with 1 attention layer that I'm not thinking of but the training process does.

Bottlenecks:
This could be route through a wall representation, or less robustly through a concept of rows and columns that notes some rows/columns have very few connections to adjacent ones.

Finally I have an intuition that finding the shortest path will generalize less well than finding any path even under this setup, and that this behavior would be very easy to induce with curated sets of individually correct training mazes including by picking a seemly 'innocent' way of generating mazes without further screening. 

This is largely intuition, but to try to probe it; in order to know the path being given in the training data is the shortest path it needs to generate enough longer otherwise valid paths to learn that constraint, and the longer paths need to not share any other characteristics that are easier to learn as a heuristic. 

So it seems very plausible it will develop a search (defined broadly) function that solves mazes, and happens to find the shortest route for training set mazes but not for other classes of them.
-edit typo fixing

I know this is (hopefully) no longer cutting edge, but as someone interested in just retarget the search. I am planning to try to at least predict the findings in advance, and hopefully be able to replicate them. Putting this comment down as an anchor for my updates as I go on.

It has been long enough that I don't fully remember my thought process and may have just been looking for an excuse to talk about taxonomy. But I think I was pointing out that his implicit definition was also something 'most modern biologists have little use for'.

I also thought this, and thought that if I had a chance to do the work shop I would ask for clarification and would like trying to register a prediction without doing that step for learning purposes but still do it before my actual physical roll.

I am trying to see if there has been any followup work on conservative concept boundaries since EY posted about it. I didn't find anything with a web search, but the people of lesswrong seem likely to know if there is anything I missed under different names, off of the main internet ect

I only just got the email about this so I have not yet spent much time evaluating this, but how much work on your end would it be to become a GDR (AU tax efficient charity)? Can you accept donations of stocks. Is anyone familiar with the tax implications of donating to a US charity as a dual tax resident of the US and Australia?

I'm also interested in naming something 'Lady Eriape Was Innocent' if I end up deciding to donate but do not want to let that influence my actual donation decision. 

Load More