Posted: Mar 07, 2017 10:50 pm
by VazScep
tuco wrote:Well, I do not think? there is such a thing as optima for tax-code system as such system is part of/influences other complex systems. IMO its purely political matter, hence my belief that for all practical purposes economy is in fact political economy (tax haven vs countries with high taxes .. both work somehow). Not even sure how to approach such scenario tbh, where to start, what to define first, etc. Naive is trying to predict stuff decades from now tho ;)
The tax code thing might not be naive. I only say that because I don't really know much about how tax returns work. The idea is this: AIs, right now, are really impressive in largely artificial environments. Everything about the universe of Go is fully formalisable. It's a self-contained artificial universe. I guess that could be the case with tax laws. The stockmarket: no. That's not self-contained.

The stuff about an AI trying to take control of its reward function, on the other hand, is based on a whole truck load of presumptions.

I drive using Google maps. I input destination and let Google plan my route. Sometimes I do (sanity/rational) check but sometimes I just drive because .. it does not matter all that much (from my experience) and I dunno what kind of information Google works with, namely traffic. Am I, in this scenario, one of those you had in mind? At the same time, am I naive not to realize potential dangers? I judge by my own standards and by those standards, scept chick lol, I am not worried. Could be ignorance but nobody explained to me why should I feel otherwise.
So long as you're not doing this, you're good: