This is a re-look at a post I did in September. Then, I ran a "return engine" 10,000 years x 1000 times to look at the shape of the annualized geometric return paths that come out of that multiplicative process. The idea then was that there were a ton of differences in the paths that kinda iron themselves out over ~infinite time. The problem now being: none of us have infinite time and the early years -- economists or physicists new to econ or finance notwithstanding -- can be pretty hard or unnerving. So now, the question today: how bad can it be -- or how long can it take -- over the foreseeable and unforeseeable future? I am sure there are better mathy ways to do this kind of post but I don't know. As I have beat my own drum before, I am an amateur!
Retirement Finance; Alternative Risk; The Economy, Markets and Investing; Society and Capital
Dec 23, 2020
Dec 19, 2020
Dec 18, 2020
A dream about pain and war
I had a dream a few nights ago about pain and war and raising a family. None of these ideas cohere, really, but here are some post-waking remnants of thought that eventually, after a few minutes, evanesced a bit like smoke in a high-ceilinged, well ventilated room.
To whom does a man say “I’m in pain” these days? His kids? No, they’re to be 100% shielded; their world is the future. Wife/girlfriend? Maybe, I suppose, but it’s always fraught; with enough prodding they will eventually desire stronger, higher status men, their princess-day vows and protestations and fake “unconditionality” notwithstanding...I mean, eventually even the feminists will turn away though we know they already have. A boss or co-worker? You’re fired! or passed over. Social media? Even cannibals will eat less of you. Other dudes? Maybe not in this weak age. Anyway, other men should generally be brothers and partners not therapists or confessors. Only one vector remains I think: inward deeply, like Augustine or Buddha or Montaigne, though none of these were warriors (well, Montaigne did serve at the siege of Rouen)...then out...out to the world, like the steppe Khans with horse and bow and a vast continent opening in front or maybe like the scourge of the North Sea, complete with longboat and axe and seax and spear. F’n McClay, and Goldmund, had it right all along but maybe I already knew it; idk. Thus sprouts the toxic, stoic myth of men, of course, but none who are not men or God can really judge any of this and I submit judgment of me, now, to me and God alone. My kids can vote, if they want, but I own the deciding one.
Even my second coffee could not shake me of the faint scent of the saddle or of the North Sea and polished seax. I fold laundry, now, and complete a dishwasher load. Then I oil my four seax with a fine textured mineral oil that is well-matched to their carbon steel.
Dec 2, 2020
On Adverse Possession
In 2004 I moved into a new house with a peach of a neighbor. He lived next to me in a 7br mansion on the river. The houses across the street from us were 1 or 2bedroom econo homes, so a bit of a class divide depending on how you look at it if I can still say that kind of thing. To give a flavor of the man, the neighbors across the street told me that when they complained about his contractors backing into their driveway – drives that were over a peat bog and thus degrade easily – his response, as paraphrased by one man that heard it, “I don’t care about you little people, I’m rich.” Maybe he was or wasn’t, idk. The house signaled status but more on that later. In appearance he was a blue blazer, tan pants, and bow-tie guy. But sartorial descriptions are banal. Here is a better way to frame it: he had a condescending smirk perfectly located halfway between his Harvard MBA bowtie and a mop of past-the-right-age prep-school hair that Tyson would have loved as a target.
Nov 21, 2020
On rebuilding eyelids
This for all zero of you interested in how an eyelid is reconstructed. I only know the details because I had most of a lower one removed a few years back (skin cancer of the lid margin which I heard is more common than one would think; remind your kids to wear UV sunglasses...) . This post, of course, has nothing to do with retirement finance.
Nov 15, 2020
Stochastic Present Value with a Floor
As I try to wind down my quant ret-fin stuff to focus on act IV of my V acts of life, I still, every once in a while, have that "I wonder what ___ would look like" moment. Today I wondered, without any real strong goal in mind, what a stochastic present value (spv) of spending would look like with a floor added in. I had a guess but I wanted to see. In the end it probably doesn't matter since I don't manage a pension fund and as my ret-friend Ken Steiner reminded me sometimes simple is better especially when working with humans. In other words, if present value is a step too far for many retirees, then spv is an alien. But I still had that "wonder" thing.
Nov 11, 2020
On inflection points
The astute will know that I have been bitchin about my blogging for maybe 2 years. The hyper-astute will recognize that I haven't done much since then. What gives? Good question. Writing, as they say, is thinking and so therefore I will write.
Nov 5, 2020
On an "early" retirement
Periodically I get asked if I am or was "FIRE" or alternatively "why did I voluntarily retire at such a risky age." Neither FIRE nor voluntary are completely true but neither are they entirely false. This kind of fuzz, and the question, demands -- even if it's only me consolidating my own thoughts by way of writing it down -- an explanation.
Oct 29, 2020
On the affinity between PWR and SPV
This is a guest post from a reader that contacted me after I did some posts on the affinity between a net wealth dispersion process (aka MC sim if it is done right) and stochastic present values (SPV or feasibility). The reader, self-described as "You can list me as "Rodney Smith, another (very) amateur retiree interested in retirement finance" made the case (said he had a short proof) that PWR and SPV are allied as well. Doesn't surprise me, I think. Most of the math in the retirement stuff I see uses same or similar parameters for vaguely related ends. I told him "cool, send it up and I'll put it on the blog for my three readers." Heh.
Here, without comment or checking his work (I am not an instructor, just a corner-cutting old-man blogger), is his proof. Thanks Rodney.
Oct 23, 2020
Real option value of spending less over 20 year horizon
The basic premise here is me trying to figure out the "real option value" of different allocation and spend choices over a 20 year horizon (65->85...ie when I might annuitize stuff) where the strike is the then cost of annuitizing $1 of consumption conditional on a longevity estimate at age 85 plus some margin of error (the strike).
Oct 22, 2020
The absurd simplicity of my own retirement process
This from a PhD-pension-dude yesterday to someone else about my last post: "...he could use some help..." Heh. No doubt. But probably not in the way he thinks. What I need help with is getting firmly into what I call act IV of my V-act life and/or monetizing what I've learned. What I need less help on is blogging or retirement finance. And anyway, PhD dude is still young and getting paid. He doesn't feel any of this in a real way yet.
Oct 21, 2020
[revised] On the alliance between fail rates and household balance sheets - Part 2
I thought I'd take this past post [On the alliance between fail rates and household balance sheets] a little further. The post-theme here, in case you want to bail out now, is on the affinity between MC simulation and stochastic present values in some quant terms. My goal here is not really to explain anything to anyone but more to try to consolidate something I didn't understand very well. This self-consolidation may nor may not interest anyone but me.
Oct 9, 2020
Random Thoughts on Portfolio Choice and its Discontents
This has never been a teaching blog but rather a reportage-of-my-learning blog. Two different things. That means a lot of my stuff comes out like any work-product of autodidacts: spotty, holes, not 100% coherent across topics, un-tutored in others, etc. On the other hand that allows me to roll with whatever - which is what I'll do here. I don't really have a tight theme or thesis just some thoughts from some recent spreadsheeting last week.
Oct 6, 2020
Benford and Retirement Simulation
I was watching a show on Netflix last night on Benford's Law and wondered if it would hold in the "fake worlds" I create in simulation. This is a quick drive-by only. The basic idea of "the Law" is something I extracted (selectively and exclusively) from Wikipedia:
Oct 2, 2020
Adding incremental uncertainty to a consumption utility model
I once joked on Twitter that extreme "risk aversion" (in terms of the coefficient and the convex CRRA model iteself) was less of an "economic" topic and more one of psychotherapy. Heh. I got some pushback on that from a retirement quant but I think in the far-extreme it makes sense. If one were to be so risk averse in the non-financial sense that one couldn't leave the house, that is not the domain of models and math but of getting mental health help to reduce the aversion.
Oct 1, 2020
Asset Classes, Efficient Frontiers and Time
This post falls, like others in the past, into the category of "I wonder what it looks like?" There is no agenda here and all of the input parameters are absolutely 100% arbitrary and are not shaken against any other parameters to see anything else other than just "what happens with the first set?" I hate to say it and my gf would shake her head but this is just a joy ride. The main question here is:
What happens to an efficient frontier when going from a 2 asset portfolio to a 5 asset portfolio but especially when the EF for both is re-rendered using a "realized geometric return at infinity" adjustment?
Sep 24, 2020
Validating the T-distribution for use in my retirement blog
In the last post I mentioned that I saw in a Sanjiv Das paper that he used the T-distribution to model returns. This had intuitive appeal because it forces fat tails and is easy to code. This is easier than trying to figure out how to parameterize a gaussian mix or a chaos hit on net wealth. For those I need to figure out how to do them every time I fire up my R-console..again. (t) has the disadvantage of being too symmetrical in the tails where the S&P, say, has mostly a fat left tail and it's fatter in monthly series than annual. But I liked the hassle free nature of using a simple random t function. The only question was "does it matter enough?"
Trying out the T-distribution for fatter tails
In past posts I used a Gaussian mix to replicate fat tailed distributions. I liked that because it highlights that there may be more than one thing going on in the return "engine:" a normal narrow thing and a wilder wider unknown thing. Then I tried the same thing with a chaotic process hitting a net wealth process, like earthquake and forest fire magnitudes, which is probably closer to what is going on. BUT, both of those are a hassle to parameterize.
Sep 15, 2020
Sense-making in Retirement via Triangulation
I had a chat with a worthy man on Twitter the other day. The idea within the chat was that early retirees, facing up to 50 years of life and a suppressed 10 year prospective-return expectation (he was using Research Associates [RA] capital market assumptions in this case for large cap stocks of some kind that had ~ 2.4% nominal return with a 2% inflation expectation) are in kind of a bind. In order to attain a very high (we talked about the pros and cons of using 99%) chance of success, one might have to spend as little as 0.25% to succeed according to the conversation. Since that is effectively a zero spend rate I thought I'd take a look at this question by triangulating my way to an understanding of how I might look at it in different ways using the various tools I have worked with over the past seven years or so.
Sep 10, 2020
Multi-period efficient frontier contextualized on a surface
A few posts back I created a geometric return surface based on combinations of arithmetic return (x), standard deviation (y) and realized long horizon geometric return (z). That was a relatively empty exercise since there is no context as in "why wouldn't we just pick the highest z?" Well, because you can't. You are limited to what is investable along the effects of diversification that are implied in the efficient frontier.
Sep 9, 2020
10,000 years of a geometric return series done 1000 times
I keep saying I'm done here on RH but that does not eliminate my curiosity. I was wondering what 10,000 years of simulated geometric returns would look like. That's way way outside any reasonable lifetime but it is closer to infinity than not in practical terms. Let's see what it looks like...
I took the (arbitrary) annualized return for N(.07,.25) and ran it through this:
Sep 5, 2020
On the alliance between fail rates and household balance sheets
In a previous post I riffed, among other things, on my shift, over 10 years, from simulated fail rates to the household balance sheet. The latter comment implies, but did not make explicit, that my move was from an accounting balance sheet to an actuarial one, and from a deterministic or point estimate of spending as part of the A/L calc to a 'distribution' of spending via a stochastic present value calculation.
Evolution of RHedge over a decade in one table
This is the evolution of my sensibilities over a good long while of doing this. I keep saying I am approaching the end, and that may still be true, yet here I still am. I was at a secret covid-bar having lunch and a drink and this is what I was thinking about as I was working on such important things as my sandwich and wine:
Riff on time averages and geometric means
I've done posts on this before but it was on my mind again. The analysis of single period finance usually relies on arithmetic returns but real people live in time so it looks different on a realized, multiplicative (geometric mean) basis. Even Markowitz (2016) made this point on his own methods.
Aug 11, 2020
Being In The "Zone"
"The optimal strategy might be executing a suboptimal plan at a fast pace. Strategy evolves as lessons are learned—and the person who moves faster, learns faster. Learning is a marathon and perfection is a weighted vest. - James Clear
“It is better to be roughly right than precisely wrong.“ — Carveth Read*
10 years ago I believed, more than I do now, in the grace of specific numbers and precision. Today, not so much. That's because even if I were to have a perfect, optimal retirement model, and if I had successfully tuned it to the infinity of possibilities of whatever reality we know, as of yesterday let's say, then: 1) you and I would still have results different enough today that it would be hard to explain, and 2) for both of us, the output today could be entirely stale as early as tomorrow morning. Agony, right? I used to think so. Instead, I have been thinking how it matters only generally what we spend and how we invest but not necessarily specifically or precisely. Getting into a "close enough zone" and being willing to adapt are stronger and less burdensome concepts than getting it exactly right. At least I am telling myself that so I don't pull out what's left of my hair.
Aug 2, 2020
The Cost of Retirement Certainty
Jun 19, 2020
3D Lorenz attractor fun on a Friday
I got bored this afternoon. I had been reading two books lately: Ubiquity (how catastrophes happen) and Chaos, a book on the history of the topic. I was 2/3 through the latter and I was curious if I could pull off a self-rolled version of some of the theory. In this case I picked one of the earliest examples, a Lorenz attractor. This was originally designed to model atmospheric convection. The point turned out to be that chaotic processes can come from deterministic models and that initial conditions matter (butterfly effect). Here is the intro in Wikipedia:
Jun 17, 2020
Some posts I've had fun with over the years (i.e., my favorites)
Jun 5, 2020
Comparing my naive complexity model to earthquakes
Then, after the post in question, I started to wonder: "huh, I wonder if this machine I cooked up is even close to any real world complexity-dynamic...in at least the way it looks and in terms of prevalence?" In this case I also said "let's try earthquakes first."
Jun 3, 2020
My baby steps into "critical states" in a decumulation model
May 15, 2020
First whack at cost of stochastic inflation in decumulation
note: some errors have been corrected since initial post
-----
Ok, let's sandbag right away. I don't know if I got this in the right groove but let's roll anyway.
Using a life consumption utility model, and a simple model for auto-regressive inflation based on historical data, I ran a few new models today:
1. a baseline with deterministic inflation set to the mean of the random distribution I'll use for #2
2. a simulation using stochastic inflation that is bootstrapped from history (1914-2018) with a coefficient of auto-regression over 1 period of .64. (see the link above on inflation)
3. This scenario is the same as #2 except that the initial wealth is stepped up a bit (+25%) to get the life consumption utility up back towards #1 levels (not done analytically. Pretty much just eyeballed it). This is more or less like evaluating "certainty equivalent wealth" but I'm not totally sure about that so I won't precisely make that claim.
The goal was to determine how much extra wealth might be necessary at retirement-start to make the life consumption utility roughly the same as the baseline i.e., that is, either: a) we implicitly spend less...I realize that I have not really shown that here, or b) we have some amount of "redundant" (higher) wealth (vs the baseline) that is held in reserve in a way. Either way, same thing. I might have to expand on this because I know it's a little fuzzy.
Apr 25, 2020
My mini fake unrealistic economy
Question: what happens if you kill a couple close-in periods of cash flows, take some time to ramp up, discount rates rise over the interval, there is a 20% extinction rate, and no new entrants?
- 40 periods
- 10 independent cash flows
- $100 cf
- discount 3-->6% over first 10 per, then steady
- first 2 periods of cf get vaporized
- next 7 periods ramp up 0 --> 100; linear
- 2 cash flows go extinct
aggregate difference: -49%
None of these assumptions are remotely realistic except maybe the cash flow, rates and extinction
Apr 24, 2020
My inadvertent pandemic hedge
Apr 16, 2020
My Indolence in Quarantine
Apr 3, 2020
On Redundancy, Robustness, and an Interesting Chart I Once Did
Mar 17, 2020
A change in the wind?
But a big question for a lot of people, myself included, is to what extent extreme volatility is already baked into a plan and just needs to be ridden vs being a situation where there have been material changes in the world and the plan no longer obtains, the plan in broken. Spoiler: that distinction is more art than science in my humble opinion and one will never 100% know, except maybe in retrospect.
Mar 8, 2020
A riff on the shift from accumulation to decumulation in an early retirement setting...
That shift, at 50, was naive and uninformed. I've learned things since then. Over the last 12 years or so I've done many things, including this blog. One of the many things I've done as well has been to ruminate on the transition from accumulation to decumulation before an age where it totally makes sense to do that. This post is not designed to be systematic or exhaustive. Mostly I just wanted to seed my own thoughts for a post later on that will be in more detail. The goal here is to think about some of the off the cuff differences between the two states, differences that are filtered through my personal experience as well as through my amateur finance capabilities. I may add to this post later.
My points are more or less extemporaneous but are also informed by some work by Michael Zwecher and a body of work by Moshe Milevsky, not to mention everything I've read over the last 6 years.
Mar 3, 2020
Does allocation matter?
I told her as a prior that my guess was that the allocation probably did not matter much and that spending was a stronger lever. But I took a look. I won't divulge personal details but let's say we have someone in mid to early 60s, a reasonable wodge of financial assets, social security, a few small deferred annuities in the future, a risk position that was relatively high[1], and a spend that as far as I could tell, was at or under 4%. The exact numbers were less important than the general sense.
I plugged that into a consumption utility simulator[3] and got this in the figure below. Based on this I figured she probably could trim her risk and I think she got him to give in on that. Otherwise, the idea that allocation doesn't matter too much over a broad range still (sorta) stands. For her spend rate, if it were me, I would (tax issues excepted) trim risk way back, which is what I do for myself but i think she'll be OK but only over the long run and only if the world stays normal. That last assumption is key and my guess is that the world will not be normal for a good long while.
The commentary in the figure speaks for itself in terms of residual conclusions[2] so I'll leave it at that. The third unspoken lever (besides allocation and spending) that is not imagined here is "when to retire" but that was mooted in this case. I could have broached the idea of immunizing spend via life income (annuities) but didn't. Probably should have.
---------------------------------------
[1] Let's arbitrarily call it like this on "levels" of risk:
- 0-30% Low risk position
- 30-80% Mid risk
- 80-100%+ High risk
I just made that up but it's not totally unreasonable.
[2] It's implicit in the figure but I'll make it explicit. High spend rates with very low allocations to risk are a bad combo. Low spend rates with either low or high risk are a better bet than that. Spend rates move the needle in the middle more than allocation does.
[3] covered here in more detail:
Feb 26, 2020
Feb 19, 2020
Message in a bottle
- bald
- had a fedora on the top closet shelf and long heavy overcoats, some with a fur collar
- liked shish-kebobs
- had some big-shot job at Prudential on highway 12
- liked his Cadillacs with fins
- loved to fish
- terrible cologne
- most of the time leave him alone but solid otherwise (like me)
- drove us all on an epic western road trip in ~1963
- turned purple some night in '65; wasn't there in the morning
Feb 16, 2020
Comments on the Floor Leverage Rule
SIEPR Discussion Paper No.13-013The abstract is thus:
The Floor-Leverage Rule for Retirement
By Jason S. Scott and John G. Watson
Stanford Institute for Economic Policy Research
2013
The Floor-Leverage Rule is a spending and investment strategy designed for retirees that can tolerate investment risk, but insist on sustainable spending. The rule calls for purchasing a spending guarantee with 85% of wealth and investing the remaining 15% in equities with 3x leverage. Surprisingly, this leverage is a tool for managing risk. We compare our rule to some popular strategies, illustrate it for a variety of retiree preferences, and evaluate its historical performance.The following is neither comprehensive nor exhaustive, just a riff based on some thoughts as I read my friends email.
Feb 10, 2020
My first kinda botched attempt at backward inducting spending via SDP
The purpose for this post is to write up my attempt to try to use an "optimal control theory" technique (e.g., stochastic dynamic programming and backward induction - BI/SDP) to evaluate lifecycle spending choice (or the decumulation half, anyway). I had tried this BI/SDP technique once before with "asset allocation choice" when I tried a couple years ago, with a modestly successful outcome, to replicate Gordon Irlam's description of the method in his article Portfolio Size Matters [2014] article.
The goal here is not replication (I'm not sure I've actually ever seen this kind of BI thing done before for spending) nor is the goal necessarily usable functional results. No, I am mostly just trying to: 1) build new skills or stretch old ones, 2) see if I can do it at all, and 3) maybe provide another avenue of confirmation for the shape of spend rates in the mid-to-late age retirement process. Since the method is considered to be quantitatively and intellectually robust in some circles of academic econ, it is probably therefore worthy in my mind of some examination. It can then be placed in the toolbox that I have for "triangulating" around my understanding of the retirement spending problem.
Feb 5, 2020
Twitter broke my pinned thread
Just for fun here is the original thread to the extent that I can reconstruct it. Most of this is redundant with my page above with my fitness stuff as well as a previous post on the same topic. I just felt obligated to rebuild what Twitter broke apart. Edits added for clarity and flow.
I burned myself to ash in a crucible of my own making, with 11 years of dead-walking, to find my own path mentally and physically. That’s a really long time. Now? Examples of fitness-follows I use at 61 to stay alive:
@TheForeverAlpha
@Mangan150
@_CynthiaThurlow
@jerryteixeira
2/ The Game…
Fast: consistently, not obsessively >=18:6
Eat: high protein, low other. Count calories, nix alcohol
Lift: often, progressively, with ROM. Recover
Balance: hormones, sleep, stress
Excellence: attempt it always and everywhere, with purpose
all that = hope for 60+ crowd
Results [maybe Q3 2019]:
7/ Chaining something else to my pinned tweet...
At the top of the blog there is a tab with a cover of my fitness program. Covers the same ground with more detail on the plan.
Feb 4, 2020
Increasing the machine's interval of interest to age 60-->95
See the integrated cover of what I'm doing here:
In the last post
Optimal onset and exhaustion of retirement savings in a life-cycle model; Cambridge U Press. 2010
Feb 1, 2020
Adding some lifetime income to the machine learning model
The original set up, with the references and links to other posts, is here:
In this post I added 15k (real) in lifetime income starting at age 70 to the other parameters. This can be viewed as exogenous income like Social Security or some other external pension or annuity.
Something to keep in mind is that:
a) This move to add income with no other changes is more or less like adding new wealth to the balance sheet since the probability weighted present value of that stream at 60 is something like 226k, money that we didn't have before.
b) the income really isn't like a static wealth PV since it is a "flow" that, in the model, is set up to last forever. I mean except that at some age the survival probability goes to zero...which moots the forever aspect.The game is still the same as before: recommend to the machine that it spend 4% but also let it learn, via some randomizing and an evaluative reinforcing value function, what might be better given random returns and lifetime, now this time with life income present.
Jan 24, 2020
Some Observations on my Machine Learning Project
- https://rivershedge.blogspot.com/p/machine-spending.html
"Why bother to run a sloppy, slow, imprecise machine when one can access the insight directly, accurately and faster by other means?" [paraphrased h/t to David Cantor]Good question; cuts to the core of my project. Let's see if I can rationalize what I call "riding a bike in first gear:" a lot of motion and heat for very little forward progress.
What happens when you try to improve the machine by suppressing outliers
The short answer to the title is that it looks like the machine's output shifts from finance to economics. That confused me at first but I think I have a bead on this. First we'll look at where we've been with: a) lower risk aversion (small, error prone sampling), and b) slightly higher risk aversion (again with smaller sampling. Then I'll change the sampling a bit to see what happens. Then finally I'll try to explain what I think I'm seeing.
What do I mean by sampling and outliers?
In the machine/model as it walks through the meta-sim -- where "1 iteration = 1 life" and then "year by year within a life" -- it is, at each age for whatever wealth level and spend rate it is at, checking by way of a forward consumption utility simulation for an estimate of the lifetime consumption utility. It does this in order to compare a course of action (changing the spending) to a baseline (what it would have done notwithstanding the change). Since that is a heavy use of the processor and since I was just playing around I originally kept the iterations for that internal mini-sim low, say 100. That is "the sample" and since it it is technically sampling from infinity, it is a laughably low sample. In this post I increased that to 300 which is still laughably low but also painfully slow. On AWS with 4x4core so 16 CPUs it takes about 50 minutes for 1000 iterations of the meta-sim. I later nudged it down to 200 due to impatience but that didn't change the conclusions much.
The main difference, an obvious statistical thing, is that the dispersion of the sampling distribution narrows a bit and the relative impact of outliers (of lifetime consumption utility) comes in. I'll try to interpret that later.
Jan 21, 2020
Machine v Merton at RA=2
- Blue is learning machine at around 300000 sim years, risk aversion coeff set to 2
- Grey is my RH40 rule of thumb
- Orange is the Merton optimum with RA=2 and years tuned to SOA annuitant 90th percentile
Choppy output but still looks like it's getting it done one way or another...
...although in runs after this, I'm noticing that the bend up at later ages here may be more pronounced than it is in my future runs because the mini sim is prone to sampling errors and the high value/utility "errors" are more likely to be captured as an advantage. In adding more cycles, which makes it really really slow it looks like it might not curve up as much as this chart. On the other hand I've noticed that late iterations are pretty strongly related to what unfolds in the first few so maybe that's part of the problem. No idea yet. TBD
Jan 20, 2020
Digging a bit more into the Machine-derived chart for higher risk aversion
Jan 19, 2020
My machine digesting some higher risk aversion
I've been playing with this thing just for fun to see where it goes. The first versions were too discrete in it's approach to spending exploration and therefore a little unstable. Also I had only designed it for log utility (i.e., low or RA=1 in CRRA math). This increment of coding added RA > 1 where the formula is [C^(1-ra)-1]/(1-ra) if I recall correctly.
For this really fast, too-short, too-few-iterations run I flipped RA to 2. Not much of a change but: a) going up a bit in RA has convex and significant effects, b) in my own work a RA=2 is about how I behave based on what I see, and c) my opinion is that really high RA needs fewer models and more counselling. Think of it this way. If I wear a seat belt I am prudently risk averse. If I am an agoraphobic and never leave the house, I am risk averse and I need help. I have an unfounded opinion that over about RA=3 it starts to get a little odd, but that's just me.
Jan 18, 2020
A peek into the learning process of my machine
- An early look (too early) into my amateur mini-machine-learning project
With a revised (minor changes) schematic like this
Jan 14, 2020
Trying to Increase the learning speed of my naive RL machine
It dawned on me, though, that the mini sims are effectively a sampling-from-infinity process and my small sample size causes problems when evaluating advantage/reward. Effectively the machine remembers too much about optimal or advantaged spend outliers especially on one side of a tail.
Jan 11, 2020
Update on my Reinforcement Learning Experiment
I've kept my data in generations for restart-recovery purposes but that also allows me a window into evolution of what it is finding. And, pretty much, what it is finding is a choppy result that isn't changing to much any more but is still imprecise or inconsistent in it's policy recommendations by age. That inconsistency I wanted to think about today.
Jan 9, 2020
Goosing the reinforcement element in my machine-learning toy
This is the revised schematic:
Jan 7, 2020
An interesting side effect in my machine-learning project
In this look, I had noticed in the data that at higher levels of wealth at some time t, the machine liked lower spend rates (we'd only looked at W(t)=$1M by the way). That was counter-intuitive to me since I feel like I'm personally closer to "the edge" than I'd prefer and I feel like if I had more $ I'd perhaps loosen up a bit in both absolute and relative terms. But the machine is the machine and we obey the machine in our dystopian sci-fi ret-fin world. Let's look at what he/she is telling us.
Jan 6, 2020
An early look (too early) into my amateur mini-machine-learning project
Interview with RiversHedge
INT: Is this thing you just did really reinforcement learning?
RH: Um, no. Maybe? Idk. It's code that "does stuff." I tried to make something that evaluated what I call fuzzed-out actions based on a value function and then adjusted a policy over many training iterations. It's probably not "real" reinforcement learning...yet. Might be a more general "machine learning" thing. Either way I hope it's an amateur hobbyist baby step in the right direction.