Fathoming the changes to the Lee-Carter model

(Feb 19, 2018)

Ancient Greek philosophers had a paradox called "The Ship of Theseus"; if pieces of a ship are replaced over time as they wear out until every one of the original components is gone, is it still the same ship?  At this point you could be forgiven for thinking (a) that this couldn't possibly be further removed from mortality modelling, and (b) that I had consumed something a lot more potent than tea at breakfast.  However, this philosophical parable is relevant to the granddaddy of all stochastic projection models: the one proposed by Lee & Carter (1992).

In their original paper Lee & Carter (1992) proposed the following model:

\[\log m_{x,y} = \alpha_x+\beta_x\kappa_y+\epsilon_y\]

where \(m_{x,y}\)…

Read more

Tags: Lee-Carter, P-splines, ARIMA

Back to the future with Whittaker smoothing

(Aug 7, 2015)

Many actuaries will be familiar with Whittaker smoothing (1923) but few will be aware of the close connection between this early method and the method of P-splines. The purpose of this blog is to explain this connection.

Figure 1 is a typical plot of log(mortality) of the kind of data we might want to smooth; here we use UK male data for 2011 for ages 2 to 30 taken from the Human Mortality Database.

Figure 1: Crude and Whittaker smoothed log mortality rates for UK males ages 2 to 30 in 2011.

Let \(y_i = \log(d_i/e_i), i = 1, \ldots, n\), be our data where the \(d_i\) are the observed deaths at age \(i\) and the \(e_i\) are the corresponding central exposures, and let \(\mu_i, i = 1, \ldots, n\), be the candidate smooth values…

Read more

Tags: Whittaker smoothing, splines, P-splines, penalty function

Forecasting with penalty functions - Part III

(Jun 2, 2015)

This is the last of my three blogs on forecasting with penalties. I discussed the 1-d case in the first blog and the 2-d case in the second. Here we discuss some of the properties of 2-d forecasting. Some readers may find some of my remarks surprising, even paradoxical.

In our first blog we used the Lee-Carter model as an example where a time series is used to forecast mortality. The method is (a) estimate the parameters in the model by fitting the model to suitable data and (b) forecast a subset of the parameters with a suitable time series. The fit to data, by definition, does not depend on the forecast horizon. This is a familiar and attractive property; we will refer to this as the invariance property. It is easy to overlook…

Read more

Tags: forecasting, splines, P-splines, penalty function, mortality crossover

Forecasting with penalty functions - Part II

(Mar 18, 2015)

Our first blog in this series of three looked at forecasting log mortality with penalties in one dimension, i.e. forecasting with data for a single age. We now look at the same problem, but in two dimensions. Figure 1 shows our data. We see an irregular surface sitting on top of the age-year plane. Just as in the 1-d case, we see an underlying smooth surface, and it is this surface that we wish both to estimate and to forecast.

Figure 1: Crude log mortality rates for Australian males ages 50-90 over 1960-2010.

In the 1-d case we saw (a) how a basis of B-splines sat under the data, and (b) that each B-spline had a coefficient associated with the peak of its B-spline. The same idea applies in 2-d.  Figure 2 shows (for a reduced…

Read more

Tags: forecasting, splines, P-splines, penalty function, mortality crossover

Forecasting with penalty functions - Part I

(Feb 2, 2015)

There is much to say on the topic of penalty forecasting, so this is the first of three blogs.  In this blog we will describe penalty forecasting in one dimension; this will establish the basic ideas.  In the second blog we will discuss the case of most interest to actuaries: two-dimensional forecasting.  In the final blog we will discuss some of the properties of penalty forecasting in two dimensions.

Forecasting with penalties is very different from forecasting with the more familiar time series methods, so let us begin with a time-series example.  The Lee-Carter model assumes that:

\(\log \mu_{i,j} = \alpha_i + \beta_i \kappa_j\qquad(1)\)

where \(\mu_{i,j}\) is the force of mortality at age \(i\) in year…

Read more

Tags: forecasting, splines, P-splines, penalty function

Effective dimension

(Feb 19, 2014)

Actuaries often need to smooth mortality rates.  Gompertz (1825) smoothed mortality rates by age and his famous law was a landmark in this area.  Figure 1 shows the Gompertz model fitted to CMI assured lives data for ages 20-90 in the year 2002. The Gompertz Law usually breaks down below about age 40 and a more general smooth curve would be appropriate.  However, a more general smooth curve would obviously require more parameters than the two for the simple Gompertz model.

Figure 1.  Crude mortality rates (black dots) with fitted Gompertz line (solid red) on a logarithmic scale.

When we switch to a forecasting scenario, Figure 2 shows both a straight line and a parabola fitted to years 1947-2002 for age 70.  Clearly,…

Read more

Tags: effective dimension, splines, P-splines

Stabilising projections

(Jul 21, 2009)

With many stochastic models of mortality, projections of future mortality rates are done using a time seriesIn a landmark paper, Currie, Durban and Eilers (2004) introduced the idea of using P-splines as an alternative means of generating a forecast.  P-splines formed the basis of a projection tool the CMI made freely available in 2005.

An oft-heard criticism of P-spline projections is that they can be volatile from year to year when adding new data.  This criticism was repeated in a recent paper by the CMI's projections working party:

"[...] the Working Party was concerned that adopting a P-spline methodology could introduce [an] unwanted "edge effect", i.e. that the initial rates of…

Read more

Tags: P-splines, time series, mortality projections, CMI

Find by key-word

Find by date

Find by tag (show all )