Poisson Processes
Many events in finance arrive at unpredictable moments: a firm defaults, an insurance claim is filed, an order reaches the exchange, a central bank surprises the market, or a stock price jumps on news. The Poisson process is the basic model for the times at which such events occur. It counts how many events have happened up to each point in time, and it rests on two assumptions: events arrive at a constant average rate, and what happens over one period of time tells us nothing about what will happen over another.
The Poisson process plays the same role for sudden events that Brownian motion plays for continuous noise. Both arise as limits of sums of Bernoulli random variables, both have independent and stationary increments, and both generate martingales that make calculations tractable. The difference lies in the paths. Brownian motion moves all the time by tiny amounts, whereas a Poisson process stays constant most of the time and moves only by jumps. Studying the Poisson process first, before we build Brownian motion, lets us see these ideas in a setting where the paths are simple to draw and the calculations require nothing beyond generating functions and martingales.
These notes draw on Grimmett and Stirzaker (2001) and on the treatment of jump processes in Shreve (2004).
Counting Events in Continuous Time
A Bernoulli Construction
Suppose that events can occur at any moment, at an average rate of \lambda events per unit of time. To model this, divide the interval [0, t] into n short slots of length \Delta t = t / n. In each slot, an event occurs with probability \lambda \Delta t and no event occurs with probability 1 - \lambda \Delta t, independently across slots. Let X_{j} be the Bernoulli indicator that an event occurs in slot j. The number of events up to time t is N_{t}^{(n)} = X_{1} + X_{2} + \cdots + X_{n}. This is a binomial random variable with n trials and success probability \lambda t / n, so the expected number of events is \lambda t regardless of n.
As the slots become shorter, the probability of an event in each slot shrinks while the number of slots grows. This is exactly the setting of the Poisson limit in the notes on generating functions. The PGF of N_{t}^{(n)} is G_{N_{t}^{(n)}}(z) = \left(1 + \frac{\lambda t (z - 1)}{n}\right)^{n} \xrightarrow[n \to \infty]{} e^{\lambda t (z - 1)}, so in the limit the number of events up to time t has a Poisson distribution with mean \lambda t.
The construction gives us more than the distribution at a single date. For s < t, the events in (s, t] are determined by the slots in that interval, which are independent of the slots in [0, s]. The number of events in (s, t] is again binomial, and in the limit it is Poisson with mean \lambda (t - s), a quantity that depends only on the length of the interval. These properties survive the limit and define the Poisson process.
Definition
Compare this definition with the definition of Brownian motion. The first two properties are identical, and the third replaces a normal increment with variance t - s by a Poisson increment with mean \lambda (t - s). The paths of N_{t} are step functions that start at zero and jump up by one at each event. By convention the paths are right-continuous, so N_{t} includes an event that occurs exactly at time t.
Using the moments of the Poisson distribution, we have \operatorname{E}(N_{t}) = \lambda t, \qquad \operatorname{V}(N_{t}) = \lambda t, \qquad G_{N_{t}}(z) = e^{\lambda t (z - 1)}. The rate \lambda is the expected number of events per unit of time. A firm with a default intensity of \lambda = 0.02 per year, for example, expects on average 0.02 defaults per year, or one default every 50 years.
The Bernoulli construction also describes the behavior of the process over a short interval. Over an interval of length \mathop{}\!\mathrm{d}t, the Poisson probabilities give \begin{aligned} \operatorname{P}(N_{t + \mathop{}\!\mathrm{d}t} - N_{t} = 0) & = e^{-\lambda \mathop{}\!\mathrm{d}t} = 1 - \lambda \mathop{}\!\mathrm{d}t+ o(\mathop{}\!\mathrm{d}t), \\ \operatorname{P}(N_{t + \mathop{}\!\mathrm{d}t} - N_{t} = 1) & = \lambda \mathop{}\!\mathrm{d}t\, e^{-\lambda \mathop{}\!\mathrm{d}t} = \lambda \mathop{}\!\mathrm{d}t+ o(\mathop{}\!\mathrm{d}t), \\ \operatorname{P}(N_{t + \mathop{}\!\mathrm{d}t} - N_{t} \geq 2) & = o(\mathop{}\!\mathrm{d}t), \end{aligned} where o(\mathop{}\!\mathrm{d}t) denotes terms that vanish faster than \mathop{}\!\mathrm{d}t. Over a short interval there is either no event or a single event, and the probability of an event is proportional to the length of the interval. Writing \mathop{}\!\mathrm{d}N_{t} = N_{t + \mathop{}\!\mathrm{d}t} - N_{t}, this says that \mathop{}\!\mathrm{d}N_{t} is approximately a Bernoulli random variable with \operatorname{E}(\mathop{}\!\mathrm{d}N_{t}) = \lambda \mathop{}\!\mathrm{d}t.
Waiting Times
Interarrival Times Are Exponential
Let T_{1} be the time of the first event. The first event occurs after time t if and only if no event occurs in [0, t], so \operatorname{P}(T_{1} > t) = \operatorname{P}(N_{t} = 0) = e^{-\lambda t}. Therefore, T_{1} has an exponential distribution with rate \lambda, and the expected waiting time for the first event is 1 / \lambda.
The Bernoulli construction gives the same answer from a different angle. In discrete time, the number of slots until the first event is geometric with success probability \lambda \Delta t, so the probability that no event occurs in the first t / \Delta t slots is (1 - \lambda \Delta t)^{t / \Delta t} \xrightarrow[\Delta t \to 0]{} e^{-\lambda t}. The exponential distribution is the continuous-time limit of the geometric distribution, in the same way that the Poisson distribution is the limit of the binomial.
The same reasoning applies after the first event. Because increments are independent and stationary, once an event has occurred the process starts afresh, and the time until the next event is again exponential with rate \lambda, independent of everything that happened before. We state the result without a formal proof.
The converse gives a simple recipe to simulate a Poisson process: draw exponential waiting times and add them up. The paths in Figure 1 were generated in this way.
Memorylessness
The exponential distribution has a property that makes it the natural model for waiting times in the Poisson process. If T \sim \text{Exp}(\lambda), then for all s, t \geq 0 \operatorname{P}(T > s + t \mid T > s) = \frac{\operatorname{P}(T > s + t)}{\operatorname{P}(T > s)} = \frac{e^{-\lambda (s + t)}}{e^{-\lambda s}} = e^{-\lambda t} = \operatorname{P}(T > t). Having waited s units of time without an event does not change the distribution of the remaining waiting time. This memoryless property characterizes the exponential distribution among continuous distributions on [0, \infty), just as the geometric distribution is the only memoryless distribution on \{1, 2, \ldots\}.
In credit risk, memorylessness means that the probability that a firm defaults over the next year does not depend on how long the firm has survived. The probability of default over a short interval, given survival up to time t, is \operatorname{P}(T \leq t + \mathop{}\!\mathrm{d}t\mid T > t) = 1 - e^{-\lambda \mathop{}\!\mathrm{d}t} = \lambda \mathop{}\!\mathrm{d}t+ o(\mathop{}\!\mathrm{d}t), which is why \lambda is also called the hazard rate of default. Models used in practice let the hazard rate vary over time and with the state of the economy, but the constant-intensity case is the building block.
Arrival Times
The time of the n-th event is W_{n} = T_{1} + \cdots + T_{n}, a sum of n independent exponential random variables. By the results in the notes on generating functions, W_{n} has a gamma distribution with M_{W_{n}}(\theta) = \left(\frac{\lambda}{\lambda - \theta}\right)^{n}, \qquad \operatorname{E}(W_{n}) = \frac{n}{\lambda}, \qquad \operatorname{V}(W_{n}) = \frac{n}{\lambda^{2}}. The arrival times and the counts are two descriptions of the same process. The n-th event has occurred by time t if and only if at least n events have occurred in [0, t], so \operatorname{P}(W_{n} \leq t) = \operatorname{P}(N_{t} \geq n) = 1 - \sum_{k = 0}^{n - 1} e^{-\lambda t} \frac{(\lambda t)^{k}}{k!}.
Example 1 A portfolio contains bonds issued by 50 firms, each defaulting at the first event of an independent Poisson process with intensity 0.02 per year. Until the first default occurs, defaults in the portfolio arrive as a Poisson process with rate 50 \times 0.02 = 1 per year, using the superposition property discussed below. Ignoring the small reduction in the rate after each default, the probability that at least two firms default within a year is \operatorname{P}(W_{2} \leq 1) = 1 - e^{-1} (1 + 1) = 1 - 2 e^{-1} = 0.2642.
Martingales of the Poisson Process
Let \mathcal{F}_{t} denote the information generated by observing the process \{N_{s} \colon s \leq t\} up to time t. The definition of a martingale carries over from discrete time: a process \{M_{t}\} adapted to \{\mathcal{F}_{t}\} is a martingale if \operatorname{E}(M_{t} \mid \mathcal{F}_{s}) = M_{s} for all s \leq t. Since increments of the Poisson process are independent of the past, conditional expectations of functions of N_{t} - N_{s} given \mathcal{F}_{s} reduce to ordinary expectations, exactly as for the random walk.
The Poisson process itself is not a martingale, since it only moves up. Its expected increase over (s, t] is \lambda (t - s), and subtracting it produces a martingale.
Proof
Fix s < t and write \Delta N = N_{t} - N_{s}, which is independent of \mathcal{F}_{s} and has a Poisson distribution with mean \lambda (t - s). Let \Delta M = M_{t} - M_{s} = \Delta N - \lambda (t - s), so that \operatorname{E}(\Delta M) = 0 and \operatorname{E}(\Delta M^{2}) = \operatorname{V}(\Delta N) = \lambda (t - s).
For the first process, \operatorname{E}(M_{t} \mid \mathcal{F}_{s}) = M_{s} + \operatorname{E}(\Delta M) = M_{s}. For the second, expanding M_{t}^{2} = M_{s}^{2} + 2 M_{s} \Delta M + \Delta M^{2} gives \operatorname{E}(M_{t}^{2} - \lambda t \mid \mathcal{F}_{s}) = M_{s}^{2} + 2 M_{s} \operatorname{E}(\Delta M) + \operatorname{E}(\Delta M^{2}) - \lambda t = M_{s}^{2} + \lambda (t - s) - \lambda t = M_{s}^{2} - \lambda s. For the third, the MGF of a Poisson random variable with mean \lambda (t - s) is \operatorname{E}(e^{\theta \Delta N}) = e^{\lambda (t - s) (e^{\theta} - 1)}, so that \operatorname{E}(Z_{t} \mid \mathcal{F}_{s}) = Z_{s} \, \operatorname{E}\left(e^{\theta \Delta N}\right) e^{-\lambda (t - s) (e^{\theta} - 1)} = Z_{s}.These three martingales are the continuous-time counterparts of the examples in the notes on discrete-time martingales. The compensated process plays the role of the random walk S_{n}, the second martingale plays the role of S_{n}^{2} - n, and the exponential martingale has the form e^{\theta N_{t} - t K(\theta)}, where K(\theta) = \lambda (e^{\theta} - 1) is the cumulant generating function of N_{1}. We will soon see that Brownian motion has three martingales with exactly the same structure.
Quadratic Variation
For a partition 0 = t_{0} < t_{1} < \cdots < t_{n} = t, consider the sum of squared increments of the Poisson process, Q_{\Pi} = \sum_{j = 0}^{n - 1} (N_{t_{j + 1}} - N_{t_{j}})^{2}. There are finitely many events in [0, t], and no two occur at the same time. As the mesh of the partition goes to zero, each subinterval eventually contains at most one event, so each increment is either zero or one, and its square equals itself. Therefore, the sum of squared increments equals the sum of increments, and [N, N]_{t} = \lim_{\|\Pi\| \to 0} Q_{\Pi} = N_{t}. The quadratic variation of a Poisson process counts its jumps. The same argument applies to the compensated process M_{t} = N_{t} - \lambda t: subtracting the smooth function \lambda t does not change the quadratic variation, so [M, M]_{t} = N_{t} as well.
In differential notation this result reads (\mathop{}\!\mathrm{d}N)^{2} = \mathop{}\!\mathrm{d}N, which together with (\mathop{}\!\mathrm{d}N)(\mathop{}\!\mathrm{d}t) = 0 and (\mathop{}\!\mathrm{d}t)^{2} = 0 gives the multiplication table for the Poisson process. Compare it with the result we will prove for Brownian motion, [B, B]_{t} = t, or (\mathop{}\!\mathrm{d}B)^{2} = \mathop{}\!\mathrm{d}t:
- The quadratic variation of Brownian motion is deterministic. The quadratic variation of the compensated Poisson process is random, and only its expectation, \operatorname{E}(N_{t}) = \lambda t, is deterministic.
- In both cases the expected quadratic variation equals the variance of the process, \operatorname{V}(B_{t}) = t and \operatorname{V}(M_{t}) = \lambda t.
- Brownian paths accumulate quadratic variation continuously through infinitely many tiny moves. Poisson paths accumulate it only at the jumps.
Combining and Splitting Poisson Processes
Two operations on Poisson processes appear constantly in applications: merging several independent streams of events into one, and splitting one stream into several types. Both follow from the generating function results for Poisson sums and thinning.
Proof
For superposition, the sum of independent processes with independent increments has independent increments, and by the notes on generating functions the increment over (s, t] is Poisson with mean (\lambda_{1} + \lambda_{2})(t - s).
For thinning, it is enough to consider a single interval [0, t], since increments over disjoint intervals are built from disjoint sets of events. We compute the joint PGF of N_{t}^{A} and N_{t}^{B} by conditioning on N_{t}. Given N_{t} = n, each of the n events contributes a factor z_{1} if it is of type A and z_{2} if it is of type B, so \operatorname{E}\left(z_{1}^{N_{t}^{A}} z_{2}^{N_{t}^{B}} \mid N_{t} = n\right) = (p z_{1} + (1 - p) z_{2})^{n}. Taking expectations over N_{t} and using its PGF, \operatorname{E}\left(z_{1}^{N_{t}^{A}} z_{2}^{N_{t}^{B}}\right) = e^{\lambda t (p z_{1} + (1 - p) z_{2} - 1)} = e^{\lambda p t (z_{1} - 1)} \, e^{\lambda (1 - p) t (z_{2} - 1)}. The joint PGF factors into the PGF of a \text{Poisson}(\lambda p t) random variable in z_{1} times the PGF of a \text{Poisson}(\lambda (1 - p) t) random variable in z_{2}. Since a joint PGF determines the joint distribution, the two counts are independent Poisson random variables.The independence of the thinned processes is surprising at first. If we learn that many type A events occurred, we might expect fewer type B events. That intuition is correct when the total number of events is fixed, but here the total is random. Many type A events suggest that the total was large, which exactly offsets the smaller share left for type B.
Example 2 Suppose large news announcements about a stock arrive as a Poisson process with rate \lambda = 6 per year, and each announcement is good news with probability p = 0.4 and bad news otherwise. Good-news jumps then arrive at rate 2.4 per year and bad-news jumps at rate 3.6 per year, and the two processes are independent. The probability of a year with no bad-news jumps is e^{-3.6} = 0.0273, whatever the number of good-news jumps.
Compound Poisson Processes
In most applications each event carries a size: an insurance claim has an amount, a default causes a loss, and a price jump has a magnitude. Let Y_{1}, Y_{2}, \ldots be iid random variables, independent of the Poisson process \{N_{t}\}, and define X_{t} = \sum_{i = 1}^{N_{t}} Y_{i}, with X_{t} = 0 when N_{t} = 0. The process \{X_{t}\} is called a compound Poisson process. Its paths are step functions, like those of N_{t}, but the jumps have random sizes Y_{i}, which can be positive or negative. A compound Poisson process also has independent and stationary increments.
For each t, X_{t} is a random sum. The argument used in the notes on generating functions for the PGF of a random sum applies to the characteristic function without change: given N_{t} = n, the characteristic function of X_{t} is \phi_{Y}(u)^{n}, so that \phi_{X_{t}}(u) = \operatorname{E}(\phi_{Y}(u)^{N_{t}}) = G_{N_{t}}(\phi_{Y}(u)).
Proof
The characteristic function follows from G_{N_{t}}(z) = e^{\lambda t (z - 1)} evaluated at z = \phi_{Y}(u). For the moments, write \psi(u) = \lambda t (\phi_{Y}(u) - 1), so that \phi_{X_{t}} = e^{\psi}. Differentiating, \phi_{X_{t}}' = \psi' e^{\psi} and \phi_{X_{t}}'' = (\psi'' + \psi'^{2}) e^{\psi}. At u = 0 we have \psi(0) = 0, \psi'(0) = \lambda t \, i \operatorname{E}(Y), and \psi''(0) = -\lambda t \operatorname{E}(Y^{2}). Therefore \begin{aligned} \operatorname{E}(X_{t}) & = -i \phi_{X_{t}}'(0) = \lambda t \operatorname{E}(Y), \\ \operatorname{E}(X_{t}^{2}) & = -\phi_{X_{t}}''(0) = \lambda t \operatorname{E}(Y^{2}) + (\lambda t \operatorname{E}(Y))^{2}, \end{aligned} and the variance is \operatorname{E}(X_{t}^{2}) - \operatorname{E}(X_{t})^{2} = \lambda t \operatorname{E}(Y^{2}).The variance depends on \operatorname{E}(Y^{2}), not on \operatorname{V}(Y), because the randomness of X_{t} comes from two sources: the number of jumps and their sizes. Equation (1) is the reason characteristic functions are the natural tool for jump processes. The density of X_{t} is an infinite mixture over the number of jumps and is rarely available in closed form, whereas its characteristic function is a single exponential. The best-known financial example is the jump-diffusion model of Merton (1976), in which the log price of a stock is the sum of a Brownian component and a compound Poisson process with normally distributed jumps.
Example 3 In the Merton model the jumps Y_{i} of the log price are normally distributed with mean m and variance s^{2}. Leaving the Brownian part aside, the characteristic function of the jump component over [0, t] is \phi_{X_{t}}(u) = \exp\left(\lambda t \left(e^{i u m - \frac{1}{2} u^{2} s^{2}} - 1\right)\right). Since the Brownian and jump components are independent, the characteristic function of the log price is the product of this expression and the normal characteristic function of the Brownian part. We return to this model in the notes on pricing with jumps.
Application: Default and Credit Spreads
A simple model of credit risk assumes that a firm defaults at the first event of a Poisson process with intensity \lambda. The default time \tau is then exponential with rate \lambda, and the probability that the firm survives until time T is \operatorname{P}(\tau > T) = e^{-\lambda T}. Consider a zero-coupon bond issued by the firm that pays one dollar at time T if the firm has not defaulted and nothing otherwise. If the risk-free rate is a constant r and bondholders value the bond at its expected payoff discounted at the risk-free rate, the price of the bond is P^{d}(T) = e^{-r T} \operatorname{P}(\tau > T) = e^{-(r + \lambda) T}. The bond is priced as if it were a risk-free bond discounted at the higher rate r + \lambda. Its yield exceeds the risk-free rate by exactly \lambda, so in this model the credit spread equals the default intensity.
Discounting expected payoffs at the risk-free rate ignores any compensation investors require for bearing default risk. The notes on pricing with jumps show that the formula remains valid once expectations are computed under the risk-neutral measure, where \lambda becomes a risk-neutral intensity that is typically larger than the historical default rate. Duffie and Singleton (1999) develop this approach in detail, including random intensities and partial recovery.
Example 4 A firm has a default intensity of \lambda = 0.02 per year and the risk-free rate is r = 0.04. The probability that the firm survives the next T = 5 years is e^{-0.02 \times 5} = 0.9048. A five-year zero-coupon bond issued by the firm is worth P^{d}(5) = e^{-(0.04 + 0.02) \times 5} = 0.7408, compared with e^{-0.04 \times 5} = 0.8187 for a risk-free zero-coupon bond with the same maturity. The yield on the defaultable bond is 6%, a credit spread of 200 basis points.
Application: The Insurance Ruin Problem
The ruin problem for a gambler has a classic continuous-time counterpart in insurance, the model of Lundberg and Cramér. An insurance company starts with capital u > 0 and collects premiums continuously at a rate of c per unit of time. Claims arrive as a Poisson process with rate \lambda, and the claim sizes Y_{1}, Y_{2}, \ldots are iid, positive, and independent of the arrival times. The surplus of the company at time t is U_{t} = u + c t - X_{t}, \qquad X_{t} = \sum_{i = 1}^{N_{t}} Y_{i}. The company is ruined at the first time \tau its surplus becomes negative, and we want the ruin probability \psi(u) = \operatorname{P}(\tau < \infty). The surplus increases at a constant rate c - \lambda \operatorname{E}(Y) on average, and we assume this rate is positive, c > \lambda \operatorname{E}(Y). Otherwise, ruin is certain.
Unlike the gambler, the company faces no upper barrier, and the surplus falls only at claim times, by random amounts. Exact ruin probabilities are hard to compute in general, but an exponential martingale gives a sharp bound.
Proof
First we show that Z_{t} = e^{-R U_{t}} is a martingale. The increment U_{t} - U_{s} = c (t - s) - (X_{t} - X_{s}) is independent of \mathcal{F}_{s}, and X_{t} - X_{s} has the same distribution as X_{t - s}. Using the MGF of the compound Poisson process, \operatorname{E}(Z_{t} \mid \mathcal{F}_{s}) = Z_{s} \, e^{-R c (t - s)} \, \operatorname{E}\left(e^{R (X_{t} - X_{s})}\right) = Z_{s} \exp\left((t - s) \left(\lambda (M_{Y}(R) - 1) - c R\right)\right) = Z_{s}, where the last step uses (2).
As in the notes on discrete-time martingales, the stopped process Z_{t \land \tau} is also a martingale, a result that carries over to continuous time. Therefore, for any t, e^{-R u} = Z_{0} = \operatorname{E}(Z_{t \land \tau}) \geq \operatorname{E}(Z_{\tau} \mathbf{1}_{\{\tau \leq t\}}), where the inequality holds because Z is positive. At the ruin time the surplus is negative, so Z_{\tau} = e^{-R U_{\tau}} > 1, and hence e^{-R u} \geq \operatorname{P}(\tau \leq t). Letting t \to \infty gives e^{-R u} \geq \operatorname{P}(\tau < \infty) = \psi(u).The structure of the proof is the same as for the gambler: find a martingale, stop it at the ruin time, and compare the value at the start with the value at the stopping time. Here the martingale is exponential in the surplus. For a biased random walk that drifts up, with p > q and no upper barrier, the same argument applied to the martingale (q / p)^{S_{n}} gives a ruin probability of (q / p)^{u} from an initial wealth of u, and e^{-R} plays the role of q / p. The bound shows that the ruin probability falls exponentially fast with the initial capital.
Example 5 Suppose claims are exponentially distributed with mean 1 / \eta, so that M_{Y}(\theta) = \eta / (\eta - \theta) for \theta < \eta. Equation (2) becomes \lambda \left(\frac{\eta}{\eta - R} - 1\right) = \frac{\lambda R}{\eta - R} = c R, with positive solution R = \eta - \lambda / c. An insurer receives \lambda = 10 claims per year with a mean size of 1 million dollars and collects premiums of c = 12 million dollars per year, 20% above expected claims. The adjustment coefficient is R = 1 - 10 / 12 = 1/6. With an initial capital of u = 5 million dollars, Lundberg’s inequality gives \psi(5) \leq e^{-5 / 6} = 0.4346. For exponential claims the exact ruin probability is known to be \psi(u) = \frac{\lambda}{c \eta} e^{-R u}, which equals 0.3622 here. A simulation of 4000 surplus paths over about 150 years yields a ruin frequency of 0.364, close to the exact value.
Summary
The table below compares the Poisson process with Brownian motion, which we construct in the next notes.
| Property | Poisson process N_{t} | Brownian motion B_{t} |
|---|---|---|
| Increment over (s, t] | Poisson, mean \lambda (t - s) | Normal, variance t - s |
| Discrete-time origin | Rare Bernoulli events | Scaled coin flips |
| Paths | Step functions, jumps of size one | Continuous, nowhere differentiable |
| Martingale | N_{t} - \lambda t | B_{t} |
| Second martingale | (N_{t} - \lambda t)^{2} - \lambda t | B_{t}^{2} - t |
| Exponential martingale | e^{\theta N_{t} - \lambda t (e^{\theta} - 1)} | e^{\theta B_{t} - \frac{1}{2} \theta^{2} t} |
| Quadratic variation | N_{t} (random) | t (deterministic) |