Stochastic Integrals

Week 4

Lecture Notes

We left off last week talking about first passage time. We said that the cdf was

Last thing before Stochastic Calculus we should talk about maximum to date. This will be beneficial in the latter half of the semester. This allows us to work with barrier options and other exotic financial instruments.

I define a process 𝑀(𝑡)=max0≤𝑢≤𝑡𝑊(𝑤0)

This process takes the largest position of my Brownian motion. Is this Markov? In order for this to be the case, the only thing we need to calculate future valuations of my process is simply knowing the most recent value of my process. We could have a different Brownian motion that reaches the same peaks, but ends up being much lower at the end. In that green path, it would be much less likely for our maximum to date to change, because it’s much further from its current maximum than the blue path.

But we could create a multidimensional process that is Markov that incorporates both the Brownian motion and the maximum to date: (𝑊(𝑡),𝑀(𝑡)), which is 2-D Markov. Just knowing the maximum gives us no idea, we need both.

An interesting thing happens when we’re working with these maximums.

𝑀(𝑡)≥𝑚⇔𝜏𝑚≤𝑡 for 𝑚>0

Why? Remember that 𝜏𝑚 is first passage time. I know that I’ve reached level 𝑚 before time 𝑡, which means that the Brownian motion reached a maximum of at least 𝑚, which means the maximum at time 𝑡 must be greater than or equal to that.

We can rewrite our reflection equality with the maximum to date with this property.

ℙ(𝑀(𝑡)≥𝑚,𝑊(𝑡)≤𝑤)=ℙ(𝑊(𝑡)≥2𝑚−𝑤)

This is simply the reflection equality replacing one with the other.

If this is true, we can use this to get the joint distribution between Brownian motion and its maximum. Assume the joint distribution exists: 𝑓𝑀(𝑡),𝑊(𝑡)(𝑚,𝑤)

If this is my joint distribution with respect to these dummy variables, I could rewrite the probability measures in my reflection equality:

∫−∞𝑤∫𝑚∞𝑓𝑀(𝑡),𝑊(𝑡)(𝑥,𝑦)𝑑𝑥𝑑𝑦=∫2𝑚−𝑤∞12𝜋𝑡𝑒−𝑧22𝑡𝑑𝑧

Now I can take the derivative of both sides with respect to 𝑚

−∫−∞𝑤𝑓𝑀(𝑡),𝑊(𝑡)(𝑚,𝑦)𝑑𝑦=−12𝜋𝑡𝑒−(2𝑚−𝑤)22𝑡(2)

We can take the derivative now with respect to 𝑤 (and get rid of negatives)

𝑓𝑀(𝑡),𝑊(𝑡)(𝑚,𝑤)=22𝜋𝑡𝑒−(2𝑚−𝑤)2𝑤𝑡(−2(2𝑚−𝑤)(−1)2𝑡)

This ends up being

=2(2𝑚−𝑤)𝑡2𝜋𝑡𝑒−(2𝑚−𝑤)2/(2𝑡)

This is the joint density of (𝑀(𝑡),𝑊(𝑡)

We also have the conditional distribution given that Brownian motion is normal, so we can take the joint over the marginal:

𝑓𝑀(𝑡)|𝑊(𝑡)(𝑚|𝑤)=2(𝑤𝑚−𝑤)𝑡𝑒−(2𝑚−𝑤)22𝑡

We will not worry about this too much until later. This process is mostly useful because it’s an example of an adaptive stochastic process which isn’t Markov, although most are.

Stochastic Calculus (Integrands)

Now it’s the big kahuna.

What does this mean: ∫0𝑇Δ(𝑡)𝑑𝑊(𝑡)=?

In order for this to be understood, Δ(𝑡) needs to be an adapted stochastic process.

Let’s go back to Riemann. The Riemann sum integrals mean you take some function where we chop up the x into little pieces. We take observations of the function at each 𝑥. What we’re going to do in this course is still this. It’s just that we’re also going to be working with a Brownian motion. Instead of getting a Δ𝑥, we could get our Δ𝑊(𝑡). You take the heights from the result of the adapted stochastic process, but the change comes from the stochastic process. However, every Brownian motion has a different result, it’s random. This means that the stochastic integral itself is a random variable. Why do we care? Let’s start with a specific, motivated example.

A simple process is one that given a partition, Δ(𝑡) is a constant.

The random walk is a simple process.

Given a partition of 𝑥, you take one value that you hold at every partition piece which changes randomly.

If we put ourselves under the constraint that Δ(𝑡) is a simple adapted process.

We’re going to construct a hypothetical. We have a stock. The value of the stock is given by Brownian motion 𝑊(𝑡). Δ(𝑡) is the position I hold in the stock, with these rules: At the beginning of the day, I take the position of the stock and hold it for the rest of the day, until the next day. I have no idea what position I’m going to hold tomorrow.

Let’s start at day 1

𝐼(𝑡)=Δ(𝑡0)(𝑊(𝑡)−𝑊(𝑡0))

Hanging out here in Day 1 𝑡1≤𝑡<𝑡2 I’ve made

𝐼(𝑡)=Δ(𝑡1)(𝑊(𝑡)−𝑊(𝑡1))+Δ(𝑡0)(𝑊(𝑡1)−𝑊(𝑡0))

from the previous day as well.

Check on Day 3

𝐼(𝑡)=Δ(𝑡2)(𝑊(𝑡)−𝑊(𝑡2))+Δ(𝑡1)(𝑊(𝑡)−𝑊(𝑡1))+Δ(𝑡0)(𝑊(𝑡1)−𝑊(𝑡0))

For Day K 𝑡𝑘≤𝑡<𝑡𝑘+1 we have made since we started investing

𝐼(𝑡)=Δ(𝑡𝑘)(𝑊(𝑡)−𝑊(𝑡𝑘))+∑𝑖=0𝑘−1Δ(𝑡𝑖)(𝑊(𝑡𝑖+1)−𝑊(𝑡𝑖))

This essentially is the size of my position which is multiplied by

I want to look at thai integral

∫𝑡𝑗𝑡𝑗+1Δ(𝑢)𝑑𝑊(𝑢)

If I know that my Δ is a simple process, it’s going to take a value at the beginning of my time increment and hold that value for the entire time.

=∫𝑡𝑗𝑡𝑗+1Δ(𝑡𝑗)𝑑𝑊(𝑢)

How does my Δ(𝑡𝑗) change as I move? It doesn’t, so I can pull it out

=Δ(𝑡𝑗)∫𝑡𝑗𝑡𝑗+1𝑑𝑊(𝑢)

which by the fundamental theorem of calculus is

=Δ(𝑡𝑗)(𝑊(𝑡𝑗+1)−𝑊(𝑡𝑗))

Therefore, I can rewrite the sum in my return calculation as this integral.

If I make these substitutions, I have that

𝐼(𝑡)=∫𝑡𝐾𝑡Δ(𝑢)𝑑𝑊(𝑢)+∑𝑖=0𝑘−1∫𝑡𝑖𝑡𝑖+1Δ(𝑢)𝑑𝑊(𝑢)

But obviously the summation of an integral is still an integral.

=∫0𝑡Δ(𝑢)𝑑𝑊(𝑢)

What does it mean to integrate a process other than Brownian motion? We shall see.

We can wave our hands a bit about the trading of a stock. You could trade at the beginning of the day and at lunch, or every minute. Not the best idea but you could do that. This time works with a partition. This is now our Ito integral. What makes it an Ito integral is that our partition pieces are from 𝑡𝑘 to 𝑡𝑘+1, where they include the left and take that value, and exclude the right. We are always taking the left Riemann integral. I can’t decide at lunch what price I bought the stock at in the morning. I can only make those choices based on the information I had at that time. That’s why adapted processes are a big deal and everything needs to be measurable. If you trade with unavailable information, that is insider trading, very illegal. So that’s why we have to use Ito integrals.

Interestingly, these Ito integrals are martingales.

Proof that Ito Integral is a Martingale

Prove that 𝐼(𝑡) is a martingale.

Here’s our situation. We have an arbitrary partition of our time, for which there exists some 𝑘 such that 𝑡 belongs to that partition piece 𝑡∈[𝑡𝑘,𝑡𝑘+1]. To prove that this is a martingale, I need to prove for that 𝑠≤𝑡,

𝔼[𝐼(𝑡)|ℱ︀(𝑠)]=𝐼(𝑠)

This has to work whether 𝑠 is in the same time piece or in an earlier one, so there are two different cases to account for.

Case 1: ∃𝑙<𝑘 s.t. 𝑠∈[𝑡𝑙,𝑡𝑙+1]

It could be in the one at the start or the one just before.

I’m going to be able to say that

𝐼(𝑡)=∑𝑗𝑙−1Δ(𝑡𝑗)(𝑊(𝑡𝑗+1)−𝑊(𝑡𝑗))+Δ(𝑡𝑙)(𝑊(𝑡𝑙+1)−𝑊(𝑡𝑙))+∑𝑗=𝑙+1𝑘−1Δ(𝑡𝑗)(𝑊(𝑡𝑗+1)−𝑊(𝑡𝑗))+Δ(𝑡𝑘)(𝑊(𝑡)−𝑊(𝑡𝑘))

All days before 𝑙, day 𝑙, and all days from 𝑙 to 𝑘 p to how far we are into day 𝑘

Because this is a sum, we can split this up by linearity of expectations:

𝔼[𝐴|ℱ︀(𝑠)]=𝔼[∑𝑗=0𝑙−1Δ(𝑡𝑗)(𝑊(𝑡𝑗+1)−𝑊(𝑡𝑗))|ℱ︀(𝑠)]

We will use the properties of expectations here. I would say at this point that linearity is already used, but let’s try something else. What is the latest time index referred to in this summation? It’s 𝑙. But here’s the thing. Because 𝑠∈[𝑡𝑙,𝑡𝑙+1], then 𝑠≥𝑡𝑙. So everything is known, so we can take out everything and leave 1.

=𝐴

Let’s try 𝐵

𝔼[𝐵|ℱ︀(𝑠)]=𝔼[Δ(𝑡𝑙)(𝑊(𝑡𝑙+1)−𝑊(𝑡𝑙)|ℱ︀(𝑠)]

=Δ(𝑡𝑙)𝔼[𝑊(𝑡𝑙+1)−𝑊(𝑡𝑙)|ℱ︀(𝑠)]

Let’s brute force this with linearity, and then do the elegant solution later

=Δ(𝑡𝑙)[𝔼[𝑊(𝑡𝑙+1)|ℱ︀(𝑠)]−𝔼[𝑊(𝑡𝑙)|ℱ︀(𝑠)]]

Generally in order to break up these problems we try to add a 0 to break it up into an independent piece and a measurable piece.

𝔼[𝑊(𝑡𝑙+1)−𝑊(𝑠)+𝑊(𝑠)|ℱ︀(𝑠)]

We know future increments are independent. Therefore, we can use linearity to split them, independence to drop the first condition, and measurability to take out what’s known from the second part.

We could have solved this with a single step if we remember that Brownian motion is a martingale.

Now let’s consider 𝐶

𝔼[Δ(𝑡𝑗)(𝑊(𝑡𝑗+1)−𝑊(𝑡𝑗))|ℱ︀(𝑠)]

We know that the Brownian motion part is independent, but the Δ isn’t. And none of this is measurable. We can use iterated conditioning, though. For ℱ︀(𝑠)⊆ℱ︀(𝑡)

𝔼[𝔼[𝑋|ℱ︀(𝑡)]|ℱ︀(𝑠)]=𝔼[𝑋|ℱ︀(𝑠)]

I can do this by using the property of filtrations.

=𝔼[𝔼[Δ(𝑡𝑗)(𝑊(𝑡𝑗+1)−𝑊(𝑡𝑗))|ℱ︀(𝑡𝑗)]|ℱ︀(𝑠)]

We have a hard time picking this time, because it’s true for a lot of them. We know that it’s time 𝑡 or later. My adapted process is measurable with respect to time 𝑡𝑗 or later. So we can use 𝑡𝑗. We can take out what’s known now.

=𝔼[Δ(𝑡𝑗)𝔼[𝑊(𝑡𝑗+1)−𝑊(𝑡𝑗)|ℱ︀(𝑡𝑗)]|ℱ︀(𝑠)]

We know that the stochastic process is independent and that it’s a martingale, so we can get rid of that whole thing and call it 0.

=0

So the conditional expectation of 𝐶 is 0.

Finally, let’s consider 𝐷.

𝔼[𝐷|ℱ︀(𝑠)]=𝔼[Δ(𝑡𝑘)(𝑊(𝑡)−𝑊(𝑡𝑘))|ℱ︀(𝑠)]

We can use the same exact proof for 𝐶 that uses iterated conditioning for 𝑡𝑘.

We have just proven that we can get rid of C and D, so our final expectation is

𝔼[𝐼(𝑠)]=∑𝑗=0𝑙−1Δ(𝑡𝑗)(𝑊(𝑡𝑗+1)−𝑊(𝑡𝑗))+Δ(𝑡𝑙)(𝑊(𝑠)−𝑊(𝑡𝑙))

We need to touch all of our spinning plates to understand why we’re doing. When 𝑠 occurs on day 𝑙. If we think about this intuitively, this value is the same as 𝐼(𝑠) because it is all the spinning plates going up to 𝑙−1 plus the time into 𝑙 that comes to 𝑠. That means

=𝐼(𝑠)

So it’s a martingale

Case 2 𝑠<𝑡;𝑠,𝑡∈[𝑡𝑘,𝑡𝑘+1)

We are trying to figure out

𝔼[𝐼(𝑡)|ℱ︀(𝑠)]=

Knowing that 𝑠 and 𝑡 occur on the same day, we don’t need all those pieces. So this is simply

=𝔼[∑𝑗=0𝑘−1Δ(𝑡𝑗)(𝑊(𝑡𝑗+1)−𝑊(𝑡𝑗))+Δ(𝑡𝑘)(𝑊(𝑡)−𝑊(𝑡𝑘))|ℱ︀(𝑠)]

What is the relationship of 𝑠 to time 𝑡𝑘? It’s greater than or equal to.

In this summation, all of these pieces are measurable because 𝑠 is greater than 𝑘.

=∑𝑗=0𝑘−1Δ(𝑡𝑗)(𝑊(𝑡𝑗+1)−𝑊(𝑡𝑗))+𝔼[Δ(𝑡𝑘)(𝑊(𝑡)−𝑊(𝑡𝑘))|ℱ︀(𝑠)]

By taking out what is known, we can get

=∑𝑗=0𝑘−1Δ(𝑡𝑗)(𝑊(𝑡𝑗+1)−𝑊(𝑡𝑗))+Δ(𝑡𝑘)𝔼[𝑊(𝑡)−𝑊(𝑡𝑘)|ℱ︀(𝑠)]

This is not a future increment. The time is smack dab in the middle of the increment. In this case, you should add a 0, which allows you to take out what is known and show independence.

=∑𝑗=0𝑘−1Δ(𝑡𝑗)(𝑊(𝑡𝑗+1)−𝑊(𝑡𝑗))+Δ(𝑡𝑘)(𝑊(𝑠)−𝑊(𝑡𝑘))

which is just

=𝐼(𝑠)

Thus, we prove that the Ito integral is a martingale for all cases.

The fact that the Ito integral is a martingale is a lifesaver later int eh course. That means that 𝐼(0)=0

Ito Isometry

We will now look at the expectation of 𝐼2

𝔼[𝐼2(𝑡)]=𝔼[∫0𝑡Δ2(𝑢)𝑑𝑢]

This gives me the variance of the Ito integral. Let’s prove that this is the case.

Let’s do a slight modification of 𝐼(𝑡) for the purpose of these proofs.

𝐷𝑗={𝑊(𝑡𝑗+1)−𝑊(𝑡𝑗),for 𝑗∈{0,1,…𝑘−1}𝑊(𝑡)−𝑊(𝑡𝑘),for 𝑗=𝑘

Which we do so that we can define

𝐼(𝑡)=∑𝑗=0𝑘Δ(𝑡𝑗)𝐷𝑗

𝐼2(𝑡)=(∑𝑗=0𝑘Δ(𝑡𝑗)𝐷𝑗)(∑𝑗=0𝑘Δ(𝑡𝑗)𝐷𝑗)

I’m also going to observe at this point.

Let’s think a little about how matrices work. We could envision a matrix like this:

=∑𝑗=0𝑘Δ2(𝑡𝑗)𝐷𝑗2+2∑0≤𝑖<𝑗≤𝑘Δ(𝑡𝑖)Δ(𝑡𝑗)𝐷𝑖𝐷𝑗

Let’s think about filtrations

ℱ︀(𝑡𝑗):Δ(𝑡𝑖)Δ(𝑡𝑗)𝐷𝑖 is measurable

𝐷𝑗 is a future value and therefore is independent

We must have independence between random variables if one of them is measurable by a 𝜎-algebra and the other is independent of that 𝜎-algebra.

𝔼[𝐼𝑤(𝑡)]=𝔼[∑𝑗=0𝑘Δ2(𝑡𝑗)𝐷𝑗2]+2𝔼[∑0≤𝑖<𝑗≤𝑘Δ(𝑡𝑖)Δ(𝑡𝑗)𝐷𝑖𝐷𝑗]

We can use linearity of expectations here

=∑𝑗=0𝑘𝔼[Δ2(𝑡𝑗)]𝔼[𝐷𝑗2]+2∑0≤𝑖<𝑗≤𝑘𝔼[Δ(𝑡𝑖)Δ(𝑡𝑗)𝐷𝑖]𝔼[𝐷𝑗]

Since 𝐷𝑗 is Brownian motion, the expected value is 0 which makes that entire sum 0, and the expectation of 𝐷𝑗2 is the variance, which is known to be 𝑡

=∑𝑗=0𝑘𝔼[Δ2(𝑡𝑗)](𝑡𝑗+1−𝑡𝑗)

Let’s take it the other way with linearity

=𝔼[∑𝑗=0𝑘Δ2(𝑡𝑗)(𝑡𝑗+1−𝑡𝑗)]

What do you call it when you add up all the area of those rectangles? This is the definition of a Riemann integral! This is nearly

=𝔼[∫0𝑡Δ2(𝑢)𝑑𝑢]

Which is the variance of any Ito integral.

All we know about Δ is that it’s an adapted stochastic process, so we can’t simplify it further. But we will get one numeric value for the variance. We can further prove that this is the quadratic variation for an Ito integral.

[𝐼,𝐼](𝑡)=∫0𝑡Δ2(𝑢)𝑑𝑢

This is similar to the isometry except that it’s not the expectation. This is because variation can be a random variable. Why do these look so similar then? Let’s prove it.

Let’s say I have a partition defined as

Π={𝑡0,𝑡1,𝑡2,…,𝑡𝑘+1}

Π𝑖={𝑠0=𝑡𝑖,𝑠1,𝑠2,𝑠3,…,𝑠𝑛+1=𝑡𝑖+1}

Essentially, let’s create a new sub-partition for each partition piece.

[𝐼,𝐼](𝑡)=lim∥Π∥→0∑𝑗=0𝑚−1(𝐼(𝑡𝑗+1)−𝐼(𝑡𝑗))2

I want to note that the difference in the sum, assuming that we are in a single time partition piece, means that

=lim𝑖=0𝑘+1lim∥Π∥→0∑𝑗=0𝑛−1(𝐼(𝑠𝑗+1)−𝐼(𝑠𝑗))2

variation over entire partition is sum of variation over each sub-partition.

Let’s look just at the difference in the sum. If we expand this squared part and eliminate it, we can show the required cancellation (Open question: work through the algebra explicitly).

We know that Δ(𝑡𝑖) is going to take one value and hold it because it is a simple process.

This limit is the very definition of the quadratic variation of Brownian motion over that time piece, so we can simplify it to time.

=∑𝑖=0𝑘−1Δ2(𝑡𝑖)(𝑡𝑖+1−𝑡𝑖)

which because it’s a simple process is

=∫0𝑡Δ2(𝑢)𝑑𝑢

Keep in mind that there are no expectations because we are looking for variation not variance

Square Integrability

Very important consideration! Our Ito integrals are only going to exist if this process Δ(𝑡) is such that the variance is finite, since infinite variance is not a well-defined concept. This is known as the square-integrability condition.

Once that is satisfied, we can define Δ𝑛(𝑡) as a sequence of simple processes which together converge to a non-simple process Δ(𝑡) in this way

lim𝑛→∞𝔼[∫0𝑇|Δ𝑛(𝑡)−Δ(𝑡)|2𝑑𝑡]=0

Then I can define my Ito integral as

∫0𝑡Δ(𝑢)𝑑𝑊(𝑢)=lim𝑛→∞∫0𝑡Δ𝑛(𝑢)𝑑𝑊(𝑢)

If you can pull all this off, you get these properties:

  1. Continuity. The integral is continuous. Brownian motion is continuous, and the integral over the short interval [𝑠,𝑡] goes to zero as 𝑡 approaches 𝑠. Thus a discontinuity in the adapted integrand does not create a jump in the integral.
  2. Adaptivity: every piece is measurable
  3. Linearity: these are all just summations, so you can apply all linearity properties
  4. Martingale (proven)
  5. Ito isometry (proven)
  6. Quadratic variation (proven)

The first stochastic integral:

∫0𝑡𝑊(𝑢)𝑑𝑊(𝑢)

essentially

∫𝑥𝑑𝑥

but it does something a little weird, not just the reverse power rule.

The result of this integral is entirely due to the fact that quadratic variation is nonzero.

Next week we will prove this.