• mathematics

Properties of Limits

With both a conceptual and rigorous understanding of limits, it’s time to practice with them. Limits have certain properties that make computing much easier. These can be intuitively memorized, but proofs with the epsilon-delta definitions will be provided and they’re worth reading through. To be rigorous, each identity only holds true if the all limits mentioned in it exist (you’d have a hard time plugging in nonexistent values).

Note that section titles in this chapter are the names I’ve given to each property, not recognized terms. Also, most pedagogy I’ve read presents these as an enumeration of facts to memorize, but even without delta-epsilon, these can be understood very easily with a simple visualization. As an aid, figures are included.

The constant property

The first property is very simple. When dealing with a horizontal line, the limit as xx approaches any value is the single output value of the function. Fig. 1 illustrates a function in this form, y=2.y = 2\text{.}

1980-01-01T00:00:00+00:00 image/svg+xml Matplotlib v3.11.0, https://matplotlib.org/
Fig. 1: Constant function

We can formalize this observation with the notation:

lim⁡x→ac=c\lim\limits_{x \to a} c = c

Given that cc is a constant, the limit as xx approaches any real aa is c.c\text{.} With a positive ε,\varepsilon\text{,} first notate f(x)=c.f(x) = c\text{.} We need to find a positive δ\delta such that

0<∣x−a∣<δ  ⟹  ∣f(x)−c∣<ε0 < |x - a| < \delta \implies |f(x) - c| < \varepsilon

Choosing any δ\delta at all, δ=1\delta = 1 for example, f(x)f(x) does not change from cc for all x.x\text{.} Therefore, ∣f(x)−c∣=0,|f(x) - c| = 0\text{,} and since ε>0,\varepsilon > 0\text{,} ∣f(x)−c∣<ε.|f(x) - c| < \varepsilon\text{.} □\square

The addition property

When one function’s outputs are defined as the sum of the outputs of two other functions, the limit of this function at any input value is the sum of the limits of the two functions. Fig. 2 illustrates this with an orange and green function, as well as their sum in dashed green.

1980-01-01T00:00:00+00:00 image/svg+xml Matplotlib v3.11.0, https://matplotlib.org/
Fig. 2: Sum of functions

Since the limits exist at x=4,x = 4\text{,} every output near that x-value behaves as if the hole didn’t exist. You can think of this as simply adding the existing surrounding output values, which would give the dashed green function a hole at the sum of the two others. This property can be formally notated as

lim⁡x→a[f(x)+g(x)]=lim⁡x→af(x)+lim⁡x→ag(x)\lim\limits_{x \to a} [f(x) + g(x)] = \lim\limits_{x \to a} f(x) + \lim\limits_{x \to a} g(x)

To prove this, we’ll use the delta-epsilon definition of limits again. First notate each limit separately:

lim⁡x→af(x)=L,lim⁡x→ag(x)=M\lim\limits_{x \to a} f(x) = L, \quad \lim\limits_{x \to a} g(x) = M

Now for any ε>0,\varepsilon > 0\text{,} we must prove that there exists a δ>0\delta > 0 such that

0<∣x−a∣<δ  ⟹  ∣[f(x)+g(x)]−(L+M)∣<ε0 < |x - a| < \delta \implies |[f(x) + g(x)] - (L + M)| < \varepsilon

We can now split the desired inequality into two terms and prove each one below ε/2.\varepsilon / 2\text{.} First, lim⁡x→af(x)=L\lim\limits_{x \to a} f(x) = L means there exists a δ1\delta_1 such that

0<∣x−a∣<δ1  ⟹  ∣f(x)−L∣<ε20 < |x - a| < \delta_1 \implies |f(x) - L| < \frac{\varepsilon}{2}

The other limit, lim⁡x→ag(x)=M,\lim\limits_{x \to a} g(x) = M\text{,} means there exists a δ2\delta_2 such that

0<∣x−a∣<δ2  ⟹  ∣g(x)−M∣<ε20 < |x - a| < \delta_2 \implies |g(x) - M| < \frac{\varepsilon}{2}

If we now let δ=min⁡(δ1,δ2),\delta = \min(\delta_1, \delta_2)\text{,} we will have both ∣f(x)−L∣|f(x) - L| and ∣g(x)−M∣|g(x) - M| less than ε/2.\varepsilon / 2\text{.} Rearrange our desired inequality to get terms we want:

∣[f(x)+g(x)]−(L+M)∣=∣(f(x)−L)+(g(x)−M)∣<ε|[f(x) + g(x)] - (L + M)| = |(f(x) - L) + (g(x) - M)| < \varepsilon

By the triangle inequality:

∣(f(x)−L)+(g(x)−M)∣≤∣f(x)−L∣⏟under half of ε+∣g(x)−M∣⏟under half of ε<ε|(f(x) - L) + (g(x) - M)| \leq \underbrace{|f(x) - L|}_{\text{under half of } \varepsilon} + \underbrace{|g(x) - M|}_{\text{under half of } \varepsilon} < \varepsilon

Since we have demonstrated that for every ε>0,\varepsilon > 0\text{,} there exists a δ=min⁡(δ1,δ2)>0\delta = \min(\delta_1, \delta_2) > 0 such that

0<∣x−a∣<δ  ⟹  ∣[f(x)+g(x)]−(L+M)∣<ε0 < |x - a| < \delta \implies |[f(x) + g(x)] - (L + M)| < \varepsilon

proving the property. □\square

The product property

The next property is that the limit of the product of two functions is the product of the limits of each function. Take a look at Fig. 3, which shows two functions and their product.

1980-01-01T00:00:00+00:00 image/svg+xml Matplotlib v3.11.0, https://matplotlib.org/
Fig. 3: Two functions and their product

The blue function is linear, the orange function is exponential, and the dashed green function is the product of the first two. As indicated by the open circles, the blue and orange functions are undefined for x=2.x = 2\text{.} Therefore, the function defined by the product of their outputs also is undefined at x=2.x = 2\text{.}

To understand this property intuitively, you can find the limit as xx approaches 22 of the green function by multiplying the approached output values of the orange and blue functions, since each graph functions as if no hole existed in the surrounding domain, excluding 22 itself.

Expressing this property formally in notation:

lim⁡x→a[f(x)g(x)]=lim⁡x→af(x)lim⁡x→ag(x)\lim\limits_{x \to a} [f(x) g(x)] = \lim\limits_{x \to a} f(x) \lim\limits_{x \to a} g(x)

To prove this, first let

lim⁡x→af(x)=L,lim⁡x→ag(x)=M\lim\limits_{x \to a} f(x) = L, \quad \lim\limits_{x \to a} g(x) = M

We want to prove for any ε>0\varepsilon > 0 that there exists a δ\delta such that

0<∣x−a∣<δ  ⟹  ∣f(x)g(x)−LM∣<ε0 < |x - a| < \delta \implies |f(x) g(x) - L M| < \varepsilon

Right now, we’re working with

∣f(x)g(x)−LM∣<ε|f(x) g(x) - L M| < \varepsilon

and we want to introduce expressions for each of our separate limits. To do this, add a net-zero expression.

∣f(x)g(x)−L⋅g(x)+L⋅g(x)⏟Net zero−LM∣<ε|f(x) g(x) \underbrace{- L \cdot g(x) + L \cdot g(x)}_{\text{Net zero}} - L M| < \varepsilon

Now we factor:

∣g(x)(f(x)−L)+L(g(x)−M)∣|g(x) (f(x) - L) + L (g(x) - M)|

By the triangle inequality we know

∣g(x)(f(x)−L)+L(g(x)−M)∣≤∣g(x)(f(x)−L)∣+∣L(g(x)−M)∣|g(x) (f(x) - L) + L (g(x) - M)| \leq |g(x) (f(x) - L)| + |L (g(x) - M)|

The expression on the right is equivalent to

∣g(x)∣∣f(x)−L∣+∣L∣∣g(x)−M∣|g(x)| |f(x) - L| + |L| |g(x) - M|

Our goal is now to prove each term to be less than ε/2,\varepsilon / 2\text{,} because this necessitates that their sum is under ε.\varepsilon\text{.} The factor of ∣g(x)∣|g(x)| in the first term is a complication, because we can’t guarantee predict both how ∣f(x)−L∣|f(x) - L| and ∣g(x)∣|g(x)| behave at the same time in order to control their product. By the delta-epsilon definition, setting ε=1,\varepsilon = 1\text{,} there exists a δ1>0\delta_1 > 0 such that

0<∣x−a∣<δ1  ⟹  ∣g(x)−M∣<10 < |x - a| < \delta_1 \implies |g(x) - M| < 1

By triangle inequality:

∣g(x)∣=∣g(x)−M+M∣≤∣g(x)−M∣+∣M∣<1+∣M∣|g(x)| = |g(x) - M + M| \leq |g(x) - M| + |M| < 1 + |M|

Our goal is

∣g(x)∣∣f(x)−L∣<ε2|g(x)| |f(x) - L| < \frac{\varepsilon}{2}

Substitute ∣g(x)∣<∣M∣+1|g(x)| < |M| + 1 to get

∣f(x)−L∣(∣M∣+1)<ε2  ⟹  ∣f(x)−L∣<ε2(∣M∣+1)|f(x) - L| (|M| + 1) < \frac{\varepsilon}{2} \implies |f(x) - L| < \frac{\varepsilon}{2(|M| + 1)}

To prove this true, start with the delta-epsilon definition of a limit. lim⁡x→af(x)=L\lim\limits_{x \to a} f(x) = L means there exists a δ2>0\delta_2 > 0 such that

0<∣x−a∣<δ2  ⟹  ∣f(x)−L∣<ε2(∣M∣+1)0 < |x - a| < \delta_2 \implies |f(x) - L| < \frac{\varepsilon}{2(|M| + 1)}

Since we now have

∣f(x)−L∣<ε2(∣M∣+1)|f(x) - L| < \frac{\varepsilon}{2(|M| + 1)}

we multiply both sides by ∣g(x)∣<∣M∣+1|g(x)| < |M| + 1 (since both terms on the left are nonnegative) and the following inequality is proven true:

∣g(x)∣∣f(x)−L∣<ε2|g(x)| |f(x) - L| < \frac{\varepsilon}{2}

Our next goal is proving

∣L∣∣g(x)−M∣<ε2|L| |g(x) - M| < \frac{\varepsilon}{2}

This is simpler since ∣L∣|L| is a constant. However, we now have to consider the case L=0,L = 0\text{,} which prohibits division. Case A will assume L≠0L \neq 0 and Case B will assume L=0.L = 0\text{.}

In Case A, we want

∣L∣∣g(x)−M∣<ε2  ⟹  ∣g(x)−M∣<ε2∣L∣|L| |g(x) - M| < \frac{\varepsilon}{2} \implies |g(x) - M| < \frac{\varepsilon}{2 |L|}

Now, by definition of lim⁡x→ag(x)=M,\lim\limits_{x \to a} g(x) = M\text{,} there exists a δ3>0\delta_3 > 0 such that

0<∣x−a∣<δ3  ⟹  ∣g(x)−M∣<ε2∣L∣0 < |x - a| < \delta_3 \implies |g(x) - M| < \frac{\varepsilon}{2 |L|}

Multiplying both sides by ∣L∣|L| yields our desired result of

∣L∣∣g(x)−M∣<ε2|L| |g(x) - M| < \frac{\varepsilon}{2}

In Case B, we have L=∣L∣=0.L = |L| = 0\text{.} Given that ε>0,\varepsilon > 0\text{,} the following is trivial:

0⋅∣g(x)−M∣=0<ε20 \cdot |g(x) - M| = 0 < \frac{\varepsilon}{2}

Now that we’ve covered δ1,δ2,δ3\delta_1, \delta_2, \delta_3 such that if xx is less than all of them, we can guarantee

∣g(x)∣∣f(x)−L∣⏟under half of ε+∣L∣∣g(x)−M∣⏟under half of ε<ε\underbrace{|g(x)| |f(x) - L|}_{\text{under half of } \varepsilon} + \underbrace{|L| |g(x) - M|}_{\text{under half of } \varepsilon} < \varepsilon

Let δ=min⁡(δ1,δ2,δ3)\delta = \min(\delta_1, \delta_2, \delta_3) in order to satisfy all tolerances. Then for all 0<∣x−a∣<δ0 < |x - a| < \delta it is true that

∣f(x)g(x)−LM∣≤∣g(x)∣∣f(x)−L∣+∣L∣∣g(x)−M∣<ε|f(x) g(x) - L M| \leq |g(x)| |f(x) - L| + |L| |g(x) - M| < \varepsilon

which concludes the proof. □\square

The exponent property

Note that from the product property, we can get another property for free:

lim⁡x→a[f(x)]n=[lim⁡x→af(x)]n\lim\limits_{x \to a} [f(x)]^n = [\lim\limits_{x \to a} f(x)]^n

Intuitively, the limit of any function to a power nn is equal to the limit of the function raised to n.n\text{.} This is because raising the function to the power of n+1n + 1 is the same as multiplying the function by the function raised to the power of n.n\text{.} A rigorous proof is easily done through induction.

The base case is n=1.n = 1\text{.} Raising anything to the power of 11 leaves it unchanged:

lim⁡x→a[f(x)]1=[lim⁡x→af(x)]1\lim\limits_{x \to a} [f(x)]^1 = [\lim\limits_{x \to a} f(x)]^1

Assume now that the property holds true for n.n\text{.} This means that

lim⁡x→a[f(x)]n=[lim⁡x→af(x)]n\lim\limits_{x \to a} [f(x)]^n = [\lim\limits_{x \to a} f(x)]^n

Apply the product property with the factor lim⁡x→af(x)\lim\limits_{x \to a} f(x) to both sides:

lim⁡x→a[f(x)n⋅f(x)]=[lim⁡x→af(x)]n⋅lim⁡x→af(x)lim⁡x→a[f(x)]n+1=[lim⁡x→af(x)]n+1\begin{gathered} \lim\limits_{x \to a} [f(x)^n \cdot f(x)] = [\lim\limits_{x \to a} f(x)]^n \cdot \lim\limits_{x \to a} f(x) \\[1em] \lim\limits_{x \to a} [f(x)]^{n + 1} = [\lim\limits_{x \to a} f(x)]^{n + 1} \end{gathered}

Which means the formula holds for n+1n + 1 given that it does for n.n\text{.} Since we’ve proven the base case n=1,n = 1\text{,} the property holds for all positive integers n.n\text{.} □\square

The scalar multiple property

With the product and constant properties proven, the next property can be done without a separate delta-epsilon proof. This property states that the limit of a function multiplied by a constant is the constant multiplied by the limit of the function. In notation, let cc be a constant and lim⁡x→af(x)=L.\lim\limits_{x \to a} f(x) = L\text{.} The scalar multiple property states that

lim⁡x→a[c⋅f(x)]=c⋅lim⁡x→af(x)\lim\limits_{x \to a} [c \cdot f(x)] = c \cdot \lim\limits_{x \to a} f(x)

By the product property, we know

lim⁡x→a[c⋅f(x)]=lim⁡x→aclim⁡x→af(x)\lim\limits_{x \to a} [c \cdot f(x)] = \lim\limits_{x \to a} c \lim\limits_{x \to a} f(x)

The constant property states that lim⁡x→ac=c,\lim\limits_{x \to a} c = c\text{,} so substitution yields

lim⁡x→a[c⋅f(x)]=c⋅lim⁡x→af(x)\lim\limits_{x \to a} [c \cdot f(x)] = c \cdot \lim\limits_{x \to a} f(x)

and the property is proved. □\square

The reciprocal property

This property has a self-explanatory name. The limit of a function’s reciprocal is the reciprocal of the limit. Let lim⁡x→af(x)=L.\lim\limits_{x \to a} f(x) = L\text{.} Obviously, since LL appears in the denominator, this property assumes L≠0.L \neq 0\text{.}

lim⁡x→a1f(x)=1L\lim\limits_{x \to a} \frac{1}{f(x)} = \frac{1}{L}

By delta-epsilon, we need to prove that for any ε>0,\varepsilon > 0\text{,} there exists a δ>0\delta > 0 such that

0<∣x−a∣<δ  ⟹  ∣1f(x)−1L∣<ε0 < |x - a| < \delta \implies \left|\frac{1}{f(x)} - \frac{1}{L}\right| < \varepsilon

We can find a common denominator:

∣1f(x)−1L∣=∣L−f(x)f(x)L∣=∣f(x)−L∣∣f(x)∣∣L∣\left|\frac{1}{f(x)} - \frac{1}{L}\right| = \left|\frac{L - f(x)}{f(x) L}\right| = \frac{|f(x) - L|}{|f(x)| |L|}

Now we would like to bound the ∣f(x)∣|f(x)| in the denominator. Since we know lim⁡x→af(x)=L,\lim\limits_{x \to a} f(x) = L\text{,} we can use the delta-epsilon with an epsilon defined as half of ∣L∣:|L|\text{:}

0<∣x−a∣<δ1  ⟹  ∣f(x)−L∣<∣L∣20 < |x - a| < \delta_1 \implies |f(x) - L| < \frac{|L|}{2}

By the triangle inequality:

∣L∣=∣L−f(x)+f(x)∣≤∣L−f(x)∣+∣f(x)∣∣f(x)∣≥∣L∣−∣L−f(x)∣\begin{gathered} |L| = |L - f(x) + f(x)| \leq |L - f(x)| + |f(x)| \\[1em] |f(x)| \geq |L| - |L - f(x)| \end{gathered}

Since we know ∣L−f(x)∣=∣f(x)−L∣<∣L∣2|L - f(x)| = |f(x) - L| < \frac{|L|}{2}

∣f(x)∣≥∣L∣−∣L−f(x)∣>∣L∣−∣L∣2=∣L∣2|f(x)| \geq |L| - |L - f(x)| > |L| - \frac{|L|}{2} = \frac{|L|}{2}

Substituting this inequality into our expression yields

∣f(x)−L∣∣f(x)∣∣L∣<∣f(x)−L∣(∣L∣2)⋅∣L∣=2∣f(x)−L∣∣L∣2\frac{|f(x) - L|}{|f(x)| |L|} < \frac{|f(x) - L|}{\left(\frac{|L|}{2}\right) \cdot |L|} = \frac{2 |f(x) - L|}{|L|^2}

Recall that we wanted this value to be less than ε:\varepsilon\text{:}

2∣f(x)−L∣∣L∣2<ε  ⟹  2∣f(x)−L∣<ε∣L∣2  ⟹  ∣f(x)−L∣<ε∣L∣22\frac{2 |f(x) - L|}{|L|^2} < \varepsilon \implies 2 |f(x) - L| < \varepsilon |L|^2 \implies |f(x) - L| < \frac{\varepsilon |L|^2}{2}

Because lim⁡x→af(x)=L,\lim\limits_{x \to a} f(x) = L\text{,} we can simply set the vertical tolerance to ε∣L∣22,\frac{\varepsilon |L|^2}{2}\text{,} meaning that there must exist a δ2\delta_2 such that

0<∣x−a∣<δ2  ⟹  ∣f(x)−L∣<ε∣L∣220 < |x - a| < \delta_2 \implies |f(x) - L| < \frac{\varepsilon |L|^2}{2}

If we now set δ=min⁡(δ1,δ2),\delta = \min(\delta_1, \delta_2)\text{,} both conditions hold:

∣f(x)∣>∣L∣2  ⟹  1∣f(x)∣<2∣L∣,∣f(x)−L∣<ε∣L∣22|f(x)| > \frac{|L|}{2} \implies \frac{1}{|f(x)|} < \frac{2}{|L|}, \quad |f(x) - L| < \frac{\varepsilon |L|^2}{2}

Now substitute into the original expression:

∣1f(x)−1L∣=∣f(x)−L∣∣f(x)∣∣L∣<2∣L∣⋅ε∣L∣22∣L∣=ε\left|\frac{1}{f(x)} - \frac{1}{L}\right| = \frac{|f(x) - L|}{|f(x)| |L|} < \frac{2}{|L|} \cdot \frac{\frac{\varepsilon |L|^2}{2}}{|L|} = \varepsilon

which completes the delta-epsilon proof. □\square

The quotient property

This is the last limit property covered in this chapter. The product and quotient properties have similar structures, with the latter stating that the limit of the quotient of two functions is equal to the quotient of the limits of each function. Of course, this assumes that the denominator is nonzero.

Intuitively, you can understand this in the same way. Since every output value surrounding the hole functions normally, a function defined as the quotient of two others will have its hole in an appropriate place. In notation, for lim⁡x→af(x)=L\lim\limits_{x \to a} f(x) = L and lim⁡x→ag(x)=M:\lim\limits_{x \to a} g(x) = M\text{:}

lim⁡x→af(x)g(x)=lim⁡x→af(x)lim⁡x→ag(x)=LM\lim\limits_{x \to a} \frac{f(x)}{g(x)} = \frac{\lim\limits_{x \to a} f(x)}{\lim\limits_{x \to a} g(x)} = \frac{L}{M}

This comes trivially since we’ve already established the product and reciprocal rules. We know, by the basic rules of fractions:

lim⁡x→af(x)g(x)=lim⁡x→a[f(x)⋅1g(x)]\lim\limits_{x \to a} \frac{f(x)}{g(x)} = \lim\limits_{x \to a} \left[f(x) \cdot \frac{1}{g(x)}\right]

By the product property:

lim⁡x→a[f(x)⋅1g(x)]=lim⁡x→af(x)⋅lim⁡x→a1g(x)\lim\limits_{x \to a} \left[f(x) \cdot \frac{1}{g(x)}\right] = \lim\limits_{x \to a} f(x) \cdot \lim\limits_{x \to a} \frac{1}{g(x)}

Applying the reciprocal property:

lim⁡x→af(x)⋅lim⁡x→a1g(x)=lim⁡x→af(x)⋅1lim⁡x→ag(x)=lim⁡x→af(x)lim⁡x→ag(x)\lim\limits_{x \to a} f(x) \cdot \lim\limits_{x \to a} \frac{1}{g(x)} = \lim\limits_{x \to a} f(x) \cdot \frac{1}{\lim\limits_{x \to a} g(x)} = \frac{\lim\limits_{x \to a} f(x)}{\lim\limits_{x \to a} g(x)}

which proves the quotient property. □\square

In this chapter, we covered the bulk of what one needs to know when manipulating limits. Next, we’ll be contextualizing the limit with the concept of continuity, which is perhaps the most important thing the limit section has to offer. That’s all for the properties of limits. Zai jian.