Harmonic Number
We define the n -th harmonic number as H n := 1 + 1 2 + 1 3 + + 1 n = k = 1 n 1 k
Closed form of a Geometric Summation
For any x R 1 and k N 0 n = 0 k x n = 1 x k + 1 1 x
Let S = n = 0 k x n , then x S S = x k + 1 x 0 therefore S = x k + 1 1 x 1 , so also S = 1 x k + 1 1 x by factoring -1 from the numerator and the denominator, as needed
Or instead it can be proven inductively as follows, in the base case we get n = 0 0 x n = x 0 = 1 = 1 x 1 1 x assume it holds true for j N 0 and we want to prove that it holds true for j + 1 n = 0 j + 1 x n = n = 0 j x n + x j + 1 = 1 x j + 1 1 x + x j + 1 ( 1 x ) 1 x = 1 x j + 1 + x j + 1 ( 1 x ) 1 x = 1 x j + 2 1 x as needed.
Geometric Summation with Offset
For any x R 1 and k N 0 we have n = m k x n = x m ( 1 x k m + 1 1 x )
Once we've proven the generalized factoring for arbitrary sums then we have n = m k x n = x m ( n = 0 k m + 1 x n ) = x m ( 1 x k m + 1 1 x )

Note that when x = 1 the sum simply yields k + 1 .

Series
Given a sequence ( a n ) n = 1 and defining S k = i = 1 k a k then we define i = 0 a i := lim n S n

Note that because it is defined as a limit we can ask if i = 0 a n converges or not.

Harmonic Series Diverges
n = 1 1 n diverges to
We claim that S 2 k k + 2 2 = k 2 + 1 for all k N 0 , for the base case we see that S 2 0 = S 1 = 1 1 0 2 + 1 so it holds true, now suppose its true for some j N 0 we want to prove that S 2 j + 1 j + 1 2 + 1 S 2 k + 1 = S 2 k + m = 2 k + 1 2 k + 1 1 m ( k 2 + 1 ) + m = 2 k + 1 2 k + 1 1 m ( k 2 + 1 ) + m = 2 k + 1 2 k + 1 1 2 k + 1 ( k 2 + 1 ) + m = 2 k + 1 2 k + 1 1 2 k + 1 = ( k 2 + 1 ) + 2 k ( 1 2 k + 1 ) = ( k 2 + 1 ) + 1 2 = k + 1 2 + 1 Thus since S 2 k k 2 + 1 and lim k k 2 + 1 = then we know that k S 2 k = and thus since a subsequence S n diverges then we know that S n diverges
Geometric Power Series
for | x | < ; 1 we have n = 0 x n = 1 1 x

By definition we know that n = 0 x n = lim k n = 0 k x n = lim k 1 x k + 1 1 x

exponent limit lemma if | x | < ; 1 then lim k x k + 1 becomes zero and we get lim k 1 x k + 1 1 x = 1 1 x
Geometric Power Series with Offset
For | x | < 1 we have n = m x n = x m 1 x
By the geometric summation with offset we know that n = m x n = lim k x m ( 1 x k m + 1 1 x ) = x m 1 x
Series of Halves is Bounded
n = 0 1 2 n = 1 1 1 2 = 2
In the above proposition take x = 1 2 .
geometric sum with incrementing factor
Given t R 0 , the following holds: i = 1 n i t i = t 1 t n ( 1 t ) 2 n t n + 1 1 t
We want to find the sum defined by
S ( t ) := t + 2 t 2 + 3 t 3 + + ( n 1 ) t n 1 + n t n ,
But then we know that
t S ( t ) = t 2 + 2 t 3 + 3 t 4 + + ( n 1 ) t n + n t n + 1
S ( t ) t S ( t ) = t + t 2 + t 3 + + t n n t n + 1
( 1 t ) S ( t ) = t + t 2 + t 3 + + t n n t n + 1
Now since we know that t + t 2 + t 3 + + t n = t 1 t n 1 t , then we have
( 1 t ) S ( t ) = t 1 t n 1 t n t n + 1
S ( t ) = t 1 t n 1 t n t n + 1 1 t
S ( t ) = t 1 t n ( 1 t ) 2 n t n + 1 1 t
geometric series with incrementing factor
Suppose that | t | < 1 , then i = 1 i t i = t ( 1 t ) 2

We know that i = 1 i t i = lim n i = 1 n i t i = lim n t 1 t n ( 1 t ) 2 n t n + 1 1 t

Now since | t | < 1 , then lim n t n = 0 and lim n n t n + 1 = 0 , therefore lim n t 1 t n ( 1 t ) 2 n t n + 1 1 t = t ( 1 t ) 2 as needed.

Convergent Series Implies Sequence goes to Zero
If n = 1 a n is convergent then lim n a n = 0
Let ( S n ) n = 1 be so defined such that S n = i = 0 n a i , observe that S n S n 1 = a n for all n 2 so then lim n a n = lim n ( s n s n 1 ) = lim n s n lim n s n 1 = 0
Cauchy Criterion for Series
Suppose that n = 1 a n is a series, then the following are equivalent:
  1. The series converges
  2. ϵ R + , N N 0  st  n N 0 , n N | k = n + 1 a k | < ϵ
  3. ϵ R + , N N 0  st  n , m N 0 , n , m N | k = n + 1 m a k | < ϵ

We start by proving that 1 2 so assume that series converges. Let S n := k = 1 n a k be the sequence of partial sums, therefore we know that for any ϵ there is an N N 0 such that for all n N , | S n L | < ϵ , note that L S n = ( lim m S m ) S n = lim m ( S m S n ) = lim m k = n + 1 m a k = k = n + 1 a k then it follows that | k = n + 1 a k | = | S n L | < ϵ as needed.


Now we'll prove that 2 3 so to show this is true, let ϵ R + therefore by considering ϵ 2 in our assumption we get an N N 1 such that for any n N we have that | k = n + 1 a k | ϵ 2

Now let a , b N and we'll prove that | k = a + 1 b a k | < ϵ , to do this note the following | k = a + 1 b a k | = | k = a + 1 b a k + k = b + 1 a k k = b + 1 a k | = | k = a + 1 a k k = b + 1 a k | | k = a + 1 a k | + | k = b + 1 a k | < ϵ 2 + ϵ 2 = ϵ as needed.


We'll prove that 3 1 , since we assume 3 and use the notation for S n as the partial sums, then we can see that | k = n + 1 m | = | S m S n | and thus assuming 3 is the same as assuming that S n is cauchy, but we know that any cauchy sequence is convergent and thus S n converges, which shows that n = 1 a n converges.

Note that 2 informally says that tails converge and are arbitrarily small, and 3 essentially says that S n is a cauchy sequence because k = n + 1 m a k = S m S n

Summable
We say that the sequence ( a n ) is summable if the limit n = 1 a n exists.
Comparison Test
Consider two sequences of real numbers ( a n ) , ( b n ) : N 1 R with | a n | b n for all n N 1 , then if ( b n ) is summable then ( a n ) is summable and | n = 1 a n | n = 1 b n while if ( a n ) is not summable, then ( b n ) is not summable.
Assume our hypothesis, and we'll show that ( a n ) is summable, to do this we'll use 2 of the cauchy criterion, so let ϵ R + , also since ( b n ) is summable, by 3 of the cauchy criterion we obtain some N N 1 such that for any n , m N we have | k = n + 1 m b k | < ϵ , but recall the inequalities we've assumed between ( a n ) , ( b n ) , which shows us that | k = n + 1 m a k | n = k + 1 m | a k | k = n + 1 m b k < ϵ The first follows from the generalized triangle inequality, the second follows from our assumed inequality. Thus ( a n ) is summable.
Suppose that ( a n ) is not summable, we'll show that ( b n ) is not summble, for if it were then by part one of the proof then ( a n ) would be which is a contradiction.
If the Absolute Valued Series Converges then so does the Original
If n = 1 | a n | converges then so does n = 1 a n
Clearly | a n | | a n | for all n N 1 thus by considering b n = | a n | in the comparison test we have that ( a n ) is summable.
Non-Negative Series Converges iff Partial Sums are Bounded Above
Suppose that a n 0 for every n N 1 , then ( a n ) is summable iff ( S n ) is bounded above, where S k := n = 1 k a n

We required that a n 0 because if you consider the series n = 1 ( 1 ) ( n + 1 ) that has a sequence of partial sums of the form 1 , 0 , 1 , 0 , 1 , 0 , which is clearly bounded but the limit doesn't exist.

Monotone Increasing Sequence with a Subsequence which is Bounded Above Implies Entire Sequence is Bounded Above
Suppose that ( a n ) is monotone increasing, and there is some subsequence ( a σ ( n ) ) that is bounded above, then ( a n ) is bounded above.
Cauchy Condensation Test
Suppose that ( a n ) : N 1 R + is monotone decreasing then n = 1 a n < n = 0 2 n a 2 n <
Let's define S n = k = 1 n a k and T n = k = 0 n 2 k a 2 k .

Assume that n = 0 2 n a 2 n converges, which by definition means that ( T n ) converges and is therefore bounded above, which means there is some M such that for any i N 0 , T i M , we'll use this fact to show that ( S n ) is bounded above by showing that it has a subsequence which is bounded above. Namely we will prove that S 2 n 1 t n 1 M

Base case n = 1 , S 2 1 1 = S 1 = a 1 = 2 0 a 2 0 = T 0 M as needed. Now asssume that it holds true for n N 1 , which is to say that S 2 n 1 T n 1 M and now let's prove that S 2 n + 1 1 T n M

Note that in the induction step the following fact will be useful, which says for any n N 1 we have that T n T n 1 = 2 n a 2 n Now continuing on, we note the following

S 2 n + 1 1 = S 2 n 1 + i = 2 n 2 n + 1 1 a i T n 1 + i = 2 n 2 n + 1 1 a i T n 1 + 2 n a 2 n = T n 1 + ( T n T n 1 ) = T n M Note that going from the second line to the third comes from the fact that ( a n ) is decreasing which means for any x { 2 n , , 2 n + 1 1 } that a 2 n a x additionally the the size of that set is 2 n + 1 1 2 n + 1 = 2 n ( 2 1 ) = 2 n , which allow us to upper bound that summation by 2 n a 2 n , which shows the induction step true. Thus we've proven that S n is bounded above, and so by the MCT it converges which is to say that n = 1 a n <

Now let's assume that n = 0 2 n a 2 n converges, and show that the other one does as well, we'll follow a similar structure that in we show that T n is bounded above. Specifically we will show that a 1 + 2 i = 2 2 n a n T n Since ( S n ) is bounded above by some M R then by adding a 1 to both sides we obtain 2 S 2 n a 1 + T n which is to say that 2 M a 1 + T n which shows that T n is bounded above, and since it is increasing we would know that it converges by the MCT.

For the base case of n = 0 we have a 1 + 2 a 2 a 1 = T 0 so it holds true. Now let n N 0 and suppose that a 1 + 2 i = 2 2 n a n T n we need to prove that a 1 + 2 i = 2 2 n + 1 a n T n + 1 , then notice that a 1 + 2 i = 2 2 n + 1 a n = a 1 + 2 i = 2 2 n a n + 2 i = 2 n + 1 2 n + 1 a n T n + 2 i = 2 n + 1 2 n + 1 a n T n + 2 ( 2 n a 2 n + 1 ) = T n + 2 n + 1 a 2 n + 1 = T n + ( T n + 1 T n ) = T n + 1 In this case the 3rd line follows by a similar argument to the previous induction step, but this team using the fact that for all x { 2 n + 1 , , 2 n + 1 } we have a x a 2 n + 1 because ( a n ) is monotone decreasing.

One over N to the p Convergence iff p is greater than One
n = 1 1 n p < p 1
Recall that n = 1 1 n p converges iff n = 0 2 n 1 ( ( 2 n ) p ) = n = 0 2 n n p = n = 0 ( 2 1 p ) n which converges iff 2 ( 1 p ) ( 1 , 1 ) since 2 ( 1 p ) is always positive then we just need 2 ( 1 p ) < 1 which is the same as 1 p < log 2 ( 1 ) = 0 which is equivalent to 1 < p
Root Test
Suppose that a n 0 for all n N 1 and let l = lim sup ( a n n ) if l < 1 then n = 1 a n converges and if l > 1 then n = 1 diverges
Suppose everything in the hypothesis is true, let's prove that n = 1 a n converges. Clearly we can pick an r ( l , 1 ) since l < 1 and since lim sup ( a n n ) = l by using ϵ = r l R + , then we know that there is some N N 1 such that for all n N we have | sup ( { a k k : k n } ) l | < ϵ since a n n { a k k : k n } then we must have a n n sup ( { a k k : k n } ) as it's an upper bound, thus | a n n l | < | sup ( { a k k : k n } ) l | < ϵ so that a n n < l + ϵ = l + ( r l ) = r , in other words a n < r n for all n N , then we construct the sequence by
  • b n := a n for n [ 1 , N 1 ]
  • b n := r n if n N
thus by construction we have | a k | = a k b k for all k N 1 moreover we can confirm that ( b n ) is summable directly as n = 1 b n = n = 1 N 1 b n + n = N r n = n = 1 N 1 b n + r N 1 r the final equality comes from a geometric series with an offset since the right hand side is the sum of two finite things then ( b n ) is summable and thus by the comparison test we conclude that n = 1 a n converges.
Now suppose that
Ratio Test
Suppose that ( a n ) n = 1 is a sequence of positive terms. Show that if lim sup n a n + 1 a n < 1 then n = 1 a n converges
Alternating Sequence
A sequence is alternating if it has the form ( 1 ) n a n or ( 1 ) ( n + 1 ) a n where a n 0 for all n N 1 .

This characterization simply states that consecutive terms change sign.

Alternating Series
A series n = 1 a n is said to be alternating if ( a n ) is alternating.
Leibniz Alternating Series Test
Suppose that ( a n ) : N 1 R is a monotone decreasing sequence and lim n a n = 0 then the alternating series n = 1 ( 1 ) n a n converges
Absolutely Convergent Series
A series n = 1 a n is said to be absolutely convergent if the series n = 1 | a n | converges.
Conditionally Convergent Series
A series n = 1 a n is said to be conditionally convergent if it converges but n = 1 a n does not.

Recall that n = 1 ( 1 ) n + 1 n converges to ln ( 2 ) and is conditionally convergent because the harmonic series diverges.

Series Rearrangement
A rearrangment of a series n = 1 is another series n = 1 a π ( n ) where π is a permutation of N 1

The above definition formalizes the idea of taking a series and then looking at it with the same terms in a different order. Also note that the definition of a series is the limit of the partial sums, which is an entirely different thing than the + operation, thus we have no idea whether or not the new series will have the same limit, or even exist.

Every Rearrangment of an Absolutely Convergent Series converges to the same Limit
As per title.