Registry Synced

Recurrence Relations

371 words
2 min read

Reading compass

Now ยท 3.1 Intuition: Defining Sequences Recursively

Recurrence Relations

3.1 Intuition: Defining Sequences Recursively

A recurrence defines each term of a sequence in terms of previous terms. The Fibonacci numbers Fn=Fnโˆ’1+Fnโˆ’2F_n = F_{n-1} + F_{n-2} are the most famous example.
๐Ÿ”‘ Key Insight: Many counting problems naturally yield recurrence relations.

3.2 Linear Homogeneous Recurrences

Form: an=c1anโˆ’1+c2anโˆ’2+โ‹ฏ+ckanโˆ’ka_n = c_1 a_{n-1} + c_2 a_{n-2} + \cdots + c_k a_{n-k} Characteristic equation: rkโˆ’c1rkโˆ’1โˆ’c2rkโˆ’2โˆ’โ‹ฏโˆ’ck=0r^k - c_1 r^{k-1} - c_2 r^{k-2} - \cdots - c_k = 0 Solution:
  • Distinct roots r1,โ€ฆ,rkr_1, \dots, r_k: an=ฮฑ1r1n+โ‹ฏ+ฮฑkrkna_n = \alpha_1 r_1^n + \cdots + \alpha_k r_k^n
  • Repeated root rr with multiplicity mm: (ฮฑ1+ฮฑ2n+โ‹ฏ+ฮฑmnmโˆ’1)rn(\alpha_1 + \alpha_2 n + \cdots + \alpha_m n^{m-1}) r^n

Example: Fibonacci

Fn=Fnโˆ’1+Fnโˆ’2F_n = F_{n-1} + F_{n-2}, F0=0F_0 = 0, F1=1F_1 = 1 Characteristic: r2โˆ’rโˆ’1=0โ€…โ€ŠโŸนโ€…โ€Šr=1ยฑ52r^2 - r - 1 = 0 \implies r = \frac{1 \pm \sqrt{5}}{2} Fn=15(ฯ•nโˆ’(โˆ’ฯ•)โˆ’n)F_n = \frac{1}{\sqrt{5}}(\phi^n - (-\phi)^{-n}) where ฯ•=1+52\phi = \frac{1+\sqrt{5}}{2}

3.3 Non-Homogeneous Recurrences

Form: an=c1anโˆ’1+โ‹ฏ+ckanโˆ’k+f(n)a_n = c_1 a_{n-1} + \cdots + c_k a_{n-k} + f(n) Solution = homogeneous solution + particular solution.

Example: an=2anโˆ’1+3a_n = 2a_{n-1} + 3, a0=1a_0 = 1

Homogeneous: an(h)=ฮฑโ‹…2na_n^{(h)} = \alpha \cdot 2^n Particular: Try constant cc: c=2c+3โ€…โ€ŠโŸนโ€…โ€Šc=โˆ’3c = 2c + 3 \implies c = -3 General: an=ฮฑโ‹…2nโˆ’3a_n = \alpha \cdot 2^n - 3, a0=1โ€…โ€ŠโŸนโ€…โ€Šฮฑ=4a_0 = 1 \implies \alpha = 4 Solution: an=4โ‹…2nโˆ’3=2n+2โˆ’3a_n = 4 \cdot 2^n - 3 = 2^{n+2} - 3

โœ… Practice Questions

Q1: Solve an=3anโˆ’1โˆ’2anโˆ’2a_n = 3a_{n-1} - 2a_{n-2}, a0=1a_0 = 1, a1=2a_1 = 2.
Solution
r2โˆ’3r+2=0โ€…โ€ŠโŸนโ€…โ€Šr=1,2r^2 - 3r + 2 = 0 \implies r = 1, 2 an=ฮฑโ‹…1n+ฮฒโ‹…2n=ฮฑ+ฮฒโ‹…2na_n = \alpha \cdot 1^n + \beta \cdot 2^n = \alpha + \beta \cdot 2^n a0=ฮฑ+ฮฒ=1a_0 = \alpha + \beta = 1, a1=ฮฑ+2ฮฒ=2โ€…โ€ŠโŸนโ€…โ€Šฮฒ=1,ฮฑ=0a_1 = \alpha + 2\beta = 2 \implies \beta = 1, \alpha = 0 an=2na_n = 2^n Q2: Solve an=4anโˆ’1โˆ’4anโˆ’2a_n = 4a_{n-1} - 4a_{n-2}, a0=0a_0 = 0, a1=2a_1 = 2. Solution
r2โˆ’4r+4=0โ€…โ€ŠโŸนโ€…โ€Š(rโˆ’2)2=0r^2 - 4r + 4 = 0 \implies (r-2)^2 = 0, repeated root r=2r=2. an=(ฮฑ+ฮฒn)โ‹…2na_n = (\alpha + \beta n) \cdot 2^n a0=ฮฑ=0a_0 = \alpha = 0, a1=(0+ฮฒ)โ‹…2=2โ€…โ€ŠโŸนโ€…โ€Šฮฒ=1a_1 = (0 + \beta) \cdot 2 = 2 \implies \beta = 1 an=nโ‹…2na_n = n \cdot 2^n Join Discord PreviousPigeonhole & Inclusion-ExclusionNextRecurrence Applications
Document outline

Keep your place and jump directly to a heading.

Table of contents

No note selected

Open a chapter to see its outline, backlinks, and sources here.