Vector Spaces: Definition & Properties
2330 words
12 min read
Visual companion
Python
Type and operator map
Python Week 1: the first filter for runtime behavior
View
Revision summary
What this note is really saying
Short form
# Vector Spaces: Definition & Properties ## 🎯 Learning Objectives After this topic you will be able to: - State the eight vector space axioms - Determine whether a given set with operations is a vector space - Prove simple properties from the axioms - Recognise $\mathbb{R}^n$, $\mathbb{R}^{m \times n}$, and polynom...

Vector Spaces: Definition & Properties
🎯 Learning Objectives
After this topic you will be able to:
- State the eight vector space axioms
- Determine whether a given set with operations is a vector space
- Prove simple properties from the axioms
- Recognise Rn, Rm×n, and polynomial spaces as vector spaces
- Identify when a set fails to be a vector space
📋 Prerequisites
- Vectors Introduction (Week 1) — vector operations in Rn
- Matrices Introduction (Week 1) — matrix algebra
- Basic set notation — set membership ∈, subset ⊆, set builder {x∣condition}
- Vector spaces are the universe in which all of linear algebra takes place
1. Intuition: What Makes a "Space"?
1.1 The Big Idea
Up to now, you've worked with vectors in R2, R3, and Rn. But vectors don't have to be n-tuples. A vector could be a polynomial p(x)=a0+a1x+a2x2, or a matrix
, or even a function like sin(x).
The key question is:
Can we add two things of this type? Can we multiply one by a scalar? If the answer is yes and the operations behave nicely (commute, associate, distribute), then the set is a vector space. The eight axioms below capture this "nice behaviour" precisely. They are the rules of the game for linear algebra. (Diagram)
1.2 Why Axioms?
Axioms let us prove theorems that apply to all vector spaces at once. When we prove "every vector space has a basis" (Week 4), it applies to polynomials, matrices, and Rn simultaneously — we don't need separate proofs for each.
2. The Eight Axioms
Definition (Vector Space). A vector space V over the real numbers R is a set equipped with two operations:
- Addition: +:V×V→V (maps two vectors to a vector)
- Scalar multiplication: ⋅:R×V→V (maps a scalar and a vector to a vector)
satisfying the following eight axioms for all u,v,w∈V and all a,b∈R:
| # | Axiom | Name | What it means |
|---|---|---|---|
| 1 | u+v∈V | Closure under addition | Adding two vectors stays in the space |
| 2 | u+v=v+u | Commutativity of + | Order doesn't matter |
| 3 | (u+v)+w=u+(v+w) | Associativity of + | Grouping doesn't matter |
| 4 | ∃0∈V such that v+0=v | Additive identity | Zero vector exists |
| 5 | ∀v,∃(−v) with v+(−v)=0 | Additive inverse | Negatives exist |
| 6 | cv∈V | Closure under scalar multiplication | Scaling stays in the space |
| 7 | a(bv)=(ab)v | Associativity of scalar multiplication | |
| 8 | 1v=v | Identity for scalar multiplication | |
| 9 | a(u+v)=au+av | Distributive (scalar over vector addition) | |
| 10 | (a+b)v=av+bv | Distributive (scalar addition over vector) |
Note: Some textbooks list 10 axioms (counting closure separately). Either way, all 10 rules must hold.
3. Examples of Vector Spaces
3.1 Rn — Euclidean Space
Set: All n-tuples x=(x1,…,xn) with xi∈R. Addition: Component-wise. Scalar multiplication: Component-wise.
This is the vector space you already know. It satisfies all axioms (we verified them in Week 1).
3.2 Rm×n — Matrices
Set: All m×n matrices with real entries. Addition: Matrix addition (entry-wise). Scalar multiplication: Entry-wise.
The zero vector is the m×n zero matrix.
3.3 Pn — Polynomials of Degree ≤n
Set: All polynomials p(x)=a0+a1x+a2x2+⋯+anxn with real coefficients. Addition: (p+q)(x)=p(x)+q(x) (add coefficients of like powers). Scalar multiplication: (cp)(x)=c⋅p(x).
The zero vector is the zero polynomial p(x)=0 (all coefficients zero).
Example 1: Polynomial vector space operationsLet p(x)=2+3x−x2, q(x)=1−2x+4x2 in P2.p+q=(2+1)+(3−2)x+(−1+4)x2=3+x+3x2−2p=−4−6x+2x2
3.4 C[a,b] — Continuous Functions
Set: All continuous functions f:[a,b]→R. Addition: (f+g)(x)=f(x)+g(x). Scalar multiplication: (cf)(x)=cf(x).
The zero vector is the constant function f(x)=0.
3.5 R∞ — Sequences
Set: All infinite sequences (x1,x2,x3,…) of real numbers. Addition and scalar multiplication: Component-wise.
4. Non-Examples (Failure Cases)
4.1 Zn — Integer Vectors
Set: n-tuples of integers.
Axiom 6 fails: scalar multiplication by 21 gives non-integer entries. 21(1,2)=(0.5,1) is not in Z2. So Zn is not a vector space over R.
4.2 First Quadrant in R2
Set: {(x,y)∣x≥0,y≥0}.
Axiom 5 fails: (−1)v=−v has negative components (unless v=0), which are not in the first quadrant.
4.3 Unit Circle
Set: {x∈R2∣∥x∥=1}.
Axiom 1 fails: (1,0)+(1,0)=(2,0) has length 2, not 1, so the sum is not on the unit circle.
Axiom 6 also fails: 2(1,0)=(2,0) is not on the unit circle.
5. Simple Consequences of the Axioms
From the axioms we can prove:
| Property | Statement | Proof |
|---|---|---|
| Uniqueness of zero | The zero vector is unique | Suppose 0 and 0′ are both zero vectors. Then 0=0+0′=0′ |
| Uniqueness of negatives | For each v , −v is unique | Similar argument |
| ** 0⋅v=0 ** | Scalar zero times any vector is the zero vector | 0⋅v=(0+0)⋅v=0⋅v+0⋅v , subtract 0⋅v |
| ** c⋅0=0 ** | Any scalar times zero vector is zero | c⋅0=c⋅(0+0)=c⋅0+c⋅0 , subtract c⋅0 |
| ** (−1)v=−v ** | −1 times a vector is its additive inverse | v+(−1)v=(1+(−1))v=0⋅v=0 |
>0⋅v=(0+0)⋅v(property of real numbers)=0⋅v+0⋅v(axiom 10 — distributivity)>Proof: 0⋅v=0
>0⋅v−0⋅v=(0⋅v+0⋅v)−0⋅v>Now subtract 0⋅v from both sides (axiom 5 says we can):
>0=0⋅v+(0⋅v−0⋅v)=0⋅v+0=0⋅v>
Thus 0⋅v=0. ∎
6. Edge Cases & Gotchas
| Situation | What Happens |
|---|---|
| Empty set | Cannot be a vector space — axiom 4 requires a zero vector |
| **Singleton set {0} ** | This is a vector space (the trivial space) |
| Different fields | Vector spaces can be defined over Q or C , not just R |
| Axiom 4 and 5 must hold for all vectors | A zero vector must exist, but it must work for every vector |
7. Common Pitfalls
❌ Pitfall 1: Checking only closure
Students check axioms 1 and 6 (closure) and assume the rest follow. But the other 8 axioms are not automatic — though in practice, if addition and scalar multiplication are defined component-wise (or coefficient-wise), the axioms usually hold.
❌ Pitfall 2: Confusing the zero vector with the number 0
In a polynomial space, the "zero" is p(x)=0 (all coefficients zero), not the number 0. In R2×2, the zero is
.
❌ Pitfall 3: Thinking any subset of Rn is a vector space
Only subsets that are subspaces (closed under addition and scalar multiplication, contain zero) qualify. Most subsets fail at least one axiom.
8. Formula Summary Table
| Concept | Key Idea |
|---|---|
| Vector space | A set with addition and scalar multiplication satisfying 10 axioms |
| Axioms 1-5 | Addition forms a commutative group (closure, commutativity, associativity, identity, inverses) |
| Axioms 6-10 | Scalar multiplication interacts properly with addition |
| ** Rn ** | The canonical vector space |
| ** Pn ** | Polynomials of degree ≤n form a vector space |
| ** Rm×n ** | Matrices form a vector space |
| Trivial space | {0} is a vector space |
9. 📝 Practice Questions
>[000000]>Q1: Verifying axioms for ℝ²Verify axiom 9 (a(u+v)=au+av) for u=(1,2), v=(3,4), a=5 in R2.Solution: LHS: a(u+v)=5((1,2)+(3,4))=5(4,6)=(20,30) RHS: au+av=5(1,2)+5(3,4)=(5,10)+(15,20)=(20,30) LHS = RHS ✓ Q2: Is this a vector space?Is V={(x,y)∈R2∣x=y} a vector space with standard operations?Solution: Yes. Check:
- Closure under addition: (a,a)+(b,b)=(a+b,a+b) ✓ (first = second)
- Closure under scalar multiplication: c(a,a)=(ca,ca) ✓
- Zero: (0,0) is in V ✓
- Negatives: −(a,a)=(−a,−a) is in V ✓
- Other axioms inherited from R2
So V is a vector space (it's the line y=x). Q3: Is this a vector space?Is V={(x,y)∈R2∣xy=0} a vector space?Solution: No. Check closure under addition: (1,0)∈V, (0,1)∈V, but (1,0)+(0,1)=(1,1) is not in V because 1⋅1=1=0. Closure fails, so V is not a vector space. Q4: Polynomial vector spaceIn P2, compute 2p−3q where p(x)=x2−2x+1, q(x)=3x+2.Solution: 2p=2x2−4x+2 3q=9x+6 2p−3q=2x2+(−4−9)x+(2−6)=2x2−13x−4 Q5: Zero vector in matrix spaceWhat is the zero vector in R2×3?Solution: The 2×3 matrix of all zeros:
. Q6: Proof from axiomsProve that c⋅0=0 for any scalar c.Solution: c⋅0=c⋅(0+0) (axiom 4) =c⋅0+c⋅0 (axiom 9) Subtract c⋅0 from both sides: c⋅0−c⋅0=(c⋅0+c⋅0)−c⋅0 0=c⋅0+(c⋅0−c⋅0)=c⋅0+0=c⋅0 ✓ Q7: Identifying axiom violationsConsider V=R2 with modified addition: (a,b)⊕(c,d)=(a+c+1,b+d). Is V a vector space? If not, which axiom fails?Solution: Let's check the zero vector. We need 0 such that (a,b)⊕0=(a,b). If 0=(z1,z2), then (a+z1+1,b+z2)=(a,b). So a+z1+1=a⇒z1=−1, b+z2=b⇒z2=0. So 0=(−1,0).But now axiom 1 (closure) and others might work... Let's check commutativity: (a,b)⊕(c,d)=(a+c+1,b+d)=(c+a+1,d+b)=(c,d)⊕(a,b) ✓.What about axiom 4 with 0=(−1,0)? (a,b)⊕(−1,0)=(a−1+1,b+0)=(a,b) ✓.But axiom 2 (usual numbering) corresponds to existence of negatives: for (a,b), we need (−a−2,−b) because (a,b)⊕(−a−2,−b)=(a+(−a−2)+1,b+(−b))=(−1,0)=0 ✓.So this actually works! But wait — is scalar multiplication standard? If scalar multiplication is also non-standard, we need to check.If scalar multiplication is standard c(a,b)=(ca,cb), then check axiom 9: c((a,b)⊕(d,e))=c(a+d+1,b+e)=(c(a+d+1),c(b+e))=(ca+cd+c,cb+ce) c(a,b)⊕c(d,e)=(ca,cb)⊕(cd,ce)=(ca+cd+1,cb+ce)These are equal only if c=1! So the distributive axiom fails for c=1.Thus V is not a vector space. Q8: Trivial vector spaceShow that V={0} with 0+0=0 and c0=0 is a vector space.Solution: All axioms hold trivially because every operation returns the only element 0. Q9: Function spaceIs V={f:R→R∣f(0)=0} a vector space?Solution: Yes.
- Closure under addition: (f+g)(0)=f(0)+g(0)=0+0=0 ✓
- Closure under scalar multiplication: (cf)(0)=c⋅f(0)=c⋅0=0 ✓
- Zero function z(x)=0 satisfies z(0)=0 ✓
- Negative: (−f)(0)=−f(0)=0 ✓ Q10: Non-example with wrong scalar field
Explain why V={(x,y)∣x,y∈Q} (vectors with rational entries) is not a vector space over R.Solution: Scalar multiplication by an irrational c (e.g., 2) gives 2(1,0)=(2,0), and 2 is not rational. So closure under scalar multiplication fails when the scalars are R.(Note: V is a vector space over Q, but the course uses R as scalars.)
🔗 Cross-References
- Next topic: Subspaces — smaller vector spaces inside larger ones
- Week 4 (Basis & Dimension): Every vector space has a basis
- Week 5 (Linear Transformations): Maps between vector spaces
- BSMA1001 (Maths 1): Functions, sets, and basic algebra
- BSCS2004 (ML Foundations): Feature spaces are vector spaces Join Discord Previous2.2 Cramer's Rule & InversesNext3.2 Subspaces