Vector Spaces: Definition & Properties
2330 words
12 min read
Visual companion
Python
Type and operator map
Python Week 1: the first filter for runtime behavior
View
Revision summary
What this note is really saying
Short form
# Vector Spaces: Definition & Properties ## ๐ฏ Learning Objectives After this topic you will be able to: - State the eight vector space axioms - Determine whether a given set with operations is a vector space - Prove simple properties from the axioms - Recognise $\mathbb{R}^n$, $\mathbb{R}^{m \times n}$, and polynom...

Vector Spaces: Definition & Properties
๐ฏ Learning Objectives
After this topic you will be able to:
- State the eight vector space axioms
- Determine whether a given set with operations is a vector space
- Prove simple properties from the axioms
- Recognise Rn, Rmรn, and polynomial spaces as vector spaces
- Identify when a set fails to be a vector space
๐ Prerequisites
- Vectors Introduction (Week 1) โ vector operations in Rn
- Matrices Introduction (Week 1) โ matrix algebra
- Basic set notation โ set membership โ, subset โ, set builder {xโฃcondition}
- Vector spaces are the universe in which all of linear algebra takes place
1. Intuition: What Makes a "Space"?
1.1 The Big Idea
Up to now, you've worked with vectors in R2, R3, and Rn. But vectors don't have to be n-tuples. A vector could be a polynomial p(x)=a0โ+a1โx+a2โx2, or a matrix
, or even a function like sin(x).
The key question is:
Can we add two things of this type? Can we multiply one by a scalar? If the answer is yes and the operations behave nicely (commute, associate, distribute), then the set is a vector space. The eight axioms below capture this "nice behaviour" precisely. They are the rules of the game for linear algebra. (Diagram)
1.2 Why Axioms?
Axioms let us prove theorems that apply to all vector spaces at once. When we prove "every vector space has a basis" (Week 4), it applies to polynomials, matrices, and Rn simultaneously โ we don't need separate proofs for each.
2. The Eight Axioms
Definition (Vector Space). A vector space V over the real numbers R is a set equipped with two operations:
- Addition: +:VรVโV (maps two vectors to a vector)
- Scalar multiplication: โ :RรVโV (maps a scalar and a vector to a vector)
satisfying the following eight axioms for all u,v,wโV and all a,bโR:
| # | Axiom | Name | What it means |
|---|---|---|---|
| 1 | u+vโV | Closure under addition | Adding two vectors stays in the space |
| 2 | u+v=v+u | Commutativity of + | Order doesn't matter |
| 3 | (u+v)+w=u+(v+w) | Associativity of + | Grouping doesn't matter |
| 4 | โ0โV such that v+0=v | Additive identity | Zero vector exists |
| 5 | โv,โ(โv) with v+(โv)=0 | Additive inverse | Negatives exist |
| 6 | cvโV | Closure under scalar multiplication | Scaling stays in the space |
| 7 | a(bv)=(ab)v | Associativity of scalar multiplication | |
| 8 | 1v=v | Identity for scalar multiplication | |
| 9 | a(u+v)=au+av | Distributive (scalar over vector addition) | |
| 10 | (a+b)v=av+bv | Distributive (scalar addition over vector) |
Note: Some textbooks list 10 axioms (counting closure separately). Either way, all 10 rules must hold.
3. Examples of Vector Spaces
3.1 Rn โ Euclidean Space
Set: All n-tuples x=(x1โ,โฆ,xnโ) with xiโโR. Addition: Component-wise. Scalar multiplication: Component-wise.
This is the vector space you already know. It satisfies all axioms (we verified them in Week 1).
3.2 Rmรn โ Matrices
Set: All mรn matrices with real entries. Addition: Matrix addition (entry-wise). Scalar multiplication: Entry-wise.
The zero vector is the mรn zero matrix.
3.3 Pnโ โ Polynomials of Degree โคn
Set: All polynomials p(x)=a0โ+a1โx+a2โx2+โฏ+anโxn with real coefficients. Addition: (p+q)(x)=p(x)+q(x) (add coefficients of like powers). Scalar multiplication: (cp)(x)=cโ
p(x).
The zero vector is the zero polynomial p(x)=0 (all coefficients zero).
Example 1: Polynomial vector space operationsLet p(x)=2+3xโx2, q(x)=1โ2x+4x2 in P2โ.p+q=(2+1)+(3โ2)x+(โ1+4)x2=3+x+3x2โ2p=โ4โ6x+2x2
3.4 C[a,b] โ Continuous Functions
Set: All continuous functions f:[a,b]โR. Addition: (f+g)(x)=f(x)+g(x). Scalar multiplication: (cf)(x)=cf(x).
The zero vector is the constant function f(x)=0.
3.5 Rโ โ Sequences
Set: All infinite sequences (x1โ,x2โ,x3โ,โฆ) of real numbers. Addition and scalar multiplication: Component-wise.
4. Non-Examples (Failure Cases)
4.1 Zn โ Integer Vectors
Set: n-tuples of integers.
Axiom 6 fails: scalar multiplication by 21โ gives non-integer entries. 21โ(1,2)=(0.5,1) is not in Z2. So Zn is not a vector space over R.
4.2 First Quadrant in R2
Set: {(x,y)โฃxโฅ0,yโฅ0}.
Axiom 5 fails: (โ1)v=โv has negative components (unless v=0), which are not in the first quadrant.
4.3 Unit Circle
Set: {xโR2โฃโฅxโฅ=1}.
Axiom 1 fails: (1,0)+(1,0)=(2,0) has length 2, not 1, so the sum is not on the unit circle.
Axiom 6 also fails: 2(1,0)=(2,0) is not on the unit circle.
5. Simple Consequences of the Axioms
From the axioms we can prove:
| Property | Statement | Proof |
|---|---|---|
| Uniqueness of zero | The zero vector is unique | Suppose 0 and 0โฒ are both zero vectors. Then 0=0+0โฒ=0โฒ |
| Uniqueness of negatives | For each v , โv is unique | Similar argument |
| ** 0โ v=0 ** | Scalar zero times any vector is the zero vector | 0โ v=(0+0)โ v=0โ v+0โ v , subtract 0โ v |
| ** cโ 0=0 ** | Any scalar times zero vector is zero | cโ 0=cโ (0+0)=cโ 0+cโ 0 , subtract cโ 0 |
| ** (โ1)v=โv ** | โ1 times a vector is its additive inverse | v+(โ1)v=(1+(โ1))v=0โ v=0 |
>0โ vโ=(0+0)โ v(propertyย ofย realย numbers)=0โ v+0โ v(axiomย 10ย โย distributivity)โ>Proof: 0โ v=0
>0โ vโ0โ v=(0โ v+0โ v)โ0โ v>Now subtract 0โ v from both sides (axiom 5 says we can):
>0=0โ v+(0โ vโ0โ v)=0โ v+0=0โ v>
Thus 0โ v=0. โ
6. Edge Cases & Gotchas
| Situation | What Happens |
|---|---|
| Empty set | Cannot be a vector space โ axiom 4 requires a zero vector |
| **Singleton set {0} ** | This is a vector space (the trivial space) |
| Different fields | Vector spaces can be defined over Q or C , not just R |
| Axiom 4 and 5 must hold for all vectors | A zero vector must exist, but it must work for every vector |
7. Common Pitfalls
โ Pitfall 1: Checking only closure
Students check axioms 1 and 6 (closure) and assume the rest follow. But the other 8 axioms are not automatic โ though in practice, if addition and scalar multiplication are defined component-wise (or coefficient-wise), the axioms usually hold.
โ Pitfall 2: Confusing the zero vector with the number 0
In a polynomial space, the "zero" is p(x)=0 (all coefficients zero), not the number 0. In R2ร2, the zero is
.
โ Pitfall 3: Thinking any subset of Rn is a vector space
Only subsets that are subspaces (closed under addition and scalar multiplication, contain zero) qualify. Most subsets fail at least one axiom.
8. Formula Summary Table
| Concept | Key Idea |
|---|---|
| Vector space | A set with addition and scalar multiplication satisfying 10 axioms |
| Axioms 1-5 | Addition forms a commutative group (closure, commutativity, associativity, identity, inverses) |
| Axioms 6-10 | Scalar multiplication interacts properly with addition |
| ** Rn ** | The canonical vector space |
| ** Pnโ ** | Polynomials of degree โคn form a vector space |
| ** Rmรn ** | Matrices form a vector space |
| Trivial space | {0} is a vector space |
9. ๐ Practice Questions
>[00โ00โ00โ]>Q1: Verifying axioms for โยฒVerify axiom 9 (a(u+v)=au+av) for u=(1,2), v=(3,4), a=5 in R2.Solution: LHS: a(u+v)=5((1,2)+(3,4))=5(4,6)=(20,30) RHS: au+av=5(1,2)+5(3,4)=(5,10)+(15,20)=(20,30) LHS = RHS โ Q2: Is this a vector space?Is V={(x,y)โR2โฃx=y} a vector space with standard operations?Solution: Yes. Check:
- Closure under addition: (a,a)+(b,b)=(a+b,a+b) โ (first = second)
- Closure under scalar multiplication: c(a,a)=(ca,ca) โ
- Zero: (0,0) is in V โ
- Negatives: โ(a,a)=(โa,โa) is in V โ
- Other axioms inherited from R2
So V is a vector space (it's the line y=x). Q3: Is this a vector space?Is V={(x,y)โR2โฃxy=0} a vector space?Solution: No. Check closure under addition: (1,0)โV, (0,1)โV, but (1,0)+(0,1)=(1,1) is not in V because 1โ 1=1๎ =0. Closure fails, so V is not a vector space. Q4: Polynomial vector spaceIn P2โ, compute 2pโ3q where p(x)=x2โ2x+1, q(x)=3x+2.Solution: 2p=2x2โ4x+2 3q=9x+6 2pโ3q=2x2+(โ4โ9)x+(2โ6)=2x2โ13xโ4 Q5: Zero vector in matrix spaceWhat is the zero vector in R2ร3?Solution: The 2ร3 matrix of all zeros:
. Q6: Proof from axiomsProve that cโ 0=0 for any scalar c.Solution: cโ 0=cโ (0+0) (axiom 4) =cโ 0+cโ 0 (axiom 9) Subtract cโ 0 from both sides: cโ 0โcโ 0=(cโ 0+cโ 0)โcโ 0 0=cโ 0+(cโ 0โcโ 0)=cโ 0+0=cโ 0 โ Q7: Identifying axiom violationsConsider V=R2 with modified addition: (a,b)โ(c,d)=(a+c+1,b+d). Is V a vector space? If not, which axiom fails?Solution: Let's check the zero vector. We need 0 such that (a,b)โ0=(a,b). If 0=(z1โ,z2โ), then (a+z1โ+1,b+z2โ)=(a,b). So a+z1โ+1=aโz1โ=โ1, b+z2โ=bโz2โ=0. So 0=(โ1,0).But now axiom 1 (closure) and others might work... Let's check commutativity: (a,b)โ(c,d)=(a+c+1,b+d)=(c+a+1,d+b)=(c,d)โ(a,b) โ.What about axiom 4 with 0=(โ1,0)? (a,b)โ(โ1,0)=(aโ1+1,b+0)=(a,b) โ.But axiom 2 (usual numbering) corresponds to existence of negatives: for (a,b), we need (โaโ2,โb) because (a,b)โ(โaโ2,โb)=(a+(โaโ2)+1,b+(โb))=(โ1,0)=0 โ.So this actually works! But wait โ is scalar multiplication standard? If scalar multiplication is also non-standard, we need to check.If scalar multiplication is standard c(a,b)=(ca,cb), then check axiom 9: c((a,b)โ(d,e))=c(a+d+1,b+e)=(c(a+d+1),c(b+e))=(ca+cd+c,cb+ce) c(a,b)โc(d,e)=(ca,cb)โ(cd,ce)=(ca+cd+1,cb+ce)These are equal only if c=1! So the distributive axiom fails for c๎ =1.Thus V is not a vector space. Q8: Trivial vector spaceShow that V={0} with 0+0=0 and c0=0 is a vector space.Solution: All axioms hold trivially because every operation returns the only element 0. Q9: Function spaceIs V={f:RโRโฃf(0)=0} a vector space?Solution: Yes.
- Closure under addition: (f+g)(0)=f(0)+g(0)=0+0=0 โ
- Closure under scalar multiplication: (cf)(0)=cโ f(0)=cโ 0=0 โ
- Zero function z(x)=0 satisfies z(0)=0 โ
- Negative: (โf)(0)=โf(0)=0 โ Q10: Non-example with wrong scalar field
Explain why V={(x,y)โฃx,yโQ} (vectors with rational entries) is not a vector space over R.Solution: Scalar multiplication by an irrational c (e.g., 2โ) gives 2โ(1,0)=(2โ,0), and 2โ is not rational. So closure under scalar multiplication fails when the scalars are R.(Note: V is a vector space over Q, but the course uses R as scalars.)
๐ Cross-References
- Next topic: Subspaces โ smaller vector spaces inside larger ones
- Week 4 (Basis & Dimension): Every vector space has a basis
- Week 5 (Linear Transformations): Maps between vector spaces
- BSMA1001 (Maths 1): Functions, sets, and basic algebra
- BSCS2004 (ML Foundations): Feature spaces are vector spaces Join Discord Previous2.2 Cramer's Rule & InversesNext3.2 Subspaces