Quiz 2
Registry Synced

SGD Variants

41 words
1 min read

Reading compass

Now · Momentum

SGD Variants

Momentum

vt+1=βvt+∇L(θt)v_{t+1} = \beta v_t + \nabla L(\theta_t) θt+1=θt−ηvt+1\theta_{t+1} = \theta_t - \eta v_{t+1}

Adam (Adaptive Moment Estimation)

Combines momentum + adaptive learning rates. Default: β1=0.9,β2=0.999\beta_1 = 0.9, \beta_2 = 0.999. Join Discord PreviousGradient DescentNextEM Algorithm
Document outline

Keep your place and jump directly to a heading.

Table of Contents
System Normal // Awaiting Context

Intelligence Hub

Navigate the knowledge graph to generate context. The Hub adapts dynamically to surface backlinks, related notes, and metadata insights.

Open library →Launch Assessment Engine