Tag

#optimization

3 posts tagged with this.

·17 min read

Automatic Differentiation

A deep-dive into automatic differentiation: symbolic vs. numerical vs. AD, AST transformation, dual numbers, tapes, hybrid methods, and a generic C++ implementation that computes gradients and solves optimisation problems.

·2 min read

SmallFunction

A header-only C++ alternative to std::function that uses fixed-size capture optimization (small-buffer optimization) to avoid heap allocation — 3–5x faster in benchmarks.