{
  "id": "differentiability",
  "title": "Differentiability",
  "lang": "en",
  "source_lang": "en",
  "summary": "Differentiability is the property of admitting a linear approximation with an error negligible relative to the size of the input change.",
  "category": "mathematics",
  "subcategory": "analysis",
  "type": "concept",
  "aliases": [
    "Differentiable property"
  ],
  "generated_at": "2026-11-03",
  "model": "pro/gpt-6.1-sol",
  "url": "https://aiwiki.page/en/differentiability/",
  "translations": {
    "zh-Hans": {
      "url": "https://aiwiki.page/zh/differentiability/",
      "json": "https://aiwiki.page/zh/differentiability.json"
    }
  },
  "sections": [
    {
      "heading": "",
      "text": "Differentiability is a local property of a function that makes it possible to approximate changes in its values by a linear rule. For a function of one real variable, it means that a finite derivative exists. For functions between higher-dimensional spaces, it normally means that a single linear transformation approximates the function in every direction simultaneously, with an error that becomes negligible compared with the size of the input change.\n\nDifferentiability supplies the mathematical basis for tangent lines and tangent planes, rates of change, sensitivity calculations, and many methods of optimization. It is stronger than continuity but weaker than continuous differentiability. Its precise meaning depends on the setting: real, complex, finite-dimensional, infinite-dimensional, or geometric. Extensions involving weak derivatives and almost-everywhere differentiability allow differential methods to remain useful even when classical derivatives fail to exist at some points."
    },
    {
      "heading": "Differentiability in one real variable",
      "text": "Let \\(f:I\\to\\mathbb R\\) be defined on an open interval \\(I\\), and let \\(a\\in I\\). The function is differentiable at \\(a\\) if the limit\n\n\\[f'(a)=\\lim_{h\\to0}\\frac{f(a+h)-f(a)}{h}\\]\n\nexists as a finite real number. The quotient compares the change in output with the change in input. Geometrically, it is the slope of a secant line; its limit is the slope of the tangent line to the graph at \\((a,f(a))\\). A divergent quotient is sometimes described informally as an infinite derivative, but it does not establish differentiability in the usual real-valued sense.\n\nAn equivalent and more generalizable definition is\n\n\\[f(a+h)=f(a)+f'(a)h+r(h), \\qquad \\lim_{h\\to0}\\frac{r(h)}{|h|}=0.\\]\n\nThe notation \\(r(h)=o(|h|)\\), associated with asymptotic notation, expresses that the error is of smaller order than the input increment. Thus differentiability is not merely the existence of an approximate slope: it requires the approximation to improve at a specified relative rate as the observation scale shrinks.\n\nEvery function differentiable at \\(a\\) is continuous there, because both \\(f'(a)h\\) and \\(r(h)\\) tend to zero. The converse fails. The function \\(f(x)=|x|\\) is continuous everywhere, but its difference quotient at zero equals \\(1\\) for positive increments and \\(-1\\) for negative increments. A corner therefore prevents differentiability. A cusp or a vertical tangent can also prevent a finite derivative: for \\(f(x)=x^{1/3}\\), the quotient at zero is \\(|h|^{-2/3}\\), which grows without bound.\n\nDifferentiability at a point does not require continuity of the derivative near that point. For example,\n\n\\[f(x)= \\begin{cases} x^2\\sin(1/x),&x\\ne0,\\\\ 0,&x=0 \\end{cases}\\]\n\nhas \\(f'(0)=0\\), whereas\n\n\\[f'(x)=2x\\sin(1/x)-\\cos(1/x),\\qquad x\\ne0.\\]\n\nThe derivative oscillates without approaching a limit at zero. Nevertheless, derivatives cannot have arbitrary discontinuities: Darboux’s theorem states that every derivative has the intermediate value property, even when it is not continuous.\n\nAt an endpoint of a closed interval, a one-sided derivative may be defined by restricting increments to the domain. Such derivatives are useful in boundary problems, but they must be distinguished from the ordinary two-sided derivative. The standard interior definition also presupposes that the function is defined throughout a neighborhood of the point; derivatives relative to more restricted domains require additional conventions."
    },
    {
      "heading": "Total differentiability in several variables",
      "text": "For a function \\(F:U\\to\\mathbb R^m\\), where \\(U\\) is an open subset of \\(\\mathbb R^n\\), differentiability at \\(a\\in U\\) means that there is a linear map \\(A:\\mathbb R^n\\to\\mathbb R^m\\) such that\n\n\\[\\lim_{h\\to0} \\frac{\\|F(a+h)-F(a)-Ah\\|}{\\|h\\|}=0.\\]\n\nThe map \\(A\\), written \\(DF(a)\\), is the total derivative or differential. It is unique: if two linear maps satisfied the condition, their difference, evaluated on increments \\(tv\\) and divided by \\(|t|\\), would have to vanish for every vector \\(v\\).\n\nIn coordinates, \\(DF(a)\\) is represented by the Jacobian matrix,\n\n\\[DF(a)= \\begin{pmatrix} \\frac{\\partial F_1}{\\partial x_1}(a)&\\cdots& \\frac{\\partial F_1}{\\partial x_n}(a)\\\\ \\vdots&&\\vdots\\\\ \\frac{\\partial F_m}{\\partial x_1}(a)&\\cdots& \\frac{\\partial F_m}{\\partial x_n}(a) \\end{pmatrix}.\\]\n\nFor a scalar-valued function on Euclidean space, the differential is represented, using the usual inner product, by the gradient:\n\n\\[Df(a)h=\\nabla f(a)\\cdot h.\\]\n\nThe differential is intrinsically a linear functional; the gradient is its vector representation after an inner product has been chosen.\n\nExistence of all partial derivatives does not imply total differentiability. Partial derivatives test only coordinate directions. Even the existence of every directional derivative, with the values depending linearly on the direction, need not suffice. Define\n\n\\[f(x,y)= \\begin{cases} \\dfrac{x^3y}{x^4+y^2},&(x,y)\\ne(0,0),\\\\ 0,&(x,y)=(0,0). \\end{cases}\\]\n\nThe estimate\n\n\\[|f(x,y)|\\le \\frac{|x|}{2}\\]\n\nshows continuity at the origin. Every directional derivative there is zero: along a line \\((x,y)=(ta,tb)\\), the quotient \\(f(ta,tb)/t\\) tends to zero. However, along \\(y=x^2\\), one has \\(f(x,x^2)=x/2\\), so\n\n\\[\\frac{|f(x,x^2)|}{\\sqrt{x^2+x^4}}\\longrightarrow\\frac12.\\]\n\nConsequently, the zero linear map does not give the required approximation, and no total derivative exists.\n\nA standard sufficient condition is the existence of all first partial derivatives in a neighborhood of \\(a\\), with those partial derivatives continuous at \\(a\\). The resulting differentiability follows by decomposing an increment into coordinate increments and controlling the errors. The distinction is one of uniformity: directional derivatives examine each fixed direction separately, whereas total differentiability controls all sufficiently small increments together. In finite-dimensional spaces, the definition is independent of the particular norm because all norms on a given finite-dimensional space are equivalent."
    },
    {
      "heading": "Higher differentiability and regularity classes",
      "text": "A differentiable function need not have a differentiable derivative. Repeated differentiability therefore produces a hierarchy. On an open set \\(U\\), the notation \\(C^0(U)\\) denotes continuous functions, \\(C^1(U)\\) functions whose first derivatives exist and are continuous, and \\(C^k(U)\\) functions with continuous derivatives through order \\(k\\). The class \\(C^\\infty(U)\\) consists of smooth functions, meaning functions with continuous derivatives of every finite order. In particular, “differentiable” and “continuously differentiable” are not interchangeable.\n\nHigher derivatives in several variables are naturally multilinear maps. For a twice continuously differentiable function \\(F\\),\n\n\\[D^2F(a)[u,v]\\]\n\nis bilinear in the increment vectors \\(u\\) and \\(v\\). For a scalar-valued function, it is represented by the Hessian matrix. Continuity of the second partial derivatives guarantees equality of mixed derivatives and hence symmetry of the Hessian. Without suitable regularity, mixed partial derivatives can exist at a point without being equal.\n\nHigher differentiability controls the accuracy of local polynomial approximations. If \\(f\\) is \\(C^k\\) near \\(a\\), then its Taylor expansion through order \\(k\\) has the form\n\n\\[f(a+h)= \\sum_{j=0}^{k}\\frac{1}{j!}D^jf(a)[h,\\ldots,h] +o(\\|h\\|^k),\\]\n\nwhere the \\(j=0\\) term is \\(f(a)\\). This formulation generalizes the familiar one-variable Taylor expansion. Stronger assumptions permit more explicit remainder estimates. For example, if a suitable \\((k+1)\\)-st derivative is bounded on a neighborhood containing the relevant line segments, the remainder after order \\(k\\) is bounded by a constant times \\(\\|h\\|^{k+1}\\).\n\nSmoothness does not imply analyticity over the real numbers. The function\n\n\\[g(x)= \\begin{cases} e^{-1/x^2},&x\\ne0,\\\\ 0,&x=0 \\end{cases}\\]\n\nis smooth, and every derivative at zero is zero, but the function is positive away from zero. Its Taylor series at zero therefore represents the zero function rather than \\(g\\) on any neighborhood. A real analytic function satisfies the stronger condition of agreeing locally with a convergent power series.\n\nIntermediate regularity is often expressed by Hölder classes. A function belongs locally to \\(C^{k,\\alpha}\\), for \\(0<\\alpha\\le1\\), if its derivatives of order \\(k\\) satisfy estimates of the form\n\n\\[\\|D^kf(x)-D^kf(y)\\|\\le C\\|x-y\\|^\\alpha\\]\n\non suitable neighborhoods. The case \\(\\alpha=1\\) is Lipschitz regularity. Such distinctions matter in differential equations and approximation theory: two functions can both be \\(C^1\\), yet have substantially different derivative variation, numerical approximation errors, and stability properties."
    },
    {
      "heading": "Differentiation rules and local structure",
      "text": "The algebraic rules of differential calculus follow from the linear-approximation definition. If \\(f\\) and \\(g\\) are differentiable scalar functions, then\n\n\\[D(fg)(a)h=f(a)Dg(a)h+g(a)Df(a)h.\\]\n\nFor composable differentiable maps, the chain rule states\n\n\\[D(G\\circ F)(a)=DG(F(a))\\circ DF(a).\\]\n\nIt expresses a basic structural fact: the best linear approximation to a composition is the composition of the best linear approximations. In coordinates this becomes matrix multiplication of Jacobians, with the order determined by the order of the maps.\n\nThe mean value theorem connects pointwise differentiability with behavior across intervals. If a real-valued function is continuous on \\([a,b]\\) and differentiable on \\((a,b)\\), then some \\(c\\in(a,b)\\) satisfies\n\n\\[f(b)-f(a)=f'(c)(b-a).\\]\n\nConsequently, a derivative bounded in absolute value by \\(M\\) yields the estimate \\(|f(b)-f(a)|\\le M|b-a|\\). A derivative identically zero on an interval forces the function to be constant there. For vector-valued functions, a single equality with one intermediate point generally fails, although norm inequalities remain available under appropriate hypotheses.\n\nThe inverse function theorem gives a particularly strong consequence of continuous differentiability. If \\(F:\\mathbb R^n\\to\\mathbb R^n\\) is \\(C^1\\) near \\(a\\) and \\(DF(a)\\) is invertible, then \\(F\\) has a \\(C^1\\) local inverse near \\(F(a)\\), with\n\n\\[D(F^{-1})(F(a))=[DF(a)]^{-1}.\\]\n\nInvertibility of the derivative is a sufficient condition for local smooth invertibility, not a necessary condition for local one-to-one behavior. The function \\(x\\mapsto x^3\\) is one-to-one near zero despite having derivative zero there, but its inverse is not differentiable at zero.\n\nThe related implicit function theorem explains when an equation determines some variables as differentiable functions of others. If \\(F(x,y)=0\\), with \\(F\\) continuously differentiable and the derivative with respect to \\(y\\) invertible at a solution, then locally \\(y=g(x)\\), and\n\n\\[Dg(x)=-[D_yF(x,g(x))]^{-1}D_xF(x,g(x)).\\]\n\nThis provides a rigorous foundation for differentiating constrained relationships without first solving them explicitly.\n\nDifferentiability also constrains extrema. If a differentiable scalar function has an interior local minimum or maximum, its differential is zero. The condition is necessary but not sufficient: \\(x^3\\) has derivative zero at zero without an extremum. Second derivatives distinguish many cases, but a degenerate Hessian can require examination of higher-order terms or the function itself."
    },
    {
      "heading": "Complex differentiability",
      "text": "For a function \\(f:U\\to\\mathbb C\\), where \\(U\\subseteq\\mathbb C\\) is open, complex differentiability at \\(z_0\\) means that\n\n\\[f'(z_0)=\\lim_{h\\to0}\\frac{f(z_0+h)-f(z_0)}{h}\\]\n\nexists as \\(h\\) approaches zero through arbitrary nonzero complex values. Although this resembles the real definition, the denominator may approach zero in every direction in the complex plane. The linear approximation must be multiplication by a single complex number, rather than an arbitrary real-linear transformation of the plane.\n\nWriting \\(z=x+iy\\) and \\(f(z)=u(x,y)+iv(x,y)\\) makes the restriction explicit. If \\(f\\) is complex differentiable at a point, its real partial derivatives there satisfy the Cauchy–Riemann equations:\n\n\\[u_x=v_y,\\qquad u_y=-v_x.\\]\n\nWhen the partial derivatives are continuous in a neighborhood, these equations are also sufficient for complex differentiability there. Mere existence of the partial derivatives and validity of the equations at one point are not sufficient unless additional control, such as real differentiability at that point, is available.\n\nFor example, complex conjugation \\(f(z)=\\overline z\\) is differentiable as a map \\(\\mathbb R^2\\to\\mathbb R^2\\), with real derivative represented by\n\n\\[\\begin{pmatrix} 1&0\\\\ 0&-1 \\end{pmatrix}.\\]\n\nIt is nowhere complex differentiable: its difference quotient is \\(1\\) along real increments and \\(-1\\) along imaginary increments. Conversely, \\(f(z)=|z|^2\\) is complex differentiable at zero, with derivative zero, but not at any nonzero point. Complex differentiability at an isolated point therefore does not imply differentiability throughout a neighborhood.\n\nA function complex differentiable at every point of an open set is called holomorphic. A central result of complex analysis is that holomorphic functions are automatically analytic: they possess convergent local power-series expansions and derivatives of every order. This is much stronger than real differentiability, where even infinitely many continuous derivatives do not guarantee analyticity.\n\nAt a point where the derivative of a holomorphic function is nonzero, its real derivative is a rotation followed by a positive scaling. It therefore preserves oriented angles locally. This links differentiability to conformal geometry. Holomorphic functions also satisfy strong uniqueness principles and integral identities; these arise from differentiability on open sets, rather than from the existence of one derivative at a single point. The contrast between real and complex differentiability is thus not simply notational but reflects a major difference in mathematical rigidity."
    },
    {
      "heading": "Differentiability in normed spaces",
      "text": "The linear-approximation definition extends to normed vector spaces. Let \\(X\\) and \\(Y\\) be such spaces, \\(U\\subseteq X\\) open, and \\(F:U\\to Y\\). The function is Fréchet differentiable at \\(a\\) if a bounded linear operator \\(A:X\\to Y\\) satisfies\n\n\\[\\lim_{\\|h\\|_X\\to0} \\frac{\\|F(a+h)-F(a)-Ah\\|_Y}{\\|h\\|_X}=0.\\]\n\nBoundedness of the derivative is essential in infinite dimensions, where linearity alone does not guarantee continuity. In finite-dimensional spaces, this definition reduces to ordinary total differentiability.\n\nA weaker notion is the Gâteaux derivative, based on limits along fixed directions:\n\n\\[D_GF(a)v= \\lim_{t\\to0}\\frac{F(a+tv)-F(a)}{t}.\\]\n\nTerminology varies: some treatments require these directional limits to define a linear map, while others discuss the limits first and impose linearity separately. In either convention, fixed-direction convergence is weaker than the uniform control required for Fréchet differentiability. Fréchet differentiability implies Gâteaux differentiability with the same derivative, but the converse fails without further assumptions.\n\nA basic example in a real Hilbert space is\n\n\\[J(x)=\\frac12\\|x\\|^2.\\]\n\nExpanding the square gives\n\n\\[J(x+h)-J(x)=\\langle x,h\\rangle+\\frac12\\|h\\|^2,\\]\n\nso \\(DJ(x)h=\\langle x,h\\rangle\\). The quadratic remainder establishes Fréchet differentiability directly. At nonzero \\(x\\), the norm itself is differentiable, with\n\n\\[D\\|\\cdot\\|(x)h=\\frac{\\langle x,h\\rangle}{\\|x\\|}.\\]\n\nAt zero the norm is not differentiable on a nontrivial real normed space: the two-sided directional quotient along a nonzero vector has incompatible signs. In a general normed space, differentiability of the norm away from zero depends on the geometry of its unit ball.\n\nThese concepts are central in functional analysis and the calculus of variations, where an input may be an entire function. For example, on the real space \\(H_0^1(\\Omega)\\), the energy\n\n\\[E(u)=\\frac12\\int_\\Omega|\\nabla u|^2\\,dx\\]\n\nhas derivative\n\n\\[DE(u)v=\\int_\\Omega\\nabla u\\cdot\\nabla v\\,dx.\\]\n\nHere the derivative is a continuous linear functional acting on perturbations \\(v\\). Setting the derivative of an energy with forcing equal to zero yields variational equations that may be meaningful even when classical second derivatives do not exist.\n\nMany finite-dimensional results extend to Banach spaces, including suitable inverse and implicit function theorems. Their hypotheses involve bounded linear isomorphisms and completeness. Infinite-dimensional distinctions between operator topologies, boundedness, and uniform approximation make the precise choice of derivative substantially more important than it is in elementary calculus."
    },
    {
      "heading": "Differentiability on manifolds",
      "text": "A manifold is locally modeled on Euclidean space but need not possess a single global coordinate system. Differentiability is defined through coordinate charts. For a map \\(F:M\\to N\\), charts \\(\\phi\\) near \\(p\\in M\\) and \\(\\psi\\) near \\(F(p)\\) produce the coordinate representation\n\n\\[\\psi\\circ F\\circ\\phi^{-1}.\\]\n\nThe map \\(F\\) is differentiable at \\(p\\) when this representation is differentiable at \\(\\phi(p)\\). Compatibility of the charts and the chain rule ensure that the definition does not depend on which admissible charts are chosen.\n\nThe derivative becomes a map between tangent spaces:\n\n\\[dF_p:T_pM\\longrightarrow T_{F(p)}N.\\]\n\nTangent vectors can be represented by velocities of curves. If \\(\\gamma(0)=p\\), then\n\n\\[dF_p\\bigl(\\gamma'(0)\\bigr)=(F\\circ\\gamma)'(0).\\]\n\nThis identifies the differential as the operation that carries an infinitesimal velocity in the domain to the corresponding velocity in the target. Coordinate Jacobians are matrix representations of this intrinsic map, rather than separate geometric objects.\n\nFor a scalar-valued function \\(f:M\\to\\mathbb R\\), the differential \\(df_p\\) belongs to the dual of \\(T_pM\\), the cotangent space. It is therefore naturally a covector. A gradient requires an additional choice of metric: a Riemannian metric determines the unique vector satisfying\n\n\\[df_p(v)=g_p(\\operatorname{grad}f(p),v)\\]\n\nfor every tangent vector \\(v\\). This distinction explains why a differential can be defined on a smooth manifold without measuring lengths or angles, whereas a gradient cannot.\n\nDifferentiability also identifies geometric subsets. The sphere in \\(\\mathbb R^{n+1}\\) is the level set of\n\n\\[F(x)=\\|x\\|^2.\\]\n\nAt a point \\(p\\) on the unit sphere,\n\n\\[DF(p)h=2p\\cdot h,\\]\n\nso its tangent space is\n\n\\[T_pS^n=\\{h:p\\cdot h=0\\}.\\]\n\nMore generally, when a smooth map \\(F:\\mathbb R^n\\to\\mathbb R^m\\) has surjective derivative at points of a level set, that level set is locally a manifold of dimension \\(n-m\\).\n\nA bijection that is smooth and has a smooth inverse is a diffeomorphism. Such maps preserve differentiable structure, a stronger requirement than the continuity preserved by a homeomorphism. A topological manifold does not automatically come with a unique smooth structure, and in some settings compatible smooth structures may fail to exist or may be inequivalent. Consequently, differential geometry studies not only shapes and coordinate formulas but also the structures that make differentiation meaningful in the first place."
    },
    {
      "heading": "Almost-everywhere and weak differentiability",
      "text": "Classical differentiability can fail at exceptional points while remaining available on most of a domain. In this setting, “most” is commonly interpreted using Lebesgue measure. A property holds almost everywhere if the set where it fails has measure zero. Rademacher’s theorem states that a locally Lipschitz map between finite-dimensional Euclidean spaces is differentiable almost everywhere. The conclusion concerns total differentiability, not merely the existence of coordinate derivatives.\n\nThe hypothesis of Lipschitz continuity gives a uniform local bound\n\n\\[\\|F(x)-F(y)\\|\\le L\\|x-y\\|.\\]\n\nIt allows corners, as in \\(f(x)=|x|\\), but prevents sufficiently violent local oscillation. In one variable, monotone real-valued functions are also differentiable with a finite derivative almost everywhere. Neither result says that the derivative determines the original function without additional assumptions. The Cantor function, for example, is continuous, nonconstant, and has derivative zero almost everywhere.\n\nThe relevant stronger property in one dimension is absolute continuity. An absolutely continuous function on \\([a,b]\\) is differentiable almost everywhere, has an integrable derivative, and satisfies\n\n\\[f(x)=f(a)+\\int_a^x f'(t)\\,dt.\\]\n\nConversely, indefinite integrals of Lebesgue-integrable functions are absolutely continuous. This is a precise form of the fundamental theorem of calculus. It explains why almost-everywhere differentiability alone is insufficient for recovering a function by integration: singular variation can be invisible to the ordinary derivative almost everywhere.\n\nWeak differentiation uses integration identities instead of pointwise limits. A locally integrable function \\(g\\) is the weak partial derivative \\(\\partial_i f\\) if\n\n\\[\\int_\\Omega f\\,\\partial_i\\varphi\\,dx = -\\int_\\Omega g\\,\\varphi\\,dx\\]\n\nfor every smooth test function \\(\\varphi\\) compactly supported in \\(\\Omega\\). The identity is modeled on integration by parts. For \\(f(x)=|x|\\), the weak derivative is the sign function, with its value at zero irrelevant. Thus a classical derivative may fail at a corner while a useful weak derivative exists.\n\nFunctions with weak derivatives satisfying specified integrability conditions form Sobolev spaces. These are fundamental in the study of partial differential equations, because physically or geometrically natural solutions need not have continuous classical derivatives. Weak derivatives are also distinguished from general distributional derivatives: a jump discontinuity produces a Dirac delta term, which is not represented by an ordinary locally integrable function. Weak differentiability therefore enlarges classical calculus without making every singularity disappear."
    },
    {
      "heading": "Historical development and pathological examples",
      "text": "The origins of differentiability lie in problems of tangents, instantaneous motion, and extrema. Seventeenth-century techniques developed by Pierre de Fermat, Isaac Newton, and Gottfried Wilhelm Leibniz gave increasingly systematic procedures for calculating derivatives. Newton’s fluxions emphasized changing quantities and velocities; Leibniz’s differential notation made relations between infinitesimal changes especially explicit. These methods preceded the modern separation between a computational rule for derivatives and a precise local property of a function.\n\nDuring the nineteenth century, limits became central to the foundations of analysis. Augustin-Louis Cauchy presented differentiation through limiting difference quotients in his early nineteenth-century work, including his 1823 treatment of infinitesimal calculus. Later developments associated with Karl Weierstrass strengthened the use of explicit approximation and limit arguments. Differentiability increasingly became a condition to be proved, rather than a geometric regularity assumed from a curve’s appearance.\n\nContinuous nowhere-differentiable functions were especially important in this change. Bernard Bolzano constructed an early example in work that remained unpublished during his lifetime. Weierstrass presented his celebrated example in 1872. A classical Weierstrass function has the form\n\n\\[W(x)=\\sum_{n=0}^{\\infty}a^n\\cos(b^n\\pi x),\\]\n\nwith \\(0<a<1\\), \\(b\\) an odd positive integer, and suitable additional restrictions. The classical sufficient condition\n\n\\[ab>1+\\frac{3\\pi}{2}\\]\n\nensures nowhere differentiability. The series converges uniformly because its terms are bounded by the summable geometric sequence \\(a^n\\), so its sum is continuous.\n\nThe example separates two kinds of control. Small amplitudes can guarantee continuity of a convergent series, while rapidly increasing frequencies destroy the existence of limiting slopes. It also shows why uniform convergence of differentiable functions does not, by itself, preserve differentiability. To pass derivatives through a limit, further hypotheses are needed, typically controlling the convergence of the derivatives as well as the values at at least one point.\n\nTwentieth-century work connected these phenomena to measure theory, functional analysis, and probability. Henri Lebesgue’s integration theory clarified the distinction between pointwise behavior and almost-everywhere behavior. Maurice Fréchet and René Gâteaux developed derivative concepts suited to spaces of functions. Hans Rademacher proved his almost-everywhere differentiability theorem in 1919. In probability, paths of standard Brownian motion are almost surely continuous and nowhere differentiable. Lack of ordinary derivatives thus appears not only in specially constructed counterexamples but also in central models of random motion."
    },
    {
      "heading": "Computation, optimization, and differential models",
      "text": "Differentiability makes local calculations possible, but it does not guarantee that a derivative is easy to compute or numerically stable. A finite-difference approximation,\n\n\\[f'(x)\\approx\\frac{f(x+h)-f(x)}{h},\\]\n\ncontains both approximation error and floating-point error. If \\(f\\) has a bounded second derivative near \\(x\\), the forward-difference truncation error is \\(O(h)\\). A central difference has error \\(O(h^2)\\) under suitable third-derivative assumptions. Making \\(h\\) extremely small can worsen the result because subtraction of nearly equal values amplifies rounding effects.\n\nAutomatic differentiation uses a different principle: it applies the chain rule to the elementary operations of a program. Forward mode propagates directional derivatives, while reverse mode propagates sensitivities from outputs toward inputs. For a scalar output depending on many inputs, reverse mode can compute a full gradient at a cost typically comparable to a small multiple of evaluating the program. It computes derivatives of the operations actually executed; it does not by itself prove that an underlying mathematical function is differentiable at a branch boundary or other singular point.\n\nIn optimization, a differentiable objective supplies first-order information for descent methods. Newton’s method uses second-order information: for solving \\(F(x)=0\\), its basic iteration is\n\n\\[x_{k+1}=x_k-[DF(x_k)]^{-1}F(x_k),\\]\n\nwhen the derivative is invertible. Local quadratic convergence follows under suitable regularity, such as a locally Lipschitz derivative near a solution with invertible Jacobian. Mere differentiability is not enough to guarantee that behavior. Similarly, an invertible but nearly singular derivative can produce large sensitivity, connecting differentiation to conditioning rather than guaranteeing numerical reliability.\n\nNondifferentiable models often retain useful structure. For a convex function, a subgradient \\(g\\) at \\(x\\) satisfies\n\n\\[f(y)\\ge f(x)+g\\cdot(y-x)\\]\n\nthroughout the domain. For \\(f(x)=|x|\\), every \\(g\\in[-1,1]\\) is a subgradient at zero. Such objects replace a unique tangent slope with a family of supporting slopes. This is relevant to absolute-value penalties, piecewise-linear models, and optimization problems whose solutions may occur precisely at corners.\n\nDifferential equations and statistical models also depend on the distinction between formal derivatives and justified differentiability. A classical solution of a differential equation must possess the derivatives appearing in the equation, whereas a weak solution satisfies an integrated formulation. In statistical estimation, differentiating an integral or expectation requires hypotheses permitting interchange of differentiation and integration. Sensitivity formulas, gradient calculations, and parameter-dependent solutions therefore rest not only on symbolic rules but on regularity conditions that ensure those rules describe genuine local behavior."
    }
  ],
  "links": [
    "mathematical-function",
    "derivative",
    "mathematical-optimization",
    "limit",
    "graph-of-a-function",
    "big-o-notation",
    "continuous-function",
    "open-set",
    "linear-map",
    "jacobian-matrix",
    "euclidean-space",
    "gradient",
    "partial-derivative",
    "directional-derivative",
    "multilinear-map",
    "hessian-matrix",
    "taylor-series",
    "analytic-function",
    "chain-rule",
    "mean-value-theorem",
    "inverse-function-theorem",
    "cauchy-riemann-equations",
    "complex-analysis",
    "normed-vector-space",
    "hilbert-space",
    "functional-analysis",
    "calculus-of-variations",
    "banach-space",
    "manifold",
    "tangent-space",
    "homeomorphism",
    "differential-geometry",
    "lebesgue-measure",
    "almost-everywhere",
    "lipschitz-continuity",
    "absolute-continuity",
    "fundamental-theorem-of-calculus",
    "sobolev-space",
    "partial-differential-equation",
    "gottfried-wilhelm-leibniz",
    "augustin-louis-cauchy",
    "karl-weierstrass",
    "weierstrass-function",
    "automatic-differentiation",
    "newtons-method",
    "convex-function"
  ],
  "sources": [],
  "license": "https://creativecommons.org/licenses/by/4.0/"
}