Differential calculus

Differential calculus

THE DERIVATIVE

Main article: Derivative

Suppose that x and y are real numbers and that y is a function of x, that is, for every value of x, there is a corresponding value of y. This relationship is written as y = f(x). If f(x) is the equation for a straight line, then there are two real numbers m and b such that y = m x + b. m is called the slope and can be determined from the formula:

where the symbol Δ (the uppercase form of the Greek letter Delta) is an abbreviation for "change in". It follows that Δy = m Δx.

A general function is not a line, so it does not have a slope. The derivative of f at the point x is the best possible approximation to the idea of the slope of f at the point x. It is usually denoted f'(x) or dy/dx. Together with the value of f at x, the derivative of f determines the best linear approximation, or linearization, of f near the point x. This latter property is usually taken as the definition of the derivative.

A closely related notion is the differential of a function.

The tangent line at (x,f(x))

When x and y are real variables, the derivative of f at x is the slope of the tangent line to the graph of f at x. Because the source and target of f are one-dimensional, the derivative of f is a real number. If x and y are vectors, then the best linear approximation to the graph of f depends on how fchanges in several directions at once. Taking the best linear approximation in a single direction determines a partial derivative, which is usually denoted ∂y/∂x. The linearization of f in all directions at once is called the total derivative.

[EDIT]HISTORY OF DIFFERENTIATION

Main article: History of calculus

The concept of a derivative in the sense of a tangent line is a very old one, familiar to Greek geometers such as Euclid (c. 300 BC),Archimedes (c. 287–212 BC) and Apollonius of Perga (c. 262–190 BC).^[1] Archimedes also introduced the use of infinitesimals, although these were primarily used to study areas and volumes rather than derivatives and tangents; see Archimedes' use of infinitesimals.

The use of infinitesimals to study rates of change can be found in Indian mathematics, perhaps as early as 500 AD, when the astronomer and mathematician Aryabhata (476–550) used infinitesimals to study the motion of the moon.^[2] The use of infinitesimals to compute rates of change was developed significantly by Bhāskara II (1114–1185); indeed, it has been argued^[3] that many of the key notions of differential calculus can be found in his work, such as "Rolle's theorem".^[4] The Persian mathematician, Sharaf al-Dīn al-Tūsī (1135–1213), was the first to discover the derivative of cubic polynomials, an important result in differential calculus;^[5] his Treatise on Equationsdeveloped concepts related to differential calculus, such as the derivative function and the maxima and minima of curves, in order to solve cubic equations which may not have positive solutions.^[6]

The modern development of calculus is usually credited to Isaac Newton (1643–1727) and Gottfried Leibniz (1646–1716), who provided independent^[7] and unified approaches to differentiation and derivatives. The key insight, however, that earned them this credit, was the fundamental theorem of calculus relating differentiation and integration: this rendered obsolete most previous methods for computing areas and volumes,^[8] which had not been significantly extended since the time of Ibn al-Haytham (Alhazen).^[9] For their ideas on derivatives, both Newton and Leibniz built on significant earlier work by mathematicians such as Isaac Barrow (1630–1677), René Descartes (1596–1650), Christiaan Huygens (1629–1695), Blaise Pascal (1623–1662) and John Wallis(1616–1703). Isaac Barrow is generally given credit for the early development of the derivative.^[10] Nevertheless, Newton and Leibniz remain key figures in the history of differentiation, not least because Newton was the first to apply differentiation to theoretical physics, while Leibniz systematically developed much of the notation still used today.

Since the 17th century many mathematicians have contributed to the theory of differentiation. In the 19th century, calculus was put on a much more rigorous footing by mathematicians such asAugustin Louis Cauchy (1789–1857), Bernhard Riemann (1826–1866), and Karl Weierstrass (1815–1897). It was also during this period that the differentiation was generalized to Euclidean spaceand the complex plane.

[EDIT]APPLICATIONS OF DERIVATIVES

[edit]Optimization

If f is a differentiable function on R (or an open interval) and x is a local maximum or a local minimum of f, then the derivative of f at x is zero; points where f'(x) = 0 are called critical points orstationary points (and the value of f at x is called a critical value). (The definition of a critical point is sometimes extended to include points where the derivative does not exist.) Conversely, a critical point x of f can be analysed by considering the second derivative of f at x:

• if it is positive, x is a local minimum;
• if it is negative, x is a local maximum;
• if it is zero, then x could be a local minimum, a local maximum, or neither. (For example, f(x) = x³ has a critical point at x = 0, but it has neither a maximum nor a minimum there, whereasf(x) = ±x⁴ has a critical point at x = 0 and a minimum and a maximum, respectively, there.)

This is called the second derivative test. An alternative approach, called the first derivative test, involves considering the sign of the f' on each side of the critical point.

Taking derivatives and solving for critical points is therefore often a simple way to find local minima or maxima, which can be useful in optimization. By the extreme value theorem, a continuous function on a closed interval must attain its minimum and maximum values at least once. If the function is differentiable, the minima and maxima can only occur at critical points or endpoints.

This also has applications in graph sketching: once the local minima and maxima of a differentiable function have been found, a rough plot of the graph can be obtained from the observation that it will be either increasing or decreasing between critical points.

In higher dimensions, a critical point of a scalar valued function is a point at which the gradient is zero. The second derivative test can still be used to analyse critical points by considering theeigenvalues of the Hessian matrix of second partial derivatives of the function at the critical point. If all of the eigenvalues are positive, then the point is a local minimum; if all are negative, it is a local maximum. If there are some positive and some negative eigenvalues, then the critical point is a saddle point, and if none of these cases hold (i.e., some of the eigenvalues are zero) then the test is inconclusive.

[edit]Calculus of variations

Main article: Calculus of variations

One example of an optimization problem is: Find the shortest curve between two points on a surface, assuming that the curve must also lie on the surface. If the surface is a plane, then the shortest curve is a line. But if the surface is, for example, egg-shaped, then the shortest path is not immediately clear. These paths are called geodesics, and one of the simplest problems in the calculus of variations is finding geodesics. Another example is: Find the smallest area surface filling in a closed curve in space. This surface is called a minimal surface and it, too, can be found using the calculus of variations.

[edit]Physics

Calculus is of vital importance in physics: many physical processes are described by equations involving derivatives, called differential equations. Physics is particularly concerned with the way quantities change and evolve over time, and the concept of the "time derivative" — the rate of change over time — is essential for the precise definition of several important concepts. In particular, the time derivatives of an object's position are significant in Newtonian physics:

• velocity is the derivative (with respect to time) of an object's displacement (distance from the original position)
• acceleration is the derivative (with respect to time) of an object's velocity, that is, the second derivative (with respect to time) of an object's position.

For example, if an object's position on a line is given by

then the object's velocity is

and the object's acceleration is

which is constant.

[edit]Differential equations

Main article: Differential equation

A differential equation is a relation between a collection of functions and their derivatives. An ordinary differential equation is a differential equation that relates functions of one variable to their derivatives with respect to that variable. A partial differential equation is a differential equation that relates functions of more than one variable to their partial derivatives. Differential equations arise naturally in the physical sciences, in mathematical modelling, and within mathematics itself. For example, Newton's second law, which describes the relationship between acceleration and force, can be stated as the ordinary differential equation

The heat equation in one space variable, which describes how heat diffuses through a straight rod, is the partial differential equation

Here u(x,t) is the temperature of the rod at position x and time t and α is a constant that depends on how fast heat diffuses through the rod.

[edit]Mean value theorem

Main article: Mean value theorem

The mean value theorem gives a relationship between values of the derivative and values of the original function. If f(x) is a real-valued function and a and b are numbers with a < b, then the mean value theorem says that under mild hypotheses, the slope between the two points (a,f(a)) and (b,f(b)) is equal to the slope of the tangent line to f at some point c between a and b. In other words,

In practice, what the mean value theorem does is control a function in terms of its derivative. For instance, suppose that f has derivative equal to zero at each point. This means that its tangent line is horizontal at every point, so the function should also be horizontal. The mean value theorem proves that this must be true: The slope between any two points on the graph of f must equal the slope of one of the tangent lines of f. All of those slopes are zero, so any line from one point on the graph to another point will also have slope zero. But that says that the function does not move up or down, so it must be a horizontal line. More complicated conditions on the derivative lead to less precise but still highly useful information about the original function.

[edit]Taylor polynomials and Taylor series

Main articles: Taylor polynomial and Taylor series

The derivative gives the best possible linear approximation, but this can be very different from the original function. One way of improving the approximation is to take a quadratic approximation. That is to say, the linearization of a real-valued function f(x) at the point x₀ is a linear polynomial a + b(x − x₀), and it may be possible to get a better approximation by considering a quadratic polynomial a + b(x − x₀) + c(x − x₀)². Still better might be a cubic polynomial a + b(x − x₀) + c(x − x₀)² + d(x − x₀)³, and this idea can be extended to arbitrarily high degree polynomials. For each one of these polynomials, there should be a best possible choice of coefficients a, b, c, and d that makes the approximation as good as possible.

In the neighbourhood of x₀, for a the best possible choice is always f(x₀), and for b the best possible choice is always f'(x₀). For c, d, and higher-degree coefficients, these coefficients are determined by higher derivatives of f. c should always be f''(x₀)/2, and d should always be f'''(x₀)/3!. Using these coefficients gives the Taylor polynomial of f. The Taylor polynomial of degree d is the polynomial of degree d which best approximates f, and its coefficients can be found by a generalization of the above formulas. Taylor's theorem gives a precise bound on how good the approximation is. If f is a polynomial of degree less than or equal to d, then the Taylor polynomial of degree d equals f.

The limit of the Taylor polynomials is an infinite series called the Taylor series. The Taylor series is frequently a very good approximation to the original function. Functions which are equal to their Taylor series are called analytic functions. It is impossible for functions with discontinuities or sharp corners to be analytic, but there are smooth functions which are not analytic.