Home Random quiz Cards

Chapter 10

Initial-Value Problems for Ordinary Differential Equations

Rendered from the uploaded full LaTeX source with KaTeX. No PDF, no PDF.js, no image extraction, and no raw LaTeX displayed.

Learning goals

After completing this chapter, the reader should be able to:

  1. formulate initial-value problems and distinguish local and global error;

  2. derive Euler, backward Euler, trapezoidal, and theta methods;

  3. derive explicit Runge–Kutta methods of orders two, three, four, and higher;

  4. write and use explicit stage formulas, not only Butcher tableaux;

  5. understand embedded Runge–Kutta pairs and adaptive step-size control;

  6. analyze absolute stability regions using the test equation y'=\lambda y;

  7. explain stiffness and why implicit methods are needed;

  8. derive Adams–Bashforth, Adams–Moulton, and BDF multistep formulas;

  9. understand polynomial, Taylor, Hermite–Obreschkoff, collocation, and Chebyshev time-spectral methods for IVPs;

  10. compare finite-step marching methods with global polynomial methods;

  11. solve basic, advanced, and research-level exercises on IVP solvers.

Initial-Value Problems

An initial-value problem is y'(t)=f(t,y(t)), \qquad y(t_0)=y_0. Here y(t)\in\mathbb R^d, \qquad f:[t_0,T]\times\mathbb R^d\to\mathbb R^d. A numerical method produces approximations y_n\approx y(t_n), \qquad t_n=t_0+nh.

Key point: Central idea

An IVP solver advances information forward in time. Its quality depends on consistency, stability, error control, stiffness handling, and the smoothness of the solution.

The integral form of the IVP is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}} f(s,y(s))\,\dd s. Most one-step methods approximate this integral.

Existence, Uniqueness, and Flow Maps

Theorem: Picard–Lindelof theorem

Suppose f(t,y) is continuous in t and Lipschitz continuous in y on a rectangle containing (t_0,y_0). Then the IVP y'=f(t,y), \qquad y(t_0)=y_0 has a unique local solution.

Proof

The IVP is equivalent to the integral equation y(t)=y_0+\int_{t_0}^{t} f(s,y(s))\,\dd s. Define the Picard operator (\mathcal T y)(t)=y_0+\int_{t_0}^{t} f(s,y(s))\,\dd s. On a sufficiently short interval, the Lipschitz constant of \mathcal T is less than one in the sup norm. Hence \mathcal T is a contraction on a closed complete set of continuous functions. Banach’s fixed-point theorem gives a unique fixed point, which is the local solution.

The exact solution operator from t_n to t_{n+1} is the flow map y(t_{n+1})=\Phi_h(t_n,y(t_n)). A one-step numerical method replaces \Phi_h by a computable map y_{n+1}=\Psi_h(t_n,y_n).

Euler’s Method

The simplest approximation is \int_{t_n}^{t_{n+1}} f(s,y(s))\,\dd s \approx h f(t_n,y_n). This gives explicit Euler: y_{n+1}=y_n+h f(t_n,y_n).

Algorithm
Caption.

Explicit Euler method

  1. f, t_0, y_0, step size h, number of steps N

  2. t\gets t_0, y\gets y_0

  3. For n=0,\ldots,N-1:

  4. y\gets y+h f(t,y)

  5. t\gets t+h

  6. Return y

Theorem: Local truncation error of explicit Euler

If the exact solution is twice continuously differentiable, then one step of explicit Euler has local truncation error y(t_{n+1})-y(t_n)-h f(t_n,y(t_n)) = \frac{h^2}{2}y''(\xi_n) for some \xi_n\in(t_n,t_{n+1}). Thus explicit Euler has local error O(h^2) and global order one.

Proof

Taylor’s theorem gives y(t_n+h)=y(t_n)+hy'(t_n)+\frac{h^2}{2}y''(\xi_n). Since y'(t_n)=f(t_n,y(t_n)), the stated local error formula follows. Accumulating O(h^2) local errors over O(1/h) steps under a stability bound gives global error O(h).

Backward Euler and the Theta Method

Backward Euler uses the endpoint value of the vector field: y_{n+1}=y_n+h f(t_{n+1},y_{n+1}). It is implicit because y_{n+1} appears on both sides.

The theta method is y_{n+1} = y_n+h\left[ (1-\theta)f(t_n,y_n) + \theta f(t_{n+1},y_{n+1}) \right]. Special cases are: \theta=0 \quad \text{explicit Euler}, \theta=1 \quad \text{backward Euler}, \theta=\frac12 \quad \text{trapezoidal rule}.

Theorem: Order of the theta method

The theta method is first order for \theta\ne1/2 and second order for \theta=1/2.

Proof

Insert the exact solution into the method and expand y(t_n+h) = y(t_n)+hy'(t_n)+\frac{h^2}{2}y''(t_n)+O(h^3). Also, f(t_n+h,y(t_n+h))=y'(t_n+h)=y'(t_n)+hy''(t_n)+O(h^2). The theta method predicts y(t_n)+h\left[(1-\theta)y'(t_n)+\theta y'(t_n+h)\right] = y(t_n)+hy'(t_n)+\theta h^2y''(t_n)+O(h^3). The h^2 terms agree exactly when \theta=\frac12. Thus the local error is O(h^3) for \theta=1/2, giving global order two; it is O(h^2) otherwise, giving global order one.

Consistency, Stability, and Convergence

A one-step method is consistent if its local truncation error tends to zero faster than h. A method is stable if perturbations do not grow uncontrollably. A method is convergent if \max_{0\le n\le N}\|y_n-y(t_n)\|\to0 \qquad \text{as }h\to0.

Theorem: One-step convergence theorem

Suppose a one-step method is consistent of order p and its numerical flow is Lipschitz stable on the interval of integration. Then the global error is \max_n\|y_n-y(t_n)\|=O(h^p).

Proof

Let e_n=y_n-y(t_n). The numerical one-step map satisfies y_{n+1}=\Psi_h(t_n,y_n), while the exact solution satisfies y(t_{n+1})=\Psi_h(t_n,y(t_n))+\tau_{n+1}, where \|\tau_{n+1}\|\le Ch^{p+1}. Lipschitz stability gives \|e_{n+1}\| \le (1+Lh)\|e_n\|+Ch^{p+1}. Discrete Gronwall’s inequality yields \|e_n\|\le C_T h^p on a fixed interval.

Runge–Kutta Methods

Runge–Kutta methods approximate the integral over a step by evaluating the vector field at several internal stages. An s-stage Runge–Kutta method has stages k_i=f\left(t_n+c_i h,\, y_n+h\sum_{j=1}^{s}a_{ij}k_j\right), \qquad i=1,\ldots,s, and update y_{n+1}=y_n+h\sum_{i=1}^{s}b_i k_i. If a_{ij}=0 for j\ge i, the method is explicit.

The coefficients are often displayed in a Butcher tableau: \begin{array}{c|cccc} c_1&a_{11}&a_{12}&\cdots&a_{1s}\\ c_2&a_{21}&a_{22}&\cdots&a_{2s}\\ \vdots&\vdots&\vdots&\ddots&\vdots\\ c_s&a_{s1}&a_{s2}&\cdots&a_{ss}\\ \hline &b_1&b_2&\cdots&b_s \end{array}.

Second-Order Runge–Kutta Methods

A general two-stage explicit Runge–Kutta method can be written k_1=f(t_n,y_n), k_2=f(t_n+\alpha h,y_n+\alpha h k_1), y_{n+1}=y_n+h\left[ \left(1-\frac{1}{2\alpha}\right)k_1 + \frac{1}{2\alpha}k_2 \right], \qquad \alpha\ne0. This family is second order.

Important cases are:

\text{Midpoint RK2:} k_1=f(t_n,y_n), k_2=f\left(t_n+\frac{h}{2},y_n+\frac{h}{2}k_1\right), y_{n+1}=y_n+h k_2.

\text{Heun RK2:} k_1=f(t_n,y_n), k_2=f(t_n+h,y_n+hk_1), y_{n+1}=y_n+\frac{h}{2}(k_1+k_2).

Theorem: Order conditions for explicit RK2

The two-stage method k_1=f(t_n,y_n), \qquad k_2=f(t_n+\alpha h,y_n+\alpha h k_1), y_{n+1}=y_n+h(b_1k_1+b_2k_2) is second order if and only if b_1+b_2=1, \qquad b_2\alpha=\frac12.

Proof

Expand k_2 about (t_n,y_n): k_2=f+h\alpha(f_t+f_y f)+O(h^2). The method gives y_{n+1}=y_n+h(b_1+b_2)f+h^2b_2\alpha(f_t+f_yf)+O(h^3). The exact Taylor expansion is y(t_n+h)=y_n+hf+\frac{h^2}{2}(f_t+f_yf)+O(h^3). Equating coefficients gives b_1+b_2=1, \qquad b_2\alpha=\frac12.

Third-Order Runge–Kutta Methods

A classical third-order explicit Runge–Kutta method is k_1=f(t_n,y_n), k_2=f\left(t_n+\frac{h}{2},y_n+\frac{h}{2}k_1\right), k_3=f\left(t_n+h,y_n-hk_1+2hk_2\right), y_{n+1}=y_n+\frac{h}{6}(k_1+4k_2+k_3).

Another third-order method, often called Heun’s third-order method, is k_1=f(t_n,y_n), k_2=f\left(t_n+\frac{h}{3},y_n+\frac{h}{3}k_1\right), k_3=f\left(t_n+\frac{2h}{3},y_n+\frac{2h}{3}k_2\right), y_{n+1}=y_n+\frac{h}{4}(k_1+3k_3).

Classical Fourth-Order Runge–Kutta Method

The classical RK4 method is k_1=f(t_n,y_n), k_2=f\left(t_n+\frac{h}{2},y_n+\frac{h}{2}k_1\right), k_3=f\left(t_n+\frac{h}{2},y_n+\frac{h}{2}k_2\right), k_4=f(t_n+h,y_n+hk_3), and y_{n+1}=y_n+\frac{h}{6} (k_1+2k_2+2k_3+k_4).

Algorithm
Caption.

Classical fourth-order Runge–Kutta method

  1. f, t_n, y_n, step size h

  2. k_1\gets f(t_n,y_n)

  3. k_2\gets f(t_n+h/2,y_n+(h/2)k_1)

  4. k_3\gets f(t_n+h/2,y_n+(h/2)k_2)

  5. k_4\gets f(t_n+h,y_n+hk_3)

  6. y_{n+1}\gets y_n+(h/6)(k_1+2k_2+2k_3+k_4)

  7. Return y_{n+1}

Theorem: Order of RK4

The classical RK4 method has global order four for sufficiently smooth solutions.

Proof

Expanding the four stages in Taylor series and substituting into the RK4 weighted average shows that the numerical increment agrees with the exact Taylor expansion of the solution through all terms of degree four in h. The local truncation error is therefore O(h^5). Under one-step stability on a finite interval, the global error is O(h^4).

Other Explicit Fourth-Order RK Methods

The Kutta 3/8 fourth-order method is k_1=f(t_n,y_n), k_2=f\left(t_n+\frac{h}{3},y_n+\frac{h}{3}k_1\right), k_3=f\left(t_n+\frac{2h}{3}, y_n-\frac{h}{3}k_1+h k_2\right), k_4=f\left(t_n+h, y_n+h k_1-h k_2+h k_3\right), y_{n+1} = y_n+\frac{h}{8}(k_1+3k_2+3k_3+k_4).

Another fourth-order method is the Ralston fourth-order method. One version is k_1=f(t_n,y_n), k_2=f\left(t_n+\frac{2h}{5}, y_n+\frac{2h}{5}k_1\right), k_3=f\left(t_n+\frac{7h}{8}, y_n+h\left(\frac{29697761}{39175800}k_1 +\frac{10904423}{39175800}k_2\right)\right), k_4=f\left(t_n+h, y_n+h\left(\frac{115075}{11282082432}k_1 -\frac{210788423}{11282082432}k_2 +\frac{111935693}{1880347072}k_3\right)\right), with an associated fourth-order weighted average. The main lesson is that order four does not determine a unique method. Coefficients can be optimized for error constants, stability, or storage.

Chapter summary: Explicit RK formulas to remember

\text{RK2 midpoint: } y_{n+1}=y_n+h f\left(t_n+\frac h2,y_n+\frac h2 f(t_n,y_n)\right). \text{RK3 classical: } y_{n+1}=y_n+\frac h6(k_1+4k_2+k_3). \text{RK4 classical: } y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). \text{Kutta }3/8: y_{n+1}=y_n+\frac h8(k_1+3k_2+3k_3+k_4).

Higher-Order Explicit Runge–Kutta Methods

For order five and beyond, explicit Runge–Kutta methods require more stages and more order conditions. In practice, higher-order explicit methods are usually used as embedded pairs.

Runge–Kutta–Fehlberg 4(5)

The Fehlberg method computes two approximations of different orders using shared stages. A common RKF45 stage structure is k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h4, y_n+h\frac14 k_1\right), k_3=f\left(t_n+\frac{3h}{8}, y_n+h\left(\frac{3}{32}k_1+\frac{9}{32}k_2\right)\right), k_4=f\left(t_n+\frac{12h}{13}, y_n+h\left( \frac{1932}{2197}k_1-\frac{7200}{2197}k_2+\frac{7296}{2197}k_3 \right)\right), k_5=f\left(t_n+h, y_n+h\left( \frac{439}{216}k_1-8k_2+\frac{3680}{513}k_3-\frac{845}{4104}k_4 \right)\right), k_6=f\left(t_n+\frac h2, y_n+h\left( -\frac{8}{27}k_1+2k_2-\frac{3544}{2565}k_3 +\frac{1859}{4104}k_4-\frac{11}{40}k_5 \right)\right). The fourth-order approximation is y_{n+1}^{[4]} = y_n+h\left( \frac{25}{216}k_1 +\frac{1408}{2565}k_3 +\frac{2197}{4104}k_4 -\frac15 k_5 \right), and the fifth-order approximation is y_{n+1}^{[5]} = y_n+h\left( \frac{16}{135}k_1 +\frac{6656}{12825}k_3 +\frac{28561}{56430}k_4 -\frac{9}{50}k_5 +\frac{2}{55}k_6 \right). The difference e_{n+1}=y_{n+1}^{[5]}-y_{n+1}^{[4]} is used for error estimation.

Dormand–Prince 5(4)

The Dormand–Prince pair is a widely used explicit RK method. It uses seven stages: k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h5, y_n+h\frac15 k_1\right), k_3=f\left(t_n+\frac{3h}{10}, y_n+h\left(\frac{3}{40}k_1+\frac{9}{40}k_2\right)\right), k_4=f\left(t_n+\frac{4h}{5}, y_n+h\left(\frac{44}{45}k_1-\frac{56}{15}k_2+\frac{32}{9}k_3\right)\right), k_5=f\left(t_n+\frac{8h}{9}, y_n+h\left( \frac{19372}{6561}k_1-\frac{25360}{2187}k_2 +\frac{64448}{6561}k_3-\frac{212}{729}k_4 \right)\right), k_6=f\left(t_n+h, y_n+h\left( \frac{9017}{3168}k_1-\frac{355}{33}k_2 +\frac{46732}{5247}k_3+\frac{49}{176}k_4 -\frac{5103}{18656}k_5 \right)\right), k_7=f\left(t_n+h, y_n+h\left( \frac{35}{384}k_1+\frac{500}{1113}k_3 +\frac{125}{192}k_4-\frac{2187}{6784}k_5 +\frac{11}{84}k_6 \right)\right). The fifth-order solution is y_{n+1}^{[5]} = y_n+h\left( \frac{35}{384}k_1 +\frac{500}{1113}k_3 +\frac{125}{192}k_4 -\frac{2187}{6784}k_5 +\frac{11}{84}k_6 \right). The embedded fourth-order solution is y_{n+1}^{[4]} = y_n+h\left( \frac{5179}{57600}k_1 +\frac{7571}{16695}k_3 +\frac{393}{640}k_4 -\frac{92097}{339200}k_5 +\frac{187}{2100}k_6 +\frac{1}{40}k_7 \right). Again, e_{n+1}=y_{n+1}^{[5]}-y_{n+1}^{[4]} estimates the local error.

Adaptive Step-Size Control

Suppose an embedded method gives approximations y_{n+1}^{[p]} and y_{n+1}^{[p+1]}. Define e_{n+1}=y_{n+1}^{[p+1]}-y_{n+1}^{[p]}. A scaled error measure is E= \left[ \frac1d\sum_{i=1}^d \left( \frac{e_i}{\mathrm{atol}+\mathrm{rtol}\max(|y_{n,i}|,|y_{n+1,i}|)} \right)^2 \right]^{1/2}. Accept the step if E\le1. A typical new step size is h_{\mathrm{new}} = h\cdot \min\left(q_{\max}, \max\left(q_{\min}, s E^{-1/(p+1)} \right)\right), where s\in(0,1) is a safety factor.

Algorithm
Caption.

Adaptive embedded Runge–Kutta step

  1. f, t, y, step h, tolerances \mathrm{atol},\mathrm{rtol}

  2. Compute embedded approximations y^{[p]} and y^{[p+1]}

  3. Estimate scaled error E

  4. If E\le1:

  5. Accept: t\gets t+h, y\gets y^{[p+1]}

  6. Else:

  7. Reject the step

  8. Update h\gets h\min(q_{\max},\max(q_{\min},sE^{-1/(p+1)}))

  9. Return updated t,y,h

Stability Regions

Apply a method to the test equation y'=\lambda y. Let z=h\lambda. A one-step method produces y_{n+1}=R(z)y_n, where R(z) is the stability function. The absolute stability region is \mathcal S=\{z\in\mathbb C:|R(z)|\le1\}.

For explicit Euler, R(z)=1+z, so the stability condition is |1+z|\le1. For RK4, R(z)= 1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}.

Theorem: Stability function of explicit RK methods

For an explicit s-stage Runge–Kutta method applied to y'=\lambda y, the stability function R(z) is a polynomial of degree at most s.

Proof

For the test equation, every stage is a scalar multiple of y_n. Since the method is explicit, the stages are computed recursively, and each stage is a polynomial in z=h\lambda times y_n. The final update is a linear combination of these stage polynomials, hence y_{n+1}=R(z)y_n with R a polynomial of degree at most s.

Figure 10.1 Euler slope step Euler follows the local slope across one time step.
Open visual gallery

Stiffness

A problem is stiff when stability forces an explicit method to take step sizes much smaller than those required by accuracy. For the test equation y'=\lambda y, \qquad \operatorname{Re}\lambda<0, explicit Euler requires |1+h\lambda|\le1. If \lambda is large and negative, this imposes a severe restriction on h.

Backward Euler has y_{n+1}=y_n+h\lambda y_{n+1}, so y_{n+1}=\frac{1}{1-z}y_n, \qquad z=h\lambda. Thus R(z)=\frac{1}{1-z}. It is stable for all \operatorname{Re}z\le0.

Definition: A-stability

A method is A-stable if its stability region contains the entire left half-plane: \{z\in\mathbb C:\operatorname{Re}z\le0\}.

Theorem: Backward Euler is A-stable

Backward Euler is A-stable.

Proof

For the test equation, R(z)=\frac{1}{1-z}. If \operatorname{Re}z\le0, then |1-z|\ge1. Therefore |R(z)|=\frac1{|1-z|}\le1. Thus the entire left half-plane lies in the stability region.

Linear Multistep Methods

A k-step linear multistep method has the form \sum_{j=0}^{k}\alpha_j y_{n+j} = h\sum_{j=0}^{k}\beta_j f(t_{n+j},y_{n+j}). If \beta_k=0, the method is explicit. If \beta_k\ne0, it is implicit.

Adams–Bashforth Methods

The two-step Adams–Bashforth method is y_{n+1}=y_n+\frac{h}{2} \left( 3f_n-f_{n-1} \right). The three-step Adams–Bashforth method is y_{n+1}=y_n+\frac{h}{12} \left( 23f_n-16f_{n-1}+5f_{n-2} \right). The four-step Adams–Bashforth method is y_{n+1}=y_n+\frac{h}{24} \left( 55f_n-59f_{n-1}+37f_{n-2}-9f_{n-3} \right).

Adams–Moulton Methods

The trapezoidal method is the one-step Adams–Moulton method: y_{n+1}=y_n+\frac h2(f_{n+1}+f_n). The two-step Adams–Moulton method is y_{n+1}=y_n+\frac h{12} \left( 5f_{n+1}+8f_n-f_{n-1} \right). The three-step Adams–Moulton method is y_{n+1}=y_n+\frac h{24} \left( 9f_{n+1}+19f_n-5f_{n-1}+f_{n-2} \right).

Backward Differentiation Formulas

BDF methods approximate y' by differentiating an interpolation polynomial through past solution values. BDF1 is backward Euler: y_{n+1}-y_n=h f_{n+1}. BDF2 is \frac{3y_{n+1}-4y_n+y_{n-1}}{2h}=f_{n+1}. BDF3 is \frac{11y_{n+1}-18y_n+9y_{n-1}-2y_{n-2}}{6h}=f_{n+1}.

Chapter summary: Multistep methods

Adams–Bashforth methods are explicit and efficient for nonstiff problems. Adams–Moulton methods are implicit and often used in predictor–corrector pairs. BDF methods are implicit and important for stiff systems.

Zero-Stability and Dahlquist Equivalence

For a linear multistep method, define the first characteristic polynomial \rho(\xi)=\sum_{j=0}^{k}\alpha_j\xi^j.

Definition: Root condition

A multistep method satisfies the root condition if every root \xi of \rho(\xi) satisfies |\xi|\le1, and every root with |\xi|=1 is simple.

Theorem: Dahlquist equivalence theorem

For a consistent linear multistep method, convergence is equivalent to zero-stability.

Proof

The proof separates the error into a local truncation part and a propagation part. Consistency makes the local defect vanish with h. Zero-stability, expressed by the root condition, prevents the accumulated defects from growing without bound. Together they imply convergence. Conversely, if the method is convergent, perturbing the starting values shows that parasitic modes must remain bounded, which is exactly zero-stability.

Polynomial and Taylor Methods

Taylor methods use derivatives of the solution: y(t_n+h) = y_n+hy'_n+\frac{h^2}{2}y''_n+\cdots+\frac{h^p}{p!}y_n^{(p)} +O(h^{p+1}). Since y'=f(t,y), higher derivatives can be obtained by repeated differentiation: y''=f_t+f_y f. The third derivative is y^{(3)} = f_{tt}+2f_{ty}f+f_{yy}(f,f)+f_y(f_t+f_yf), where f_{yy}(f,f) denotes the bilinear second derivative applied to f twice.

A polynomial one-step method may approximate the solution on a step by y_n(t)=\sum_{j=0}^{p} a_j(t-t_n)^j and impose differential equation conditions at selected points.

Algorithm
Caption.

Taylor method of order p

  1. f, derivative functions F_j(t,y)\approx y^{(j)}(t), order p

  2. For n=0,\ldots,N-1:

  3. y_{n+1}\gets y_n+\sum_{j=1}^{p}\dfrac{h^j}{j!}F_j(t_n,y_n)

  4. t_{n+1}\gets t_n+h

  5. Return y_N

Collocation Methods

Collocation methods seek a polynomial u(t) on [t_n,t_{n+1}] satisfying u(t_n)=y_n, and u'(t_n+c_i h)=f(t_n+c_i h,u(t_n+c_i h)), \qquad i=1,\ldots,s. The next value is y_{n+1}=u(t_{n+1}). Collocation methods are Runge–Kutta methods. Gauss collocation methods have order 2s. Radau and Lobatto methods include one or both endpoints and are important for stiff problems.

Theorem: Order of Gauss collocation

An s-stage Gauss collocation method has order 2s.

Proof

Gauss collocation is equivalent to integrating the polynomial interpolant of the vector field at Gauss nodes. Gauss quadrature with s nodes is exact for polynomials of degree at most 2s-1. The collocation residual and quadrature exactness imply that the one-step method matches the exact integral expansion through order 2s, giving order 2s.

Hermite–Obreschkoff Methods

Hermite–Obreschkoff methods use derivatives at both endpoints. A simple symmetric example is y_{n+1}=y_n+\frac h2(y'_n+y'_{n+1}) -\frac{h^2}{12}(y''_{n+1}-y''_n)+O(h^5). Since y'_n=f(t_n,y_n), and y''=f_t+f_yf, these methods can achieve high order with compact formulas, often implicitly.

Chebyshev Polynomial Methods for IVPs

Chebyshev methods approximate the entire solution over a time interval by a global polynomial. Map t\in[t_0,T] to x\in[-1,1] using t=\frac{T-t_0}{2}x+\frac{T+t_0}{2}. Then \frac{\dd}{\dd t} = \frac{2}{T-t_0}\frac{\dd}{\dd x}. Approximate y(t(x))\approx Y_N(x)=\sum_{k=0}^{N} a_k T_k(x), ] where \(T_k\) are Chebyshev polynomials. At Chebyshev--Gauss--Lobatto nodes \[ x_j=\cos\left(\frac{\pi j}{N}\right), \qquad j=0,\ldots,N, let D be the Chebyshev differentiation matrix. The IVP collocation equations are \frac{2}{T-t_0}(D\mathbf Y)_j = f(t_j,Y_j), \qquad j=0,\ldots,N-1, together with the initial condition Y_N=y_0 if x_N=-1 corresponds to t=t_0. Depending on ordering, the initial condition is imposed at the node corresponding to x=-1.

Algorithm
Caption.

Chebyshev collocation method for an IVP

  1. f, interval [t_0,T], initial value y_0, degree N

  2. Construct Chebyshev–Gauss–Lobatto nodes x_j=\cos(\pi j/N)

  3. Map nodes to t_j=(T-t_0)x_j/2+(T+t_0)/2

  4. Construct Chebyshev differentiation matrix D

  5. Form nonlinear equations

  6. \item \frac{2}{T-t_0}(D\mathbf Y)_j=f(t_j,Y_j) \item

  7. at collocation nodes, replacing one equation by Y(t_0)=y_0

  8. Solve the nonlinear algebraic system for \mathbf Y

  9. Return polynomial interpolant Y_N(t)

Theorem: Spectral accuracy of Chebyshev IVP collocation

If the IVP solution is analytic on and near the time interval and the nonlinear collocation equations are solved accurately, Chebyshev collocation can converge spectrally with respect to the polynomial degree N.

Proof

Analyticity of the solution implies rapid decay of its Chebyshev coefficients. The Chebyshev interpolant therefore converges geometrically in suitable norms. Since the differential equation is imposed at spectral collocation nodes and the derivative is computed by differentiating the interpolant, the residual inherits spectral decay provided the nonlinear solve is accurate and the problem is well conditioned.

Chapter summary: Chebyshev IVP methods versus time-marching
Time-marching RK methods.

Advance step by step. They are flexible, adaptive, and robust for long intervals.

Chebyshev collocation.

Approximates the whole solution on an interval by a polynomial. It can be extremely accurate for smooth analytic solutions.

Practical challenge.

Chebyshev IVP collocation leads to global nonlinear algebraic systems and can be less convenient for long-time integration or problems with sharp transitions.

Best use.

Short-to-moderate intervals with smooth solutions, boundary/initial constraints, or when a high-order global-in-time approximation is desired.

Figure 10.2 Heun predictor-corrector Heun averages predictor and corrected slopes.
Open visual gallery

Spectral Deferred Correction and Polynomial Correction

Spectral deferred correction methods start with a low-order approximation on a set of quadrature nodes and iteratively correct the integral equation y(t)=y(t_n)+\int_{t_n}^{t}f(s,y(s))\,\dd s. Using high-order quadrature nodes, such as Gauss, Radau, Lobatto, or Chebyshev nodes, successive corrections increase the order.

A correction equation has the schematic form e(t)= \int_{t_n}^{t} \left[ f(s,y^{(m)}(s)+e(s))-f(s,y^{(m)}(s)) \right]\dd s + \delta^{(m)}(t), where \delta^{(m)} is the current defect in the integral equation.

Dense Output and Event Detection

Many applications require approximations between time nodes. Dense output constructs a polynomial P_n(t) such that P_n(t_n)=y_n, \qquad P_n(t_{n+1})=y_{n+1}, and possibly matches stage derivatives. Event detection solves g(t,y(t))=0 inside a time step, often using dense output and root-finding.

Practical Comparison of IVP Methods

Chapter summary: Choosing an IVP solver
Explicit Euler.

Useful for teaching and quick prototypes. Rarely adequate for high accuracy.

RK2/RK3.

Good low-cost methods when moderate accuracy is enough.

RK4.

Excellent fixed-step nonstiff method. Simple and reliable for smooth problems.

Embedded RK45.

Standard choice for nonstiff adaptive integration.

Dormand–Prince.

A high-quality embedded RK pair widely used in practical solvers.

Backward Euler.

First-order but robust for stiff decay.

Trapezoidal rule.

Second-order A-stable, but can oscillate on very stiff components.

BDF methods.

Important for stiff systems, especially variable-order implementations.

Adams methods.

Efficient for smooth nonstiff problems when past values are available.

Collocation methods.

High-order implicit methods with strong stability properties.

Chebyshev and polynomial time methods.

Potentially spectral for smooth solutions on bounded intervals, but require solving global or block systems.

SDC methods.

Flexible high-order correction framework connecting quadrature, collocation, and time stepping.

Exercises

The following exercise bank is intentionally large. Basic problems test definitions, computations, and essential formulas. Starred exercises require proofs, careful stability analysis, or advanced numerical ODE arguments. Problems marked \star, \star\star, and \star\star\star are progressively harder.

Basic problems

Exercise 10.1 Basic Integral form

Derive the integral form y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s.

Exercise 10.2 Basic Euler derivation

Derive explicit Euler by approximating the integral with the left endpoint rule.

Exercise 10.3 Basic Backward Euler

Derive backward Euler by approximating the integral with the right endpoint rule.

Exercise 10.4 Basic Trapezoidal method

Derive the trapezoidal method for IVPs.

Exercise 10.5 Basic Euler local error

Prove the local truncation error formula for explicit Euler.

Exercise 10.6 Basic One Euler step

Apply one explicit Euler step to y'=t+y,\qquad y(0)=1, with h=0.1.

Exercise 10.7 Basic One RK4 step

Write the four stages for one RK4 step applied to y'=y,\qquad y(0)=1.

Exercise 10.8 Basic Midpoint RK2

Write the explicit formulas for midpoint RK2.

Exercise 10.9 Basic Heun method

Write the explicit formulas for Heun’s RK2 method.

Exercise 10.10 Basic Classical RK3

Write the explicit formulas for the classical third-order RK method.

Exercise 10.11 Basic Classical RK4

Write the explicit formulas for classical RK4.

Exercise 10.12 Basic Kutta 3/8

Write the explicit formulas for the Kutta 3/8 fourth-order method.

Exercise 10.13 Basic Stability test equation

For y'=\lambda y, derive the explicit Euler stability function.

Exercise 10.14 Basic Euler stability region

Show that explicit Euler is stable when |1+h\lambda|\le1.

Exercise 10.15 Basic Backward Euler stability

Derive the backward Euler stability function.

Exercise 10.16 Basic Stiffness

Explain stiffness in one paragraph.

Exercise 10.17 Basic Adaptive error estimate

Explain how an embedded RK pair estimates local error.

Exercise 10.18 Basic Adams–Bashforth two-step

Write the AB2 formula.

Exercise 10.19 Basic BDF2

Write the BDF2 formula.

Exercise 10.20 Basic Chebyshev IVP idea

Explain the basic idea of Chebyshev collocation for an IVP.

Intermediate problems \star

Exercise 10.21 Intermediate Picard theorem

Prove the referenced result.

Exercise 10.22 Intermediate Euler local error

Prove the referenced result.

Exercise 10.23 Intermediate Theta method order

Prove the referenced result.

Exercise 10.24 Intermediate One-step convergence

Prove the referenced result.

Exercise 10.25 Intermediate RK2 order conditions

Prove the referenced result.

Exercise 10.26 Intermediate RK4 order

Verify the order-four conditions for classical RK4.

Exercise 10.27 Intermediate Kutta 3/8 order

Verify that the Kutta 3/8 method satisfies fourth-order conditions.

Exercise 10.28 Intermediate RKF45 estimator

Derive the embedded error estimate for the RKF45 formulas given in the chapter.

Exercise 10.29 Intermediate Dormand–Prince estimator

Derive the embedded error estimate for the Dormand–Prince 5(4) formulas.

Exercise 10.30 Intermediate Step-size controller

Derive the adaptive step-size formula h_{\mathrm{new}}=h\,sE^{-1/(p+1)}.

Exercise 10.31 Intermediate RK stability polynomial

Prove the referenced result.

Exercise 10.32 Intermediate RK4 stability function

Derive the RK4 stability polynomial R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}.

Exercise 10.33 Intermediate Backward Euler A-stability

Prove the referenced result.

Exercise 10.34 Intermediate Trapezoidal stability

Show that the trapezoidal rule has stability function R(z)=\frac{1+z/2}{1-z/2}.

Exercise 10.35 Intermediate Adams–Bashforth derivation

Derive AB2 by integrating a linear interpolant of f.

Exercise 10.36 Intermediate Adams–Moulton derivation

Derive the two-step Adams–Moulton formula.

Exercise 10.37 Intermediate BDF2 derivation

Derive BDF2 by differentiating the quadratic interpolant through y_{n+1}, y_n, and y_{n-1}.

Exercise 10.38 Intermediate Root condition

Check the root condition for BDF2.

Exercise 10.39 Intermediate Taylor second derivative

Show that y''=f_t+f_yf.

Exercise 10.40 Intermediate Collocation equations

Derive the collocation equations for a polynomial u(t) on one step.

Exercise 10.41 Intermediate Chebyshev time scaling

Derive the time scaling \frac{\dd}{\dd t}=\frac{2}{T-t_0}\frac{\dd}{\dd x}.

Exercise 10.42 Intermediate Chebyshev collocation equations

Write the Chebyshev collocation equations for the scalar IVP y'=y,\qquad y(0)=1 on [0,1].

Exercise 10.43 Intermediate Dense output

Explain how RK stages can be used to construct dense output.

Exercise 10.44 Intermediate Event detection

Describe how to locate an event g(t,y(t))=0 inside a step.

Exercise 10.45 Intermediate Work precision

Design a work-precision experiment comparing Euler, RK2, RK4, and RK45.

Advanced problems \star\star

Exercise 10.46 Advanced Butcher trees

Introduce rooted trees and derive Runge–Kutta order conditions up to order four.

Exercise 10.47 Advanced Fifth-order RK conditions

Study the order conditions required for an explicit fifth-order Runge–Kutta method.

Exercise 10.48 Advanced FSAL property

Explain the first-same-as-last property of Dormand–Prince methods and its computational advantage.

Exercise 10.49 Advanced Embedded pairs

Analyze how embedded RK pairs share stages to produce two orders at once.

Exercise 10.50 Advanced PI step-size control

Derive a proportional-integral step-size controller for adaptive RK methods.

Exercise 10.51 Advanced Absolute stability of RK4

Numerically plot the absolute stability region of RK4 and determine its intersection with the negative real axis.

Exercise 10.52 Advanced Dahlquist barriers

State the first and second Dahlquist barriers and explain their implications.

Exercise 10.53 Advanced A-stability of trapezoidal rule

Prove that the trapezoidal rule is A-stable but not L-stable.

Exercise 10.54 Advanced L-stability

Define L-stability and show that backward Euler is L-stable.

Exercise 10.55 Advanced Stiff decay

Analyze explicit Euler, backward Euler, and trapezoidal rule on y'=-1000(y-\cos t)-\sin t.

Exercise 10.56 Advanced Newton solves in implicit methods

Derive Newton’s method for solving one backward Euler step.

Exercise 10.57 Advanced Jacobian reuse

Discuss Jacobian reuse and simplified Newton methods for stiff IVP solvers.

Exercise 10.58 Advanced Variable-step BDF

Derive a variable-step BDF2 formula.

Exercise 10.59 Advanced Predictor–corrector

Construct an AB2–AM2 predictor–corrector method and analyze its order.

Exercise 10.60 Advanced Nordsieck representation

Explain the Nordsieck representation for variable-order multistep methods.

Exercise 10.61 Advanced Gauss collocation order

Prove the referenced result.

Exercise 10.62 Advanced Radau IIA

Study Radau IIA methods and explain why they are useful for stiff problems.

Exercise 10.63 Advanced Lobatto methods

Study Lobatto collocation methods and their relation to symplectic integration.

Exercise 10.64 Advanced Symplectic Euler

Derive symplectic Euler for a Hamiltonian system and compare it with explicit Euler.

Exercise 10.65 Advanced Stormer–Verlet

Derive the Stormer–Verlet method for second-order mechanical systems.

Exercise 10.66 Advanced Chebyshev collocation matrix

Construct the Chebyshev differentiation matrix and use it to solve a linear scalar IVP by collocation.

Exercise 10.67 Advanced Chebyshev versus RK4

Design a numerical experiment comparing RK4 and Chebyshev collocation for an analytic solution on [0,1].

Exercise 10.68 Advanced Spectral deferred correction

Derive one correction sweep of spectral deferred correction for an explicit Euler base method.

Exercise 10.69 Advanced Polynomial residual minimization

Formulate an IVP solver that minimizes the residual of the differential equation over a polynomial trial space.

Exercise 10.70 Advanced Hermite–Obreschkoff

Derive a fourth-order Hermite–Obreschkoff method using endpoint derivatives.

Research-level problems \star\star\star

Exercise 10.71 Research-level B-series theory

Develop B-series for Runge–Kutta methods and prove composition rules.

Exercise 10.72 Research-level Algebraic stability

Study algebraic stability of implicit Runge–Kutta methods and its connection with contractivity.

Exercise 10.73 Research-level Stiff order reduction

Investigate order reduction of high-order methods on stiff problems with boundary or forcing layers.

Exercise 10.74 Research-level Exponential integrators

Derive exponential Euler and exponential Runge–Kutta methods for semilinear problems.

Exercise 10.75 Research-level IMEX methods

Develop an implicit–explicit method for y'=F(t,y)+G(t,y), where G is stiff.

Exercise 10.76 Research-level Rosenbrock methods

Study Rosenbrock–W methods for stiff systems and derive their linear stage solves.

Exercise 10.77 Research-level Krylov exponential methods

Analyze Krylov approximations for computing \varphi-functions in exponential integrators.

Exercise 10.78 Research-level Parallel-in-time methods

Study Parareal or PFASST methods for parallel-in-time integration.

Exercise 10.79 Research-level Chebyshev spectral IVP theory

Prove a rigorous spectral convergence theorem for Chebyshev collocation applied to a linear analytic IVP.

Exercise 10.80 Research-level hp time finite elements

Develop an hp-version time finite element method for IVPs and compare it with Chebyshev collocation.

Exercise 10.81 Research-level Neural ODE solvers

Compare adaptive RK solvers with residual-minimizing polynomial or neural trial functions for IVPs.

Exercise 10.82 Research-level Certified IVP integration

Study interval Taylor methods for validated integration of ODEs.

Exercise 10.83 Research-level Geometric integration

Analyze long-time energy behavior of symplectic methods for Hamiltonian systems.

Exercise 10.84 Research-level Adaptive stiffness detection

Design an adaptive stiffness detector that switches between explicit and implicit methods.

Exercise 10.85 Research-level DAEs

Extend the discussion to differential-algebraic equations and explain index-related difficulties.

Exercise 10.86 Research-level Delay differential equations

Discuss how IVP solvers change for delay differential equations.

Exercise 10.87 Research-level Fractional ODEs

Compare classical IVP solvers with predictor–corrector methods for Caputo fractional differential equations.

Exercise 10.88 Research-level Mixed precision IVP solvers

Analyze mixed-precision time stepping with high-precision error estimation.

Exercise 10.89 Research-level Reproducible solver benchmarks

Design reproducible benchmarks comparing RK4, RK45, BDF, Radau, Chebyshev collocation, and SDC methods.

Exercise 10.90 Research-level Automatic method selection

Design a decision system that selects an IVP solver based on stiffness, smoothness, accuracy requirements, and event structure.

Exercise solutions

The solutions below are converted from the uploaded LaTeX solution file. Open an accordion to view the full solution.

This chapter gives detailed worked solutions for the exercises in Chapter 10. Each solution includes the problem formulation, the method, the mathematical derivation, the conclusion, and a diagnostic comment.

Exercise 10.1

Problem formulation.

Derive the integral form y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.2

Problem formulation.

Derive explicit Euler by approximating the integral with the left endpoint rule.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.3

Problem formulation.

Derive backward Euler by approximating the integral with the right endpoint rule.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.4

Problem formulation.

Derive the trapezoidal method for IVPs.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.5

Problem formulation.

Prove the local truncation error formula for explicit Euler.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.6

Problem formulation.

Apply one explicit Euler step to y'=t+y,\qquad y(0)=1, with h=0.1.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.7

Problem formulation.

Write the four stages for one RK4 step applied to y'=y,\qquad y(0)=1.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.8

Problem formulation.

Write the explicit formulas for midpoint RK2.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.9

Problem formulation.

Write the explicit formulas for Heun’s RK2 method.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.10

Problem formulation.

Write the explicit formulas for the classical third-order RK method.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.11

Problem formulation.

Write the explicit formulas for classical RK4.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.12

Problem formulation.

Write the explicit formulas for the Kutta 3/8 fourth-order method.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.13

Problem formulation.

For y'=\lambda y, derive the explicit Euler stability function.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.14

Problem formulation.

Show that explicit Euler is stable when |1+h\lambda|\le1.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.15

Problem formulation.

Derive the backward Euler stability function.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.16

Problem formulation.

Explain stiffness in one paragraph.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.17

Problem formulation.

Explain how an embedded RK pair estimates local error.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.18

Problem formulation.

Write the AB2 formula.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Linear multistep methods approximate the integral or derivative using values from several time levels. For example, AB2 is obtained by integrating the linear interpolant of f: y_{n+1}=y_n+\frac h2(3f_n-f_{n-1}). BDF2 differentiates the quadratic interpolant through y_{n-1},y_n,y_{n+1}: \frac{3y_{n+1}-4y_n+y_{n-1}}{2h} = f(t_{n+1},y_{n+1}). Its characteristic polynomial satisfies the root condition: 3\xi^2-4\xi+1=(\xi-1)(3\xi-1), so it is zero-stable.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.19

Problem formulation.

Write the BDF2 formula.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Linear multistep methods approximate the integral or derivative using values from several time levels. For example, AB2 is obtained by integrating the linear interpolant of f: y_{n+1}=y_n+\frac h2(3f_n-f_{n-1}). BDF2 differentiates the quadratic interpolant through y_{n-1},y_n,y_{n+1}: \frac{3y_{n+1}-4y_n+y_{n-1}}{2h} = f(t_{n+1},y_{n+1}). Its characteristic polynomial satisfies the root condition: 3\xi^2-4\xi+1=(\xi-1)(3\xi-1), so it is zero-stable.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.20

Problem formulation.

Explain the basic idea of Chebyshev collocation for an IVP.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.21

Problem formulation.

Prove the referenced result.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.22

Problem formulation.

Prove the referenced result.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.23

Problem formulation.

Prove the referenced result.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.24

Problem formulation.

Prove the referenced result.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.25

Problem formulation.

Prove the referenced result.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.26

Problem formulation.

Verify the order-four conditions for classical RK4.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.27

Problem formulation.

Verify that the Kutta 3/8 method satisfies fourth-order conditions.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.28

Problem formulation.

Derive the embedded error estimate for the RKF45 formulas given in the chapter.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.29

Problem formulation.

Derive the embedded error estimate for the Dormand–Prince 5(4) formulas.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.30

Problem formulation.

Derive the adaptive step-size formula h_{\mathrm{new}}=h\,sE^{-1/(p+1)}.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.31

Problem formulation.

Prove the referenced result.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.32

Problem formulation.

Derive the RK4 stability polynomial R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.33

Problem formulation.

Prove the referenced result.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.34

Problem formulation.

Show that the trapezoidal rule has stability function R(z)=\frac{1+z/2}{1-z/2}.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.35

Problem formulation.

Derive AB2 by integrating a linear interpolant of f.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Linear multistep methods approximate the integral or derivative using values from several time levels. For example, AB2 is obtained by integrating the linear interpolant of f: y_{n+1}=y_n+\frac h2(3f_n-f_{n-1}). BDF2 differentiates the quadratic interpolant through y_{n-1},y_n,y_{n+1}: \frac{3y_{n+1}-4y_n+y_{n-1}}{2h} = f(t_{n+1},y_{n+1}). Its characteristic polynomial satisfies the root condition: 3\xi^2-4\xi+1=(\xi-1)(3\xi-1), so it is zero-stable.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.36

Problem formulation.

Derive the two-step Adams–Moulton formula.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Linear multistep methods approximate the integral or derivative using values from several time levels. For example, AB2 is obtained by integrating the linear interpolant of f: y_{n+1}=y_n+\frac h2(3f_n-f_{n-1}). BDF2 differentiates the quadratic interpolant through y_{n-1},y_n,y_{n+1}: \frac{3y_{n+1}-4y_n+y_{n-1}}{2h} = f(t_{n+1},y_{n+1}). Its characteristic polynomial satisfies the root condition: 3\xi^2-4\xi+1=(\xi-1)(3\xi-1), so it is zero-stable.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.37

Problem formulation.

Derive BDF2 by differentiating the quadratic interpolant through y_{n+1}, y_n, and y_{n-1}.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Linear multistep methods approximate the integral or derivative using values from several time levels. For example, AB2 is obtained by integrating the linear interpolant of f: y_{n+1}=y_n+\frac h2(3f_n-f_{n-1}). BDF2 differentiates the quadratic interpolant through y_{n-1},y_n,y_{n+1}: \frac{3y_{n+1}-4y_n+y_{n-1}}{2h} = f(t_{n+1},y_{n+1}). Its characteristic polynomial satisfies the root condition: 3\xi^2-4\xi+1=(\xi-1)(3\xi-1), so it is zero-stable.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.38

Problem formulation.

Check the root condition for BDF2.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Linear multistep methods approximate the integral or derivative using values from several time levels. For example, AB2 is obtained by integrating the linear interpolant of f: y_{n+1}=y_n+\frac h2(3f_n-f_{n-1}). BDF2 differentiates the quadratic interpolant through y_{n-1},y_n,y_{n+1}: \frac{3y_{n+1}-4y_n+y_{n-1}}{2h} = f(t_{n+1},y_{n+1}). Its characteristic polynomial satisfies the root condition: 3\xi^2-4\xi+1=(\xi-1)(3\xi-1), so it is zero-stable.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Distinguish forward error from backward error; a small residual does not imply a small forward error when the problem is ill-conditioned.

Exercise 10.39

Problem formulation.

Show that y''=f_t+f_yf.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.40

Problem formulation.

Derive the collocation equations for a polynomial u(t) on one step.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.41

Problem formulation.

Derive the time scaling \frac{\dd}{\dd t}=\frac{2}{T-t_0}\frac{\dd}{\dd x}.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.42

Problem formulation.

Write the Chebyshev collocation equations for the scalar IVP y'=y,\qquad y(0)=1 on [0,1].

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.43

Problem formulation.

Explain how RK stages can be used to construct dense output.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.44

Problem formulation.

Describe how to locate an event g(t,y(t))=0 inside a step.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.45

Problem formulation.

Design a work-precision experiment comparing Euler, RK2, RK4, and RK45.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.46

Problem formulation.

Introduce rooted trees and derive Runge–Kutta order conditions up to order four.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.47

Problem formulation.

Study the order conditions required for an explicit fifth-order Runge–Kutta method.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.48

Problem formulation.

Explain the first-same-as-last property of Dormand–Prince methods and its computational advantage.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.49

Problem formulation.

Analyze how embedded RK pairs share stages to produce two orders at once.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.50

Problem formulation.

Derive a proportional-integral step-size controller for adaptive RK methods.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.51

Problem formulation.

Numerically plot the absolute stability region of RK4 and determine its intersection with the negative real axis.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.52

Problem formulation.

State the first and second Dahlquist barriers and explain their implications.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.53

Problem formulation.

Prove that the trapezoidal rule is A-stable but not L-stable.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.54

Problem formulation.

Define L-stability and show that backward Euler is L-stable.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.55

Problem formulation.

Analyze explicit Euler, backward Euler, and trapezoidal rule on y'=-1000(y-\cos t)-\sin t.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.56

Problem formulation.

Derive Newton’s method for solving one backward Euler step.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Verify the stationarity residual, feasibility residual, and descent or curvature condition, not only the final numerical value.

Exercise 10.57

Problem formulation.

Discuss Jacobian reuse and simplified Newton methods for stiff IVP solvers.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.58

Problem formulation.

Derive a variable-step BDF2 formula.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Linear multistep methods approximate the integral or derivative using values from several time levels. For example, AB2 is obtained by integrating the linear interpolant of f: y_{n+1}=y_n+\frac h2(3f_n-f_{n-1}). BDF2 differentiates the quadratic interpolant through y_{n-1},y_n,y_{n+1}: \frac{3y_{n+1}-4y_n+y_{n-1}}{2h} = f(t_{n+1},y_{n+1}). Its characteristic polynomial satisfies the root condition: 3\xi^2-4\xi+1=(\xi-1)(3\xi-1), so it is zero-stable.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.59

Problem formulation.

Construct an AB2–AM2 predictor–corrector method and analyze its order.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.60

Problem formulation.

Explain the Nordsieck representation for variable-order multistep methods.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.61

Problem formulation.

Prove the referenced result.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.62

Problem formulation.

Study Radau IIA methods and explain why they are useful for stiff problems.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.63

Problem formulation.

Study Lobatto collocation methods and their relation to symplectic integration.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.64

Problem formulation.

Derive symplectic Euler for a Hamiltonian system and compare it with explicit Euler.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.65

Problem formulation.

Derive the Stormer–Verlet method for second-order mechanical systems.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.66

Problem formulation.

Construct the Chebyshev differentiation matrix and use it to solve a linear scalar IVP by collocation.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.67

Problem formulation.

Design a numerical experiment comparing RK4 and Chebyshev collocation for an analytic solution on [0,1].

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.68

Problem formulation.

Derive one correction sweep of spectral deferred correction for an explicit Euler base method.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.69

Problem formulation.

Formulate an IVP solver that minimizes the residual of the differential equation over a polynomial trial space.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.70

Problem formulation.

Derive a fourth-order Hermite–Obreschkoff method using endpoint derivatives.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.71

Problem formulation.

Develop B-series for Runge–Kutta methods and prove composition rules.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.72

Problem formulation.

Study algebraic stability of implicit Runge–Kutta methods and its connection with contractivity.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.73

Problem formulation.

Investigate order reduction of high-order methods on stiff problems with boundary or forcing layers.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.74

Problem formulation.

Derive exponential Euler and exponential Runge–Kutta methods for semilinear problems.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.75

Problem formulation.

Develop an implicit–explicit method for y'=F(t,y)+G(t,y), where G is stiff.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.76

Problem formulation.

Study Rosenbrock–W methods for stiff systems and derive their linear stage solves.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.77

Problem formulation.

Analyze Krylov approximations for computing \varphi-functions in exponential integrators.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.78

Problem formulation.

Study Parareal or PFASST methods for parallel-in-time integration.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.79

Problem formulation.

Prove a rigorous spectral convergence theorem for Chebyshev collocation applied to a linear analytic IVP.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.80

Problem formulation.

Develop an hp-version time finite element method for IVPs and compare it with Chebyshev collocation.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.81

Problem formulation.

Compare adaptive RK solvers with residual-minimizing polynomial or neural trial functions for IVPs.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.82

Problem formulation.

Study interval Taylor methods for validated integration of ODEs.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.83

Problem formulation.

Analyze long-time energy behavior of symplectic methods for Hamiltonian systems.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.84

Problem formulation.

Design an adaptive stiffness detector that switches between explicit and implicit methods.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Exercise 10.85

Problem formulation.

Extend the discussion to differential-algebraic equations and explain index-related difficulties.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.86

Problem formulation.

Discuss how IVP solvers change for delay differential equations.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.87

Problem formulation.

Compare classical IVP solvers with predictor–corrector methods for Caputo fractional differential equations.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Check both the singular kernel evaluation and the long-history summation; fractional errors often come from the memory term rather than the algebraic solver.

Exercise 10.88

Problem formulation.

Analyze mixed-precision time stepping with high-precision error estimation.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.

Exercise 10.89

Problem formulation.

Design reproducible benchmarks comparing RK4, RK45, BDF, Radau, Chebyshev collocation, and SDC methods.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.

Exercise 10.90

Problem formulation.

Design a decision system that selects an IVP solver based on stiffness, smoothness, accuracy requirements, and event structure.

Method.

Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.

Detailed solution and justification.

Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.

Conclusion.

The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.

Diagnostic comment.

Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.

Interactive tools

The theory and solutions come first. These tools are for review, laboratories, games, memory cards, and randomized assessment.

Professional visualsAnimated diagrams and conceptual graphics. Programming practiceDebug JavaScript/PHP method snippets with corrected code.

Interactive PHP laboratories for this chapter

These experiments run inside the same web page. The student changes the input data and presses Run PHP. Results are returned by the PHP server and displayed immediately.