Chapter 10
Initial-Value Problems for Ordinary Differential Equations
Rendered from the uploaded full LaTeX source with KaTeX. No PDF, no PDF.js, no image extraction, and no raw LaTeX displayed.
After completing this chapter, the reader should be able to:
formulate initial-value problems and distinguish local and global error;
derive Euler, backward Euler, trapezoidal, and theta methods;
derive explicit Runge–Kutta methods of orders two, three, four, and higher;
write and use explicit stage formulas, not only Butcher tableaux;
understand embedded Runge–Kutta pairs and adaptive step-size control;
analyze absolute stability regions using the test equation y'=\lambda y;
explain stiffness and why implicit methods are needed;
derive Adams–Bashforth, Adams–Moulton, and BDF multistep formulas;
understand polynomial, Taylor, Hermite–Obreschkoff, collocation, and Chebyshev time-spectral methods for IVPs;
compare finite-step marching methods with global polynomial methods;
solve basic, advanced, and research-level exercises on IVP solvers.
Initial-Value Problems
An initial-value problem is y'(t)=f(t,y(t)), \qquad y(t_0)=y_0. Here y(t)\in\mathbb R^d, \qquad f:[t_0,T]\times\mathbb R^d\to\mathbb R^d. A numerical method produces approximations y_n\approx y(t_n), \qquad t_n=t_0+nh.
An IVP solver advances information forward in time. Its quality depends on consistency, stability, error control, stiffness handling, and the smoothness of the solution.
The integral form of the IVP is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}} f(s,y(s))\,\dd s. Most one-step methods approximate this integral.
Existence, Uniqueness, and Flow Maps
Suppose f(t,y) is continuous in t and Lipschitz continuous in y on a rectangle containing (t_0,y_0). Then the IVP y'=f(t,y), \qquad y(t_0)=y_0 has a unique local solution.
The IVP is equivalent to the integral equation y(t)=y_0+\int_{t_0}^{t} f(s,y(s))\,\dd s. Define the Picard operator (\mathcal T y)(t)=y_0+\int_{t_0}^{t} f(s,y(s))\,\dd s. On a sufficiently short interval, the Lipschitz constant of \mathcal T is less than one in the sup norm. Hence \mathcal T is a contraction on a closed complete set of continuous functions. Banach’s fixed-point theorem gives a unique fixed point, which is the local solution.
□
The exact solution operator from t_n to t_{n+1} is the flow map y(t_{n+1})=\Phi_h(t_n,y(t_n)). A one-step numerical method replaces \Phi_h by a computable map y_{n+1}=\Psi_h(t_n,y_n).
Euler’s Method
The simplest approximation is \int_{t_n}^{t_{n+1}} f(s,y(s))\,\dd s \approx h f(t_n,y_n). This gives explicit Euler: y_{n+1}=y_n+h f(t_n,y_n).
Caption.
Explicit Euler method
f, t_0, y_0, step size h, number of steps N
t\gets t_0, y\gets y_0
For n=0,\ldots,N-1:
y\gets y+h f(t,y)
t\gets t+h
Return y
If the exact solution is twice continuously differentiable, then one step of explicit Euler has local truncation error y(t_{n+1})-y(t_n)-h f(t_n,y(t_n)) = \frac{h^2}{2}y''(\xi_n) for some \xi_n\in(t_n,t_{n+1}). Thus explicit Euler has local error O(h^2) and global order one.
Taylor’s theorem gives y(t_n+h)=y(t_n)+hy'(t_n)+\frac{h^2}{2}y''(\xi_n). Since y'(t_n)=f(t_n,y(t_n)), the stated local error formula follows. Accumulating O(h^2) local errors over O(1/h) steps under a stability bound gives global error O(h).
□
Backward Euler and the Theta Method
Backward Euler uses the endpoint value of the vector field: y_{n+1}=y_n+h f(t_{n+1},y_{n+1}). It is implicit because y_{n+1} appears on both sides.
The theta method is y_{n+1} = y_n+h\left[ (1-\theta)f(t_n,y_n) + \theta f(t_{n+1},y_{n+1}) \right]. Special cases are: \theta=0 \quad \text{explicit Euler}, \theta=1 \quad \text{backward Euler}, \theta=\frac12 \quad \text{trapezoidal rule}.
The theta method is first order for \theta\ne1/2 and second order for \theta=1/2.
Insert the exact solution into the method and expand y(t_n+h) = y(t_n)+hy'(t_n)+\frac{h^2}{2}y''(t_n)+O(h^3). Also, f(t_n+h,y(t_n+h))=y'(t_n+h)=y'(t_n)+hy''(t_n)+O(h^2). The theta method predicts y(t_n)+h\left[(1-\theta)y'(t_n)+\theta y'(t_n+h)\right] = y(t_n)+hy'(t_n)+\theta h^2y''(t_n)+O(h^3). The h^2 terms agree exactly when \theta=\frac12. Thus the local error is O(h^3) for \theta=1/2, giving global order two; it is O(h^2) otherwise, giving global order one.
□
Consistency, Stability, and Convergence
A one-step method is consistent if its local truncation error tends to zero faster than h. A method is stable if perturbations do not grow uncontrollably. A method is convergent if \max_{0\le n\le N}\|y_n-y(t_n)\|\to0 \qquad \text{as }h\to0.
Suppose a one-step method is consistent of order p and its numerical flow is Lipschitz stable on the interval of integration. Then the global error is \max_n\|y_n-y(t_n)\|=O(h^p).
Let e_n=y_n-y(t_n). The numerical one-step map satisfies y_{n+1}=\Psi_h(t_n,y_n), while the exact solution satisfies y(t_{n+1})=\Psi_h(t_n,y(t_n))+\tau_{n+1}, where \|\tau_{n+1}\|\le Ch^{p+1}. Lipschitz stability gives \|e_{n+1}\| \le (1+Lh)\|e_n\|+Ch^{p+1}. Discrete Gronwall’s inequality yields \|e_n\|\le C_T h^p on a fixed interval.
□
Runge–Kutta Methods
Runge–Kutta methods approximate the integral over a step by evaluating the vector field at several internal stages. An s-stage Runge–Kutta method has stages k_i=f\left(t_n+c_i h,\, y_n+h\sum_{j=1}^{s}a_{ij}k_j\right), \qquad i=1,\ldots,s, and update y_{n+1}=y_n+h\sum_{i=1}^{s}b_i k_i. If a_{ij}=0 for j\ge i, the method is explicit.
The coefficients are often displayed in a Butcher tableau: \begin{array}{c|cccc} c_1&a_{11}&a_{12}&\cdots&a_{1s}\\ c_2&a_{21}&a_{22}&\cdots&a_{2s}\\ \vdots&\vdots&\vdots&\ddots&\vdots\\ c_s&a_{s1}&a_{s2}&\cdots&a_{ss}\\ \hline &b_1&b_2&\cdots&b_s \end{array}.
Second-Order Runge–Kutta Methods
A general two-stage explicit Runge–Kutta method can be written k_1=f(t_n,y_n), k_2=f(t_n+\alpha h,y_n+\alpha h k_1), y_{n+1}=y_n+h\left[ \left(1-\frac{1}{2\alpha}\right)k_1 + \frac{1}{2\alpha}k_2 \right], \qquad \alpha\ne0. This family is second order.
Important cases are:
\text{Midpoint RK2:} k_1=f(t_n,y_n), k_2=f\left(t_n+\frac{h}{2},y_n+\frac{h}{2}k_1\right), y_{n+1}=y_n+h k_2.
\text{Heun RK2:} k_1=f(t_n,y_n), k_2=f(t_n+h,y_n+hk_1), y_{n+1}=y_n+\frac{h}{2}(k_1+k_2).
The two-stage method k_1=f(t_n,y_n), \qquad k_2=f(t_n+\alpha h,y_n+\alpha h k_1), y_{n+1}=y_n+h(b_1k_1+b_2k_2) is second order if and only if b_1+b_2=1, \qquad b_2\alpha=\frac12.
Expand k_2 about (t_n,y_n): k_2=f+h\alpha(f_t+f_y f)+O(h^2). The method gives y_{n+1}=y_n+h(b_1+b_2)f+h^2b_2\alpha(f_t+f_yf)+O(h^3). The exact Taylor expansion is y(t_n+h)=y_n+hf+\frac{h^2}{2}(f_t+f_yf)+O(h^3). Equating coefficients gives b_1+b_2=1, \qquad b_2\alpha=\frac12.
□
Third-Order Runge–Kutta Methods
A classical third-order explicit Runge–Kutta method is k_1=f(t_n,y_n), k_2=f\left(t_n+\frac{h}{2},y_n+\frac{h}{2}k_1\right), k_3=f\left(t_n+h,y_n-hk_1+2hk_2\right), y_{n+1}=y_n+\frac{h}{6}(k_1+4k_2+k_3).
Another third-order method, often called Heun’s third-order method, is k_1=f(t_n,y_n), k_2=f\left(t_n+\frac{h}{3},y_n+\frac{h}{3}k_1\right), k_3=f\left(t_n+\frac{2h}{3},y_n+\frac{2h}{3}k_2\right), y_{n+1}=y_n+\frac{h}{4}(k_1+3k_3).
Classical Fourth-Order Runge–Kutta Method
The classical RK4 method is k_1=f(t_n,y_n), k_2=f\left(t_n+\frac{h}{2},y_n+\frac{h}{2}k_1\right), k_3=f\left(t_n+\frac{h}{2},y_n+\frac{h}{2}k_2\right), k_4=f(t_n+h,y_n+hk_3), and y_{n+1}=y_n+\frac{h}{6} (k_1+2k_2+2k_3+k_4).
Caption.
Classical fourth-order Runge–Kutta method
f, t_n, y_n, step size h
k_1\gets f(t_n,y_n)
k_2\gets f(t_n+h/2,y_n+(h/2)k_1)
k_3\gets f(t_n+h/2,y_n+(h/2)k_2)
k_4\gets f(t_n+h,y_n+hk_3)
y_{n+1}\gets y_n+(h/6)(k_1+2k_2+2k_3+k_4)
Return y_{n+1}
The classical RK4 method has global order four for sufficiently smooth solutions.
Expanding the four stages in Taylor series and substituting into the RK4 weighted average shows that the numerical increment agrees with the exact Taylor expansion of the solution through all terms of degree four in h. The local truncation error is therefore O(h^5). Under one-step stability on a finite interval, the global error is O(h^4).
□
Other Explicit Fourth-Order RK Methods
The Kutta 3/8 fourth-order method is k_1=f(t_n,y_n), k_2=f\left(t_n+\frac{h}{3},y_n+\frac{h}{3}k_1\right), k_3=f\left(t_n+\frac{2h}{3}, y_n-\frac{h}{3}k_1+h k_2\right), k_4=f\left(t_n+h, y_n+h k_1-h k_2+h k_3\right), y_{n+1} = y_n+\frac{h}{8}(k_1+3k_2+3k_3+k_4).
Another fourth-order method is the Ralston fourth-order method. One version is k_1=f(t_n,y_n), k_2=f\left(t_n+\frac{2h}{5}, y_n+\frac{2h}{5}k_1\right), k_3=f\left(t_n+\frac{7h}{8}, y_n+h\left(\frac{29697761}{39175800}k_1 +\frac{10904423}{39175800}k_2\right)\right), k_4=f\left(t_n+h, y_n+h\left(\frac{115075}{11282082432}k_1 -\frac{210788423}{11282082432}k_2 +\frac{111935693}{1880347072}k_3\right)\right), with an associated fourth-order weighted average. The main lesson is that order four does not determine a unique method. Coefficients can be optimized for error constants, stability, or storage.
\text{RK2 midpoint: } y_{n+1}=y_n+h f\left(t_n+\frac h2,y_n+\frac h2 f(t_n,y_n)\right). \text{RK3 classical: } y_{n+1}=y_n+\frac h6(k_1+4k_2+k_3). \text{RK4 classical: } y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). \text{Kutta }3/8: y_{n+1}=y_n+\frac h8(k_1+3k_2+3k_3+k_4).
Higher-Order Explicit Runge–Kutta Methods
For order five and beyond, explicit Runge–Kutta methods require more stages and more order conditions. In practice, higher-order explicit methods are usually used as embedded pairs.
Runge–Kutta–Fehlberg 4(5)
The Fehlberg method computes two approximations of different orders using shared stages. A common RKF45 stage structure is k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h4, y_n+h\frac14 k_1\right), k_3=f\left(t_n+\frac{3h}{8}, y_n+h\left(\frac{3}{32}k_1+\frac{9}{32}k_2\right)\right), k_4=f\left(t_n+\frac{12h}{13}, y_n+h\left( \frac{1932}{2197}k_1-\frac{7200}{2197}k_2+\frac{7296}{2197}k_3 \right)\right), k_5=f\left(t_n+h, y_n+h\left( \frac{439}{216}k_1-8k_2+\frac{3680}{513}k_3-\frac{845}{4104}k_4 \right)\right), k_6=f\left(t_n+\frac h2, y_n+h\left( -\frac{8}{27}k_1+2k_2-\frac{3544}{2565}k_3 +\frac{1859}{4104}k_4-\frac{11}{40}k_5 \right)\right). The fourth-order approximation is y_{n+1}^{[4]} = y_n+h\left( \frac{25}{216}k_1 +\frac{1408}{2565}k_3 +\frac{2197}{4104}k_4 -\frac15 k_5 \right), and the fifth-order approximation is y_{n+1}^{[5]} = y_n+h\left( \frac{16}{135}k_1 +\frac{6656}{12825}k_3 +\frac{28561}{56430}k_4 -\frac{9}{50}k_5 +\frac{2}{55}k_6 \right). The difference e_{n+1}=y_{n+1}^{[5]}-y_{n+1}^{[4]} is used for error estimation.
Dormand–Prince 5(4)
The Dormand–Prince pair is a widely used explicit RK method. It uses seven stages: k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h5, y_n+h\frac15 k_1\right), k_3=f\left(t_n+\frac{3h}{10}, y_n+h\left(\frac{3}{40}k_1+\frac{9}{40}k_2\right)\right), k_4=f\left(t_n+\frac{4h}{5}, y_n+h\left(\frac{44}{45}k_1-\frac{56}{15}k_2+\frac{32}{9}k_3\right)\right), k_5=f\left(t_n+\frac{8h}{9}, y_n+h\left( \frac{19372}{6561}k_1-\frac{25360}{2187}k_2 +\frac{64448}{6561}k_3-\frac{212}{729}k_4 \right)\right), k_6=f\left(t_n+h, y_n+h\left( \frac{9017}{3168}k_1-\frac{355}{33}k_2 +\frac{46732}{5247}k_3+\frac{49}{176}k_4 -\frac{5103}{18656}k_5 \right)\right), k_7=f\left(t_n+h, y_n+h\left( \frac{35}{384}k_1+\frac{500}{1113}k_3 +\frac{125}{192}k_4-\frac{2187}{6784}k_5 +\frac{11}{84}k_6 \right)\right). The fifth-order solution is y_{n+1}^{[5]} = y_n+h\left( \frac{35}{384}k_1 +\frac{500}{1113}k_3 +\frac{125}{192}k_4 -\frac{2187}{6784}k_5 +\frac{11}{84}k_6 \right). The embedded fourth-order solution is y_{n+1}^{[4]} = y_n+h\left( \frac{5179}{57600}k_1 +\frac{7571}{16695}k_3 +\frac{393}{640}k_4 -\frac{92097}{339200}k_5 +\frac{187}{2100}k_6 +\frac{1}{40}k_7 \right). Again, e_{n+1}=y_{n+1}^{[5]}-y_{n+1}^{[4]} estimates the local error.
Adaptive Step-Size Control
Suppose an embedded method gives approximations y_{n+1}^{[p]} and y_{n+1}^{[p+1]}. Define e_{n+1}=y_{n+1}^{[p+1]}-y_{n+1}^{[p]}. A scaled error measure is E= \left[ \frac1d\sum_{i=1}^d \left( \frac{e_i}{\mathrm{atol}+\mathrm{rtol}\max(|y_{n,i}|,|y_{n+1,i}|)} \right)^2 \right]^{1/2}. Accept the step if E\le1. A typical new step size is h_{\mathrm{new}} = h\cdot \min\left(q_{\max}, \max\left(q_{\min}, s E^{-1/(p+1)} \right)\right), where s\in(0,1) is a safety factor.
Caption.
Adaptive embedded Runge–Kutta step
f, t, y, step h, tolerances \mathrm{atol},\mathrm{rtol}
Compute embedded approximations y^{[p]} and y^{[p+1]}
Estimate scaled error E
If E\le1:
Accept: t\gets t+h, y\gets y^{[p+1]}
Else:
Reject the step
Update h\gets h\min(q_{\max},\max(q_{\min},sE^{-1/(p+1)}))
Return updated t,y,h
Stability Regions
Apply a method to the test equation y'=\lambda y. Let z=h\lambda. A one-step method produces y_{n+1}=R(z)y_n, where R(z) is the stability function. The absolute stability region is \mathcal S=\{z\in\mathbb C:|R(z)|\le1\}.
For explicit Euler, R(z)=1+z, so the stability condition is |1+z|\le1. For RK4, R(z)= 1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}.
For an explicit s-stage Runge–Kutta method applied to y'=\lambda y, the stability function R(z) is a polynomial of degree at most s.
For the test equation, every stage is a scalar multiple of y_n. Since the method is explicit, the stages are computed recursively, and each stage is a polynomial in z=h\lambda times y_n. The final update is a linear combination of these stage polynomials, hence y_{n+1}=R(z)y_n with R a polynomial of degree at most s.
□
Stiffness
A problem is stiff when stability forces an explicit method to take step sizes much smaller than those required by accuracy. For the test equation y'=\lambda y, \qquad \operatorname{Re}\lambda<0, explicit Euler requires |1+h\lambda|\le1. If \lambda is large and negative, this imposes a severe restriction on h.
Backward Euler has y_{n+1}=y_n+h\lambda y_{n+1}, so y_{n+1}=\frac{1}{1-z}y_n, \qquad z=h\lambda. Thus R(z)=\frac{1}{1-z}. It is stable for all \operatorname{Re}z\le0.
A method is A-stable if its stability region contains the entire left half-plane: \{z\in\mathbb C:\operatorname{Re}z\le0\}.
Backward Euler is A-stable.
For the test equation, R(z)=\frac{1}{1-z}. If \operatorname{Re}z\le0, then |1-z|\ge1. Therefore |R(z)|=\frac1{|1-z|}\le1. Thus the entire left half-plane lies in the stability region.
□
Linear Multistep Methods
A k-step linear multistep method has the form \sum_{j=0}^{k}\alpha_j y_{n+j} = h\sum_{j=0}^{k}\beta_j f(t_{n+j},y_{n+j}). If \beta_k=0, the method is explicit. If \beta_k\ne0, it is implicit.
Adams–Bashforth Methods
The two-step Adams–Bashforth method is y_{n+1}=y_n+\frac{h}{2} \left( 3f_n-f_{n-1} \right). The three-step Adams–Bashforth method is y_{n+1}=y_n+\frac{h}{12} \left( 23f_n-16f_{n-1}+5f_{n-2} \right). The four-step Adams–Bashforth method is y_{n+1}=y_n+\frac{h}{24} \left( 55f_n-59f_{n-1}+37f_{n-2}-9f_{n-3} \right).
Adams–Moulton Methods
The trapezoidal method is the one-step Adams–Moulton method: y_{n+1}=y_n+\frac h2(f_{n+1}+f_n). The two-step Adams–Moulton method is y_{n+1}=y_n+\frac h{12} \left( 5f_{n+1}+8f_n-f_{n-1} \right). The three-step Adams–Moulton method is y_{n+1}=y_n+\frac h{24} \left( 9f_{n+1}+19f_n-5f_{n-1}+f_{n-2} \right).
Backward Differentiation Formulas
BDF methods approximate y' by differentiating an interpolation polynomial through past solution values. BDF1 is backward Euler: y_{n+1}-y_n=h f_{n+1}. BDF2 is \frac{3y_{n+1}-4y_n+y_{n-1}}{2h}=f_{n+1}. BDF3 is \frac{11y_{n+1}-18y_n+9y_{n-1}-2y_{n-2}}{6h}=f_{n+1}.
Adams–Bashforth methods are explicit and efficient for nonstiff problems. Adams–Moulton methods are implicit and often used in predictor–corrector pairs. BDF methods are implicit and important for stiff systems.
Zero-Stability and Dahlquist Equivalence
For a linear multistep method, define the first characteristic polynomial \rho(\xi)=\sum_{j=0}^{k}\alpha_j\xi^j.
A multistep method satisfies the root condition if every root \xi of \rho(\xi) satisfies |\xi|\le1, and every root with |\xi|=1 is simple.
For a consistent linear multistep method, convergence is equivalent to zero-stability.
The proof separates the error into a local truncation part and a propagation part. Consistency makes the local defect vanish with h. Zero-stability, expressed by the root condition, prevents the accumulated defects from growing without bound. Together they imply convergence. Conversely, if the method is convergent, perturbing the starting values shows that parasitic modes must remain bounded, which is exactly zero-stability.
□
Polynomial and Taylor Methods
Taylor methods use derivatives of the solution: y(t_n+h) = y_n+hy'_n+\frac{h^2}{2}y''_n+\cdots+\frac{h^p}{p!}y_n^{(p)} +O(h^{p+1}). Since y'=f(t,y), higher derivatives can be obtained by repeated differentiation: y''=f_t+f_y f. The third derivative is y^{(3)} = f_{tt}+2f_{ty}f+f_{yy}(f,f)+f_y(f_t+f_yf), where f_{yy}(f,f) denotes the bilinear second derivative applied to f twice.
A polynomial one-step method may approximate the solution on a step by y_n(t)=\sum_{j=0}^{p} a_j(t-t_n)^j and impose differential equation conditions at selected points.
Caption.
Taylor method of order p
f, derivative functions F_j(t,y)\approx y^{(j)}(t), order p
For n=0,\ldots,N-1:
y_{n+1}\gets y_n+\sum_{j=1}^{p}\dfrac{h^j}{j!}F_j(t_n,y_n)
t_{n+1}\gets t_n+h
Return y_N
Collocation Methods
Collocation methods seek a polynomial u(t) on [t_n,t_{n+1}] satisfying u(t_n)=y_n, and u'(t_n+c_i h)=f(t_n+c_i h,u(t_n+c_i h)), \qquad i=1,\ldots,s. The next value is y_{n+1}=u(t_{n+1}). Collocation methods are Runge–Kutta methods. Gauss collocation methods have order 2s. Radau and Lobatto methods include one or both endpoints and are important for stiff problems.
An s-stage Gauss collocation method has order 2s.
Gauss collocation is equivalent to integrating the polynomial interpolant of the vector field at Gauss nodes. Gauss quadrature with s nodes is exact for polynomials of degree at most 2s-1. The collocation residual and quadrature exactness imply that the one-step method matches the exact integral expansion through order 2s, giving order 2s.
□
Hermite–Obreschkoff Methods
Hermite–Obreschkoff methods use derivatives at both endpoints. A simple symmetric example is y_{n+1}=y_n+\frac h2(y'_n+y'_{n+1}) -\frac{h^2}{12}(y''_{n+1}-y''_n)+O(h^5). Since y'_n=f(t_n,y_n), and y''=f_t+f_yf, these methods can achieve high order with compact formulas, often implicitly.
Chebyshev Polynomial Methods for IVPs
Chebyshev methods approximate the entire solution over a time interval by a global polynomial. Map t\in[t_0,T] to x\in[-1,1] using t=\frac{T-t_0}{2}x+\frac{T+t_0}{2}. Then \frac{\dd}{\dd t} = \frac{2}{T-t_0}\frac{\dd}{\dd x}. Approximate y(t(x))\approx Y_N(x)=\sum_{k=0}^{N} a_k T_k(x), ] where \(T_k\) are Chebyshev polynomials. At Chebyshev--Gauss--Lobatto nodes \[ x_j=\cos\left(\frac{\pi j}{N}\right), \qquad j=0,\ldots,N, let D be the Chebyshev differentiation matrix. The IVP collocation equations are \frac{2}{T-t_0}(D\mathbf Y)_j = f(t_j,Y_j), \qquad j=0,\ldots,N-1, together with the initial condition Y_N=y_0 if x_N=-1 corresponds to t=t_0. Depending on ordering, the initial condition is imposed at the node corresponding to x=-1.
Caption.
Chebyshev collocation method for an IVP
f, interval [t_0,T], initial value y_0, degree N
Construct Chebyshev–Gauss–Lobatto nodes x_j=\cos(\pi j/N)
Map nodes to t_j=(T-t_0)x_j/2+(T+t_0)/2
Construct Chebyshev differentiation matrix D
Form nonlinear equations
\item \frac{2}{T-t_0}(D\mathbf Y)_j=f(t_j,Y_j) \item
at collocation nodes, replacing one equation by Y(t_0)=y_0
Solve the nonlinear algebraic system for \mathbf Y
Return polynomial interpolant Y_N(t)
If the IVP solution is analytic on and near the time interval and the nonlinear collocation equations are solved accurately, Chebyshev collocation can converge spectrally with respect to the polynomial degree N.
Analyticity of the solution implies rapid decay of its Chebyshev coefficients. The Chebyshev interpolant therefore converges geometrically in suitable norms. Since the differential equation is imposed at spectral collocation nodes and the derivative is computed by differentiating the interpolant, the residual inherits spectral decay provided the nonlinear solve is accurate and the problem is well conditioned.
□
- Time-marching RK methods.
-
Advance step by step. They are flexible, adaptive, and robust for long intervals.
- Chebyshev collocation.
-
Approximates the whole solution on an interval by a polynomial. It can be extremely accurate for smooth analytic solutions.
- Practical challenge.
-
Chebyshev IVP collocation leads to global nonlinear algebraic systems and can be less convenient for long-time integration or problems with sharp transitions.
- Best use.
-
Short-to-moderate intervals with smooth solutions, boundary/initial constraints, or when a high-order global-in-time approximation is desired.
Spectral Deferred Correction and Polynomial Correction
Spectral deferred correction methods start with a low-order approximation on a set of quadrature nodes and iteratively correct the integral equation y(t)=y(t_n)+\int_{t_n}^{t}f(s,y(s))\,\dd s. Using high-order quadrature nodes, such as Gauss, Radau, Lobatto, or Chebyshev nodes, successive corrections increase the order.
A correction equation has the schematic form e(t)= \int_{t_n}^{t} \left[ f(s,y^{(m)}(s)+e(s))-f(s,y^{(m)}(s)) \right]\dd s + \delta^{(m)}(t), where \delta^{(m)} is the current defect in the integral equation.
Dense Output and Event Detection
Many applications require approximations between time nodes. Dense output constructs a polynomial P_n(t) such that P_n(t_n)=y_n, \qquad P_n(t_{n+1})=y_{n+1}, and possibly matches stage derivatives. Event detection solves g(t,y(t))=0 inside a time step, often using dense output and root-finding.
Practical Comparison of IVP Methods
- Explicit Euler.
-
Useful for teaching and quick prototypes. Rarely adequate for high accuracy.
- RK2/RK3.
-
Good low-cost methods when moderate accuracy is enough.
- RK4.
-
Excellent fixed-step nonstiff method. Simple and reliable for smooth problems.
- Embedded RK45.
-
Standard choice for nonstiff adaptive integration.
- Dormand–Prince.
-
A high-quality embedded RK pair widely used in practical solvers.
- Backward Euler.
-
First-order but robust for stiff decay.
- Trapezoidal rule.
-
Second-order A-stable, but can oscillate on very stiff components.
- BDF methods.
-
Important for stiff systems, especially variable-order implementations.
- Adams methods.
-
Efficient for smooth nonstiff problems when past values are available.
- Collocation methods.
-
High-order implicit methods with strong stability properties.
- Chebyshev and polynomial time methods.
-
Potentially spectral for smooth solutions on bounded intervals, but require solving global or block systems.
- SDC methods.
-
Flexible high-order correction framework connecting quadrature, collocation, and time stepping.
Exercises
The following exercise bank is intentionally large. Basic problems test definitions, computations, and essential formulas. Starred exercises require proofs, careful stability analysis, or advanced numerical ODE arguments. Problems marked \star, \star\star, and \star\star\star are progressively harder.
Basic problems
Derive the integral form y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s.
Derive explicit Euler by approximating the integral with the left endpoint rule.
Derive backward Euler by approximating the integral with the right endpoint rule.
Derive the trapezoidal method for IVPs.
Prove the local truncation error formula for explicit Euler.
Apply one explicit Euler step to y'=t+y,\qquad y(0)=1, with h=0.1.
Write the four stages for one RK4 step applied to y'=y,\qquad y(0)=1.
Write the explicit formulas for midpoint RK2.
Write the explicit formulas for Heun’s RK2 method.
Write the explicit formulas for the classical third-order RK method.
Write the explicit formulas for classical RK4.
Write the explicit formulas for the Kutta 3/8 fourth-order method.
For y'=\lambda y, derive the explicit Euler stability function.
Show that explicit Euler is stable when |1+h\lambda|\le1.
Derive the backward Euler stability function.
Explain stiffness in one paragraph.
Explain how an embedded RK pair estimates local error.
Write the AB2 formula.
Write the BDF2 formula.
Explain the basic idea of Chebyshev collocation for an IVP.
Intermediate problems \star
Prove the referenced result.
Prove the referenced result.
Prove the referenced result.
Prove the referenced result.
Prove the referenced result.
Verify the order-four conditions for classical RK4.
Verify that the Kutta 3/8 method satisfies fourth-order conditions.
Derive the embedded error estimate for the RKF45 formulas given in the chapter.
Derive the embedded error estimate for the Dormand–Prince 5(4) formulas.
Derive the adaptive step-size formula h_{\mathrm{new}}=h\,sE^{-1/(p+1)}.
Prove the referenced result.
Derive the RK4 stability polynomial R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}.
Prove the referenced result.
Show that the trapezoidal rule has stability function R(z)=\frac{1+z/2}{1-z/2}.
Derive AB2 by integrating a linear interpolant of f.
Derive the two-step Adams–Moulton formula.
Derive BDF2 by differentiating the quadratic interpolant through y_{n+1}, y_n, and y_{n-1}.
Check the root condition for BDF2.
Show that y''=f_t+f_yf.
Derive the collocation equations for a polynomial u(t) on one step.
Derive the time scaling \frac{\dd}{\dd t}=\frac{2}{T-t_0}\frac{\dd}{\dd x}.
Write the Chebyshev collocation equations for the scalar IVP y'=y,\qquad y(0)=1 on [0,1].
Explain how RK stages can be used to construct dense output.
Describe how to locate an event g(t,y(t))=0 inside a step.
Design a work-precision experiment comparing Euler, RK2, RK4, and RK45.
Advanced problems \star\star
Introduce rooted trees and derive Runge–Kutta order conditions up to order four.
Study the order conditions required for an explicit fifth-order Runge–Kutta method.
Explain the first-same-as-last property of Dormand–Prince methods and its computational advantage.
Analyze how embedded RK pairs share stages to produce two orders at once.
Derive a proportional-integral step-size controller for adaptive RK methods.
Numerically plot the absolute stability region of RK4 and determine its intersection with the negative real axis.
State the first and second Dahlquist barriers and explain their implications.
Prove that the trapezoidal rule is A-stable but not L-stable.
Define L-stability and show that backward Euler is L-stable.
Analyze explicit Euler, backward Euler, and trapezoidal rule on y'=-1000(y-\cos t)-\sin t.
Derive Newton’s method for solving one backward Euler step.
Discuss Jacobian reuse and simplified Newton methods for stiff IVP solvers.
Derive a variable-step BDF2 formula.
Construct an AB2–AM2 predictor–corrector method and analyze its order.
Explain the Nordsieck representation for variable-order multistep methods.
Prove the referenced result.
Study Radau IIA methods and explain why they are useful for stiff problems.
Study Lobatto collocation methods and their relation to symplectic integration.
Derive symplectic Euler for a Hamiltonian system and compare it with explicit Euler.
Derive the Stormer–Verlet method for second-order mechanical systems.
Construct the Chebyshev differentiation matrix and use it to solve a linear scalar IVP by collocation.
Design a numerical experiment comparing RK4 and Chebyshev collocation for an analytic solution on [0,1].
Derive one correction sweep of spectral deferred correction for an explicit Euler base method.
Formulate an IVP solver that minimizes the residual of the differential equation over a polynomial trial space.
Derive a fourth-order Hermite–Obreschkoff method using endpoint derivatives.
Research-level problems \star\star\star
Develop B-series for Runge–Kutta methods and prove composition rules.
Study algebraic stability of implicit Runge–Kutta methods and its connection with contractivity.
Investigate order reduction of high-order methods on stiff problems with boundary or forcing layers.
Derive exponential Euler and exponential Runge–Kutta methods for semilinear problems.
Develop an implicit–explicit method for y'=F(t,y)+G(t,y), where G is stiff.
Study Rosenbrock–W methods for stiff systems and derive their linear stage solves.
Analyze Krylov approximations for computing \varphi-functions in exponential integrators.
Study Parareal or PFASST methods for parallel-in-time integration.
Prove a rigorous spectral convergence theorem for Chebyshev collocation applied to a linear analytic IVP.
Develop an hp-version time finite element method for IVPs and compare it with Chebyshev collocation.
Compare adaptive RK solvers with residual-minimizing polynomial or neural trial functions for IVPs.
Study interval Taylor methods for validated integration of ODEs.
Analyze long-time energy behavior of symplectic methods for Hamiltonian systems.
Design an adaptive stiffness detector that switches between explicit and implicit methods.
Extend the discussion to differential-algebraic equations and explain index-related difficulties.
Discuss how IVP solvers change for delay differential equations.
Compare classical IVP solvers with predictor–corrector methods for Caputo fractional differential equations.
Analyze mixed-precision time stepping with high-precision error estimation.
Design reproducible benchmarks comparing RK4, RK45, BDF, Radau, Chebyshev collocation, and SDC methods.
Design a decision system that selects an IVP solver based on stiffness, smoothness, accuracy requirements, and event structure.
Exercise solutions
The solutions below are converted from the uploaded LaTeX solution file. Open an accordion to view the full solution.
This chapter gives detailed worked solutions for the exercises in Chapter 10. Each solution includes the problem formulation, the method, the mathematical derivation, the conclusion, and a diagnostic comment.
Exercise 10.1
Problem formulation.
Derive the integral form y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.2
Problem formulation.
Derive explicit Euler by approximating the integral with the left endpoint rule.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.3
Problem formulation.
Derive backward Euler by approximating the integral with the right endpoint rule.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.4
Problem formulation.
Derive the trapezoidal method for IVPs.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.5
Problem formulation.
Prove the local truncation error formula for explicit Euler.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.6
Problem formulation.
Apply one explicit Euler step to y'=t+y,\qquad y(0)=1, with h=0.1.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.7
Problem formulation.
Write the four stages for one RK4 step applied to y'=y,\qquad y(0)=1.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.8
Problem formulation.
Write the explicit formulas for midpoint RK2.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.9
Problem formulation.
Write the explicit formulas for Heun’s RK2 method.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.10
Problem formulation.
Write the explicit formulas for the classical third-order RK method.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.11
Problem formulation.
Write the explicit formulas for classical RK4.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.12
Problem formulation.
Write the explicit formulas for the Kutta 3/8 fourth-order method.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.13
Problem formulation.
For y'=\lambda y, derive the explicit Euler stability function.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.14
Problem formulation.
Show that explicit Euler is stable when |1+h\lambda|\le1.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.15
Problem formulation.
Derive the backward Euler stability function.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.16
Problem formulation.
Explain stiffness in one paragraph.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.17
Problem formulation.
Explain how an embedded RK pair estimates local error.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.18
Problem formulation.
Write the AB2 formula.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Linear multistep methods approximate the integral or derivative using values from several time levels. For example, AB2 is obtained by integrating the linear interpolant of f: y_{n+1}=y_n+\frac h2(3f_n-f_{n-1}). BDF2 differentiates the quadratic interpolant through y_{n-1},y_n,y_{n+1}: \frac{3y_{n+1}-4y_n+y_{n-1}}{2h} = f(t_{n+1},y_{n+1}). Its characteristic polynomial satisfies the root condition: 3\xi^2-4\xi+1=(\xi-1)(3\xi-1), so it is zero-stable.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.19
Problem formulation.
Write the BDF2 formula.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Linear multistep methods approximate the integral or derivative using values from several time levels. For example, AB2 is obtained by integrating the linear interpolant of f: y_{n+1}=y_n+\frac h2(3f_n-f_{n-1}). BDF2 differentiates the quadratic interpolant through y_{n-1},y_n,y_{n+1}: \frac{3y_{n+1}-4y_n+y_{n-1}}{2h} = f(t_{n+1},y_{n+1}). Its characteristic polynomial satisfies the root condition: 3\xi^2-4\xi+1=(\xi-1)(3\xi-1), so it is zero-stable.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.20
Problem formulation.
Explain the basic idea of Chebyshev collocation for an IVP.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.21
Problem formulation.
Prove the referenced result.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.22
Problem formulation.
Prove the referenced result.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.23
Problem formulation.
Prove the referenced result.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.24
Problem formulation.
Prove the referenced result.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.25
Problem formulation.
Prove the referenced result.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.26
Problem formulation.
Verify the order-four conditions for classical RK4.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.27
Problem formulation.
Verify that the Kutta 3/8 method satisfies fourth-order conditions.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.28
Problem formulation.
Derive the embedded error estimate for the RKF45 formulas given in the chapter.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.29
Problem formulation.
Derive the embedded error estimate for the Dormand–Prince 5(4) formulas.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.30
Problem formulation.
Derive the adaptive step-size formula h_{\mathrm{new}}=h\,sE^{-1/(p+1)}.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.31
Problem formulation.
Prove the referenced result.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.32
Problem formulation.
Derive the RK4 stability polynomial R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.33
Problem formulation.
Prove the referenced result.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.34
Problem formulation.
Show that the trapezoidal rule has stability function R(z)=\frac{1+z/2}{1-z/2}.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.35
Problem formulation.
Derive AB2 by integrating a linear interpolant of f.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Linear multistep methods approximate the integral or derivative using values from several time levels. For example, AB2 is obtained by integrating the linear interpolant of f: y_{n+1}=y_n+\frac h2(3f_n-f_{n-1}). BDF2 differentiates the quadratic interpolant through y_{n-1},y_n,y_{n+1}: \frac{3y_{n+1}-4y_n+y_{n-1}}{2h} = f(t_{n+1},y_{n+1}). Its characteristic polynomial satisfies the root condition: 3\xi^2-4\xi+1=(\xi-1)(3\xi-1), so it is zero-stable.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.36
Problem formulation.
Derive the two-step Adams–Moulton formula.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Linear multistep methods approximate the integral or derivative using values from several time levels. For example, AB2 is obtained by integrating the linear interpolant of f: y_{n+1}=y_n+\frac h2(3f_n-f_{n-1}). BDF2 differentiates the quadratic interpolant through y_{n-1},y_n,y_{n+1}: \frac{3y_{n+1}-4y_n+y_{n-1}}{2h} = f(t_{n+1},y_{n+1}). Its characteristic polynomial satisfies the root condition: 3\xi^2-4\xi+1=(\xi-1)(3\xi-1), so it is zero-stable.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.37
Problem formulation.
Derive BDF2 by differentiating the quadratic interpolant through y_{n+1}, y_n, and y_{n-1}.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Linear multistep methods approximate the integral or derivative using values from several time levels. For example, AB2 is obtained by integrating the linear interpolant of f: y_{n+1}=y_n+\frac h2(3f_n-f_{n-1}). BDF2 differentiates the quadratic interpolant through y_{n-1},y_n,y_{n+1}: \frac{3y_{n+1}-4y_n+y_{n-1}}{2h} = f(t_{n+1},y_{n+1}). Its characteristic polynomial satisfies the root condition: 3\xi^2-4\xi+1=(\xi-1)(3\xi-1), so it is zero-stable.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.38
Problem formulation.
Check the root condition for BDF2.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Linear multistep methods approximate the integral or derivative using values from several time levels. For example, AB2 is obtained by integrating the linear interpolant of f: y_{n+1}=y_n+\frac h2(3f_n-f_{n-1}). BDF2 differentiates the quadratic interpolant through y_{n-1},y_n,y_{n+1}: \frac{3y_{n+1}-4y_n+y_{n-1}}{2h} = f(t_{n+1},y_{n+1}). Its characteristic polynomial satisfies the root condition: 3\xi^2-4\xi+1=(\xi-1)(3\xi-1), so it is zero-stable.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Distinguish forward error from backward error; a small residual does not imply a small forward error when the problem is ill-conditioned.
Exercise 10.39
Problem formulation.
Show that y''=f_t+f_yf.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.40
Problem formulation.
Derive the collocation equations for a polynomial u(t) on one step.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.41
Problem formulation.
Derive the time scaling \frac{\dd}{\dd t}=\frac{2}{T-t_0}\frac{\dd}{\dd x}.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.42
Problem formulation.
Write the Chebyshev collocation equations for the scalar IVP y'=y,\qquad y(0)=1 on [0,1].
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.43
Problem formulation.
Explain how RK stages can be used to construct dense output.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.44
Problem formulation.
Describe how to locate an event g(t,y(t))=0 inside a step.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.45
Problem formulation.
Design a work-precision experiment comparing Euler, RK2, RK4, and RK45.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.46
Problem formulation.
Introduce rooted trees and derive Runge–Kutta order conditions up to order four.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.47
Problem formulation.
Study the order conditions required for an explicit fifth-order Runge–Kutta method.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.48
Problem formulation.
Explain the first-same-as-last property of Dormand–Prince methods and its computational advantage.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.49
Problem formulation.
Analyze how embedded RK pairs share stages to produce two orders at once.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.50
Problem formulation.
Derive a proportional-integral step-size controller for adaptive RK methods.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.51
Problem formulation.
Numerically plot the absolute stability region of RK4 and determine its intersection with the negative real axis.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.52
Problem formulation.
State the first and second Dahlquist barriers and explain their implications.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.53
Problem formulation.
Prove that the trapezoidal rule is A-stable but not L-stable.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.54
Problem formulation.
Define L-stability and show that backward Euler is L-stable.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.55
Problem formulation.
Analyze explicit Euler, backward Euler, and trapezoidal rule on y'=-1000(y-\cos t)-\sin t.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.56
Problem formulation.
Derive Newton’s method for solving one backward Euler step.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Verify the stationarity residual, feasibility residual, and descent or curvature condition, not only the final numerical value.
Exercise 10.57
Problem formulation.
Discuss Jacobian reuse and simplified Newton methods for stiff IVP solvers.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.58
Problem formulation.
Derive a variable-step BDF2 formula.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Linear multistep methods approximate the integral or derivative using values from several time levels. For example, AB2 is obtained by integrating the linear interpolant of f: y_{n+1}=y_n+\frac h2(3f_n-f_{n-1}). BDF2 differentiates the quadratic interpolant through y_{n-1},y_n,y_{n+1}: \frac{3y_{n+1}-4y_n+y_{n-1}}{2h} = f(t_{n+1},y_{n+1}). Its characteristic polynomial satisfies the root condition: 3\xi^2-4\xi+1=(\xi-1)(3\xi-1), so it is zero-stable.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.59
Problem formulation.
Construct an AB2–AM2 predictor–corrector method and analyze its order.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.60
Problem formulation.
Explain the Nordsieck representation for variable-order multistep methods.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.61
Problem formulation.
Prove the referenced result.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.62
Problem formulation.
Study Radau IIA methods and explain why they are useful for stiff problems.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.63
Problem formulation.
Study Lobatto collocation methods and their relation to symplectic integration.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.64
Problem formulation.
Derive symplectic Euler for a Hamiltonian system and compare it with explicit Euler.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.65
Problem formulation.
Derive the Stormer–Verlet method for second-order mechanical systems.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.66
Problem formulation.
Construct the Chebyshev differentiation matrix and use it to solve a linear scalar IVP by collocation.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.67
Problem formulation.
Design a numerical experiment comparing RK4 and Chebyshev collocation for an analytic solution on [0,1].
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.68
Problem formulation.
Derive one correction sweep of spectral deferred correction for an explicit Euler base method.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.69
Problem formulation.
Formulate an IVP solver that minimizes the residual of the differential equation over a polynomial trial space.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.70
Problem formulation.
Derive a fourth-order Hermite–Obreschkoff method using endpoint derivatives.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.71
Problem formulation.
Develop B-series for Runge–Kutta methods and prove composition rules.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.72
Problem formulation.
Study algebraic stability of implicit Runge–Kutta methods and its connection with contractivity.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.73
Problem formulation.
Investigate order reduction of high-order methods on stiff problems with boundary or forcing layers.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.74
Problem formulation.
Derive exponential Euler and exponential Runge–Kutta methods for semilinear problems.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
The exact integral form is y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. Explicit Euler approximates the integral by the left endpoint rule: \int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s = h f(t_n,y(t_n))+O(h^2). Thus y_{n+1}=y_n+h f(t_n,y_n). Taylor expansion gives the local truncation error \tau_{n+1} = \frac{h^2}{2}y''(\xi_n), so the method has local order 2 and global order 1.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.75
Problem formulation.
Develop an implicit–explicit method for y'=F(t,y)+G(t,y), where G is stiff.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.76
Problem formulation.
Study Rosenbrock–W methods for stiff systems and derive their linear stage solves.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.77
Problem formulation.
Analyze Krylov approximations for computing \varphi-functions in exponential integrators.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.78
Problem formulation.
Study Parareal or PFASST methods for parallel-in-time integration.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.79
Problem formulation.
Prove a rigorous spectral convergence theorem for Chebyshev collocation applied to a linear analytic IVP.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.80
Problem formulation.
Develop an hp-version time finite element method for IVPs and compare it with Chebyshev collocation.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.81
Problem formulation.
Compare adaptive RK solvers with residual-minimizing polynomial or neural trial functions for IVPs.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.82
Problem formulation.
Study interval Taylor methods for validated integration of ODEs.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.83
Problem formulation.
Analyze long-time energy behavior of symplectic methods for Hamiltonian systems.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.84
Problem formulation.
Design an adaptive stiffness detector that switches between explicit and implicit methods.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Exercise 10.85
Problem formulation.
Extend the discussion to differential-algebraic equations and explain index-related difficulties.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.86
Problem formulation.
Discuss how IVP solvers change for delay differential equations.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.87
Problem formulation.
Compare classical IVP solvers with predictor–corrector methods for Caputo fractional differential equations.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Check both the singular kernel evaluation and the long-history summation; fractional errors often come from the memory term rather than the algebraic solver.
Exercise 10.88
Problem formulation.
Analyze mixed-precision time stepping with high-precision error estimation.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Start from y(t_{n+1})=y(t_n)+\int_{t_n}^{t_{n+1}}f(s,y(s))\,\dd s. One-step methods approximate this integral by quadrature or collocation. Stability is tested with y'=\lambda y, which produces an amplification factor y_{n+1}=R(h\lambda)y_n. The method is stable for those z=h\lambda satisfying |R(z)|\le1. Accuracy follows by Taylor expansion and comparison with the exact solution series.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The order claim should be confirmed by a Taylor expansion or a log-log refinement table using a problem with a known exact solution.
Exercise 10.89
Problem formulation.
Design reproducible benchmarks comparing RK4, RK45, BDF, Radau, Chebyshev collocation, and SDC methods.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
For classical RK4, k_1=f(t_n,y_n), k_2=f\left(t_n+\frac h2,y_n+\frac h2k_1\right), \quad k_3=f\left(t_n+\frac h2,y_n+\frac h2k_2\right), k_4=f(t_n+h,y_n+hk_3), y_{n+1}=y_n+\frac h6(k_1+2k_2+2k_3+k_4). Applied to y'=\lambda y, z=h\lambda, this gives R(z)=1+z+\frac{z^2}{2}+\frac{z^3}{6}+\frac{z^4}{24}. The method matches the Taylor series through order h^4, hence local error O(h^5) and global error O(h^4).
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
The formula should be verified by substitution into the defining equation and, when possible, by a small numerical test.
Exercise 10.90
Problem formulation.
Design a decision system that selects an IVP solver based on stiffness, smoothness, accuracy requirements, and event structure.
Method.
Use the exact integral form of the IVP, Taylor expansion, Runge–Kutta order conditions, linear stability analysis, and collocation equations.
Detailed solution and justification.
Apply the method to the test equation y'=\lambda y,\qquad z=h\lambda. The numerical update has the form y_{n+1}=R(z)y_n. Absolute stability requires |R(z)|\le1. For explicit Euler, R(z)=1+z, so the stability region is |1+z|\le1. For backward Euler, R(z)=\frac{1}{1-z}, which is A-stable because |1-z|\ge1 for \Re z\le0. Stiffness occurs when stability imposes a much smaller step size than accuracy requires.
Conclusion.
The displayed derivation gives the requested formula, proof, or computation. The final expression should be checked against the assumptions and notation of the corresponding chapter.
Diagnostic comment.
Always test the result on the scalar model equation or Fourier mode and verify the amplification factor satisfies the stated stability bound.
Interactive tools
The theory and solutions come first. These tools are for review, laboratories, games, memory cards, and randomized assessment.