Select a passage or formula to leave a suggestion here. Saved suggestions remain private until reviewed.
Unit 3, continued: summing scales after separation and fixing the predictor family
This part treats D §§5.3–5.4, pp.30–34, Lemma 5.3 and Corollary 5.4. The preceding quadrilinear expansion leaves two projection differences and two residual positions. We first fix two scalar structured functions from the projection differences and construct a family of functions for subsequently approximating the residuals. This family must be chosen before the functions in the other two positions and their projection constructions.
The argument uses scalar separation, uniform truncation, frequency counting, and fixed-function Bessel estimates from H. We identify these statements individually and explain how D applies them to depth-varying functions. The scalar results from H remain explicit assumptions here.
1. The approximation problem after fixing two positions
Among the four positions , choose distinct positions , and let be the other two. Write . Fix two bounded quadratic structured functions on a common initial root . If they come from two existing columns, their common root is the deeper of the two initial intervals; disjoint initial intervals have no common interval of use.
Define the bilinear form
For now, keep the scalar coefficients in the projection expansion outside this form, separate from the fixed structured functions.
The progression separation in H Lemma 4.5 (p.20) expresses the product of the two structured functions in the fixed-atom positions (the paper's low positions) as an absolutely controlled sum of separated terms. After its scalar coefficient is removed, each term has the form
These three functions are fixed quadratic structured functions. Denote a common complexity bound by . We first consider one such fixed term.
2. The permitted functions in the other two positions
This is the setup on D p.31.
Fix a dyadic subroot and a finite family of original intervals of use inside it. Also fix and . In position , the sequence may be a sum of at most three terms:
The coefficients are fixed, independent of and . Each component must belong to one of the following three classes:
- An original function ;
- A current projection ;
- A function supported on , denoted by , satisfying
All original functions and projected functions in one position come from the same complete normalized blockwise sequence. Positions may use different blocks. Each projected component uses one fixed realization of an inherited projection family; the finitely many such families share the constant . Depths with no summation intervals are still filled in by inheritance and local reprojection.
Bilinearity reduces the combinations in the two positions to at most nine pairs of components. Replacing one position requires at most three opposing components. Once each class has been estimated, these fixed finite numbers of terms can be absorbed into the constants.
3. The Fourier supremum and size classes
Choose a fixed cutoff
On the kernel support, , hence , so inserting this cutoff leaves the form unchanged. Set and define
Then and .
Write
For an integer , let be any chosen subfamily of intervals of use satisfying
D Lemma 5.3 asserts that
Here denotes a polynomial bound of fixed finite degree. Neither its coefficients nor its degree may grow with the number of intervals. The key point is that the size of the projections in the complementary positions (the paper's high positions) enters only through .
4. The scalar results used from H
The proof in D uses the scalar part of H Lemma 5.1 (pp.30–31). Set
The following facts concern the already fixed functions and do not depend on the choice of functions in the other two positions.
First, the single-scale separation estimate in H Lemma 4.6 bounds the operator norm of the original bilinear form by , with both functions measured in normalized . On a small collection of exceptional scales, this permits direct estimation of the original form before expanding all the structured coefficients.
Second, H Lemmas 4.3–4.4 give scale-dependent expansions whose principal phases are
The unscaled parameters come from combinations of bounded rational height of one fixed real parameter vector. The permitted combinations and scalar coefficients vary with the scale; the underlying parameter vector is not replaced by an unrelated one.
The truncation error satisfies more than a small single-scale bound. Each fixed phase pair has an absolute coefficient bound valid across scales and permitted decompositions. These bounds are summable over the fixed pairs, and their total can be made smaller than
where the fixed integer is chosen larger than the degree of the later smooth-kernel polynomial cost plus one. Thus the tail is made smaller to absorb that cost. This is the pooled tail result from H used on D p.32, referred to below as the uniform coefficient tail bound across scales.
Finally, the height-grouping result in H Lemma 3.5 controls the number of scales with intermediate nonzero quadratic size or linear difference . That number is polynomial in . On the remaining scales, the total errors from discarding very small quadratic terms and replacing nearby centers by representatives are also summable. H p.31 further gives a joint Bessel bound over the retained scales, intervals, and representative centers.
These are the scalar assumptions for the conditional argument in this part. We next check how varying functions enter the estimates.
5. Errors controlled by the size at each depth
Fix a depth . Intervals of use at that depth are pairwise disjoint. For original functions, normalization gives
For projected functions, the contraction property of orthogonal projection on each interval gives the same bound. For an energy-type component, the global square sum in (Energy) gives the bound at this depth.
There are at most three terms in (Allowed), so
Cauchy–Schwarz in the two positions then bounds the sum of the products of their ordinary norms by .
On exceptional scales, first apply the original single-scale bound , then (One-depth). There are only polynomially many exceptional scales, so their contribution satisfies (Band-sum). This avoids a potentially large factor from the total absolute mass of the structured coefficients.
For fixed , one can also calculate directly that
If , every term vanishes; otherwise the quantities decrease by a factor of at successive smaller scales. This handles the second term in
whose smooth-kernel norm contains the factor
Together with (One-depth) and the uniform coefficient tail bound, this makes the error summable over all scales. The geometric-series argument is applied to a fixed throughout.
6. Why the mean-zero tensor expansion admits smooth-row estimates
For the linear-phase part, first absorb into two fixed multipliers, then express the unmodulated kernel in coordinates . The zero marginals and double primitive below concern this ; no such assertion is made directly for . The absolute Jacobian is , fixed and nonzero. The four-direction cancellation condition includes directions , so integrating the transformed kernel in either variable with the other fixed gives zero.
Integrate once in each variable to obtain a double primitive. The zero marginal integrals ensure that it vanishes outside a rectangle strictly inside . Expand this primitive in a smooth Fourier series on a slightly larger fixed rectangle, multiply by an interior cutoff equal to one on its support, and differentiate in both variables. This gives a tensor expansion of the original kernel.
Each one-variable function is the derivative of a compactly supported function and therefore has integral exactly zero. Fixed-order derivative bounds grow at most polynomially in the full Fourier index, while the coefficients decay faster than the reciprocal of any fixed polynomial. We may therefore prove the row estimate at one fixed full tensor index, then sum absolutely over the indices.
For a fixed position and frequency representative , the full multiplier is
The function is fixed in advance on the common initial root. A given uses the same on every interval. The corresponding row is
where is the smooth mean-zero function just constructed.
7. Estimates for original, projected, and energy-type functions
7.1 Original function sequences
Fix a tensor index and the set of interval–frequency representatives selected in the source proof. For this actual selected set, H p.31 gives an ordinary joint Bessel bound with operator norm . Its square is polynomial in and depends polynomially on the current tensor index. Denote the bounds for the smooth function and its scaled first derivative by .
The fixed multiplier family satisfies
This follows by counting the dimension of the fixed parameter vector, the rational heights, and the uniform truncation. The frequencies themselves need not be bounded.
Retain only rows supported on the subroot . Extending any test function by zero to the common initial root preserves the original joint Bessel bound. D Lemma 4.6 from the preceding part therefore gives
The right-hand side still has only the required polynomial loss.
For a fixed linear phase pair in the uniform tail bound, fix its frequencies and full multipliers before estimating its rows. There is then only one multiplier index. Sum over the absolute coefficient bounds for phase pairs only afterward.
7.2 Current projected function sequences
The original function in (Raw-rows) cannot simply be replaced by its interval-dependent projection. A new ordinary joint operator bound is needed first.
Applied to an inherited projection family, the Compression statement in H Lemma 3.4 (p.9 onward) asserts the following. If the original rows supported on decision intervals have joint Bessel norm , then the composed rows
have ordinary joint operator norm
This statement applies to arbitrary fixed functions and is another explicit result from H used here. The rows and projection family must first be fixed by the actual construction.
View the original rows as rows on the augmented space, ignoring its private coordinates. Their Bessel norm is unchanged. The adjoint of a composed row is
Its output on the whole of is a constant-coefficient combination of fixed available column functions, and its input depends only on . Order the support depths increasingly, place all rows at one depth in one round, use the full partition at that depth for both support and observation, and use in each round. The refinement relation and nondecreasing indices satisfy D Lemma 4.4.
Applying (Compression-one) and then the varying-function row estimate gives the source equation (5.14):
No factor grows with the total depth.
7.3 Energy-type functions
For , use the Bessel bound over separated frequency centers on each fixed interval from the same row construction in H, then sum over intervals. Equation (Energy) gives
This requires neither the projection-composition result nor an identification of the different as one function.
8. Small retained frequency coefficients and summation over scales
The Fourier-supremum test in H shows that the combined scalar coefficient of each cluster of linear centers is . Test the cluster's representative frequency against the original . Its own coefficient is multiplied by the fixed nonzero number ; separation makes the other clusters contribute controlled Fourier tails. The earlier quadratic, truncation, and nearby-center replacement errors are already bounded at the same scale.
This bound applies after combining the coefficients within a cluster. It does not give a small bound for every original large coefficient after taking absolute values separately.
At a fixed tensor index, times the bilinear form is a product of two normalized row values, multiplied by the fixed Jacobian factor and the cluster coefficient. Apply Cauchy–Schwarz over all indices of the paired rows, then (Raw-rows), (Projected-rows), or the energy bound. The result is
The rapid decay of the tensor coefficients absorbs the polynomial dependence of derivative bounds and Bessel constants on the tensor index. Adding the exceptional scales and tails controlled in Section 5 proves (Band-sum).
If , the compactly supported function has identically zero Fourier transform and hence vanishes almost everywhere. On the relevant region , we have , so the corresponding bilinear form vanishes. Every positive value of belongs to one of the stated size classes.
9. The full statement for a fixed predictor family
This is D Corollary 5.4, p.34, equations (5.15)–(5.17).
Fix the functions in the fixed-atom positions with complexity at most , and fix a precision parameter . There exist a finite index set , a constant , fixed triples
and scalar coefficients depending only on the dyadic scale , denoted by , such that
If , then .
The triples and all scale coefficients depend only on the fixed functions in the fixed-atom positions, their scalar construction, and . They must be fixed before choosing the functions in the other two positions and their final projection families. Define
For every dyadic , every finite family of intervals of use, and every pair satisfying (Allowed), define the actual error by
Then
The error may depend on the current functions in the two positions. The triples and coefficients remain fixed; the conclusion bounds the sum of the actual errors for every such choice.
10. Why the truncation does not depend on later projection sizes
The separation expansion in H Lemma 4.5 has rapidly decaying total coefficient mass in successive shells, with prescribed polynomial growth of shell complexity. The polynomial in (Band-sum) can be enlarged to a product of two nonnegative polynomials:
Thus the separation shells can first be truncated using only , with sufficiently small total error from the discarded high shells. For each retained term, discard sufficiently small values of , equivalently sufficiently large . The geometric decay absorbs the fixed polynomial growth of , while remains on the right-hand side of the final error estimate.
For the finitely many remaining shells and size classes, truncate again using the uniform coefficient tail bound from Section 4. The logarithms of these thresholds are bounded by a fixed power of . The unscaled phase parameters come from finitely many choices of bounded rational height, so the retained triples form a fixed finite family.
Split the linear phase between the two fixed multipliers using
Move scalar magnitudes into the coefficients so that both multipliers retain absolute value at most one. Their real oscillation parameters may be large, but those parameters do not count toward complexity in the original definition of a structured function. This gives the triples, coefficients, and complexity bounds in Section 9.
11. Why the same family works on every subroot
Once the scalar truncations, phases, and multipliers have been chosen, they remain unchanged on any . Retain only the source rows supported on intervals in the current family of use.
Extending any function by zero to preserves the ordinary Bessel bound. Restricting the original sequence to preserves normalization. Locally reproject the projection family on using the retained columns; the column-function constants from the preceding part do not increase. The estimates in Sections 5–7 therefore apply again on , with a size factor for each position.
Summing the same discarded scalar shells, size classes, and uniform tails gives (Predictor-error). The argument reapplies operator estimates on the subroot; it does not distribute an arbitrary parent-root error in proportion to subroot length.
Source coverage and the next step
- D pp.30–31: fixed structured functions in the fixed-atom positions, the three permitted classes of opposing functions, full multipliers, and the Fourier supremum.
- D pp.32–34, Lemma 5.3: exceptional scales, the uniform coefficient tail bound, and varying-function estimates for smooth rows and rows composed with projections.
- D p.34, Corollary 5.4: fixing the predictor family before the other two positions and controlling the actual error on every subroot.
- H Lemmas 3.4–3.5, 4.3–4.6, and the proof of Lemma 5.1: the fixed-function and scalar assumptions used explicitly here. Their proofs have not all been independently verified.
The next part, on D Lemma 5.5, places these fixed predictors in the augmented space and uses their private coordinates to control moments of delayed projection residuals. The required replacement is , rather than . The predictor-family estimate alone does not establish that replacement.