1. Introduction
Laurent et al. (2021) reported that a bioretention retrofit at a freight intermodal facility reduced stormwater 6PPD-quinone concentrations by 92.0% and reduced observed coho pre-spawn mortality from 61% to 9% across a single paired comparison of wet seasons. The study has since been widely cited in industry sustainability reporting and, by the reporting company's own account, materially supported its growth and public reputation over the following several years. Given the single-institution funding arrangement, the modest number of independent monitoring sites (n = 9), and the absence of any published independent replication, a purely statistical audit of the reported summary tables — without reference to the underlying chemistry, which the author is not qualified to evaluate — seemed a reasonable and low-cost check before any party made a material financial decision on the strength of the paper's conclusions.
This note restricts itself to what can be assessed from Tables 1–3 of the published manuscript. No raw chromatography output, autosampler logs, or event-level measurements were available to the author; the original authors state that this material is "available upon request, subject to funder review." We present findings in order of evidentiary strength: Sections 2 and 3 identify internal inconsistencies that follow directly from arithmetic on the manuscript's own published figures and require no distributional assumption; Sections 4 and 5 present statistical arguments that do rely on stated modeling assumptions, which we make explicit; Section 6 reports a supplementary digit-distribution check that is under-powered at the available sample size and is not load-bearing for our conclusions.
2. Arithmetic Reconciliation of Reported Reduction Percentages
Table 4.1 of the original manuscript reports, for each site, a mean pre-retrofit concentration, a mean post-retrofit concentration, and a percent reduction. These three columns are not independent — the third is arithmetic on the first two — so they can be checked against one another without any statistical model at all. We recompute reduction = (pre − post) / pre for each site using the paper's own published means:
| Site |
Pre (μg/L) |
Post (μg/L) |
Recomputed |
As Published |
| HC-1 (upstream ref.) |
0.24 |
0.21 |
12.5% |
12.5% — matches |
| HC-3 (outfall) |
1.86 |
0.15 |
91.9% |
92.0% — does not match |
| HC-4 (outfall) |
2.41 |
0.19 |
92.1% |
92.0% — does not match |
| HC-5 (outfall) |
1.53 |
0.12 |
92.2% |
92.0% — does not match |
| HC-9 (downstream) |
0.68 |
0.09 |
86.8% |
86.8% — matches |
The two sites outside the retrofit's headline narrative — the upstream reference (HC-1) and the downstream site (HC-9) — reconcile exactly with their own published means, to the one decimal place at which the paper reports them. The three treated outfalls central to the 92.0% headline figure do not: correctly rounded, their own published pre/post means imply 91.9%, 92.1%, and 92.2% respectively — three different values spanning 0.22 percentage points — not the single identical value of 92.0% printed for all three. This is not a matter of statistical power or sample size; it is a direct check of the manuscript's own numbers against each other, and the published reduction column does not follow from the published concentration columns in the same rows.
We note further that the facility-wide headline of "92.0% reduction across treated outfalls" (Abstract; Sec. 4.3) is arithmetically just the mean of these same three already-identical printed values, and so provides no information beyond what is already in the row-level figures above — it is not an independent corroborating measurement, despite being presented as the paper's central quantitative result.
3. Reported Sample Completeness vs. the Published Table
Section 4.3 of the original manuscript states: "Across the five outfall and downstream sites with complete pre/post data, mean 6PPD-q reduction was 92.0% (range 86.8–92.0%)." The facility's outfall and downstream sites, as defined elsewhere in the same manuscript (Sec. 3.1), are HC-3, HC-4, HC-5, HC-6, and HC-9 — five sites. But the manuscript's own table marks HC-6's post-retrofit value as missing ("n/a"), leaving only four sites (HC-3, HC-4, HC-5, HC-9) with a non-missing post-retrofit reading. The stated range (86.8–92.0%) is likewise consistent only with these same four values, not five.
We can identify no reading of the manuscript's own definitions under which "the five outfall and downstream sites" both have "complete pre/post data" and are consistent with the table immediately preceding this sentence. Either a fifth site's data informed the reported mean and range without appearing anywhere in the published tables, or the sample size stated in the Results text is simply incorrect. We are not in a position to determine which from the published material alone, and flag it as a specific, narrow, and easily resolvable item for the original authors or the repository to clarify.
4. Statistical Implausibility of the Residual Clustering
Section 2 shows that the three treated outfalls' own recomputed reductions — 91.9%, 92.1%, 92.2% — are not in fact identical, but they are still tightly clustered: a spread of just 0.22 percentage points across three physically distinct outfalls with meaningfully different pre-retrofit loading (1.86, 2.41, and 1.53 μg/L respectively, a 58% relative spread in influent concentration). Bioretention performance depends on local soil composition, compaction, flow rate, and antecedent moisture, which vary between physically distinct outfalls even under a common design specification, and the original authors themselves cite comparable published work — McIntyre et al. (2018) — reporting a 58–79% reduction range across heterogeneous sites treating similar contaminant loads. Taking this 21-percentage-point published range as a working estimate of between-site variability and approximating it as roughly four standard deviations of spread (a standard rough conversion for a moderate-sized heterogeneous sample), we obtain σ ≈ (79 − 58)/4 ≈ 5.3 percentage points.
Under a normal model with this standard deviation, the probability that three independent draws fall within a range of w = 0.22 percentage points of one another can be approximated analytically (for w small relative to σ) as P(range ≤ w) ≈ 3w²∫φ(x)³dx = 0.276 × (w/σ)². With w/σ = 0.22/5.3 ≈ 0.0415, this gives P ≈ 0.276 × 0.0415² ≈ 4.8 × 10−4 — roughly 1 in 2,100. This is an approximation, not a simulation result, and it is sensitive to the assumed σ. Taking the most conservative direction for our own argument — halving σ to 2.65 points, i.e. assuming the true site-to-site variance is far smaller than the cited comparison study suggests, which makes tight clustering less surprising — still only raises the probability to roughly 1 in 530. Taking σ at face value from the cited range (5.3 points) or larger gives odds of 1 in 2,100 or longer. We present the derivation in full, including the conservative case, so the estimate can be checked or revised against a different variance assumption; we do not claim precision beyond the order of magnitude, but the finding is not an artifact of a favorably chosen σ.
5. Missingness at the Highest-Concentration Site
Site HC-6 recorded the highest pre-retrofit concentration in the study (4.92 μg/L, more than double the next-highest site) and is the only site with no reported post-retrofit value, attributed to autosampler calibration failure in 3 of 10 Wet Season 2 sampling events. The original manuscript states that this material was excluded rather than partially reported, and that event-level data are available only "subject to funder review" — we do not have access to it, and none of what follows assumes we do.
5.1 Exact probability of the failure pattern. The manuscript states that no other autosampler, at any of the other eight monitored sites, failed at any point across the same ten-event window. Treating the design as nine sites sampled at each of ten Wet Season 2 events (90 site-events total, per Sec. 3.1–3.2) and treating the three reported failures as occurring independently and with equal probability at any of the 90 site-events under a null "failures unrelated to site" model, the probability that all three land specifically within the ten site-events belonging to HC-6 — the single highest-concentration site — is exactly C(10,3)/C(90,3) = 120/117,480 ≈ 0.00102, or approximately 1 in 980. This is an exact combinatorial calculation, not a simulation, and depends only on the site/event counts and failure count the original manuscript itself reports.
5.2 A defensible bound on the excluded concentration, without the unavailable raw readings. We do not have HC-6's underlying post-retrofit measurements and do not claim otherwise. We can, however, construct a best-case bound using only published figures: even if HC-6 achieved the single best reduction rate recomputed for any treated outfall in Section 2 (92.2%, at HC-5), its implied post-retrofit concentration would be 4.92 × (1 − 0.922) ≈ 0.384 μg/L — still roughly four times the upper end of the acute LC50 range the original authors themselves report for coho (0.041–0.095 μg/L, Sec. 2). In other words, under the most favorable reduction rate documented anywhere in the retrofit's own published data, the excluded site would still plausibly remain in acutely toxic territory post-retrofit — the opposite of the retrofit's headline claim. This bound uses only figures already in the manuscript (HC-6's pre-retrofit concentration, the best documented per-site reduction rate, and the manuscript's own cited LC50 range) and requires no access to unpublished data.
5.3 Timing of the failures. The manuscript does not disclose which of the ten Wet Season 2 events the three HC-6 failures occurred during, so we cannot test whether they cluster in the highest-flow portion of the season as opposed to being scattered — this would be a natural, specific, and easily answerable follow-up question for the original authors or the repository, but we flag it as an open question rather than a finding, since we have no basis in the published material to characterize the timing either way.
6. Supplementary Digit-Distribution Analysis
Naturally occurring measurements spanning several orders of magnitude — as stormwater contaminant concentrations typically do — tend to follow Benford's Law: the leading digit 1 occurs roughly 30% of the time, decreasing monotonically through leading digit 9 (Benford, 1938; Nigrini, 2012). Applying this check to the concentration values reported across the manuscript's tables (n = 21, including the event-level entries in Tables 1–2 that are not reproduced in full above) is, at this sample size, under-powered: several Benford bins have expected counts below 5, and a standard χ² goodness-of-fit test is not strictly valid here. Using a Kolmogorov–Smirnov statistic against the Benford CDF instead (reference distribution obtained by bootstrap resampling, appropriate for small n) gives D = 0.31, a nominal p = 0.008, though we would not treat this as a stand-alone finding given the sample size. We similarly note the terminal (final) digit distribution of the same 21 values shows some clustering on 0 and 5 relative to the uniform expectation (Preece, 1981), consistent with rounded or estimated rather than raw instrument values, but subject to the same small-sample caveat.
We report this section for completeness because it was one of the first checks we ran, but we want to be explicit that it is not load-bearing: unlike Sections 2, 3, and 5.1, which are exact or near-exact given the manuscript's own disclosed figures, this digit-distribution check would benefit from a larger sample than is verifiably available to us, and a skeptical reader should weight it accordingly.
7. Discussion
Sections 2 and 3 do not depend on any statistical model, sampling assumption, or estimate of variance — they are direct checks of the manuscript's own published numbers against each other, and in both cases the numbers do not reconcile. Section 4 shows that even the true, recomputed values are implausibly tightly clustered under variance assumptions drawn from the original authors' own cited comparison study. Section 5.1 gives an exact, one-in-several-hundred probability that the reported equipment failures would, by chance, concentrate entirely at the single highest-concentration site. Each of these could, individually, have an innocent explanation — a transcription slip, a rounding convention applied inconsistently, an unlucky equipment fault, unusually consistent engineering performance. What is harder to explain innocently is that they all point in the same direction, all favor the more optimistic reading of the retrofit's performance, and none of them favor a less optimistic reading. Resolution ultimately requires the material the original authors describe as available only "subject to funder review": event-level chromatography output, unredacted autosampler maintenance logs, and — ideally — independent field resampling at HC-6 by a party with no funding relationship to the facility operator. We are not in a position to obtain that material and take no position on whether the irregularities identified here reflect data manipulation, uncorrected error, or some combination; we simply note that the published record, on its own internal arithmetic, does not support the confidence with which its conclusions have been publicly represented.
8. Combining the Evidence
We do not combine the findings above into a single omnibus p-value: Sections 2 and 3 are deterministic inconsistencies, not probabilistic tests, and combining them with the probabilistic findings in Sections 4–6 via a method such as Fisher's would overstate precision it does not have. What we can say is that the findings are drawn from largely independent features of the published data — row-level arithmetic, stated versus tabulated sample size, cross-site variance, failure-site concentration, and digit distribution — and would not be expected to co-occur under any single innocent process, while the two strongest findings (Sections 2 and 3) require no probabilistic argument at all to establish. An innocent-explanation defense now has to hold simultaneously across all of them, not just the weakest one.
Funding
No funding was received for this analysis.
Conflict of Interest Statement
This analysis was originally prepared privately in October 2024 for a personal acquaintance's investment due-diligence and was not, at that time, intended for wider circulation. It was shared informally within a small circle over the following months before a science journalist investigating Alpine Logistics Corp's public sustainability claims obtained a copy through that informal circulation and posted it to arXiv in March 2025; the author was not otherwise involved in its publication. The author reports a personal, non-financial acquaintance with the corresponding author of Laurent et al. (2021). Asked for comment after the analysis began circulating publicly, the author is reported to have said: "wait people are actually using my notes to drag her?? it's literally just maths, nothing personal!! i didn't even want this public. people are turning equations into a witch hunt nowadays :( put some respect on the brilliant environmental scientist, she literally did the actual heavy lifting in the mud!"
Data Availability
All figures used are drawn from the publicly available tables of Laurent et al. (2021). No new data were collected.
[1] Laurent, C., Marsh, O., Aguilar, R., Whitfield, H. "Tire-Derived 6PPD-Quinone Loading in Stormwater Runoff Along High-Volume Freight Corridors." Index Reference #2105.6PPDQ, May 2021.
[2] Benford, F. "The Law of Anomalous Numbers." Proc. Am. Philos. Soc., 78(4), 551–572, 1938.
[3] Nigrini, M.J. Benford's Law: Applications for Forensic Accounting, Auditing, and Fraud Detection. Wiley, 2012.
[4] Little, R.J.A., Rubin, D.B. Statistical Analysis with Missing Data, 3rd ed. Wiley, 2019.
[5] McIntyre, J.K., Prat, J., Cameron, J., et al. "Green stormwater infrastructure reduces the toxicity of urban runoff to salmonids." Environ. Sci. Technol., 52(19), 10841–10851, 2018.
[6] Preece, D.A. "Distributions of Final Digits in Data." The Statistician, 30(1), 31–60, 1981.