Paper · 2019 · Methods in Ecology and Evolution

Accuracy of image analysis tools for functional root traits: A comment on Delory et al. (2017)

Laura Rose; Guillaume Lobet

16
claims
18
verbatim quotes
20
citations
2
research areas
✓
Open access

Abstract

Abstract Root traits get increasing attention as functional equivalents of above‐ground traits. Image analysis software such as WinRhizo ™ and IJ_Rhizo facilitate root trait analyses. Delory et al. ( ) presented a comparison between the accuracy of WinRhizo ™ and IJ_Rhizo for measuring root length. We complement their analyses with a comparison of diameter and volume estimates and a comparison of different image resolutions with manual and automatic threshold. We analysed 100 images of fibrous and taproot systems, which were obtained using the root model ArchiSimple. As a result, for each image, diameter, length and volume were known. The images were analysed with WinRhizo ™ and IJ_Rhizo and we compared the estimates of diameter, length and volume to ground‐truth values. We further computed relative errors and their magnitude and analysed their dependency on image characteristics and root system properties. At 1,200 and 800 dpi, diameter and length estimates provided by WinRhizo ™ and IJ_Rhizo were of comparable accuracy. Diameter errors were balanced. Volume estimates were subjected to a systematic error caused by the assumption of constant diameter. WinRhizo ™ , however, provides the opportunity to calculate correctly computed volumes from diameter classes. At 1,200 dpi, IJ_Rhizo failed to automatically find an appropriate threshold for pixel classification, which fundamentally decreased accuracy. The magnitude of diameter errors increased with root overlap for IJ_Rhizo. The length errors increased with increasing root length, overlap and root length density for WinRhizo ™ . The magnitude of underestimation of the volume (WinRhizo ™ ) decreased with volume. It was higher for taproot than for fibrous root systems. All errors increased with lower resolution. Our results confirm the results of Delory et al. ( ) regarding the accuracy for length. They further confirm that estimates derived from different software packages or at different resolution should not be compared directly. The characteristics of root systems should be standardized for image analysis. The dependency of errors on the response variable of interest can influence the effect size and increase the probability of errors. Validation of methods should be conducted for each analysed dataset. New image analysis tools should be validated against a real ground‐truth.

Abstract from the paper’s OpenAlex record, shown for indexing and research. Copyright remains with the authors or the publisher. Read at the source ↗

The text the model read, with the source record’s inline markup (italics, sub- and superscripts) rendered and its character entities decoded; quote offsets refer to the raw text.

Claims 16

Method / resourceobservedoriginal resultno effectmeasured

Claim · model-written summary

WinRhizo and IJ_Rhizo gave comparable accuracy for diameter and length estimates at 1,200 and 800 dpi.

Outcome
diameter and length estimatese0
Qualifier
At 1,200 and 800 dpie0
Comparator
IJ_Rhizoe0

Not reportedTaxon

Verbatim

e0

“At 1,200 and 800 dpi, diameter and length estimates provided by WinRhizo ™ and IJ_Rhizo were of comparable accuracy”

✓ located verbatim in the source · abstract, characters 921–1036 · show in text ↑
Method / resourceobservedoriginal resultno effectmeasured

Claim · model-written summary

Diameter errors were balanced when estimated against ground-truth values.

Outcome
Diameter errorse0
Direction
balancede0
Comparator
ground‐truth valuese1

Not reportedTaxon

Verbatim

e0

“Diameter errors were balanced”

✓ located verbatim in the source · abstract, characters 1038–1067 · show in text ↑
e1

“we compared the estimates of diameter, length and volume to ground‐truth values”

✓ located verbatim in the source · abstract, characters 701–780 · show in text ↑
Method / resourceobservedoriginal resultnegativemeasured

Claim · model-written summary

Volume estimates had a systematic error caused by the assumption of constant diameter.

Outcome
Volume estimatese0
Qualifier
systematic error caused by the assumption of constant diametere0
Comparator
ground‐truth valuese1

Not reportedTaxon

Verbatim

e0

“Volume estimates were subjected to a systematic error caused by the assumption of constant diameter”

✓ located verbatim in the source · abstract, characters 1069–1168 · show in text ↑
e1

“we compared the estimates of diameter, length and volume to ground‐truth values”

✓ located verbatim in the source · abstract, characters 701–780 · show in text ↑
Observationobservedoriginal resultpositivebasis n/a

Claim · model-written summary

WinRhizo provides the opportunity to calculate correctly computed volumes from diameter classes.

Outcome
correctly computed volumese0

Not reportedTaxon

Verbatim

e0

“WinRhizo ™ , however, provides the opportunity to calculate correctly computed volumes from diameter classes”

✓ located verbatim in the source · abstract, characters 1170–1278 · show in text ↑
Observationobservedoriginal resultnegativemeasured

Claim · model-written summary

At 1,200 dpi, IJ_Rhizo failed to find an appropriate threshold, which decreased accuracy.

Outcome
accuracye0
Direction
decreasede0
Qualifier
At 1,200 dpie0

Not reportedTaxon

Verbatim

e0

“At 1,200 dpi, IJ_Rhizo failed to automatically find an appropriate threshold for pixel classification, which fundamentally decreased accuracy”

✓ located verbatim in the source · abstract, characters 1280–1421 · show in text ↑
Associationobservedoriginal resultnegativemeasured

Claim · model-written summary

The magnitude of diameter errors increased with root overlap for IJ_Rhizo.

Treatment
root overlape0
Outcome
magnitude of diameter errorse0
Direction
increasede0

Not reportedTaxon

Verbatim

e0

“The magnitude of diameter errors increased with root overlap for IJ_Rhizo”

✓ located verbatim in the source · abstract, characters 1423–1496 · show in text ↑
Associationobservedoriginal resultnegativemeasured

Claim · model-written summary

Length errors of WinRhizo increased with root length, overlap and root length density.

Treatment
increasing root length, overlap and root length densitye0
Outcome
length errorse0
Direction
increasede0

Not reportedTaxon

Verbatim

e0

“The length errors increased with increasing root length, overlap and root length density for WinRhizo ™”

✓ located verbatim in the source · abstract, characters 1498–1601 · show in text ↑
Associationobservedoriginal resultmeasured

Claim · model-written summary

The magnitude of WinRhizo volume underestimation decreased with volume.

Treatment
volumee0
Outcome
magnitude of underestimation of the volumee0
Direction
decreasede0

Not reportedTaxon

Verbatim

e0

“The magnitude of underestimation of the volume (WinRhizo ™) decreased with volume”

✓ located after whitespace/quote normalisation · abstract, characters 1604–1686 · show in text ↑
Associationobservedoriginal resultmeasured

Claim · model-written summary

Volume underestimation was higher for taproot than for fibrous root systems.

Organ / stage
taproote0
Outcome
underestimatione0
Direction
highere0
Comparator
fibrous root systemse0

Not reportedTaxon

Verbatim

e0

“The magnitude of underestimation of the volume (WinRhizo ™) decreased with volume. It was higher for taproot than for fibrous root systems”

✓ located after whitespace/quote normalisation · abstract, characters 1604–1743 · show in text ↑
Associationobservedoriginal resultnegativemeasured

Claim · model-written summary

All errors increased with lower resolution.

Treatment
lower resolutione0
Outcome
errorse0
Direction
increasede0

Not reportedTaxon

Verbatim

e0

“All errors increased with lower resolution”

✓ located verbatim in the source · abstract, characters 1745–1787 · show in text ↑
Method / resourceobservedoriginal resultpositivemeasured

Claim · model-written summary

The results confirm the earlier accuracy results of Delory et al. for length.

Outcome
accuracy for lengthe0
Comparator
Delory et al.e0

Not reportedTaxon

Verbatim

e0

“Our results confirm the results of Delory et al. ( ) regarding the accuracy for length”

✓ located verbatim in the source · abstract, characters 1789–1875 · show in text ↑
Recommendationauthor interpretationoriginal resultpositivebasis n/a

Claim · model-written summary

Estimates from different software packages or resolutions should not be compared directly.

Outcome
estimates derived from different software packages or at different resolutione0

Not reportedTaxon

Verbatim

e0

“They further confirm that estimates derived from different software packages or at different resolution should not be compared directly”

✓ located verbatim in the source · abstract, characters 1877–2012 · show in text ↑
Recommendationauthor interpretationoriginal resultpositivebasis n/a

Claim · model-written summary

Characteristics of root systems should be standardised for image analysis.

Outcome
characteristics of root systemse0

Not reportedTaxon

Verbatim

e0

“The characteristics of root systems should be standardized for image analysis”

✓ located verbatim in the source · abstract, characters 2014–2091 · show in text ↑
Recommendationauthor interpretationoriginal resultpositivebasis n/a

Claim · model-written summary

Methods should be validated for each analysed dataset.

Outcome
Validation of methodse0

Not reportedTaxon

Verbatim

e0

“Validation of methods should be conducted for each analysed dataset”

✓ located verbatim in the source · abstract, characters 2225–2292 · show in text ↑
Recommendationauthor interpretationoriginal resultpositivebasis n/a

Claim · model-written summary

New image analysis tools should be validated against a real ground-truth.

Outcome
New image analysis toolse0

Not reportedTaxon

Verbatim

e0

“New image analysis tools should be validated against a real ground‐truth”

✓ located verbatim in the source · abstract, characters 2294–2366 · show in text ↑
Associationauthor interpretationoriginal resultnegativebasis n/a

Claim · model-written summary

The dependency of errors on the response variable of interest can increase the probability of errors.

Treatment
dependency of errors on the response variable of intereste0
Outcome
probability of errorse0
Direction
increasee0

Not reportedTaxon

Verbatim

e0

“The dependency of errors on the response variable of interest can influence the effect size and increase the probability of errors”

✓ located verbatim in the source · abstract, characters 2093–2223 · show in text ↑