The National Marine Biological Analytical Quality Control Scheme www.nmbaqcs.org Ring Test Bulletin Seagrass OMC RT05 Dr Emma Wells Wells Marine Surveys April 2014 Email: emma@wellsmarine.org 1
RING TEST DETAILS Ring Test Seagrass OMC RT05 Type /Contents - % cover estimations of seagrass Circulated - 4 th February 2014 Completion Date - 4 th March 2014 Number of Subscribing Laboratories - 13 Number of Participating Laboratories - 12 Total Number of Participants - 23 Number of Results Received Per Test - 16 (Test A), 20 (Test B), 11 (Test C) *multiple data entries per lab submitted 2
Test A (Open Quadrat) Table 1. Results for % cover estimations received from participating laboratories for test A. Lab Code MA2103a MA2103b MA2103c MA2103d MA2111 Image analysis results Test A Seagrass coverage % Quadrat 1 63.93 80 51 60 65 60 58 58 60 67 65 60 35 60 60 55 55 Quadrat 2 60.00 80 72 70 75 65 70 75 65 63 70 65 60 65 70 70 65 Quadrat 3 19.48 30 46 30 20 25 22 30 20 17 25 15 15 15 15 15 20 Quadrat 4 18.98 35 42 40 25 20 28 33 15 15 27 15 20 12 15 25 25 Quadrat 5 28.91 45 53 40 25 30 30 43 30 35 42 20 30 25 25 35 35 Quadrat 6 64.36 90 89 90 90 85 85 82 85 90 80 75 85 90 90 90 85 Quadrat 7 41.01 55 61 50 55 45 42 50 40 45 40 25 45 55 45 50 45 Quadrat 8 32.19 40 55 35 40 35 39 35 25 40 30 30 25 28 40 30 35 Quadrat 9 52.87 75 79 70 45 60 62 66 55 75 60 50 60 75 55 70 70 Quadrat 10 48.90 30 55 45 25 35 30 45 30 35 35 20 25 30 30 45 25 Quadrat 11 7.87 10 38 10 5 10 12 18 5 5 10 6 5 5 5 8 7 Quadrat 12 50.37 50 68 60 55 50 48 53 48 40 47 40 40 60 35 50 50 Quadrat 13 36.33 40 54 35 25 35 30 40 30 30 30 20 30 45 25 35 30 Quadrat 14 39.01 75 73 70 60 50 48 60 50 55 55 50 55 55 40 50 60 Quadrat 15 18.53 30 29 20 15 15 17 19 10 10 10 10 10 12 15 10 15 MA2102a MA2102b MA2102c MA2102d MA2102e MA2112c MA2119 MA2131a MA2133 MA2134a MA2134b 3
Figure 1. Difference in % cover between submitted results and image analysis results, displayed as the average difference across all quadrats in test A for each participant. 4
Figure 2. Number of quadrat fails per participant based on z-scores derived from mean % cover estimates for test A. Figure 3. Number of quadrat fails per participant based on z-scores derived from % cover as calculated using image analysis for test A. 5
Test B (9 x 9 Gridded Quadrat) Table 2. Results for % cover estimations received from participating laboratories for test B. Lab Code Image analysis results MA2117e MA2117d MA2117c MA2103a MA2103b MA2103c MA2103d Test B Seagrass coverage % Quadrat 1 63.93 65 65 54 75 74.1 77.8 72 64 60 68 59 84 71.6 68 64 60 64 52 76 54 Quadrat 2 60.00 80 75 64 83 81.5 86.4 83 80 63 74 61 90 77.7 73 74 64 70 60 83 64 Quadrat 3 19.48 25 25 27 43 39.5 48.1 33 33 21 22 20 48 30.9 25 20 14 30 15 37 22 Quadrat 4 18.98 25 25 28 32 38.3 58 32 37 19 20 22 33 30.9 28 18 14 40 12 59 36 Quadrat 5 28.91 35 40 42 48 60.5 63 40 49 35 43 25 42 33.3 47 28 36 51 30 56 40 Quadrat 6 64.36 90 80 78 86 92.6 91.4 87 89 80 74 75 95 81.5 85 88 89 93.5 90 88 88 Quadrat 7 41.01 45 55 51 60 70.4 75.3 64 54 42 38 32 80 67.9 60 48 38 61 28 65 48 Quadrat 8 32.19 45 45 30 41 43.2 55.6 37 37 25 28 23 36 34.6 38 32 23 39 36 43 36 Quadrat 9 52.87 70 70 64 78 71.6 86.4 63 67 54 58 40 93 53.1 74 60 53 79 45 76 64 Quadrat 10 48.90 40 35 46 58 63 66.7 38 48 33 37 26 63 44.4 49 32 31 44 35 60 34 Quadrat 11 7.87 10 10 17 33 32.1 39.5 6 22 7 9 9 17 14.8 16 4 7 12 4 20 8 Quadrat 12 50.37 55 55 53 64 66.7 65.4 58 59 44 51 45 72 50.6 56 48 51 81 40 56 52 Quadrat 13 36.33 35 40 46 49 53.1 58 36 44 27 30 25 59 40.7 35 28 27 40 20 48 34 Quadrat 14 39.01 60 65 64 75 77.8 81.5 60 63 52 59 52 80 50.6 54 52 54 78 45 70 58 Quadrat 15 18.53 15 20 21 26 23.5 35.8 14 21 10 7 19 11 13.6 17 10 9 75 10 23 16 MA2102b MA2102c MA2102e MA2112c MA2109a MA2109b MA2109c MA2110 MA2119 MA2131a MA2133 MA2134a MA2134b 6
Figure 4. Difference in % cover between submitted results and image analysis results, displayed as the average difference across all quadrats in test B for each participant. 7
Figure 5. Number of quadrat fails per participant based on z-scores derived from mean % cover estimates for test B. Figure 6. Number of quadrat fails per participant based on z-scores derived from % cover as calculated using image analysis for test B. 8
Test C (4 x 4 Gridded Quadrat) Table 3. Results for % cover estimations received from participating laboratories for test C. Lab Codes MA2103a MA2103b MA2103c MA2103d MA2111 MA2112c MA2119 MA2131a MA2133 MA2134a MA2134b Image analysis results Test C Seagrass coverage % Quadrat 1 63.93 60 72 66 60 72 73 47 60 45 45 55 Quadrat 2 60.00 62 81 70 65 85 74 52 66 56 56 75 Quadrat 3 19.48 31 33 36 25 35 30 16 38 15 18 24 Quadrat 4 18.98 27 39 38 28 41 33 12 34 9 22 30 Quadrat 5 28.91 37 54 42 26 51 48 21 52 23 27 33 Quadrat 6 64.36 80 88 78 90 94 90 66 92 90 81 90 Quadrat 7 41.01 48 65 58 50 63 60 39 64 36 36 53 Quadrat 8 32.19 34 41 38 34 48 36 24 40 34 24 35 Quadrat 9 52.87 58 70 64 50 62 64 46 74 40 47 74 Quadrat 10 48.90 43 52 50 30 51 37 29 54 30 34 45 Quadrat 11 7.87 12 25 20 6 15 17 5 22 4 11 17 Quadrat 12 50.37 54 61 58 46 63 54 40 66 42 42 55 Quadrat 13 36.33 35 44 42 28 43 44 22 46 19 24 37 Quadrat 14 39.01 57 59 60 52 67 62 43 72 42 49 68 Quadrat 15 18.53 18 29 24 16 15 12 9 30 11 16 14 9
Figure 7. Difference in % cover between submitted results and image analysis results, displayed as the average difference across all quadrats in test C for each participant. 10
Figure 8. Number of quadrat fails per participant based on z-scores derived from mean % cover estimates for test C. Figure 9. Number of quadrat fails per participant based on z-scores derived from % cover as calculated using image analysis for test C. 11
Table 4. Summary of results from tests A, B and C including minimum values recorded, maximum, mean and range per quadrat across all participants Results from Test A Results from Test B Results from Test C Average deviation mean from actual StDev Range Min Max Mean Avergae deviation mean from actual StDev Range Min Max Mean Average deviation mean from actual StDev Range image analysis seagrass coverage % Min Max Mean Quadrat 1 54.51 35 80 59 4.6 9.1 45 54 78 67 2.8 7.5 24 45 73 60 4.4 10.6 28 Quadrat 2 31.09 60 80 69 8.7 5.2 20 61 86 76 15.5 9.0 25 52 85 67 7.5 10.7 33 Quadrat 3 28.82 15 46 23 3.0 8.4 31 20 48 31 11.2 9.6 28 15 38 27 7.9 8.3 23 Quadrat 4 75.39 12 42 25 5.5 9.3 30 19 58 31 11.6 11.2 39 9 41 28 9.5 10.5 32 Quadrat 5 8.12 20 53 34 5.0 8.8 33 25 63 44 14.8 11.1 38 21 54 38 8.7 12.4 33 Quadrat 6 18.90 75 90 86 22.0 4.5 15 74 93 84 19.6 6.7 19 66 94 85 21.0 8.3 28 Quadrat 7 83.22 25 61 47 5.7 8.3 36 32 75 53 12.4 13.5 43 36 65 52 11.0 11.2 29 Quadrat 8 28.66 25 55 35 2.9 7.5 30 23 56 37 5.0 10.0 33 24 48 35 3.1 7.0 24 Quadrat 9 58.31 45 79 64 11.3 9.9 34 40 86 66 12.7 12.3 46 40 74 59 6.2 11.8 34 Quadrat 10 48.92 20 55 34 15.1 9.4 35 26 67 45 4.3 13.1 41 29 54 41 7.5 9.7 25 Quadrat 11 8.27 5 38 10 2.1 8.3 33 6 40 18 9.9 12.1 34 4 25 14 6.2 7.1 21 Quadrat 12 39.51 35 68 50 0.7 8.6 33 44 67 56 5.7 7.7 23 40 66 53 2.5 9.1 26 Quadrat 13 43.41 20 54 33 3.0 8.3 34 25 58 40 4.0 10.8 33 19 46 35 1.4 10.0 27 Quadrat 14 5.37 40 75 57 17.6 9.5 35 52 81 65 25.5 9.8 29 42 72 57 18.3 10.0 30 Quadrat 15 32.99 10 30 15 3.1 6.4 20 7 36 19 0.8 7.9 29 9 30 18 0.9 7.0 21 Average 7.37 8.11 30.93 Average 10.39 10.15 32.22 Average 7.7 9.6 27.6 12
Table 5. Comparison of estimated results from tests A, B and C with image analysis % cover results. The value represents the average deviation from image analysis % cover value for each participant. Lab Code Test A Test B Test C MA2117e 9.32 MA2117d 10.00 MA2117c 8.82 MA2103a 14.72 18.02 6.44 MA2103b 20.54 20.33 15.35 MA2103c 10.71 27.08 10.75 MA2103d 9.94 11.70 7.65 MA2111 5.56 15.29 MA2102a 7.23 MA2102b 9.59 12.53 MA2102c 6.37 6.23 MA2102d 9.08 MA2102e 7.60 7.28 MA2112c 9.00 7.29 12.61 MA2109a 22.39 MA2109b 8.82 MA2109c 9.87 MA2110 7.16 MA2119 9.50 7.71 8.20 MA2131a 10.19 18.97 15.67 MA2133 7.92 8.92 9.84 MA2134a 7.65 18.48 7.75 MA2134b 8.47 8.71 10.47 13
Figure 10. Comparison of deviation in image analysis % cover from estimated % cover between quadrats highlighting those problematic quadrats. (Quadrats are arranged in order of lowest to highest % cover). 14
Image Analysis Results Areas of seagrass coverage as calculated using imagej analysis. Summary results for each quadrat include the total number of failures across all three tests as calculated using Z-scores based on both the mean % cover across all participants and the actual % cover as determined by image analysis. Quadrat: 1 Actual % cover: 69.93 Total No. of fails from Z-score of mean: 3 Total No. of fails from Z-score of actual % cover: 2 Average deviation across 3 tests: 7.84 Quadrat: 2 Actual % cover: 60.00 Total No. of fails from Z-score of mean: 1 Total No. of fails from Z-score of actual % cover: 13 Average deviation from mean: 11.15 15
Quadrat: 3 Actual % cover: 19.48 Total No. of fails from Z-score of mean: 1 Total No. of fails from Z-score of actual % cover: 6 Average deviation from mean: 8.73 Quadrat: 4 Actual % cover: 18.98 Total No. of fails from Z-score of mean: 2 Total No. of fails from Z-score of actual % cover: 4 Average deviation from mean: 11.22 16
Quadrat: 5 Actual % cover: 28.91 Total No. of fails from Z-score of mean: 2 Total No. of fails from Z-score of actual % cover: 5 Average deviation from mean: 11.17 Quadrat: 6 Actual % cover: 64.36 Total No. of fails from Z-score of mean: 2 Total No. of fails from Z-score of actual % cover: 42 Average deviation from mean: 21.56 17
Quadrat: 7 Actual % cover: 41.01 Total No. of fails from Z-score of mean: 1 Total No. of fails from Z-score of actual % cover: 6 Average deviation from mean: 12.40 Quadrat: 8 Actual % cover: 32.19 Total No. of fails from Z-score of mean: 2 Total No. of fails from Z-score of actual % cover: 3 Average deviation from mean: 6.50 18
Quadrat: 9 Actual % cover: 52.87 Total No. of fails from Z-score of mean: 1 Total No. of fails from Z-score of actual % cover: 6 Average deviation from mean: 13.04 Quadrat: 10 Actual % cover: 48.90 Total No. of fails from Z-score of mean: 1 Total No. of fails from Z-score of actual % cover: 10 Average deviation from mean: 12.29 19
Quadrat: 11 Actual % cover: 7.87 Total No. of fails from Z-score of mean: 2 Total No. of fails from Z-score of actual % cover: 5 Average deviation from mean: 6.82 Quadrat: 12 Actual % cover: 50.37 Total No. of fails from Z-score of mean: 2 Total No. of fails from Z-score of actual % cover: 3 Average deviation from mean: 7.56 20
Quadrat: 13 Actual % cover: 36.33 Total No. of fails from Z-score of mean: 1 Total No. of fails from Z-score of actual % cover: 2 Average deviation from mean: 8.21 Quadrat: 14 Actual % cover: 39.01 Total No. of fails from Z-score of mean: 0 Total No. of fails from Z-score of actual % cover: 22 Average deviation from mean: 19.83 21
Quadrat: 15 Actual % cover: 18.53 Total No. of fails from Z-score of mean: 3 Total No. of fails from Z-score of actual % cover: 1 Average deviation from mean: 6.78 22