The National Marine Biological Analytical Quality Control Scheme

The National Marine Biological Analytical Quality Control Scheme www.nmbaqcs.org Ring Test Bulletin Macroalgae OMC RT05 Dr Emma Wells Wells Marine Surveys April 2014 Email: emma@wellsmarine.org 1

RING TEST DETAILS Ring Test Macroalgae OMC RT05 Type /Contents - % cover estimations of opportunist macroalgae Circulated - 4 th February 2014 Completion Date 4 th April 2014 Number of Subscribing Laboratories - 13 Number of Participating Laboratories - 12 Total Number of Participants - 24 Number of Results Received Per Test - 17 (Test A), 22 (Test B), 13 (Test C) *multiple data entries per lab submitted 2

Test A (Open Quadrat) Table 1. Results for % cover estimations received from participating laboratories for test A. Lab Code MA2103a MA2103b MA2103c MA2103d MA2111 MA2102a Image analysis results Algal coverage Test A % Quadrat 1 25.19 30 30 40 25 30 29 33 26 30 28 55 25 32 20 35 25 30 Quadrat 2 37.78 40 45 50 40 35 40 40 40 40 38 35 32 40 35 70 35 40 Quadrat 3 7.33 15 13 20 10 10 12 13 12 15 12 11 8 15 7 20 8 10 Quadrat 4 41.87 40 42 60 50 45 45 48 40 45 45 45 37 51 30 40 45 40 Quadrat 5 84.93 85 86 85 85 85 85 77 80 90 80 88 85 88 90 85 85 85 Quadrat 6 14.97 15 24 25 15 20 19 19 20 22 27 20 15 22 15 25 15 20 Quadrat 7 15.27 15 17 20 15 15 15 15 15 17 23 15 13 16 13 10 10 15 Quadrat 8 62.49 70 71 80 65 65 63 69 68 68 70 70 75 68 75 75 60 65 Quadrat 9 7.66 15 14 15 10 15 12 14 10 10 10 6 10 17 5 15 5 8 Quadrat 10 20.45 20 29 35 20 30 22 23 23 25 26 25 20 28 20 30 10 20 Quadrat 11 32.21 35 37 50 25 35 36 29 25 35 38 45 25 35 25 45 20 30 Quadrat 12 53.00 60 62 75 60 70 60 59 60 60 60 65 60 84 50 60 55 55 Quadrat 13 26.82 35 40 60 35 40 38 45 40 45 47 40 35 46 30 40 25 40 Quadrat 14 100.00 100 100 100 90 100 99 100 99 100 100 100 100 100 100 95 98 90 Quadrat 15 79.76 80 79 90 80 85 78 78 80 85 72 85 80 95 92 85 75 85 MA2102b MA2102c MA2102d MA2102e MA2112c MA2119 MA2114 MA2131a MA2133 MA2134a MA2134b 3

Figure 1. Difference in % cover between submitted results and image analysis results, displayed as the average difference across all quadrats in test A for each participant. 4

Figure 2. Number of quadrat fails per participant based on z-scores derived from mean % cover estimates for test A. Figure 3. Number of quadrat fails per participant based on z-scores derived from % cover as calculated using image analysis for test A. 5

Test B (9 x 9 Gridded Quadrat) Table 2. Results for % cover estimations received from participating laboratories for test B. Lab Code MA2117a MA2117b MA2117c MA2103a MA2103b MA2103c MA2103d MA2102a Image analysis results Algal coverage Test B % Quadrat 1 25.19 28 28 27 32 33 44 27 35 32 22 32 33 31 23 25 25 30 28 32 31 34 25 Quadrat 2 37.78 44 43 48 43 44 56 38 44 44 41 44 40 46 38 41 42 37 37 40 53 46 40 Quadrat 3 7.33 14 14 16 16 16 19 11 16 15 10 17 11 11 10 14 13 9 8 15 10 16 12 Quadrat 4 41.87 48 48 49 48 47 51 45 51 49 44 49 47 47 49 47 49 43 42 51 43 50 44 Quadrat 5 84.93 91 94 84 86 88 91 84 90 89 83 90 86 90 88 90 86 86 90 88 90 86 82 Quadrat 6 14.97 26 25 24 27 26 30 18 28 27 23 25 27 28 25 28 22 22 17 22 17 27 18 Quadrat 7 15.27 20 19 16 20 19 21 12 22 19 19 19 18 19 16 16 18 16 11 16 14 18 12 Quadrat 8 62.49 79 80 64 72 67 80 67 74 72 63 72 68 70 68 68 70 67 76 68 74 69 68 Quadrat 9 7.66 12 14 11 14 12 20 12 15 11 10 11 6 11 7 11 12 6 9 17 10 13 8 Quadrat 10 20.45 28 27 28 32 32 36 23 33 31 26 29 23 31 27 26 28 27 22 28 26 28 24 Quadrat 11 32.21 38 36 31 41 36 46 26 37 35 28 36 26 31 32 31 33 26 30 35 36 35 32 Quadrat 12 53.00 78 78 59 73 69 75 63 78 72 64 64 64 68 69 61 64 64 69 84 65 67 52 Quadrat 13 26.82 53 52 47 46 51 54 35 54 49 42 41 47 51 44 48 52 43 34 46 43 50 34 Quadrat 14 100.00 100 100 100 100 100 100 88 100 100 100 100 100 100 99 98 99 100 100 100 99 98 88 Quadrat 15 79.76 94 93 84 90 89 93 86 10 89 83 89 85 88 90 84 88 91 88 95 89 86 80 MA2102b MA2102c MA2102d MA2102e MA2112c MA2109a MA2109b MA2109c MA2119 MA2131a MA2114 MA2133 MA2134a MA2134b 6

Figure 4. Difference in % cover between submitted results and image analysis results, displayed as the average difference across all quadrats in test B for each participant. 7

Figure 5. Number of quadrat fails per participant based on z-scores derived from mean % cover estimates for test B. Figure 6. Number of quadrat fails per participant based on z-scores derived from % cover as calculated using image analysis for test B. 8

Test C (4 x 4 Gridded Quadrat) Table 3. Results for % cover estimations received from participating laboratories for test C. Lab Codes MA2103a MA2103b MA2103c MA2103d MA2111 MA2112c MA2110 MA2119 MA2131a MA2114 MA2133 MA2134a MA2134b Image analysis results Algal coverage Test C % Quadrat 1 25.19 27 48 34 20 35 33 26 24 27 25 36 19 27 Quadrat 2 37.78 39 47 46 37 40 40 36 34 38 40 74 33 43 Quadrat 3 7.33 10 18 16 8 16 13 8 8 8 10 11 8 13 Quadrat 4 41.87 43 58 48 44 48 43 44 38 40 40 49 42 48 Quadrat 5 84.93 86 85 92 82 88 87 88 79 80 80 95 83 88 Quadrat 6 14.97 21 23 24 14 28 20 20 16 17 15 27 14 22 Quadrat 7 15.27 14 18 18 12 21 12 14 12 14 15 20 14 16 Quadrat 8 62.49 69 78 76 64 78 70 68 60 64 60 85 60 69 Quadrat 9 7.66 14 16 18 8 21 11 10 8 14 10 17 7 8 Quadrat 10 20.45 27 31 30 22 30 27 22 20 20 15 32 20 26 Quadrat 11 32.21 29 38 40 22 40 34 28 24 26 20 58 25 30 Quadrat 12 53.00 67 71 70 58 74 62 64 60 63 50 83 48 53 Quadrat 13 26.82 38 52 48 32 52 41 44 32 36 25 49 33 42 Quadrat 14 100.00 100 100 100 88 100 100 100 100 100 100 98 100 90 Quadrat 15 79.76 82 81 86 84 91 83 14 70 83 80 88 76 88 9

Figure 7. Difference in % cover between submitted results and image analysis results, displayed as the average difference across all quadrats in test C for each participant. 10

Number of fails based on Z-scores of mean 3 2 1 0 Laboratory Figure 8. Number of quadrat fails per participant based on z-scores derived from mean % cover estimates for test C. Figure 9. Number of quadrat fails per participant based on z-scores derived from % cover as calculated using image analysis for test C. 11

Table 4. Summary of results from tests A, B and C including minimum values recorded, maximum, mean and range per quadrat across all participants Results from Test A Results from Test B Results from Test C Average deviation mean Average deviation mean from actual StDev Range Min Max Mean from actual StDev Range Min Max Mean Average deviation mean from actual StDev Range image analysis algal coverage % Min Max Mean Quadrat 1 25.19 20 55 30.77-5.58 7.70 35 22.0 44.44 30-4.70 4.88 22 19 48 29.3-4.12 7.79 29 Quadrat 2 37.78 32 70 40.85-3.08 8.59 38 37.0 55.56 43-5.39 4.72 19 33 74 42.1-4.30 10.44 41 Quadrat 3 7.33 7 20 12.40-5.08 3.73 13 8.3 18.52 13-5.93 2.91 10 8 18 11.3-3.98 3.57 10 Quadrat 4 41.87 30 60 43.98-2.11 6.47 30 42.0 50.62 47-5.43 2.69 9 38 58 45.0-3.13 5.24 20 Quadrat 5 84.93 77 90 84.92 0.01 3.36 13 82.0 94 88-2.90 3.05 12 79 95 85.6-0.68 4.79 16 Quadrat 6 14.97 15 27 19.90-4.92 3.96 12 16.5 29.63 24-9.20 3.91 13 14 28 20.1-5.10 4.70 14 Quadrat 7 15.27 10 23 15.24 0.03 3.11 13 10.5 22.2 17-1.90 2.97 12 12 21 15.4-0.11 3.01 9 Quadrat 8 62.49 60 80 69.23-6.73 5.02 20 63.0 80.25 71-8.23 4.85 17 60 85 69.3-6.81 7.96 25 Quadrat 9 7.66 5 17.28 11.25-3.59 3.81 12.28 6.0 19.75 11-3.83 3.30 14 7 21 12.5-4.80 4.52 14 Quadrat 10 20.45 10 35 23.91-3.45 5.73 25 22.0 35.8 28-7.54 3.50 14 15 32 24.8-4.32 5.29 17 Quadrat 11 32.21 20 50 33.50-1.30 8.24 30 26.0 45.68 33-1.23 4.88 20 20 58 31.8 0.36 10.27 38 Quadrat 12 53.00 50 83.95 62.06-9.06 7.93 33.95 52.0 83.95 68-15.14 7.39 32 48 83 63.3-10.31 9.91 35 Quadrat 13 26.82 25 60 40.04-13.22 7.65 35 34.0 54.32 46-19.37 6.20 20 25 52 40.3-13.49 8.54 27 Quadrat 14 100.00 90 100 98.29 1.71 3.37 10 88.0 100 99 1.44 3.49 12 88 100 98.2 1.85 4.12 12 Quadrat 15 79.76 72 95.06 82.59-2.83 6.02 23.06 9.9 95.06 85-4.93 17.11 85 14 91 77.4 2.37 19.81 77 Average -3.95 5.65 22.89 Average -6.29 5.06 20.71 Average -3.8 7.3 25.6 12

Table 5. Comparison of estimated results from tests A, B and C with image analysis % cover results. The value represents the average deviation from image analysis % cover value for each participant. Lab Code Test A Test B Test C MA2117a 9.64 MA2117b 9.42 MA2117c 5.50 MA2103a 3.36 8.65 4.35 MA2103b 5.39 7.91 10.28 MA2103c 13.02 13.67 9.08 MA2103d 3.43 4.67 3.73 MA2111 5.09 10.15 MA2102a 3.29 14.50 MA2102b 5.24 8.27 MA2102c 3.92 4.46 MA2102d 5.15 7.22 MA2102e 6.11 5.80 MA2112c 6.98 7.60 4.85 MA2109a 5.56 MA2109b 5.63 MA2109c 6.24 MA2110 8.15 MA2119 3.45 4.97 3.55 MA2131a 4.58 4.39 3.32 MA2133 9.64 6.32 14.42 MA2114 8.40 8.40 2.65 MA2134a 3.37 7.82 2.78 MA2134b 3.52 3.23 5.18 13

Figure 10. Comparison of deviation in image analysis % cover from estimated % cover between quadrats highlighting those problematic quadrats. (Quadrats are arranged in order of lowest to highest % cover). 14

Image Analysis Results Areas of algal coverage as calculated using imagej analysis. Summary results for each quadrat include the total number of failures across all three tests as calculated using Z-scores based on both the mean % cover across all participants and the actual % cover as determined by image analysis. Quadrat: 1 Actual % cover: 25.19 Total No. of fails from Z-score of mean: 3 Total No. of fails from Z-score of actual % cover: 3 Average deviation across 3 tests: 5.86 Quadrat: 2 Actual % cover: 37.78 Total No. of fails from Z-score of mean: 4 Total No. of fails from Z-score of actual % cover: 5 Average deviation from mean: 5.53 15

Quadrat: 3 Actual % cover: 7.33 Total No. of fails from Z-score of mean: 2 Total No. of fails from Z-score of actual % cover: 20 Average deviation from mean: 5.01 Quadrat: 4 Actual % cover: 41.87 Total No. of fails from Z-score of mean: 3 Total No. of fails from Z-score of actual % cover: 14 Average deviation from mean: 4.90 16

Quadrat: 5 Actual % cover: 84.93 Total No. of fails from Z-score of mean: 1 Total No. of fails from Z-score of actual % cover: 5 Average deviation from mean: 3.15 Quadrat: 6 Actual % cover: 14.97 Total No. of fails from Z-score of mean: 0 Total No. of fails from Z-score of actual % cover: 21 Average deviation from mean: 6.51 17

Quadrat: 7 Actual % cover: 15.27 Total No. of fails from Z-score of mean: 2 Total No. of fails from Z-score of actual % cover: 2 Average deviation from mean: 2.50 Quadrat: 8 Actual % cover: 62.49 Total No. of fails from Z-score of mean: 1 Total No. of fails from Z-score of actual % cover: 11 Average deviation from mean: 7.74 18

Quadrat: 9 Actual % cover: 7.66 Total No. of fails from Z-score of mean: 1 Total No. of fails from Z-score of actual % cover: 12 Average deviation from mean: 4.49 Quadrat: 10 Actual % cover: 20.45 Total No. of fails from Z-score of mean: 2 Total No. of fails from Z-score of actual % cover: 17 Average deviation from mean: 5.95 19

Quadrat: 11 Actual % cover: 32.21 Total No. of fails from Z-score of mean: 3 Total No. of fails from Z-score of actual % cover: 3 Average deviation from mean: 6.18 Quadrat: 12 Actual % cover: 53.00 Total No. of fails from Z-score of mean: 3 Total No. of fails from Z-score of actual % cover: 18 Average deviation from mean: 12.06 20

Quadrat: 13 Actual % cover: 26.82 Total No. of fails from Z-score of mean: 1 Total No. of fails from Z-score of actual % cover: 30 Average deviation from mean: 15.53 Quadrat: 14 Actual % cover: 100 Total No. of fails from Z-score of mean: 5 Total No. of fails from Z-score of actual % cover: 6 Average deviation from mean: 1.66 21

Quadrat: 15 Actual % cover: 79.76 Total No. of fails from Z-score of mean: 3 Total No. of fails from Z-score of actual % cover: 4 Average deviation from mean: 8.64 22