Tropical cyclone forecast verification - southern hemisphere 2011-12

1. Introduction

A summary of tropical cyclone activity in the Southern Hemisphere for the 2011-12 season is presented below together with an assessment of the performance of the Met Office global model in predicting the tracks of these tropical cyclones.

Tropical cyclones are experienced in the South Indian Ocean, tropical seas to the west, north and east of Australia and the western and central South Pacific Ocean. For the purpose of tropical cyclone verification the Southern Hemisphere is usually divided in to two basins; the South-West Indian (west of 90° E) and Australian (east of 90° E). Mean error statistics for each basin are presented together with a table of statistics for the whole Southern Hemisphere. The global model produces a six-day forecast every 12 hours. Verification is performed at 12-hour intervals up to forecast time T+168, although statistics are only presented at 24-hour intervals in this report.

The global model resolution in operation during most of the season was 0.3515625°x 0.234375°x 70 levels. This is equivalent to a horizontal resolution of 39 km x 26 km at the equator.

Tropical cyclone forecast verification - measures of error

Advisory positions from RSMCs La Réunion and Nadi, Fiji, Bureau of Meteorology, Australia and JTWC Hawaii are used as verifying observations of storm location. Best track data from these centres will be obtained once they become available. Past experience shows that use of best track rather than real time data usually only makes minor differences to seasonal track error statistics. Some mean error statistics for last season are also included for the purposes of a comparison. Forecast tracks are only verified when a depression reaches tropical storm status.

2. Tropical cyclone activity

Tropical cyclone activity
SWI AUS SAT TOTAL
Tropical depressions (<34 knots) 2(1) 2(2) 0(0) 4(3)
Tropical storms (>34 knots, <64 knots) 7(1) 6(6) 0(1) 13(8)
Hurricanes/typhoons (>64 knots) 4(2) 2(8) 0(0) 6(10)
Total 13(4) 10(16) 0(1) 23(21)

Basin name abbreviations:
SWI : South-West Indian (west of 90° E)
AUS : Australian (east of 90° E)
SAT : South Atlantic

The number in brackets indicates the figure for the 2010-11 season.

N.B. 10-minute averaged wind speeds from RSMCs used when available. Data from JTWC (1-minute averaged) is only used when other data is unavailable and maximum wind speeds are scaled to make them equivalent to the RSMC 10-minute averages.

3. Summary of all southern hemisphere storms

3.1 South-west Indian basin storms

Table of mean error statistics
T+0 T+24 T+48 T+72 T+96 T+120 T+144 T+168
Cases verified 109 88 70 52 40 30 23 17
Detection rate (%) 100 100 100 96 98 97 96 94
Mean AT -3 -68 -185 -280 -313 -264 -357 -401
Mean CT 0 -31 -33 10 78 121 223 90
Mean skill (%) ***** 39 40 31 ***** ***** ***** *****
2010-11 skill (%) ***** 32 42 56 ***** ***** ***** *****
Mean DPE 28 133 269 400 560 687 790 971
* 2010-11 DPE 37 117 219 262 411 546 694 643
Intensity skill (%) ***** 39 49 35 20 40 48 29

* DPE for all south-west Indian storms in 2010-11 season

Plot of the observed tracks of all storms in the south-west Indian basin
Forecast positional errors in the south-west Indian basin
Forecast skill in the south-west Indian basin

After a quiet season in 2010-11, this season saw the highest number of tropical cyclones for nine years. Track forecast errors were a little higher than last season, but similar to the previous few seasons. Skill scores against CLIPER were close to last season's values. There was a slow bias in forecasts. The intensity tendency skill had a value of 39% overall. The charts show the long term trend in forecast errors and skill.

3.2 Australian basin storms

Table of mean error statistics
T+0 T+24 T+48 T+72 T+96 T+120 T+144 T+168
Cases verified 67 51 38 30 25 19 14 8
Detection rate (%) 100 100 100 100 100 100 93 73
Mean AT -6 -62 -85 -139 -258 -223 -104 -146
Mean CT 1 -9 -23 -19 52 88 68 102
Mean skill (%) ***** 60 55 41 ***** ***** ***** *****
2010-11 skill (%) ***** 67 67 50 ***** ***** ***** *****
Mean DPE 32 111 185 293 401 529 593 470
* 2010-11 DPE 33 119 218 201 522 669 579 499
Intensity skill (%) ***** 49 53 47 52 26 57 50

* DPE for all Australian storms in 2010-11 season

Plot of the observed tracks of all storms in the eastern Australian basin
Plot of the observed tracks of all storms in the western Australian basin
Forecast positional errors in the Australian basin
Forecast skill in the Australian basin

2011-12 saw the fewest number of tropical cyclones in this region for over 20 years. Track forecast errors were mostly lower than seen in the last two seasons. Skill scores against CLIPER were a little lower than in the last few seasons. There was a slow bias in forecasts. The intensity tendency skill was 52% overall. The charts show the long term trend in forecast errors and skill.

3.3 Combined Statistics for whole Southern Hemisphere

Table of mean error statistics
T+0 T+24 T+48 T+72 T+96 T+120 T+144 T+168
Cases verified 176 139 122 93 65 49 37 25
Detection rate (%) 100 100 100 98 98 98 95 86
Mean AT -4 -66 -150 -228 -292 -248 -261 -320
Mean CT 0 -23 -30 0 68 108 164 94
Mean skill (%) ***** 45 44 34 ***** ***** ***** *****
2010-11 skill (%) ***** 63 64 60 ***** ***** ***** *****
Mean DPE 29 125 239 361 499 626 716 811
* 2010-11 DPE 34 119 218 302 500 642 608 527
Intensity skill (%) ***** 42 50 39 32 35 51 36

* DPE for all southern hemisphere storms in 2010-11 season

Forecast positional errors for the whole southern hemisphere.
Forecast skill for the whole southern hemisphere.
Along-track errors for the whole southern hemisphere.
Cross-track errors for the whole southern hemisphere.
Intensity skill for the whole southern hemisphere.

Activity for the southern hemisphere as a whole was near average, although the activity was skewed towards the South-West Indian region. Track forecast errors were mostly close to values seen in the last few seasons, although skill scores against CLIPER were lower than some previous seasons. The slow bias seen in previous seasons continued. The overall intensity tendency skill score was 44%, which is the lowest value for several years.

Further tropical cyclone information

The Weather and climate change contain information on tropical cyclone forecasting at the Met Office. Monthly updates of tropical cyclone activity and forecasts are made, together with observed and forecast track information of recent storms, track prediction error statistics, lists of names and real-time tropical cyclone forecast guidance.

Seasonal summaries of tropical cyclone activity and forecasts have been issued since the 1994-5 Southern Hemisphere season. To obtain these or any further information on tropical cyclone forecasting email the Met Office.

________________________

Acknowledgements

Mr.S.Lord, NCEP, Washington, USA and Mr.C.Mauck, FNOC, Monterey, USA supplied CLIPER models for various basins.
Mr.S.Lord and Dr.M.Fiorino supplied GrADS software used to produce track plotting charts.