Scoring the High School Swimming All-Americans

Published: July 16, 2020

Introduction

The National Interscholastic Swim Coaches Association (NISCA) recently announced its 2019-2020 High School All-Americans.  The full lists can be found here.

Since these lists are objective rankings of (up to 100) All-American times only, with no points ascribed, this publication uses the MeenaMethod to spin the swims and score each performance under three scoring scenarios.

As a reminder, the MeenaMethod primarily applies to Metric Sports, like swimming, and therefore diving (a Marvel Sport) is not included in this publication. 

The Scoring Scenarios

The MeenaMethod framework revolves around benchmarks, scales, slopes, performance points, and adjustments.

In this publication, since there are three scoring scenarios that means there are three benchmarks (two individual benchmarks and one group benchmark), using three scales (all with linear slopes), to determine three different point values.  Adjustments are not used in this publication.

From an equation perspective:


Scenario 1
Benchmark = High School Record

In this scenario, every performance for each event is compared against the High School (HS) Record for that event which is sourced from each event page.


Scenario 2
Benchmark = All-American Time Standard

In this scenario, every performance for each event is compared against the All-American Time Standard for that event which is sourced from each event page.


Scenario 3
Benchmark = Event Average
aka “Zero-Sum”

In this scenario, every performance for each event is compared against the average of every All-American performance in that same event which is sourced from each event page.

Scenario Summary

The Data Set

The following data set was used for this analysis:

Analysis of 1st Place Performances

Note: due to the volume of the performances, this publication only presents the top individual performances and the top 10 school rankings.

Since there are three scoring scenarios, the “individual champion” in this publication is the performance that is the best in most scenarios.

Therefore, under this guidance:

The following tables show the female and male 1st Place performances, all relevant benchmarks, and the associated performance points for each event.

Female 1st Place Performances

Male 1st Place Performances

1st Place Performance Summary

In isolation, each of these performances is beyond impressive.  However, when looking at the performances relative to others within the same scenario, there are some themes:

Analysis of School Rankings

Just like the 1st place performances, there are three scoring scenarios considered.  However, in this case, the “school champion” is the school with the lowest combined sum of their absolute placement. This means each scenario is valued equally against one another.

Therefore, under this guidance:

The following tables show the list of school rankings sorted, in ascending order, from the lowest combined sum of their absolute placement to the largest combined sum of their absolute placement.  The top 10 schools from each scenario are included, as are schools that placed in the top 10 of another scenario.

Female School Rankings

Male School Rankings

School Rankings Summary

When looking at school rankings, as opposed to individual performances, points serve more of a purpose in an effort to “gamify” the outcome.  When this is done swimming can effectively be treated like a quasi-Match Sport whereas opponent contact is still not allowed, but using points gives each school a collected ability to be ranked against other schools.

As previously written in "Rethinking Performance Methodology in 'Objective' Sport", subjectively ascribed point values dilute the outcome and give unnecessary advantages to certain swims.  However, all three scenarios in this publication result in objective point values that are directly correlated to the performances, treats every event equally, and maintains the integrity of placement.

Please note, points only tell a story within a single scenario, but rankings can be compared across scenarios.


Individual Benchmarks

Since the High School Record and All-American Time Standard are single data points, they are individual benchmarks.

When comparing the rankings of the High School Record and All-American Time Standard scenarios, the results are similarly correlated for each school, and that is primarily due to the volume of performances.

Therefore, in these two scenarios, since every performance scores points, the strategy is “quantity over quality”.


Regarding the HS Record Rankings, there is a direct correlation between placement and the number of events. For the:

Female Schools:

Male Schools:

Regarding the All-American Time Standard Rankings, while not direct, there is still a correlation between placement and the number of events. For the:

Female Schools:

Male Schools:


Group Benchmark

Since the average time of all the event performances is a collection of data points, and not a single data point like a record, the Event Average is a group benchmark.

In this scenario, the strategy is “quality over quantity” because only above-average performances gain points, whereas below-average performances lose points.  Remember, this is a zero-sum game, so large quantities of performances can hurt you if your performance is not one of the fastest 40 in a given event.

As such, unlike the individual benchmarks above, there is very little, if any, correlation between placement and number of performances in the entire list.  Instead, the correlation is targeted between the number of performances that are above average (~1 - 40) and below average (~41 - 100).

Female Schools:

Male Schools:

Conclusion

In conclusion, any of the three scenarios presented today awards objective points to every performance equally, so the rankings tell an unbiased story of who swam the best.  

Whenever everyone is chasing the same record or time-standard, an individual benchmark scenario is the right choice.  Alternatively, when the cohort is measured in isolation, a group benchmark is the right choice.

The ultimate goal is to correlate the point scoring system directly to the performance itself, and not indirectly via a subjectively chosen method that only uses round numbers in a sport measured in decimals.

Footnotes

Author: Elliot Meena

Published: July 16, 2020

Sources: National Interscholastic Swim Coaches Association (“NISCA”)

Notes: