Below are the updated season forecasts using data from games through August 13.
Power Rankings
The “Power Rankings” we concoct are the “strength” of the team according to its competitive expectations. They are computed by forecasting the expected points (3 x win probability + 1 x draw probability) against every other MLS team – both home and away – and taking the average per team.
SEBA has the Union declining from 10th to 13th. For comparison, Soccer America has Philadelphia declining from 13th to 16th, ESPN has the Union declining from 14th to 17th, SI has Philadelphia declining from 12th to 13th, and MLSSoccer has the Union declining from 14th to 16th.
For those interested in how Philadelphia’s matches are weighted in the model (especially if skeptical about why SEBA’s rankings can be different from other outlets):
‘wght’ is the actual weight value used in the model, which is a combination of the ‘timewght’ (how long ago the match occurred), ‘goalWght’ (how much luck could have influenced the match result, as indicated by the goal differential), and ‘rostWght’ (how similar the roster deployments for both teams were compared with current trends).
For comparison, the current roster expectations for maximum weight for the Union are currently:
The following shows the evolution of SEBA’s power rankings for the MLS Eastern Conference over time:
Playoffs probability and more
Philadelphia’s playoffs odds have decreased from 15.3% to 2.6%.
The following shows the simulation distribution for the points earned by the sixth place MLS East club as well as the simulation distribution of points that Philadelphia is expected to earn.
Tiebreakers aside, the Union make the playoffs when >= this MLS-East-6th value.
The most common number of points required to make the playoffs in the East’s 6th slot increased from 48 to 49 while the most common number of points simulated for the Union decreased from 43 to 40.
In part, clubs that score a lot of goals are given an advantage in MLS Cup due to the two-leg aggregate goal format of the conference semi-finals and conference finals. This gives those clubs a better chance at notching large victories which carry over.
The Union’s chances of winning the MLS Cup have decreased from 0.3% to practically zero.
In the U.S. Open Cup, poor teams with a higher propensity to earn a draw are given an advantage as they are more likely to reach penalty kicks, which are a complete tossup. Conversely, good teams with a higher propensity to earn a draw have a disadvantage for the same reason.
This was run before the NYRB/Cincinnati match.
Philadelphia’s chances for qualifying in 2017 for the 2019 edition of the CONCACAF Champions League have decreased from 0.3% to practically zero.
Over time, we can see how Philadelphia’s odds for different prizes have changed.
The following are probabilities for each category of outcomes for Philadelphia:
The following shows the probability of each post-playoff ranking finish.
The following shows the summary of the simulations in an easy table format.
Next, we show how the Remaining Strength of Schedule affects each team.
The “Points Percentage Advantage” shown on the X-axis represents the percentage of points expected over the league average schedule. This “points expected” value is generated by simulating how all teams would perform with all remaining schedules (and therefore judges a schedule based upon how all teams would perform in that scenario).
In short, the higher the value, the easier the remaining schedule.
Accompanying the advantage percentage in the following table is their current standings rank (right now ties are not properly calculated beyond pts/gd/gf; I may fix that, but maybe not for a while), the remaining home matches, the remaining away matches, the current average points-per-game of future opponents (results-based, not model-based), and the average power ranking of future opponents according to SEBA.
The following shows the expectations for upcoming Philadelphia matches:
Last Game Probability Chart
This model finally incorporates changing team statistics due to subs and yellow/red cards.
For the following, the green line represents the odds of a win, the blue line the odds of a tie, and the red line the odds of a loss.
The following shows the changing proportion of Philadelphia’s probability of scoring goals compared with their opponent’s. This proportion can only change due to subs, yellow cards, and red cards.
*For example, in the first half, the Union were barely half as likely to score a goal than Montreal was according to the model.
The following shows the changing raw probability of the two teams each scoring a goal. Green is Philadelphia’s probability of scoring a goal and red is their opponent’s probability of scoring a goal.
The reason for the spike at the 45th minute is because ’45+x’ is condensed to the 45th minute (therefore increasing the frequency of goals occurring in the 45th minute) to avoid duplication with the actual 46th/47th/etc minute, whereas the same situation does not occur for ’90+x’ minute, for which we actually calculate the addition and attribute the action to the goals to the 91st/92nd/etc minute if they occur.
Philadelphia +/- Player Analysis
plyr | NetGoals | PlusGoals | MinusGoals | MINS | NetGoalsPer90 | PlusGoalsPer90 | MinusGoalsPer90 | |
---|---|---|---|---|---|---|---|---|
1 | Oguchi Onyewu | 8 | 28 | 20 | 4320 | 0.167 | 0.583 | 0.417 |
2 | Chris Pontius | 7 | 24 | 17 | 3257 | 0.193 | 0.663 | 0.470 |
3 | Jack Elliott | 7 | 27 | 20 | 4124 | 0.153 | 0.589 | 0.436 |
4 | Raymon Gaddis | 4 | 24 | 20 | 3900 | 0.092 | 0.554 | 0.462 |
5 | Andre Blake | 4 | 24 | 20 | 3960 | 0.091 | 0.545 | 0.455 |
6 | Derrick Jones | 3 | 12 | 9 | 1523 | 0.177 | 0.709 | 0.532 |
7 | Ilsinho | 3 | 21 | 18 | 2732 | 0.099 | 0.692 | 0.593 |
8 | CJ Sapong | 3 | 31 | 28 | 5164 | 0.052 | 0.540 | 0.488 |
9 | Warren Creavalle | 2 | 4 | 2 | 334 | 0.539 | 1.078 | 0.539 |
10 | Giliano Wijnaldum | 2 | 14 | 12 | 2325 | 0.077 | 0.542 | 0.465 |
11 | Alejandro Bedoya | 2 | 26 | 24 | 4500 | 0.040 | 0.520 | 0.480 |
12 | Haris Medunjanin | 1 | 32 | 31 | 5661 | 0.016 | 0.509 | 0.493 |
13 | Fabian Herbers | 0 | 8 | 8 | 660 | 0.000 | 1.091 | 1.091 |
14 | Fabinho | -1 | 18 | 19 | 3330 | -0.027 | 0.486 | 0.514 |
15 | Fafa Picault | -1 | 16 | 17 | 2514 | -0.036 | 0.573 | 0.609 |
16 | Marcus Epps | -1 | 5 | 6 | 552 | -0.163 | 0.815 | 0.978 |
17 | Adam Najem | -1 | 1 | 2 | 131 | -0.687 | 0.687 | 1.374 |
18 | John McCarthy | -3 | 8 | 11 | 1710 | -0.158 | 0.421 | 0.579 |
19 | Keegan Rosenberry | -3 | 8 | 11 | 1521 | -0.178 | 0.473 | 0.651 |
20 | Roland Alberg | -5 | 8 | 13 | 1114 | -0.404 | 0.646 | 1.050 |
21 | Joshua Yaro | -5 | 1 | 6 | 426 | -1.056 | 0.211 | 1.268 |
22 | Jay Simpson | -5 | 4 | 9 | 350 | -1.286 | 1.029 | 2.314 |
23 | Richie Marquez | -8 | 8 | 16 | 1953 | -0.369 | 0.369 | 0.737 |
HomeAway | plyr | NetGoals | PlusGoals | MinusGoals | MINS | NetGoalsPer90 | PlusGoalsPer90 | MinusGoalsPer90 | |
---|---|---|---|---|---|---|---|---|---|
1 | Home | Alejandro Bedoya | 11 | 20 | 9 | 2610 | 0.379 | 0.690 | 0.310 |
2 | Home | CJ Sapong | 11 | 22 | 11 | 2941 | 0.337 | 0.673 | 0.337 |
3 | Home | Andre Blake | 10 | 17 | 7 | 2160 | 0.417 | 0.708 | 0.292 |
4 | Home | Chris Pontius | 10 | 19 | 9 | 2248 | 0.400 | 0.761 | 0.360 |
5 | Home | Jack Elliott | 9 | 19 | 10 | 2554 | 0.317 | 0.670 | 0.352 |
6 | Home | Oguchi Onyewu | 9 | 20 | 11 | 2790 | 0.290 | 0.645 | 0.355 |
7 | Home | Haris Medunjanin | 9 | 23 | 14 | 3321 | 0.244 | 0.623 | 0.379 |
8 | Home | Ilsinho | 7 | 17 | 10 | 1886 | 0.334 | 0.811 | 0.477 |
9 | Home | Raymon Gaddis | 7 | 17 | 10 | 2372 | 0.266 | 0.645 | 0.379 |
10 | Home | Giliano Wijnaldum | 5 | 12 | 7 | 1695 | 0.265 | 0.637 | 0.372 |
11 | Home | Derrick Jones | 4 | 9 | 5 | 1018 | 0.354 | 0.796 | 0.442 |
12 | Home | Fabinho | 4 | 11 | 7 | 1620 | 0.222 | 0.611 | 0.389 |
13 | Home | Fabian Herbers | 3 | 4 | 1 | 241 | 1.120 | 1.494 | 0.373 |
14 | Home | Marcus Epps | 2 | 4 | 2 | 428 | 0.421 | 0.841 | 0.421 |
15 | Home | Keegan Rosenberry | 2 | 6 | 4 | 711 | 0.253 | 0.759 | 0.506 |
16 | Home | Fafa Picault | 2 | 10 | 8 | 1378 | 0.131 | 0.653 | 0.522 |
17 | Home | Roland Alberg | 1 | 6 | 5 | 668 | 0.135 | 0.808 | 0.674 |
18 | Home | Richie Marquez | 0 | 6 | 6 | 912 | 0.000 | 0.592 | 0.592 |
19 | Home | Adam Najem | 0 | 1 | 1 | 112 | 0.000 | 0.804 | 0.804 |
20 | Home | John McCarthy | -1 | 6 | 7 | 1170 | -0.077 | 0.462 | 0.538 |
21 | Home | Jay Simpson | -2 | 3 | 5 | 305 | -0.590 | 0.885 | 1.475 |
22 | Home | Warren Creavalle | -2 | 0 | 2 | 158 | -1.139 | 0.000 | 1.139 |
23 | Home | Joshua Yaro | -2 | 1 | 3 | 156 | -1.154 | 0.577 | 1.731 |
HomeAway | plyr | NetGoals | PlusGoals | MinusGoals | MINS | NetGoalsPer90 | PlusGoalsPer90 | MinusGoalsPer90 | |
---|---|---|---|---|---|---|---|---|---|
1 | Away | Warren Creavalle | 4 | 4 | 0 | 176 | 2.045 | 2.045 | 0.000 |
2 | Away | Oguchi Onyewu | -1 | 8 | 9 | 1530 | -0.059 | 0.471 | 0.529 |
3 | Away | Derrick Jones | -1 | 3 | 4 | 505 | -0.178 | 0.535 | 0.713 |
4 | Away | Adam Najem | -1 | 0 | 1 | 19 | -4.737 | 0.000 | 4.737 |
5 | Away | Jack Elliott | -2 | 8 | 10 | 1570 | -0.115 | 0.459 | 0.573 |
6 | Away | John McCarthy | -2 | 2 | 4 | 540 | -0.333 | 0.333 | 0.667 |
7 | Away | Raymon Gaddis | -3 | 7 | 10 | 1528 | -0.177 | 0.412 | 0.589 |
8 | Away | Fafa Picault | -3 | 6 | 9 | 1136 | -0.238 | 0.475 | 0.713 |
9 | Away | Chris Pontius | -3 | 5 | 8 | 1009 | -0.268 | 0.446 | 0.714 |
10 | Away | Giliano Wijnaldum | -3 | 2 | 5 | 630 | -0.429 | 0.286 | 0.714 |
11 | Away | Fabian Herbers | -3 | 4 | 7 | 419 | -0.644 | 0.859 | 1.504 |
12 | Away | Joshua Yaro | -3 | 0 | 3 | 270 | -1.000 | 0.000 | 1.000 |
13 | Away | Marcus Epps | -3 | 1 | 4 | 124 | -2.177 | 0.726 | 2.903 |
14 | Away | Jay Simpson | -3 | 1 | 4 | 45 | -6.000 | 2.000 | 8.000 |
15 | Away | Ilsinho | -4 | 4 | 8 | 846 | -0.426 | 0.426 | 0.851 |
16 | Away | Fabinho | -5 | 7 | 12 | 1710 | -0.263 | 0.368 | 0.632 |
17 | Away | Keegan Rosenberry | -5 | 2 | 7 | 810 | -0.556 | 0.222 | 0.778 |
18 | Away | Andre Blake | -6 | 7 | 13 | 1800 | -0.300 | 0.350 | 0.650 |
19 | Away | Roland Alberg | -6 | 2 | 8 | 446 | -1.211 | 0.404 | 1.614 |
20 | Away | Haris Medunjanin | -8 | 9 | 17 | 2340 | -0.308 | 0.346 | 0.654 |
21 | Away | CJ Sapong | -8 | 9 | 17 | 2223 | -0.324 | 0.364 | 0.688 |
22 | Away | Richie Marquez | -8 | 2 | 10 | 1041 | -0.692 | 0.173 | 0.865 |
23 | Away | Alejandro Bedoya | -9 | 6 | 15 | 1890 | -0.429 | 0.286 | 0.714 |
Model Validation
The following shows the degree of error by the model vs the error if the model was purely random without intelligence. The x-axis is based on the date from which the forecast was made (this will update throughout the season as more results are finalized and compared with predictions). The ordinal squared error metric (not a traditional metric) is calculated as:
(ProbW – ActW)^2 + (ProbT – ActT)^2 + (ProbL – ActL)^2 +
((ProbW + ProbT) – (ActW + ActT))^2 +
((ProbL + ProbT) – (ActL + ActT))^2
where Prob[W/T/L] is the model’s probability of resulting outcomes and Act[W/T/L] is a 1 or 0 representation of whether it actually happened.
Random errors will decline when more ties occur as there is a less severe penalty for ties.
We should expect random errors to remain relatively constant over time, where our model’s errors will hopefully decline as the season goes on as it gathers new information.
These data points are not fixed until the end of the season due to additional matches adding to them.
USL
Power Rankings
SEBA has the Bethlehem Steel remaining at 15th while it has Harrisburg City decreasing from 22nd to 25th.
The following shows the evolution of SEBA’s power rankings for the USL East over time.
Playoffs probability and more
Bethlehem’s playoff odds have increased from 85.1% to 88.4% while Harrisburg City’s odds of reaching the postseason have decreased from 16.1% to 1.6%.
Bethlehem’s odds at becoming the USL Champion have increased from 1.6% to 1.7% while Harrisburg City’s declined from at 0.2% to practically zero:
Over time, we can see how the odds for different prizes change for Bethlehem and Harrisburg.
The following are probabilities for each category of outcomes for Bethlehem.
The following are probabilities for each category of outcomes for Harrisburg City:
The following shows the probability of each post-playoff ranking finish:
The following shows the summary of simulations in an easy table format.
We can also show how the Remaining Strength of Schedule affects each team.
The “Points Percentage Advantage” shown on the X-axis represents the percentage of points expected over the league average schedule. This “points expected” value is generated by simulating how all teams would perform with all remaining schedules (and therefore judges a schedule based upon how all teams would perform in that scenario).
In short, the higher the value, the easier the remaining schedule.
Remaining home field advantage will make a large contribution here. It can also be true that a better team has an ‘easier’ schedule simply because they do not have to play themselves. Likewise, a bad team may have a ‘harder’ schedule because they also do not play themselves.
The table following the chart also shares helpful context with these percentages.
Accompanying the advantage percentage in the following table is their current standings rank (right now ties are not properly calculated beyond pts/gd/gf), the remaining home matches, the remaining away matches, the current average points-per-game of future opponents (results-based, not model-based), and the average power ranking of future opponents according to SEBA.
The following shows the expectations for upcoming matches for both Bethlehem and Harrisburg:
Model Validation
This chart is the same as that in the MLS forecast (except for USL matches instead of MLS).
Remember that these data points are not fixed until the end of the season.
NWSL
Power Rankings
Playoffs probability and more
The following shows the summary of the simulations in an easy table format.
As a new feature, we can also show how the Remaining Strength of Schedule affects each team.
The “Points Percentage Advantage” shown on the X-axis represents the percentage of points expected over the league average schedule. This “points expected” value is generated by simulating how all teams would perform with all remaining schedules (and therefore judges a schedule based upon how all teams would perform in that scenario).
In short, the higher the value, the easier the remaining schedule.
It can also be true that a better team has an ‘easier’ schedule simply because they do not have to play themselves. Likewise, a bad team may have a ‘harder’ schedule because they also do not play themselves.
The table following the chart also shares helpful context with these percentages:
Accompanying the advantage percentage in the following table is their current standings rank (right now ties are not properly calculated beyond pts/gd/gf), the remaining home matches, the remaining away matches, the current average points-per-game of future opponents (results-based, not model-based), and the average power ranking of future opponents according to SEBA.
The SEBA Projection System is an acronym for a tortured collection of words in the Statistical Extrapolation Bayesian Analyzer Projection System. Check out the first season’s post to find out how it works (https://phillysoccerpage.net/2017/03/03/2017-initial-seba-projections/)
Depressing (but not unexpected) to see the playoff probability drop from 15% to 2%.
Hopefully I’m not too late and Chris still reads this.
.
I really like the +/-, gives some basic insight into the relative contributions of each of the players. Seems a bit surprising to see Pontius up so high given how much people like to complain about him here.
.
Do you have +/- data for other teams? It would be really interesting to see how this would effect the match and score predictions when combined with your roster weight algorithm.
Yes, I have it for all players within MLS matches from 2013 and on. I am planning to try and incorporate the player data, but it probably won’t happen until the off-season.
Also, it appears that some of the +/- charts are cut off by the PSP border, particularly the PlusGoalsPer90 in the home and away charts. Is it appearing like this for anyone else?
Yeah, it is happening for me too. I need to try and fix that