Very good points, which echoes my thoughts on the matter.
For anyone that hasn't seen this video, I strongly recommend it. You can see Mike's thought process in the Dangerous tracklist and tellingly you can see him grooving to CLHGA around 5 mins. Clearly he loved CLHGA, like he loved Smooth Criminal on the Bad album
Blood, Ghosts, SPYHO and Joy were all fantastic songs left off the record, but perhaps their inclusion would have changed the focus of the album.
The story of the song Dangerous is similar to Blood, so it would make sense to pick one or the other.
Same with SPYHO - Will You Be There,
Ghosts - Trip
Joy probably has most in common with RTT, but perhaps Mike didn't want to convey love on Dangerous like he had on the Bad album.
Personally provided we hear MJ's version of Joy one day, I'm happy with choices that were made on Dangerous
You have to remember that if you were to swap songs in and out, you’d risk rubbing the balance. For example, the suggestion to swap out two of the up tempo songs for Someone Put Your Hand Out and For All Time would make the album quite heavy with ballads, which ironically is a common complaint about Invincible.