Re-watching the series again, and reading up on the comments again. So, read this and thought to correct it :)
It was established that the Minbari win the war 1000 years ago without B4, however, at the cost of more Vorlons / troops, therefore they have the inability to survive the war that is...