Maybe, but that's not how it's done today, and it's not the sort of thing you change overnight.
Complicating matters is the fly ash component of modern concrete. Fly ash can replace 50% or more of the portland cement in concrete. Fly ash is a byproduct of burning coal. So when you replace the coal plants with solar arrays, you need to create even more portland cement than you would need to if you were burning coal (and using the subsequent fly ash in your concrete.)
