I think “let it burn” was either meant figuratively or in the sense that the police won’t prevent arson.

I don’t think the implication was that police should be putting out fires once started, or that they’re doing that but selectively.