I think the main problem wouldn't be the oxygen (there's plenty of that in a skyscraper), but the resulting fire.
Napalm, as far as I know, burns quite hot, so either the building would catch fire leading to a "structural failure" (collaps), or the elevators and staircases would cause an effect...