Brandy Norwood -- This Video Is Sooo Embarrassing ... Crickets for Subway Singing

Brandy Norwood's on Broadway in "Chicago" ... but she might want to stay of the NYC subways -- after she got humiliated while singing her heart out to a bunch of commuters. Brandy went incognito -- wearing a hoodie and shades -- and belted out a…