I've read a fairly low-heat torch will soften it enough so you can scrape it off, but of course you'd have to be careful not to melt the glass.
EDIT: Apparently air-craft stripper works well, too. But again, you said household chemical. Sounds like you may have a problem with that. The chemical I mentioned before you can get at O-Reilly.