Several options and I'd love a follow up to know what you did and how it turned out. Folks need to be careful using acids, even diluted vinegar, on natural stone, especially marble (worst case stone). Solvents and heat won't be an issue though. It may scratch somewhat easily as well if using metal scrapers but w/o seeing photos and the polished look I cannot say how risky scraping would be. If it were me I'd try a few things in order of aggressiveness and even testing in small spot as you progress (assuming the first or second option doesn't do the trick).
1. As suggested, try allowing hot water to dwell on it. Get water as hot as possible (even boiling water from the stove after first running sink hot water over the area to heat up the stone). Allow to dwell ~30min then try scraping with a stiff plastic scraper or even a credit card.
2. Try softening the glue with a heat gun (on low at first) and scraping in the same manner as mentioned above
3. If options 1 & 2 didn't work try adding hot water and acetone (more acetone than water but need some heat) for a ~30min dwell and scrape