I think I need to plant a herb garden - before I get thrown in jail

As I left church this morning, I was walking on the sidewalk between the church and the parish hall. I happened to look at the small garden on the side of the hall and went "oooh!!!! fresh sage! I should grab some of that!" Wtf?! I'm considering taking sage from the church herb garden?! What's next? Sneaking onto a nearby farm at night to milk a cow?!