In John Masefield's children's story The Box of Delights (1935) a couple of crooks disguised as curates 'teach' the schoolboy Kay the game of 'spotting-the-lady' and diddle him out of half-a-crown.

I'm certain there must be earlier references, but I can't offhand find one right now.