I have found a few references indicating the possibility that Ginseng may increase the effects of some diabetes medications.
Taking it is not strictly speaking contraindicated, but caution is advised: test your blood sugar more often the first few weeks of taking ginseng, as a precaution.
I hope this has been helpful, please feel free if you have any other questions!