LED lamps are strange beasts.
They are high impedance devises and will work, sort of, with very little current flow.
What you are seeing is possibly a bit of stray, cable induced, pickup from the house wiring.
Fitting an AC rated capacitor (for example a fan motor capacitor) across the light fitting terminals should fix this.