Do the insects seem dormant until you water, then they hop all over the place? If so, they're springtails. They like medium or soil that is decaying. A soapy water spray might kill them, then you will have to repot because it's an indication that the medium is breaking down.