EZ Drummer's drag and drop feature drags MIDI loops and not audio so be sure that you are trying to drop the files into a MIDI track and not an audio track.

Once you have the loops into a MIDI track you can then output the MIDI data to EZ Drummer by selecting EZ Drummer in the MIDI tracks output section.