Yes, this is normal. The MicroTrack 24/96 does not support hot-swapping of media. As long as you do not eject the media while recording or playback is in progress, there is no risk that data would get lost or recorded files would get corrupted. However, the device will always automatically power down when inserting- or ejecting CompactFlash cards or Microdrives while it is powered on.