Unused voices do use a little CPU when not used, especially at higher settings. a manual setting of 40 voices for a piano part that will end up using 16 voices means wasting a lot of CPU. Try to measure how many voices your MIDI part uses, and set the polyphony display accordingly. You can also try to lower the setting and listen to missing notes.