The small button on the FastlaneUSB is a "Thru" switch. When enganged (pressed IN), it routes Midi IN "A" to Midi OUT "A", and the same for Port B. It also BYPASSES communication to the USB connection to your computer.
When using the FastlaneUSB with a computer, always be sure that the Thru switch it OUT.