There is nothing wrong w/ the OP plan, the wiring is protected at 20A upstream & if wanted to use a 200A disco w/ 200A fuses protected upstream at 20A, still the only harm would be lugs not rated for the conductor size. That is a extreme example but there is no harm in the OP's plan.