If you are using Combined Shipping Rules, and the rule is set to no discount, the same rate applies to each additional item. You need to set the option to free additional items.
If just single listings with a quantity available, you need to set additional items to free in the shipping section for each shipping option offered.
