The fashion giant faces a double whammy of steep U.S. tariffs and an end to its duty-free shipping to America.