The Albanese government has started playing down the prospects of securing tariff exemption for the Trump administration.