They are often used inter-changeably but they don’t always have the same meaning.
Material has a specific IFRS meaning which relates matters to the financial statements. So we can say “revenue is material”, “inventory is immaterial” – and this is what we should say rather than “revenue is significant”, “inventory is insignificant”.
Significance has a wider mean – “significant deficiency”, “significant risk”, “significant judgment”, “significant influence”.