Mother tongue vs native language

Mother tongue and native language are set phrases that both refer to the language one has started learning from birth. One generally associates mother with tongue and native with language but it is sometimes found the other way round. Language and tongue are here synonyms.