If a person has left the group in the past, you need to be in their Telegram contacts to add them back. They can still join via an invite link as long as they are not on the Removed Users list.