One big caveat, though: You need your contact's phone number