You should get a burner phone number (even if you are not a spy)

No, you don't need to buy a new phone.