You have an "Unmatch" button in every matched character's profile. You can access their profiles by tapping on their profile picture inside your private chats with them. The unmatch button is on the right side of the match character's profile picture. Clicking on the button will unmatch you with the character and they will not appear inside your chats anymore.