Open the conversation and click "Leave conversation" in the upper right. Leaving the conversation removes it from your inbox and gives you a chance to ignore it if the other person responds again, or to accept and rejoin it.
Good answer. Can't say I blame you for the confusion either because this different software and the whole 'conversation' system, although actually superior for a number of reasons, had me pretty confused at first too.