Accepting that Discourse uses flat topics as opposed to threads, I would find it incredibly confusing if I couldn’t see what someone was responding to. Context is everything, and it would be very easy to misinterpret responses without that link.
If each post in a topic didn’t have a reply button it would also be impossible to alert the user in question that their post within that topic had received a response.