I only hear one side of the conversation when I listen to a replay of a call.

In many cases, and depending on the dialer you are using, recordings of conversations keep the audio stream of the customer and the CSR/rep on different channels that are not mixed together.

This manifests in the audio of the customer and rep on isolated sides of your headset. This is done in order to log more accurate transcripts of calls.