On the performance of dual-hop systems with multiple antennas: Effects of spatial correlation, keyhole, and co-channel interference

In this paper, taking into account realistic propagation conditions, namely, spatial correlation, keyhole channels, and unequal-power co-channel interference, we investigate the performance of a wireless relay network where all the nodes are equipped with multiple antennas. Considering channel state information assisted amplify-and-forward protocol, we present analytical expressions for the symbol error rate (SER) and outage probability. More specifically, we first derive the SER expressions of a relay system with orthogonal space-time block coding (OSTBC) over correlated/keyhole fading channels. We also analyze the outage probability of interference corrupted relay systems with maximal ratio combing (MRC) at the receiver as well as multiple-input multiple-output MRC (MIMO MRC). Numerical results are given to illustrate and verify the analytical results.