Even though virtual reality applications are nowadays multimodal, developers focus their efforts on the visual rendering system. Complex visual rendering systems using stereoscopic techniques are employed in order to place visual objects in a three dimensions environment. Similar systems such as binaural rendering through headphones can be used for the auditory modality. However, several studies have reported a visual attractive effect in case of auditory-visual object which reduces the benefit of complex auditory rendering systems. A cognitive process combines both acoustic and visual cues and gives a higher influence to the visual modality. The resulting multimodal object is thus placed at the position of the visual cue. However, this effect has been less studied in the distance dimension. This study investigates the effect of separate visual and acoustic distance cues. For this purpose a binaural rendering is employed for acoustic cues and combined to a stereoscopic display for visual cues. The results show an asymmetrical ventriloquism effect in the distance dimension: the relative position of the sound source in comparison to the visual object has an influence on the perceived position of the auditory-visual object. A description and a possible explanation of this asymmetrical ventriloquism effect is detailed in this study.