I'm on PC but using a controller for now and it took me a while to figure it out but once I highlight the player name if I press RT or R2 it adds the ghost. I don't know if it's the same for you on PS4 but might be worth a go.
Edit: Sorry must have got mixed up... the button to press is RB or R1.
Last edited: Jun 12, 2015