I've noticed a lot of console users having issues with using the Shellphone, myself included.
But! There is a fix!
Check your keybindings, specifically your "interact" and "use (secondary)" bindings. If those are duplicate bindings, change one or the other. The "interact" binding...