On the Apple TV 4K Remote on iPhone, you can use buttons instead of swipe gestures. It’s a single accessibility setting called Directional Buttons, and once it’s on, the Apple TV Remote on your iPhone gives you buttons to use from then on.
Go to Settings > Accessibility > Apple TV Remote, then turn on Directional Buttons.
