Remote Play Vision Bot Personal Project
An automation layer built on top of the pyremoteplay library, which connects to and controls PS4/PS5 Remote Play hosts over their live video stream. The bot reads the game purely from decoded frames and drives an emulated DualShock controller in response.
The vision pipeline performs glyph-based OCR with adaptive scaling and fallbacks, template matching for inventory icon recognition, and cached item-layout detection to track stock and quantities. On top of that sits automated vending logic with out-of-stock handling, idle behavior, timing control, and a paginated history feed posted to an API. Includes a hot-reloading training/testing harness for tuning the recognition pipeline.