People at Games Industry have seen a recently published patent from Sony Interactive Entertainment that allows players to use cheap things like controllers. In the illustrations and explanations, the company used bananas and oranges as examples.
“It would be desirable if a user could use a cheap, simple and non-electronic device as a video game peripheral,” the application reads. “The current disclosure is designed to address or at least mitigate some of the issues identified above.” Sony’s technology would use any “non-luminous passive object held by a user” as a controller. Two of the illustrations for the banana example show dual banana controllers and an augmented reality banana controller.
So how does it all work? Well, a camera scans the item in the hands of a player and tracks the colors, shape, contours, etc. Video games can be programmed to recognize different objects as controllers or they can have advanced configurations to use certain items as controllers, and let players know what to use.
For example, it may be known in advance that a user intends to use a banana or orange as a controller for video games (for example, by having selected an option such as ‘add a banana for player 2 to join’), and thus the Object detector can be configured to segment colors that do not match yellow or orange from the acquired images. The object detector can be configured to generate a binary mask from each acquired image, after filtering out colors that are known not to match the object held by the user. The contour detection can then be performed on the binary mask generated for each image.
What do our readers think?