New XR Skeleton release brings significantly improved precision and performance
Today, Crunchfish launches an update of its latest gesture control product XR Skeleton with further precision and performance improvements as well as features. In XR Skeleton 1.1, Crunchfish has managed to compress more functions in the same neural network and doubled the precision with a 30 percent reduction in processing power. With an ordinary mobile camera, XR Skeleton detects and follows the hand through 21 points in three dimensions.
By identifying all the moving parts and contours of the hand and then linking these points together into a skeletal structure, the possibility of using 3D models as an exact image of the hand and its position in an augmented reality is opened up. Crunchfish’s latest software provides a full 3-dimensional experience despite the use of a standard 2-dimensional mobile camera – watch video.
The technology behind the XR Skeleton software product is based on Artificial Intelligence (AI) and the use of advanced neural networks. This gives the system intelligence to calculate how a hand moves in all three dimensions, even though the camera used can only read the hand “flat”, i.e. in two dimensions. This normally requires several large neural networks, which is demanding both on the processor and the battery. In XR Skeleton 1.1, Crunchfish has managed to compress more functions in the same neural network and thus increased performance by 30 percent. The precision in XR Skeleton 1.1, i.e. how close each of the 21 points on the hand is to the actual joint on the hand, has also been doubled.
An important difference between augmented reality (AR) and virtual reality (VR) is that in AR, you always see reality. This brings the complexity that all augmented information, such as the robot hand in the video above, must follow the real hand with extreme precision to give the user a good experience. Achieving this is one of Crunchfish’s main strengths.
“Since the last product release, we have taken further steps forward in the area of recreating 3D information based on 2D images. This is largely done through an advanced process for producing very high-quality data in combination with deep expertise in optimizing neural networks for real-time applications. With the latest version of XR Skeleton, we show the team’s incredible ability to create extremely efficient solutions with small resources,” says Daniel Milesson, Head of R&D at Crunchfish Gesture Interaction AB.
For more information, please contact:
Joakim Nydemark, CEO Crunchfish Gesture Interaction AB
+46 706 35 16 09
joakim.nydemark@crunchfish.com
Ulf Rogius Svensson, IR & Marketing Manager
+46 733 26 81 05
ulf.rogius.svensson@crunchfish.com
Västra Hamnen Corporate Finance AB is the Certified Adviser. Email: ca@vhcorp.se. Telephone +46 40 200 250.
About Crunchfish – crunchfish.com/gestures
Crunchfish is a tech company with a patent-pending solution for digital offline payments that can be integrated both with the payment rail or in a mobile wallet. The offline solution is globally scalable and makes digital payments more robust as the risks of disruptions and downtime are eliminated. We have also developed Blippit, an app terminal that connects to a cash register system for both online and offline payments. Crunchfish also develops gesture control of smart AR glasses for the consumer market. Crunchfish has been listed on Nasdaq First North Growth Market since 2016 with headquarters in Malmö, Sweden and with representation in India.
