Today, Crunchfish launches an update of its latest gesture control product XR Skeleton with further precision and performance improvements as well as features. In XR Skeleton 1.1, Crunchfish has managed to compress more functions in the same neural network and doubled the precision with a 30 percent reduction in processing power. With an ordinary mobile camera, XR Skeleton detects and follows the hand through 21 points in three dimensions.

By identifying all the moving parts and contours of the hand and then linking these points together into a skeletal structure, the possibility of using 3D models as an exact image of the hand and its position in an augmented reality is opened up. Crunchfish’s latest software provides a full 3-dimensional experience despite the use of a standard 2-dimensional mobile camera – watch video.

The technology behind the XR Skeleton software product is based on Artificial Intelligence (AI) and the use of advanced neural networks. This gives the system intelligence to calculate how a hand moves in all three dimensions, even though the camera used can only read the hand “flat”, i.e. in two dimensions. This normally requires several large neural networks, which is demanding both on the processor and the battery. In XR Skeleton 1.1, Crunchfish has managed to compress more functions in the same neural network and thus increased performance by 30 percent. The precision in XR Skeleton 1.1, i.e. how close each of the 21 points on the hand is to the actual joint on the hand, has also been doubled.

An important difference between augmented reality (AR) and virtual reality (VR) is that in AR, you always see reality. This brings the complexity that all augmented information, such as the robot hand in the video above, must follow the real hand with extreme precision to give the user a good experience. Achieving this is one of Crunchfish’s main strengths.

“Since the last product release, we have taken further steps forward in the area of recreating 3D information based on 2D images. This is largely done through an advanced process for producing very high-quality data in combination with deep expertise in optimizing neural networks for real-time applications. With the latest version of XR Skeleton, we show the team’s incredible ability to create extremely efficient solutions with small resources,” says Daniel Milesson, Head of R&D at Crunchfish Gesture Interaction AB.

For more information, please contact:
Joakim Nydemark, CEO Crunchfish Gesture Interaction AB
+46 706 35 16 09
joakim.nydemark@crunchfish.com

Ulf Rogius Svensson, IR & Marketing Manager
+46 733 26 81 05
ulf.rogius.svensson@crunchfish.com

Västra Hamnen Corporate Finance AB is the Certified Adviser. Email: ca@vhcorp.se. Telephone +46 40 200 250.

About Crunchfish – crunchfish.com/gestures
Crunchfish is a tech company with a patent-pending solution for digital offline payments that can be integrated both with the payment rail or in a mobile wallet. The offline solution is globally scalable and makes digital payments more robust as the risks of disruptions and downtime are eliminated. We have also developed Blippit, an app terminal that connects to a cash register system for both online and offline payments. Crunchfish also develops gesture control of smart AR glasses for the consumer market. Crunchfish has been listed on Nasdaq First North Growth Market since 2016 with headquarters in Malmö, Sweden and with representation in India.

Crunchfish lanserar idag en uppdatering av sin senaste geststyrningsprodukt XR Skeleton med ytterligare förbättrad precision, prestanda och nya features. I XR Skeleton 1.1 har Crunchfish lyckats pressa ihop fler funktioner i ett och samma neurala nätverk och därmed fördubblat produktens precision med en 30-procentig reduktion i processorkraft. XR Skeleton kan med en helt vanlig mobilkamera detektera och följa 21 punkter i handen i tre dimensioner.

Genom att identifiera handens alla rörliga delar och konturer och sedan sammanlänka dessa punkter till en skelettstruktur öppnas möjligheten att använda 3D-modeller som en exakt avbildning av handen och dess position i en förstärkt verklighet. Crunchfishs senaste mjukvara ger en full 3-dimensionell upplevelse trots att en vanlig 2-dimensionell mobilkamera används – se video.

Teknologin bakom mjukvaruprodukten XR Skeleton bygger på Artificiell Intelligens (AI) och användning av avancerade neurala nätverk. Detta ger systemet intelligens att räkna ut hur en hand rör sig i alla tre dimensionerna trots att kameran som används bara kan läsa av handen ”platt”, dvs i två dimensioner. Detta kräver normalt sett flera stora neurala nätverk, vilka är processor- och batterikrävande. I XR Skeleton 1.1 har Crunchfish lyckats pressa ihop fler funktioner i ett och samma neurala nät och därmed ökat prestandan med 30 procent. Samtidigt har precisionen i XR Skeleton 1.1 fördubblats, dvs hur nära var och en av de 21 punkterna på handen är den verkliga leden på handen.

En viktig skillnad mellan augmenterad verklighet (AR) och virtuell verkligen (VR) är att man i AR hela tiden ser verkligheten. Detta medför komplexiteten att all augmenterad information, som exempelvis robothanden i videon ovan, måste följa den verkliga handen med extrem precision för att ge användaren en bra upplevelse. Att åstadkomma detta är en av Crunchfishs absoluta styrkor.

“Sedan förra produktreleasen har vi tagit ytterligare kliv framåt i området att återskapa 3D information utifrån 2D bilder. Detta till stor del genom en avancerad process för framtagning av mycket högkvalitativ data i kombination med djup expertis inom optimering av neurala nätverk för realtidsapplikationer. Med den senaste versionen av XR Skeleton visar vi teamets otroliga förmåga att skapa extremt effektiva lösningar med små resurser”, säger Daniel Milesson, utvecklingschef på Crunchfish Gesture Interaction AB

För ytterligare information, vänligen kontakta:
Joakim Nydemark, VD Crunchfish Gesture Interaction AB
+46 706 35 16 09
joakim.nydemark@crunchfish.com

Ulf Rogius Svensson, IR & Marketing Manager
+46 733 26 81 05
ulf.rogius.svensson@crunchfish.com

Västra Hamnen Corporate Finance AB är Certified Adviser. Epost: ca@vhcorp.se. Telefon +46 40 200 250.

Ladda ner som PDF

Gestures are in focus in this fourth week in our interview season. is focusing on Joachim Samuelsson starts off by talking to our senior research engineer Anders Henrysson who has a PhD in computer vision-based interaction.

Anders and Joachim discuss the intricate process of teaching a computer to recognize a hand, the difference between algorithms and neural nets, how neural nets for hand recognition are able to train themselves from data – and last but not least mountaineering and skydiving that Anders does when he’s not doing his magic at Crunchfish.

You can take a look at this video of our XR Skeleton product using only the camera sensor in a mobile phone – https://lnkd.in/erz6gwm – a really cool project that Anders has been working on.

Interview 10 of 36 in the second season – Cash goes digital, a payment pandemic – out tomorrow morning 6 am CET / 10.30 am IST. https://lnkd.in/e5RHAYD

Joachim Samuelsson rounds off the Alumni week talking to Henrik Winberg, our Head of Global Sales for five years 2015 – January 2020, who currently serves as COO of Dlaboratory Sweden AB, an innovative company that provides power companies with an intelligent analytics platform to manage their grids.

Henrik and Joachim discuss the famous Ketchup effect and how technology should be adjusted to humans instead of the other way around – something that permeates everything we do at Crunchfish. Don’t miss this interesting discussion!
Please visit https://dlaboratory.com/ to find out more about how they’re unlocking valuable insights in power grids with their data-based analytics tool.

Interview 9 of 36 in the second season – Cash goes digital, a payment pandemic – out Friday morning 6 am CET / 10.30 am IST.

Crunchfish AB (”Crunchfish”) meddelar idag att bolaget ingått ett tilläggsavtal med mobiltelefontillverkaren OPPO, som innebär att OPPO tillsammans med flera systerbolag kommer använda Crunchfishs mjukvara för geststyrning i kommande mobiltelefonmodeller. Det nya avtalet löper till december 2022 och inkluderar en licens för användning av fördefinierade gester inom specifika applikationsområden. Det garanterade ordervärdet är $250,000 USD med en affärsmodell som medger högre belopp under avtalstiden.

Det nya avtalet innebär att många av OPPO:s kommande telefonmodeller kommer med Crunchfishs mjukvara för geststyrning under kommande år. Avtalet består av både licens- och supportkomponenter och löper till december 2022.

”Det känns väldigt roligt att kunna meddela att vi återigen fått förnyat förtroende från OPPO och deras systerbolag, att leverera mjukvara för geststyrning till deras mobiltelefonplattformar. Samarbetet med OPPO går närmare 7 år tillbaka i tiden, vilket visar på såväl långsiktighet och stort förtroende för oss som leverantör som kvalitet i våra geststyrningsteknologier. OPPO är en mycket strategisk kund då de utöver att vara en av Kinas största mobilleverantörer, även är aktiva inom AR-glasögon till konsumentmarknaden – den marknad där de största affärsmöjligheterna för geststyrning inom AR kommer att finnas framöver”, säger Joakim Nydemark, COO på Crunchfish och VD för Crunchfish Gesture Interaction AB.

För ytterligare information, vänligen kontakta:
Joakim Nydemark, COO på Crunchfish och VD för Crunchfish Gesture Interaction AB
+46 706 35 16 09
joakim.nydemark@crunchfish.com

Ulf Rogius Svensson, IR & Marketing Manager
+46 733 26 81 05
ulf.rogius.svensson@crunchfish.com

Västra Hamnen Corporate Finance AB är Certified Adviser. Epost: ca@vhcorp.se. Telefon +46 40 200 250.

Denna information är sådan information som Crunchfish AB är skyldigt att offentliggöra enligt EU:s marknadsmissbruksförordning. Informationen lämnades, genom ovanstående kontaktpersons försorg, för offentliggörande den 29 december 2020.

Ladda ner som PDF

Crunchfish is proud to now start shipping its next generation gesture control technology – XR Skeleton 1.0 to customers and partners. The product – which detects and follows 21 points on each hand in three dimensions using a standard mobile camera – has got additional gestures and refined tracking during the autumn and is now […]

Crunchfish is proud to now start shipping its next generation gesture control technology – XR Skeleton 1.0 to customers and partners. The product – which detects and follows 21 points on each hand in three dimensions using a standard mobile camera – has got additional gestures and refined tracking during the autumn and is now ready for shippment to customers and partners for use in commercial products.

Earlier this year, the company announced its new generation gesture control technology – Crunchfish XR Skeleton. XR Skeleton 1.0 enables an exceedingly precise and flexible interaction solution, where each of the 21 points that represent the joints of the hand can be used as an interaction surface to control e.g. virtual objects or menu systems. In order to achieve an experience that is as realistic as possible in augmented reality, extreme accuracy is required of how the software interprets the movement of the hands. The product that we are now shipping to the market, uses a standard mobile camera, but still delivers distances between all 21 points in three dimensions. The software is optimized for AR glasses and VR devices but also supports interaction with mobile phones and public screens.

“Crunchfish XR Skeleton provides simplicity, is easy to integrate and enables an intuitive interaction experience for the user, with an incredibly advanced product underneath. With specially adapted neural networks and machine learning, we create gesture control solutions that enable full flexibility for the user, and it will be very exciting to see how our latest product is received by consumer electronics manufacturers and of course the end users”, says Joakim Nydemark, CEO of Crunchfish Gesture Interaction AB.

For more information, please contact:
Joakim Nydemark, COO of Crunchfish and CEO of Crunchfish Gesture Interaction AB
+46 706 35 16 09
joakim.nydemark@crunchfish.com

Ulf Rogius Svensson, IR & Marketing Manager
+46 733 26 81 05
ulf.rogius.svensson@crunchfish.com

Västra Hamnen Corporate Finance AB is the Certified Adviser. Email: ca@vhcorp.se. Telephone +46 40 200 250.

About Crunchfish – crunchfish.com
Crunchfish is a tech company with patent-pending solutions for digital cash that can be integrated with both the payment rail and in mobile wallets. The solutions are globally scalable and makes digital payments more robust as the risks of disruptions and downtime are eliminated. We have also developed Blippit, an app terminal that connects to cash register systems for both online and offline payments, and have a patent-pending solution to reduce food waste. Crunchfish also develops gesture control of smart AR glasses for the consumer market. Crunchfish is listed on Nasdaq First North Growth Market since 2016, with headquarters in Malmö, Sweden and with representation in India.

Download press release as PDF