Crunchfish is pleased to announce the public release of XR Tracking 2.0, which is the company’s newest and most powerful gesture software for Augmented Reality (AR) applications. With a full 3D experience XR Tracking 2.0 enables a powerful gesture interaction using a standard 2D RGB camera. On top of that there are a lot of […]

Crunchfish is pleased to announce the public release of XR Tracking 2.0, which is the company’s newest and most powerful gesture software for Augmented Reality (AR) applications. With a full 3D experience XR Tracking 2.0 enables a powerful gesture interaction using a standard 2D RGB camera. On top of that there are a lot of updates in underlying algorithms. XR Tracking 2.0 first debuted at Augmented World Expo (AWE) US in May 2019. Now, with an updated downloadable demo, Crunchfish is making it possible for everyone to try it out in minutes. 

Demand is growing for user-friendly and efficient ways to engage with AR smart glasses. Without a touchscreen, the natural way to interact is to use touchless hand gestures. Crunchfish is in the forefront of development within the AR sector and provides efficient gesture interaction for enterprise and consumer AR smart glasses.

XR Tracking 2.0 is made for touchless interaction in XR and was demoed at Augmented World Expo (AWE) US in May 2019. XR Tracking offers the unique experience of a mouse-like UI paradigm by just using a hand. The position of the hand is tracked with high precision for a responsive UI feedback. The detection is specially adopted for AR/VR glasses where the camera is mounted on the device, facing away from the user. The detected gesture also provides a tracked position. It is easy to adopt to existing applications and offer a quick learning curve for the user since fewer gestures need to be remembered and the interaction can be made consistent.

Check out XR Tracking 2.0 in action in this video:

Want to try it for yourself?

To show the potential of our powerful XR Tracking 2.0, Crunchfish has made a demo application publicly available. The demo demonstrates Crunchfish’s solution designed for efficient touchless interaction with most standard AR smart glasses. Using the pinch, open and closed hand, interactions such as navigation, item selection, annotation and zooming can be performed. The demo is available on:

• Epson BT3xx
• Lenovo New C200
• RealWear HMT-1
• Vuzix M-series (external link)
• Smartphones (mobile AR)*

*Compatible with the majority smartphones running Android 5.0 or later.

TRY THE XR TRACKING 2.0 DEMO NOW

Interested in bringing gesture controls to your AR hardware or software? Please contact our sales team:

Henrik Winberg, Sales Director at Crunchfish
henrik.winberg@crunchfish.com
+46 (0)702 126 129

Joakim Nydemark, CEO at Crunchfish
joakim.nydemark@crunchfish.com
+46 (0)706 351 609

Last week, Crunchfish attended the world’s largest AR+VR (Augmented Reality + Virtual Reality) conference, AWE (Augmented World Expo) 2019, in Santa Clara, USA where the company demonstrated its patented gesture interaction technology. The leading augmented reality companies in the world were brought together to exhibit augmented reality smart glasses, applications, software technologies, and more. The […]

Last week, Crunchfish attended the world’s largest AR+VR (Augmented Reality + Virtual Reality) conference, AWE (Augmented World Expo) 2019, in Santa Clara, USA where the company demonstrated its patented gesture interaction technology. The leading augmented reality companies in the world were brought together to exhibit augmented reality smart glasses, applications, software technologies, and more. The interest for touchless interaction grows every year and Crunchfish – as a leading provider of interaction technologies – demonstrated how touchless interaction with hand gestures will revolutionise how we interact with and experience our physical and virtual environment in AR.

AWE, the world’s most visited AR+VR conference now in its 10th year, gathered more industry professionals than ever before. Crunchfish participated with its own booth and exhibited its gesture control technology using AR-enabled mobile devices and augmented reality smart glasses from Vuzix and Realwear.

It was clear during the show that consumer products are now in the spotlight. Many new products were launched with better performance and more capacity than ever before, including Nreal’s smart glasses and Qualcomm’s Snapdragon 855 chipset and reference design. Following the success of Pokémon Go, new augmented reality games are being launched for the mobile and tablet market, including the much anticipated, Minecraft Earth game. Although Apple, the 3^rd largest AR company in the world according to DigiCapital, did not exhibit at the show, the company is expected to launch an AR device for the consumer market within the next year. As the hype crescendos for the new Minecraft Earth and the AR gaming industry in general, one issue with AR gaming remains – power consumption. Because of this long-standing issue, Crunchfish has developed its gesture control software to be extremely power efficient. With its latest product track using NPU (neural processing unit), the company broadens its range of products with the most efficient and best-performing solution to date. Crunchfish takes pride in providing gesture solutions that exceeds the market’s expectations.

“During the show, we had many fruitful discussions about our technology and the advantages of using hand gestures for AR interaction. It is clear that Crunchfish has a market advantage with our pinch gesture and that we are at the forefront of gesture interaction with our energy efficient technology, which was confirmed during the conference”, comments Daniel Milesson, Head of R&D at Crunchfish..

Looking from a commercial aspect, it is clear that the market is growing. New segments were introduced at this year’s AWE and it is both within the enterprise segment and the earlier addressed consumer segment. More companies have conducted pilot studies and the atmosphere at the show enabled the exchange of knowledge and ideas. PTC and AMA are two major market players that presented their product lines with sharp use cases for Industrial AR (manufacturing, service and maintenance).

“A crucial aspect for a successful deployment of smart AR glasses is the user focus, where touchless interaction is a key contributor to accomplish outstanding experiences. During the AWE 2019 in Santa Clara we showed how our extensive knowledge in this field has resulted in one of the markets most intuitive gesture interaction technologies. This created a lot of attention and interest to our stand where we got the possibility to tighten our relationship with existing customers and partners, as well as connecting with a wide range of new potential clients”, comments Henrik Winberg, Head of Sales at Crunchfish.

AR glasses continue to get better performance and more attractive form factor. The segment will continue to develop and after seeing the Nreal smartglasses that are planned to be introduced later this year, it is fair to say that the design is getting closer to a product for consumer market and all day use with a much better form factor and design. It will be interesting following the development of the AR glasses segment. Crunchfish had many visitors in its booth requesting gesture control for AR smartglasses and the company demoed its solutions for market leading companies such as Qualcomm, Apple, Vuzix and PTC. The market has understood that interaction with glasses requires interaction methods, and that hand gesture control is the market leading solution.

“Crunchfish is pleased to see that the AR market continues to grow with interest from both the industry and consumers and that the interest in gesture control is bigger than ever. We had a great AWE show that gave us both new insights and many new customer leads”, finishes Joakim Nydemark, the CEO of Crunchfish.

Usability is key for AR to succeed – visit Crunchfish at AWE USA and experience true user focused interaction The AR-interaction and UX-specialist Crunchfish demonstrates the importance of efficient interaction in AR glasses at AWE USA in Santa Clara, May 29th-31st – setting a new standard for AR user experience. Focus on user experience in […]

Usability is key for AR to succeed – visit Crunchfish at AWE USA and experience true user focused interaction

The AR-interaction and UX-specialist Crunchfish demonstrates the importance of efficient interaction in AR glasses at AWE USA in Santa Clara, May 29th-31st – setting a new standard for AR user experience.

Focus on user experience in AR is key to success

So far, AR projects have focused on technology to provide the AR experience rather than methods that allow users to better engage with the content. It is crucial to include the user experience to secure confidence in AR and avoid project failure. Crunchfish has in its new interaction solution used UX-experience from projects during the last 8 years resulting in a cutting edge and user-friendly interaction solution for AR.

Crunchfish demonstrates the importance of usability and how to change the AR-experience

At AWE USA in Santa Clara Crunchfish will demonstrate several solutions increasing the usability and security when using AR glasses.

Gesture interaction – One gesture concept
Touchless gesture interaction lets you engage with AR devices and environments in a direct way, making interactions more fluid and immersive.
In Crunchfish’s One gesture concept, a pointer tracks the hand and a pinch-gesture is used to activate the different functions in the AR glasses. Examples of functions to control are zoom, drag & drop objects, and draw in the AR-view.

iOS support and gestures for Unity developers
Naturally Crunchfish’s latest touchless interaction software supports iOS as well as Android, and we have now also added a more advanced Unity API to the benefit for our developers.

XR-tracking 2.0 – Our most powerful product to date
With a full 3D experience XR-tracking 2.0 enables a powerful interaction using a standard 2D RGB camera. On top of that there are a lot of updates in underlying algorithms, which will be obvious when it is tried out. We have visualised all the bells and whistles in a mobileAR demo that can be experienced in the Crunchfish booth 843.

Increased information security in AR with gesture-controlled pin code
The new Crunchfish solution tackles the information security issues when using AR glasses by offering a smooth pinch-click solution for entering the pin code when using AR glasses.

Welcome to visit Crunchfish in booth 843 to discuss the possibilities of touchless gesture interaction and contextual awareness.

For more information, please contact:
Henrik Winberg, Sales Director at Crunchfish
+46 702 12 61 29,
henrik.winberg@crunchfish.com

Joakim Nydemark, CEO
+46 706 35 16 09,
joakim.nydemark@crunchfish.com

Watch the new AR-interaction demonstration films from Crunchfish

Crunchfish 3D gesture interaction using 2D RGB camera

Gesture control and contextual awareness for AR glasses

About Crunchfish
Crunchfish develops software for AR that creates new possibilities for interaction. We use cameras to detect and track a person’s face and hands, which enables you to engage in a more natural way with digital interfaces using gestures. Through Low Energy Bluetooth, we provide applications with an intelligent proximity layer, that lets users locally and seamlessly discover who and what is nearby, connect and share information.
Crunchfish’s technologies are licensed to hardware manufacturers and application developers and are currently available in millions of devices from global enterprises. The company was founded in 2010 and is based in Malmö, Sweden. Crunchfish is listed on Nasdaq First North since 2016. Visit crunchfish.com for more information.

Crunchfish’s high-precision gesture solution is specially designed to provide 3D AR interaction using a standard RGB camera sensor in any mobile and AR-glasses. Try Crunchfish’s solution and get immersed in the augmented reality.

Crunchfish’s high-precision gesture solution is specially designed to provide 3D AR interaction using a standard RGB camera sensor in any mobile and AR-glasses. Try Crunchfish’s solution and get immersed in the augmented reality.

Crunchfishs partner och återförsäljare Nibiru tecknar avtal med kinesiska Shenzhen ARTS-STAR Technology avseende AR-glasögon under varumärket Polaroid. Nibiru kommer att leverera sin AR-plattform, med integrerad geststyrning från Crunchfish, för användning i AR-glasögon av märket Polaroid. Nasdaq First North-listade Crunchfish ingick partnerskap med det kinesiska företaget Nibiru 2018, vilket innebar att Nibiru blev återförsäljare av bolagets […]

Crunchfishs partner och återförsäljare Nibiru tecknar avtal med kinesiska Shenzhen ARTS-STAR Technology avseende AR-glasögon under varumärket Polaroid. Nibiru kommer att leverera sin AR-plattform, med integrerad geststyrning från Crunchfish, för användning i AR-glasögon av märket Polaroid.

Nasdaq First North-listade Crunchfish ingick partnerskap med det kinesiska företaget Nibiru 2018, vilket innebar att Nibiru blev återförsäljare av bolagets geststyrningsteknologi som en integrerad del av Nibirus mjukvaruplattform för AR/VR produkter.

Nibiru har nu tecknat avtal med kinesiska Shenzhen ARTS-STAR Technology, där ARTS-STAR ska nyttja Nibirus plattform inklusive mjukvaran för geststyrning, i AR-glasögon av märket Polaroid.

AR-glasögonen ska initialt säljas i Kina men planen är att på sikt adressera en global marknad. De har en konsumentprofil men kommer också att marknadsföras inom andra marknadssegment som museer och utbildning.

“Samarbetet mellan Nibiru och Crunchfish förbättrar interaktionsmöjligheterna i Nibirus AR-plattform. Användarvänligheten och strömsnålheten i geststyrningsmjukvaran adderar ett flertal användarscenarier inom XR. Samarbetet mellan Nibiru och Crunchfish stärker båda bolagen och skapar en ökad användarvänlighet i AR/VR miljö”, säger Nibirus Vice President Peter Liu.

“På grundval av att inte öka hårdvarukostnaden fokuserar vi på att göra våra produkter och interaktion med dem så enkel och användarvänlig som möjligt. Samarbetet stärker våra produkter och därigenom också vår konkurrenskraft. Nibirus och Crunchfishs integrerade lösning gör det möjligt för oss att fullt ut fokusera på produktionen, säger Polaroids General Manager Jeff Zou.

“Vi är väldigt glada över samarbetet med Nibiru och att vara en integrerad del av deras AR-plattform. Polaroid är ett starkt varumärke med stora möjligheter och det är även positivt för den fortsatta marknadsföringen av vårt gemensamma erbjudande med Nibiru”, säger Crunchfishs VD Joakim Nydemark.

Samarbetet mellan Nibiru och Crunchfish kring Polaroidglasögonen stärker ytterligare vår position som en av de ledande leverantörerna av geststyrningsteknologi för AR-glasögon. Under det senaste året har Crunchfish ingått flera strategiska partnerskap med stora globala aktörer. Detta har resulterat i ett globalt nätverk av partners, vilket är en viktig faktor för framgång på en växande marknad.

För ytterligare information kontakta:

VD Joakim Nydemark
0706 351 609,
ir@crunchfish.com

Certified Adviser: Sedermera Fondkommission, epost: ca@sedermera.se, telefon 040-615 14 10

Denna information är sådan information som Crunchfish AB är skyldigt att offentliggöra enligt EU:s Marknads­missbruksförordning. Informationen lämnades, genom ovanstående personers försorg, för offentliggörande den 15 mars 2019. 

Om Crunchfish – crunchfish.com

Crunchfish AB utvecklar och marknadsför patenterade interaktionslösningar för mobil handel och augmented reality. Verksamheten kring Mobil handel bedrivs i dotterbolaget Crunchfish Proximity med fokus på närhets­baserad interaktion. Med egenutvecklad appterminal och mjukvara möjliggörs blippbar kuponginlösen och betalning. Kommersialiseringen görs i samarbete med ClearOn i det gemensamma bolaget Blippit. Inom AR erbjuder bolaget mjukvara för geststyrning av AR-glasögon och annan konsumentelektronik. Mjukvaran är en av de ledande i världen och finns i tiotals miljoner enheter på marknaden genom kunder som OPPO, Epson och Lenovo. Crunchfish är noterat på Nasdaq First North sedan 2016. Företaget grundades 2010 med huvudkontor i Malmö.

Ladda ner som PDF

Augmented reality and gesture control will change the future – and that future is already here. This was the message from Mobile World Congress (MWC) 2019, which has just taken place in Barcelona. The solutions on show in Barcelona demonstrated how augmented reality and touchless interaction with hand gestures will revolutionise how we experience our […]

Augmented reality and gesture control will change the future – and that future is already here.
This was the message from Mobile World Congress (MWC) 2019, which has just taken place in Barcelona.

The solutions on show in Barcelona demonstrated how augmented reality and touchless interaction with hand gestures will revolutionise how we experience our physical environment.

Among the headline makers was Microsoft, which unveiled its second iteration of HoloLens, the world’s leading AR glasses. HoloLens 2 uses touchless gestures as its main control technology. See the presentation at https://youtu.be/k_eNxzn9DT0.

Besides HoloLens, more and more companies are making smart AR glasses, AR software and optical display technology. This is great news for us at Crunchfish and our AR technology, which enables all forms of interaction with a simple pinch gesture.

Another eye-catching innovation came from LG, which exhibited mobile phones with 3D sensors and touchless gesture control. LG also showed how smart AR glasses will be part of the consumer experience through its collaboration with Nreal.

Meanwhile, our friends at Vuzix reused the CES booth setup to show how the Blade can be used in everyday life.

Crunchfish exhibited in the Swedish pavilion and in the Infineon booth. Besides showing our gesture control technology integrated in smart glasses from Vuzix, Realwear, Epson, LLVision and RealMax, we proudly showed a demo of how our gesture control technology can be used for controlling lamps in smart homes.

Using hand gestures to interact with virtual AR objects gives the user a more immersive experience compared to when interacting with a screen or using a HW control device.

In the Infineon booth the demo consisted of a Philips Hue lamp that could be controlled by a UI only visible in AR when pointing the mobile device at the lamp. By using gestures to interact with the UI, the lamp could then be turned on/off, dimmed and change colour. The UI could also be moved around in 3D to be placed wherever the user would like to have it. See the demo film https://youtu.be/bO_t4lFjO_Y

We demonstrated how our technology adds value in smart AR glasses together with our hardware partners and one of our software partners, Nibiru. With Infineon, we displayed how it can be used in a mobile AR and smart home context.

We were delighted to see substantial interest from hardware and software makers alike. Visitors ranged from Samsung and HTC to RealMax, Volvo Cars and PTC – to name a few.

Like them, we look forward to being part of the AR and gesture control revolution. And in helping to shape a future that has already arrived.