Qualcomm Unified AI Stack launched for cloud-to-edge intelligence

New Qualcomm AI Stack lays the muse for industry-specific SDK

Whereas advances in synthetic intelligence accelerators have improved silicon efficiency greater than a thousand occasions, it’s the software program that turns bits of silicon into helpful capabilities for customers and companies. In spite of everything, none of us even take into consideration the first chip after we take a low-light picture on our cellphone, play a VR recreation, or ask our digital assistant to set a reminder. The underlying synthetic intelligence that permits these features is hidden by software program developed by hundreds of engineers around the globe. These software ninjas want software program instruments intently associated to silicon to be productive and capable of produce efficiency code. The last word purpose is for AI engineers to develop, enhance, deploy, and speed up their fashions on a selected machine. Builders additionally need a number of entry layers inside a software program bundle that work with their design workflow, write this code as soon as and run it on any machine, no matter whether or not or not there are particular acceleration options.

Qualcomm Applied sciences, Inc. (QTI) not too long ago redesigned and enhanced its complete suite of AI software program to assist these builders acquire a number of entry factors throughout software program layers and transfer their code extra freely throughout the corporate’s merchandise and tiers. The corporate’s new AI suite of software program additionally powers industry-specific software program growth kits (SDKs) that stretch capabilities throughout a variety of QTI {hardware} platforms. It can be used as a standalone growth device should you solely need to, for instance, develop on the Snapdragon cellular platform.

What’s QTI AI Stack?

QTI’s purpose in creating this suite was to standardize and simplify their software program toolkit for OEMs and builders to create, enhance, and deploy AI purposes on Qualcomm Applied sciences merchandise whereas taking full benefit of the efficiency and effectivity of the Qualcomm® AI Engine.

Qualcomm AI Stack helps a spread of various standard AI frameworks together with TensorFlow and PyTorch, and runtimes together with TFLite and ONNXRT. AI Stack consists of libraries and companies for core builders, system software program, instruments, and compilers in order that any AI function developed for one machine can simply be deployed on different units. Qualcomm present® The Neural Processing SDK, the favored Qualcomm® AI Mannequin Effectivity Toolkit (AIMET) Professional, the AIMET Mannequin Zoo, Mannequin Analyzers, and Neural Structure Search (NAS) are included. Moreover, Qualcomm not too long ago ported the Qualcomm Neural Processing SDK to Microsoft Home windows, whereas the Qualcomm Reside AI Engine, a complicated AI runtime, has been prolonged throughout all Qualcomm Applied sciences merchandise together with the Qualcomm® Cloud AI 100 Inference Processor. This newest enchancment helps Builders are working to attain the “write as soon as” anyplace purpose set by QTI, permitting builders to deploy present fashions on to AI accelerators on Qualcomm Applied sciences platforms.

On prime of the Qualcomm AI Software program Stack are three industry-specific SDKs for autonomous automobiles (Snapdragon Trip™ SDK), and a multimedia intelligence SDK for robotics, IoT and digital actuality (Snapdragon Areas™ SDK). As soon as once more, constructing the SDK on a standard foundation helps builders help the total suite of QTI {hardware} purposes in numerous sectors, together with the Qualcomm Cloud AI 100.

Qualcomm AI Stack standardizes varied AI frameworks and customary runtimes together with TensorFlow, PyTorch, and ONNX. These frameworks are constructed on core developer libraries and companies, system software program, instruments, and compilers in order that any AI function developed for one machine can simply be deployed on different units. The prevailing Qualcomm Neural Processing SDK, AI Mannequin Effectivity Toolkit (AIMET), AIMET Mannequin Zoo, Mannequin Analyzers, and Neural Engineering Analysis (NAS) are included. As well as, Qualcomm not too long ago ported the Neural Processing SDK to Microsoft Home windows, whereas the AI ​​Engine Direct was prolonged throughout all Qualcomm merchandise together with the Cloud AI 100 Inference Processor. This newest enchancment helps builders obtain the write-once-anywhere purpose you set QTI to allow builders to deploy present fashions on to AI accelerators on Qualcomm Applied sciences platforms.

On the prime of the Software program Stack are three industry-specific SDKs for autonomous automobiles (Snapdragon Trip), good multimedia, and digital actuality (Snapdragon Areas). As soon as once more, constructing the SDK on a standard foundation helps builders help the total suite of QTI {hardware} purposes in numerous sectors, together with Cloud AI 100.

Conclusions

Unifying Qualcomm Applied sciences’ complete suite of AI software program will allow builders to extra simply create purposes utilizing the identical set of instruments whatever the goal deployment platform, together with cellular, automotive, XR, computing, IoT and cloud platforms. As QTI expands its entry to the linked good edge, the unified software program suite has grown in significance, and the corporate has now taken this problem head-on with the Qualcomm AI Stack and can have the potential to usher in extra AI growth instruments and extra domain-specific SDKs sooner or later.

.