Released ailia SDK 1.2.10

We are pleased to introduce version 1.2.10 of ailia SDK, a cross-platform framework to perform fast AI inference on GPU or CPU. You can find more information about ailia SDK on the official website.

Support of ONNX opset 12 to 15

With the addition of the latest opset, more layers are supported which means more models can be exported. Newly supported layers include Celu, Einsum, HardSwish, LpNormalization, MeanVarianceNormalization and Trilu.

Faster loading of compressed models

Quantized and compressed ONNX models can be loaded faster in this new release. An example model which took 1345ms to load on Google Pixel 6 with ailia SDK 1.2.9 now only takes 358ms with ailia SDK 1.2.10, or 3.7 times faster. It now really close to the loading time of the uncompressed model which takes 322 ms.

Optimizations

Layers Transpose,Softmax, Resize and Conv3D have been greatly optimized on CPU. We also performed CUDA acceleration for Matmul and Softmax, and Vulkan acceleration for Resize.

Support for Nvidia drivers that support Vulkan 1.3

We fixed an issue that caused instance creation to fail with the latest Nvidia drivers supporting Vulkan 1.3. It was dueto a bug from khronos/VulkanHeader, which is used by the ailia SDK, and it’s been addressed by updating khronos/VulkanHeader to the latest version.

Release of web documentation

API specifications can now be checked online from our website.

Extract of API reference（https://ailia-ai.github.io/ailia-sdk/api/python/en/）

All the links can be found at the site below.

GitHub — ailia-ai/ailia-sdk: cross-platform high speed inference SDKSDK for optimized running of many popular neural networks on multiple platform ailia SDK is a cross-platform high speed…github.com

Addition of new models

ailia SDK 1.2.10 comes with some new models.

Detic: Object detection model and segmentation supporting 21k classes with high accuracy

Source: https://web.eecs.umich.edu/~fouhey/fun/desk/desk.jpg

ailia-models/object_detection/detic at master · ailia-ai/ailia-models(Image from https://web.eecs.umich.edu/~fouhey/fun/desk/desk.jpg, credit David Fouhey) Automatically downloads the onnx…github.com

Traffic Sign Detection: Traffic sign recognition model

Source: https://github.com/aarcosg/traffic-sign-detection/blob/master/test_images/image2.jpg

ailia-models/object_detection/traffic-sign-detection at master · ailia-ai/ailia-models(Image from https://github.com/aarcosg/traffic-sign-detection/blob/master/test_images/image2.jpg) Automatically…github.co

ailia Inc. has developed ailia SDK, which enables cross-platform, GPU-based rapid inference.

ailia Inc. provides a wide range of services from consulting and model creation, to the development of AI-based applications and SDKs. Feel free to contact us for any inquiry.