LiteRT-LM + React Native: Run LLMs locally in your Android app!

Hey guys, today you're gonna learn how to use the LiteRT-LM library along with React Native to perform on-device inference on an Android device. More specifically, we will be using the FunctionGemma LLM along with tool support.
Since LiteRT-LM is Kotlin/Java only, we'll be using Expo's Native Module API to use it in React Native.
Links:
Project repo: https://github.com/HussainArif12/litert-tutorial
FunctionGemma LiteRT-LM model file: https://huggingface.co/JackJ1/functiongemma-270m-it-mobile-actions-litertlm/tree/main
FunctionGemma Finetuned for Tool calling: https://youtu.be/ioPJzfw6pW8?si=4_Dtj02Tv_oOqnx-
Expo- Building Kotlin modules: https://youtu.be/w9ipID5hkmA?si=4Fz8gtku1HsGMf5A

Timestamps:
0:00 Intro
0:55 Project overview
1:51 Project setup
3:46 Initial code
5:16 Model File picker
7:36 Dealing with file system
10:00 Building Kotlin module
10:51 Initializing LLM engine
18:16 Sending message to LLM
28:38 Tool support
32:39 Building a custom tool
35:45 Saving path to local storage
38:32 Closing LLM engine
39:55 Closing notes
40:34 Outro
Thank you for watching!

Видео LiteRT-LM + React Native: Run LLMs locally in your Android app! канала Hussain Arif