react-native-executorch-multi-qa-MiniLM-L6-cos

This repository hosts the multi-qa-MiniLM-L6-cos-v1 models exported for the React Native ExecuTorch library as ExecuTorch .pte programs, ready to run on device.

Upstream model: multi-qa-MiniLM-L6-cos-v1

Variants

Repository structure

config.json                                         47 B
coreml/config.json                                  947 B
coreml/multi_qa_minilm_l6_cos_v1_coreml_fp16.pte    43.4 MB
tokenizer.json                                      695 kB
tokenizer_config.json                               383 B
vulkan/config.json                                  947 B
vulkan/multi_qa_minilm_l6_cos_v1_vulkan_fp16.pte    43.1 MB
xnnpack/config.json                                 949 B
xnnpack/multi_qa_minilm_l6_cos_v1_xnnpack_fp32.pte  86.2 MB

Compatibility

These files are published for the ExecuTorch v1.4.1 runtime. ExecuTorch gives no forward compatibility guarantee, so an older runtime may fail to load them.

To use them in React Native ExecuTorch, pass the model constant shipped in the library's model registry to the corresponding task pipeline. See the documentation.

To load these files in your own ExecuTorch runtime, read the compatibility note first.