LFM2-350M

Ultra-compact 350M parameter model for edge devices and low latency deployments

← Back to Text Models

LFM2-350M is Liquid AI’s smallest text model, designed for edge devices with strict memory and compute constraints. Delivers surprisingly strong performance for its size, making it ideal for low-latency applications.

HFGGUFMLXONNX

Specifications

Property	Value
Parameters	350M
Context Length	32K tokens
Architecture	LFM2 (Dense)

Ultra-Light

Minimal memory and compute footprint

Low Latency

Fastest inference in the LFM family

Edge-Ready

Runs on IoT and embedded devices

Quick Start

Transformers

Install:

pip install transformers torch

Download & Run:

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("LiquidAI/LFM2-350M", device_map="auto")
tokenizer = AutoTokenizer.from_pretrained("LiquidAI/LFM2-350M")

input_ids = tokenizer.apply_chat_template(
    [{"role": "user", "content": "What is machine learning?"}],
    add_generation_prompt=True, return_tensors="pt"
).to(model.device)

output = model.generate(input_ids, max_new_tokens=256)
print(tokenizer.decode(output[0], skip_special_tokens=True))

llama.cpp

Install:

brew install llama.cpp
pip install huggingface-hub

Download:

huggingface-cli download LiquidAI/LFM2-350M-GGUF \
  lfm2-350m-q4_k_m.gguf --local-dir .

Run:

llama-cli -m lfm2-350m-q4_k_m.gguf \
  -p "What is machine learning?" -n 256

vLLM

Install:

pip install vllm

Run:

from vllm import LLM, SamplingParams

llm = LLM(model="LiquidAI/LFM2-350M")
output = llm.chat("What is machine learning?", SamplingParams(max_tokens=256))
print(output[0].outputs[0].text)