Microsoft Introduces Phi-3, LLM That Runs on the Phone

Phi-3-Mini, being highly capable, can run locally on a cell phone. Its small size allows it to be quantized to 4 bits, occupying approximately 1.8GB of memory.

https://analyticsindiamag.com/microsoft-introduces-phi-3-llm-that-runs-on-the-phone