Did Google hide the best version of Gemma 4 e4b in Android? The extracted model beats Unsloth and everything else I've tried.

A Reddit user, u/LawyerCompetitive478, reported that Google's Gemma 4 e4b model, extracted from the AI Edge Gallery on Android via ADB in litertlm format, outperforms all other versions they've tested, including Unsloth's 3.7GB GGUF (gemma-4-E4B-it-UD-Q2_K_XL.gguf). The Android version weighs only 3.6GB, yet demonstrates superior reasoning and coherence, particularly in Russian text generation. In contrast, the litert-community/gemma-4-E4B-it-litert-lm variant produced incoherent output, suggesting potential bugs or quantization issues in community builds.

This discovery underscores the impact of model format and optimization on performance. Google's proprietary litertlm format, likely tailored for Android's AI Edge Gallery, may include optimizations for edge inference that improve quality without increasing size. The user's experience highlights how official, platform-specific builds can outperform generalized open-source versions, even when slightly smaller. For developers and AI enthusiasts, this suggests that model extraction from official sources may yield better results than downloading from repositories like Unsloth or Hugging Face, especially for multilingual tasks.