Voice conversations between Gemma4 12B and E2B on GPU and Jetson Orin
Voice conversations between Gemma4 12B and E2B on GPU and Jetson Orin
Deep Dive
Gemma 4 12B runs on an RTX PRO 4500 Blackwell. Gemma 4 E2B run on a Jetson Orin NX 16GB; similar performance is expected on a Jetson Orin Nano Super 8GB. Both systems use a reSpeaker Flex 4-mic array and a 3W speaker. Inference is handled by Cortexist Little Gemma, a small LLM engine written in C fo