Back

03 / 05

LLM IME

A Chinese pinyin input method: type only the initials, and a small fine-tuned model guesses the whole sentence from context.

  • Qwen3-0.6B fine-tune
  • MLX
  • beam search
  • Swift · InputMethodKit
llm-ime — initials only
Type just the initials; the model guesses the sentence from context

What I built

You type only initials (nh → 你好); a fine-tuned Qwen3-0.6B scores whole sentences against the context, and beam search finds the candidates.

It still reads you right when you mistype or swap two keys, and it remembers the words you use often.

The model runs locally on the Mac (MLX); the input method itself is Swift and InputMethodKit.