One thing to note is that, after I submitted the final draft of this article, the Japanese government ended the MEXT university track or is at least planning to. There was a memo, but the status is not clear.
Anyway, I had a great time doing my PhD this way, and generally I recommend that people work before a PhD and try to work during it (if you are in CS). It gives you a lot of freedom and, at least for me, it is very helpful to have more than one pipeline of work at a time so that when one slows down (as it inevitably does in research), you can draw on the other.
> at Google I work primarily on on-device language models for keyboards.
It's difficult to reconcile the amount of horsepower your typical keyboard, and a language mode, let alone how a language model might be useful in a keyboard (the mind boggles at the thought it starts correcting your typing).
What are the potential uses of a language model in a keyboard?
Predictive texting/typing was basically the use for language models before LLMs. Not all language models are LLMs. And yes, correcting/predicting your typing has been the main feature for at least the last decade.
mcyc · · focus · HN ↗
One thing to note is that, after I submitted the final draft of this article, the Japanese government ended the MEXT university track or is at least planning to. There was a memo, but the status is not clear.
Anyway, I had a great time doing my PhD this way, and generally I recommend that people work before a PhD and try to work during it (if you are in CS). It gives you a lot of freedom and, at least for me, it is very helpful to have more than one pipeline of work at a time so that when one slows down (as it inevitably does in research), you can draw on the other.
rstuart4133 · · focus · HN ↗
> at Google I work primarily on on-device language models for keyboards.
It's difficult to reconcile the amount of horsepower your typical keyboard, and a language mode, let alone how a language model might be useful in a keyboard (the mind boggles at the thought it starts correcting your typing).
What are the potential uses of a language model in a keyboard?
rcxdude · · focus · HN ↗
froh · · focus · HN ↗