Loading…
20
My professor told me to ignore the hype around small language models last year.
He said focusing on the biggest models was the only real path for innovation, but the breakthroughs in local, efficient AI like Phi-3 have proven him totally wrong. Anyone else find their old assumptions about AI scale getting flipped recently?
2 comments
Log in to join the discussion
Log In2 Comments
caseyrivera6mo ago
Remember when I said bigger was always better, lol?
6
patricianguyen6mo ago
My professor said something similar in 2022. I get the push for efficiency, but the real frontier is still in massive multimodal systems. Models like GPT-4o or Gemini handling video and audio are doing things Phi-3 just can't. The small models are great for specific tasks, but the big leaps in what AI can actually understand still come from scale.
2