GAMMA has such a head start and is now (OpenAI at least) trying to pull the ladder up through self-regulation that it leads me to believe that open source will not have the resources (GPUs/TPUs/energy) needed to ever catch up fully. The fact that Zuckerberg is so pro-open source kind of confirms this, as his LLaMa model is leagues behind OpenAI, therefore he is trying to flatten the market, hope someone develops something cool, and then probably try to acquire it. There are rumblings that you can run some very good models on just a smart phone, but I am skeptical of how good those can actually be. I think it comes down to use cases. For small/simple use cases, a small open source model than you can run yourself on your phone's processor might be totally adequate. But my gut says, until we get a several-fold increase in processing power coupled with a reduction in energy costs, open source won't be able to do any of the cool stuff, like replace doctors/lawyers/analysts etc. Thanks for the comment!
Any thoughts on how open sourced models may effect the GAMMA oligopoly of AI?
GAMMA has such a head start and is now (OpenAI at least) trying to pull the ladder up through self-regulation that it leads me to believe that open source will not have the resources (GPUs/TPUs/energy) needed to ever catch up fully. The fact that Zuckerberg is so pro-open source kind of confirms this, as his LLaMa model is leagues behind OpenAI, therefore he is trying to flatten the market, hope someone develops something cool, and then probably try to acquire it. There are rumblings that you can run some very good models on just a smart phone, but I am skeptical of how good those can actually be. I think it comes down to use cases. For small/simple use cases, a small open source model than you can run yourself on your phone's processor might be totally adequate. But my gut says, until we get a several-fold increase in processing power coupled with a reduction in energy costs, open source won't be able to do any of the cool stuff, like replace doctors/lawyers/analysts etc. Thanks for the comment!