Yeah, there’s a lot of innovation going on to run powerful models on modest hardware and the state of the art for running local models is changing all the time. If the trend continues, models hosted in a data center will only be for niche use cases.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments