Paywall removed: https://archive.is/MqHc4

you are viewing a single comment's thread
view the rest of the comments
[–] 14 points 2 years ago (6 children)

China has a huge advantage in AI models because of how lax they are on intellectual property rights. US companies are fighting over API licensing costs, while china is just going to scrape everything and use it for free.

The US has a lead now, but I don't think they can maintain it without giving up on ethical training. Then again it may not matter if the US models are ethical if everyone will eventually just uses the superior unethically trained chinese models instead.

  • source
  • hideshow 6 child comments
  • [+] 20 points 2 years ago* (last edited 11 months ago) (3 children)
  • [–] 5 points 2 years ago (2 children)

    I mean, they are right. Asside the question of whether we can even make meaningfully better models by just using LLMs and more data and what the future of AI will look like, and whether it's ethical or not to steal the data, it is quite possible that OpenAI and the like will get into legal trouble because of the methods they use for acquiring data, but Chinese companies won't have to worry about that. If more data = better models then China has an obvious advantage.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 10 points 2 years ago (1 child)

    The US companies already scraped the data while they could. If anything, data scraping is far far more difficult now for everyone due to technical reasons.

    Most of the new models are trained on synthetic data or higher quality of data or with RLHF. The reason deepseek is able to perform is likely because LLMs are very very new things, there are many low hanging fruits. Its no longer just about the data we already hit that limit for quite some time.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 2 years ago

    Honestly, even from the beginning it's pretty obvious scraped data is going to have a ton of issues. There's too much nonsense out there, both from misinformation and people just not able to communicate.

    That's before you get into the ethical aspects of stealing other people's content and the way these things are being misused.

  • source
  • parent