This past week, OpenAI dumped a staggering trove of answers to elusive math problems solved by its internal artificial intelligence models – the mathematics world isn’t happy about it. “What are they trying to achieve? I don’t know. They’re just destroying early-career mathematicians with a PR stunt,” says NYU math professor Tristan Buckmaster. Buckmaster and his collaborator Levent Alpöge had made significant progress on solving an historic math equation before OpenAI’s model beat them to it. They’ve “destroyed the whole incentive system for science and mathematics.”

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 89 points 1 day ago* (last edited 1 day ago) (7 children)

The most interesting bit in this interview for me is when Tristan Buckmaster explained how OpenAI stole his PhD students' work: the students didn't even have to use a LLM. All they had to do was apply for a grant for their work, and for whoever reviewed the grant to write the summary using ChatGPT, and hey-presto, OpenAI got the outline of their work in progress to feed to their model and front run them.

I'm going to make my company's CTO watch this. He thinks our software is safe because the company uses paid models and the contract says the material submitted to them won't be used to train other models - and he believes it...

  • source
  • hideshow 7 child comments
  • [–] 35 points 1 day ago (4 children)

    I've been bringing this up to my bosses, they do not care at all.

    In my opinion, employers are so high on a prospect of letting employees go in a "near" future, that they are completely okay with liabilities way bigger than hiring workers is right now. No idea why they would ignore such direct existential danger for their companies.

    Short term thinking probably.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 24 points 1 day ago

    I really wonder if they don't understand that they change from a distributed dependence for labour to a single dependency for labour and what that means for their position in their eco system.

    Dear boss, 50 people won't strike or leave the company all at once for no reason at Monday 9:38am. Your ai overlords might decide change the terms of the contract randomly on a Monday morning and there is nothing you can do. You had effectively a crown and gave it away.

  • source
  • parent
  • [–] [S] 16 points 1 day ago (1 child)

    My company is not like that. They care about the employees. It's actually written in black and white in the company's charter: the purpose of the company is to do good by its employees and the community it operates in.

    I've brought up my concerns about AI before and they've reacted: they invested in machines capable of running models locally for the engineers (I have one on my desk) and they formed a committee on AI safety and building local infrastructure to untie ourselves from the big cloud AI providers.

    My company is one of a rare few such companies. Most other employers are like yours. Yet as good as mine is, AI is like cocaine to those who use it and to the bean counters: they know it's bad but they just can't stop.

  • source
  • parent
  • hideshow 1 child comment
  • No idea why they would ignore such direct existential danger for their companies.

    Risk Management (that's what they named the LLM after they fired the people responsible for that) is probably telling them that there will be a huge pool of willing applicants to work for less money than the people they let go, that talent is fungible, etc.

    The real fun part is when people start asking for hiring bonuses to come in and unfuck the company slop. They won't start trying to hire people until they start losing customers which means the quality of the product is lower than it was when they took on the customer. If it takes them longer to fix their codebase than it would for a competitor to start from scratch and outdo them on marketing or advertising, then they'll go under.

  • source
  • parent
  • [–] 3 points 1 day ago

    ...the contract says the material submitted to them won't be used to train other models - and he believes it...

    This is what I just don't get, that people trust major companies when they claim to not analyze or use your data in any way they can once you have uploaded it to them.

    It is a simple equation, how much does the actual breach of contract cost, how likely is it that we get sued and loose, and how much better will our models get by analyzing and training on everything?

    Unless you can honestly say that a huge corporation like Microsoft/Google/Amazon would pay more to you and every other customer for missusing your data than they will earn by improving their models on all their customer's data, you can't use proprietary data in an LLM/AI.

    I miss the old network shares, now it is all OneDrive and SharePoint, it sucks.

  • source
  • parent