Wait, I thought the provenance of the proof is still disputed? There's a mathematician in NY saying he used OpenAI to develop his Navier-Stokes ideas. And OpenAI's proof is suspiciously similar.
At this point, how can we tell whether AI is improving or it's just reappropriating its users work? It's probably a bit of both. But still, thick milky.
Buckmaster (the mathematician) and Alpöge used and credit AI substantially for their proof. Even if OpenAI did copy their ideas, it still wouldn't show that this didn't come from AI improving.
OpenAI's proof is substantially different and I don't think anyone has claimed otherwise. The accusation is that they used the same avenue of attack, and it's an uncommon one, and that makes it suspicious that they may have taken the idea.
There are several cases of this already. Bubeck himself had to retract earlier claims of novelty, and more recently, the provenance of the non-sofic group result was brought into question. Most recently, it turn out that the construction used for Anthropic's counterexample to the Jacobian Conjecture had appeared in an unpublished but publically available draft: https://news.ycombinator.com/item?id=49657499
This has a few practical implications: First of all, if you are in the target group of the marketing material, be wary. While these things can do non-trivial stuff, the amount of magic is being grossly over-stated. But also, when several of the big results have indeed been reappropriating the work of others; when the companies fail to provide proper attribution (the NS case in particular is laughable) and present the results as the models' own work, that's plagiarism.
At this point, how can we tell whether AI is improving or it's just reappropriating its users work? It's probably a bit of both. But still, thick milky.