• 0 Posts
  • 14 Comments
Joined 3 years ago
cake
Cake day: July 3rd, 2023

help-circle


  • The article is not clear on what a “distillation attack” is… what exactly is Alibaba supposed to be getting away with here? The article mentions using many different connections through obfuscation networks and proxies… so that would get them around rate limiting, and maybe enable them to submit many queries on free accounts… just spin up a new account whenever you hit the token limit of an unpaid account. So basically it’s a terms of service violation?

    I don’t see why it’s necessarily a huge leg up for a competitor… they are just using the outputs of another model as training data. They still need to train their model, which is the expensive and energy intensive part.

    It sounds to me like Anthropic just wants the US Government to help enforce its TOS internationally and force Alibaba to pay for those precious tokens? Because apart from that piece, the “attack” just seems like normal use of the service. If Anthropic’s service has an inherent vulnerability, that’s their problem.

    Of course all the other comments about how they stole all their training data in the first place are spot on.








  • The idea of LLMs putting coders out of work at a large scale seems inherently self-defeating.

    The LLMs needed to ingest a massive volume of code to get to their current level of proficiency. What will happen if they put all the coders out of work and Stack Overflow is down to just a small number of hobbyists? Will the LLMs just stop advancing?

    I’m sure Sam Altman would say they are just about to have reasoning capabilities that will allow them to improve. But Sam Altman is not credible.