Basically a deer with a human face. Despite probably being some sort of magical nature spirit, his interests are primarily in technology and politics and science fiction.

Spent many years on Reddit and then some time on kbin.social.

  • 0 Posts
  • 36 Comments
Joined 8 months ago
cake
Cake day: March 3rd, 2024

help-circle

  • I’ve found my participation slowly declining here on the Fediverse, and ramping back up again on Reddit. I think I’m never going to stop coming here entirely, there’s plenty of neat links that come along to explore, but the main thing that’s causing decline is that IMO the communities here are a lot “bubblier.” It’s probably inherent in the simple fact that they’re small, and that they’re populated by a very self-selected fragment of social media, but the result is that if I “say the wrong thing” I get pummeled with downvotes and snide comments a lot easier here. Makes it less interesting to comment at all. Some of Reddit’s communities are pretty insular too but at least there are enough of them that I can find ones to my taste.

    As a major example that comes to mind, all of the technology communities I’ve found here seem to be quite strongly anti-AI. I have an interest in AI, but when I click through to the comments on stories about AI topics it’s often nothing but rants about how awful it is. And if I say anything - even to correct a factual error - I get piled on. So lately I just sigh and move on.


  • There have been many systems developed over the years for handling decentralized data storage, decentralized user identities, and decentralized decision-making. There are excellent options out there for all this stuff.

    IMO the problem is that there’s a huge “not invented here” problem, combined with a popular “ew, I don’t want to be associated with that technology (or more accurately with the group behind that technology)” reflex that has nothing to do with the technology itself. So projects like the Fediverse keep reinventing the wheel over and over, and whenever a project manages to do something right it’s rare for the other projects to abandon their own implementations to borrow from the best.




  • My point is that if we turn up our gibberish dial now then at least our llms will be learning the wrong thing & we have some control.

    We’d be covering ourselves in poop to prevent people from sitting next to us on the train. Sure, people will avoid sitting next to us, but in the meantime we’ll be covered in poop.

    And then other people will learn the trick, cover themselves in poop too, and now everyone’s poopy and the trick stops working.

    There is still a lot of understanding that we do automatically that an llm will never do.

    Are you willing to bet the convenience of comprehensible online discourse on that? “Automatically understanding stuff” is basically the one job of LLMs.

    LLMs model language, and coming up with some kind of “gibberish” filter is simply inventing a new language. If there’s semantic meaning in it the LLMs will figure it out just like any other language, and if there isn’t semantic meaning then we’ve lost the ability to communicate entirely. I see no upside.


  • Well, the “at least for now” part is my point - if people start using “gibberish” to communicate or to hide their communication, that provides training material for LLMs to let them figure out how to use it too.

    LLMs learn how to communicate based on existing examples of communication. As long as humans are communicating with each other somehow then LLMs will be able to train how to do that too. They have the same communication capabilities that we do at this point, so there’s not really any way we can make a secret clubhouse that they can’t figure out how to infiltrate.

    Personally, I think there’s two main routes we can go to deal with this. Either we can simply accept that there’s no way to be 100% sure we’re talking to a human any more and evaluate the value of our conversation based on the content of the words spoken rather than the composition of the entity generating them, or we could come up with some kind of “proof of personhood” system to allow people to label the text the write as coming from them.

    The latter is extremely hard to do, of course, both from a technical and cultural perspective. And such a system would likely still allow someone’s “person token” to be sneakily used by AI, either by voluntarily delegating it (I could very well be retyping all of this out of a ChatGPT window) or through hackery.

    So I’m inclined toward the former. If I’m chatting with someone and I’m having a good time doing it, and then later I find out it was a bot, why should that change how much fun I had?


  • I don’t see how that would be practical. People who aren’t “in on the joke”, as it were, will call out the gibberish and downvote it. If enough people are “in on the joke” then the whole forum becomes useless and some other forum will be created to fill the role of the original. The AI will train off of that one.

    Basically, if you don’t want an AI training on your content, then don’t post your content in public where an AI will see it. The Fediverse is the last place you should be posting since its very nature is about openly broadcasting your content to whoever wants to see it.