GET IN THE ROBOT BUTLER SHINJI!

topologically I only see 2.5 options here.

I don’t think anything I wrote has bearing on this being a bubble or to what extent other than it’s clear that what we have now isn’t what those working to get people to invest further in the bubble claim it to be.

Usually when people are out there claiming it’s not a bubble is just before it pops.

I use arch btw.

I mean they aren’t a technological dead end just as they aren’t a technological panacea.

You can absolutely use them as coding assistants. They can be used to fool people, sometimes quite effectively. There is definitely “something” going on under the hood even if we don’t want to use words traditionally applied to the human experience like"learning" or “intelligence”. There is a surprising amount of consilience in current models, where you train to get good at task A, but also get good at task B, for no obvious reason.

It’s clear to me no amount of paper mache smearing over the half-glass of wine issue fixes it. There is something fundamental to the “gappiness” present in llms both knowledge set and appearance of logic. It’s becoming clear this is something intrinsic to the architecture and gluing in hot fixes isn’t going to change that. There is some very real underlying weirdness (sea horse emoji). Context windows still only create the mirage of global states (and maybe with a large enough window this doesn’t matter (relative to a human perspective). It’s also clear that nothing about llms or transformers overcomes basic principles of entropy or information theory: you can’t just model noise like some kind of infinite training cheat code.

From where we were (lstm’s) to where we are, they are easily a 100x improvement. ML now is MUCH better than ML 10 years ago, and it has everything to do with transformers.

When llms came into the scene, attention and transformers were not new. but it was a new approach to training them, and creating some clever things to get them to generalize, along with making them utterly massive. But “Attention is all you need” had been published quite a while before this generation, and I promise, if Google has seen the potential, they would not have released that research.

There will be stepwise and generational improvements to AI and ML. even though transformers are what broke through to the mainstream, the progress is much more linear and continuous than it might at first appear. So we shouldn’t expect transformers to be the end state, nor should we expect the next major jump to come from them, or even necessarily something novel. it may be the tools for the next big jump are already here, just waiting to be applied in a clever way

Having been gaming on Linux for the past 10 years and facing basically 0 issues, I can also affirmatively I don’t understand the attachment to windows. I get it if you need specifically word or excel. and I guess if you’ve got kids who want to play fortnite.

this is an opinion that gets strongly hated on, but I believe the marvel rebuild of the past 15 years can be directly attributed to this.

Trump’s cabinet probably:

Oh shit its the CEO.

fuck shit fuck shit everyone look bussy

The entire world rapidly moving into an electrified future based on renewables:

piccolo theme?

I think for me its about being around fellow travelers. I’ve been on the internet for a while. Started commenting forums, then in political threads via craigslist. Then fark, digg, reddit. Users and commenters made those places, and when one went to shit, we just moved along to the next.

I have to say that I think I truly see the fediverse as a place to build a home. It meets my values where they are, and I don’t have to make compromises.

And I think my fellow travelers would agree, if this place goes to shit, we’ll vote with our feet.

Data centers in the ocean didn’t work out. This doesn’t seem smarter

1 cup black coffee, 2 pieces black chocolate, 5 figs.

consume orally before 6 am.

Well, there you are then.

One liter?

That’s like, barely enough for a brief hike. Minimum 20 liters a head.

More like genocide or mass murder.

It’s the destruction of something a human can never create.

yeah but movements take time to build. BLM had almost a decade of build up before 2020.

Obviously we need to speed run this but also things start “somewhere”. The police assaults and response to the BLM protest of 2019 and 2020 did more to radicalize normies than anything has previously. Like, more people understand the contradictions of this country than ever before