As I pointed out in another root comment, the average - depending on the model being tested - tends to sit between 60% and 80%. But this is with no restriction on source materials… the LLMs are essentially pulling from world+dog in that case

So this opens up an interesting option for users, in that hallucinations/inaccuracies can be controlled for and potentially reduced by as much as ⅔ simply by restricting the model to those documents/resources that the user is absolutely certain contains the correct answer.

I mean, 25% is still stupidly high. In any prior era, even 2.5% would have been an unacceptably high error rate for a business to stomach. But source-restriction seems to be a somewhat promising guardrail to use for the average user doing personal work.

How much do large language models actually hallucinate when answering questions grounded in provided documents?

Okay, this is looking promising, at least in terms of the most important qualifications being plainly stated in the opening line.

Because the amount of hallucinations/inaccuracies “in the wild” - depending on the model being tested - runs about 60-80%. But then again, this would be average use on generalized data sets, not questions focusing on specific documentation. So of course the “in the wild” questions will see a higher rate.

This also helps users, as it shows that hallucinations/inaccuracies can be reduced by as much as ⅔ by simply limiting LLMs to specific documentation that the user is certain contains the desired information, rather than letting them trawl world+dog.

Very interesting!

ANYTHING cloud-connected - your doorbell, your security system, even all f**king post-2006 vehicles, regardless of manufacturer - are suspect.

And are highly likely to be actually spying on you.

I’ve been working with computers since 1982, on the Internet since 1988, on the Web since 1992, and in the IT industry since 1997. The proportion of average people who don’t realize how much of their stuff is exposing them, and by how much, is frankly astounding. It’s almost 100% of normies who are woefully ignorant. Even IT people who have no clue is in the majority.

And the security on this stuff that tracks you tends to be - except in rare circumstances - absolute dogshite. Sometimes it comes without any security at all, such as all devices sold having admin creds baked in, or all remote-access credentials being identical and non-user-editable.

This is why almost all of my stuff is hardlined, I have no IoT devices at all, and the wifi for my family’s devices is physically separate from everything else.

Don’t get me wrong, as IT for almost three decades I love all the new shinies. But I’m not blind, and I’m not stupid.

I don’t know how valid it is these days, but when I was last in Germany in 1989, I asked my much older cousin about automatic vehicles.

Conceptually he knew what they were and that Americans drove them, but aside from large commercial vehicles - and it was rare at the time even there - he had never come across a consumer vehicle with an automatic transmission in his life. Like, everything at the time was stick and three pedals on the floor. Everything. If you wanted an automatic it had to be special-ordered and shipped in at significant expense from America or something like that

…The fuck?

Is Tim Sweeney legitimately outing himself as a pedophile? Does the Parasite Class really feel so comfortable and immune from consequences that they can openly advocate for pedophilia?

Sooo… he works multiple part-time jobs?

Weird how a forced technique of the ultra-poor is showing up here.

Just don’t take away passwords + TOTP 2FA for those of us who are actually using it correctly.

This looks small enough to be installed within the wheel hub itself. Imagine a car with four motors, one inside each wheel. The entire floor pan could just be one thin battery, and everything above it could be passenger and storage space.

“If you think you can intimidate us, tough luck. We will never let our beautiful country be taken away by extremist troublemakers,” the party’s leader, Rob Jette, wrote on X.

Oh, the irony.

Aside from the Rotary Un-Phone, there are pretty much no dumb phones anymore. Those that market themselves as dumb are just reskinned full-fat platforms.

Even almost all flip phones are smart phones with a dumb skin, as they run either Android or KaiOS.

The main reason why I would switch is for device security - a true dumb phone OS that operates purely out of the ROM and has no ability to install anything that could survive a reboot.

And for something that primitive, it would be a flip phone on par with the Motorola StarTac. Simple black-on-green screen, low-res display, with a calendar and address book as the only non-phone, non-SMS functionality.

Once again we see the Parasite Class playing unethically with the labour/wealth they have stolen from their employees.

“Microsoft Excel is testing a new AI-powered function that can automatically fill cells in your spreadsheets.”

Every year, Microsoft gives me more reasons to permanently leave their products.

Unfortunately, due to compatibility with financial and other Windows-only software I still need to run Windows, but I am down to two rigs and it might go down to one in the new year.

I would love to see Europe ban/block the API endpoints that AI communicates over.

Then ban all Meta endpoints if/when meta moves AI communication onto the same endpoints as non-AI communication.

European laws are not perfect, but they at least make an effort to put the needs of the people ahead of corporations and the Parasite Class.

Markup pro tip: to have multiple separate lines appear as a single large block quote, insert the quote signifier (>) into the blank newlines between them as well.

so this

is one giant

block quote

despite the newlines.

I have been using the same web browser, in terms of ideology, codebase and heritage, since the release of NCSA Mosaic.

That was 32 years ago. And holy f**ck, that dates me.

Sure, I dabbled around with others. There was the original Opera, back when Netscape cratered and the only other real option was IE. Opera’s tab behaviours made me install Tab Mix Plus for FF, and I still find that extension to be the second-most critically important extension FF has, right after UBlock Origin.

And lately I took a shine to Vivaldi, but I have been weaning myself off of it once I realized that the Manifest v2 shutdown was unavoidable for it as well.

And the only reason why I even have Chromium is as a sandbox for any Google services I access and as a “naked” web browser for those websites who implement malware and spyware in the name of “website security”. Which, of course, also means a majority of websites that are “protected” by CloudFlare’s incredibly hostile anti-user practices.

And of course, I also run forks, such as Librewolf and others, also with the appropriate anti-malware and anti-spyware add-ins. It can be useful having multiple web browsers up at once.

But my main will always be Firefox.

I love how the Streisand Effect works. They just made this app the hottest thing out there.

I don’t have a problem with actual pedophiles that are caught in these dragnets.

My problem arises from the lack of rigorous and well-documented investigation into the target before shite starts popping off. As the article pointed out, there is nothing wrong with a 22yo dating an 18yo. And the problem here is a sense of vindictiveness trying to manufacture targets where not all targets are guilty of pedophilia.

So: you want to take a pipe wrench to warm over a pedophile? Make sure there is oodles of evidence that clearly and unambiguously makes the person a pedophile, and sure as shite I will look the other way. But the problem is that there is no self-reinforcing framework in place within the vigilante system to ensure and enforce this threshold of evidence. And without this system, innocent people are going to get hurt or killed.

Canada might need these sooner rather than later.

With the breakdown of democracy and the rule of law in America, the Constitution just became wholly unenforceable and therefore irrelevant. That means that Trump could make good on his fever dream of invading Canada.

And there are many Americans who would jump at the chance to obey his command to slaughter Canadians. With only 40M against America’s 334M - and 0.097M military personnel against America’s 2.1M - it would be absolutely no contest.

Our only way of making such a fascist act of aggression as painful as possible would be with asymmetrical warfare using tiny, hard-to-defeat drones that could act independently and strike without warning. Deploy 10k of these suckers onto a battlefield, and the only survivors would be those within sealed armour or flying at high altitude. Because even an A10 Warthog loitering low over the field can be taken out if it unexpectedly ingests a half-dozen of the explosive buggers.

If it wasn’t for Marketplace, I would be off Facebook entirely.

But I am not on threads at all, and only get punted over to Instagram with reels that appear on my Facebook account.

“Trickle down economics only occurs when the wealthy bleed.”

Similar, and appropriate. The working class will only benefit once the wealthy are no longer wealthy.