• 0 Posts
  • 7 Comments
Joined 2 months ago
cake
Cake day: May 20th, 2024

help-circle



  • It really depends on what model you want to run and how much training is bundled with it. You can pretty much run any model if you have enough disk space but of course GPU + VRAM is preferred for a ChatGPT like fast response. Otherwise, running on an older CPU and RAM is going to be noticeably slower, especially with complex models with a lot of training data to trawl through.

    There are some pretty lite models out there but the responses will be more barebones and probably seem ‘less informed’.

    Give GPT4All a try for your first time. It makes install, configuration and usage point-and-click while being fairly straight forward. For the presented/featured models, it presents a small summary and VRAM recommended, though there are many, many other models available from inside the UI.


  • Not that I’m defending it but the data and the model itself on Recall stays all local and encrypted, according to Microsoft. It also says it won’t use it for ad targeting or will sell the data. Of course, the caveat is that is what they are saying right now and may not be saying in the future. We’ve obviously seen strategies where gradually things move down the spectrum as it continuously normalizes.

    With MS we’ve seen the “Start” menu advertise Candy Crush forever and then “recommended apps” and it isn’t a far step to show “sponsored recommended apps” and then just “sponsored content” as things continue to become more normal for everyone, especially if its for the “Home” version or whatever. People will just argue to pay whatever for a Pro license.

    Going to full blown ads now though? It’ll piss the consumer off. Do it gradually over a decade? There will be some rumblings, sure, but it probably won’t matter. By then they might be able to give you a “free” cloud VDI (with lots ads from the OS) with less ads and CPU/GPU power based on subscription tiers and you just need to buy a cheap $30 thin client and everyone will just be OK with that.


  • For those that don’t know, they are going to release something called FreeLlama which might be FOSS (no public info as to what the license actually will be).

    Winamp says that they still want to control ‘what features’ go into winamp and it’ll remain proprietary. I assume they really just want people to contribute interesting things to FreeLlama and then put the contribution into Winamp.

    The license probably won’t be FOSS because they probably aren’t going to want anyone contributing to own copyright to the code that they are committing.

    It is odd because FOSS contributors aren’t really known for being OK with this sort of thing in the past, so I doubt they’re going to get much out of it. Maybe it’s a Hail Mary and they’ll end up blaming people for not freely giving up their devtime and creativity to a company that wants to make money on it.