• 26 Posts
  • 136 Comments
Joined 6 years ago
cake
Cake day: June 30th, 2020

help-circle









  • FrankLaskey@lemmy.mltoOpen Source@lemmy.mla foos GenAi tool for daily usage
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    17 days ago

    I would check out Open WebUI which can be self-hosted via docker etc and configured with any OpenAI compatible endpoint so you can use a service like OpenRouter to run nearly any LLM remotely. Most of the open weights ones like Qwen 3 or Kimi K2 Thinking are great and cost pennies per inquiry and can be configured with Zero Data Retention (ZDR) so your data is not recorded. You could also use something like Ollama to run local LLMs if you want even more privacy and have the hardware (typically a modern Nvidia GPU with at least 16-24 GB of VRAM).








  • Technically, yes the info would be available but not everyone is able to read code so this is a welcome additional bit of info and transparency. I also see it as an example of how future open source social media platforms can promote and demonstrate the way their algorithms work as opposed to the black boxes of proprietary web apps like Instagram etc (which, while not algorithmically transparent or open, have been pretty well established to have algorithms that prioritize maximizing time on platform and engagement over all else with some serious negative repercussions for that).




  • Much of this reads like what the Democrats’ strategy has already been for the last 10 years or so with some additional calls towards a “moderate” “centrism” that has not proven to be as popular as left populist policies with most Americans. And a lot of it seems confused or just wrong. For example, Medicare for All is not an unpopular policy. Last I checked it it was polling at around a 60% approval.

    Even if your politics are more centrist, I don’t see how this represents a substantive shift in any way. It’s minor tinkering around the edges or slightly altering messaging. That’s what the moment calls for? That’s the key to success and the way to fight back against an increasingly overt and ascendant strain of fascism in the country? If that’s what the Democratic leadership thinks then one must honestly wonder if the party is institutionally incapable of the change that would need to happen to actually win elections and improve their godawful approval ratings. And based on their donor base, this shouldn’t actually be surprising. The leadership is still utterly captured by and beholden to wealthy interests that would rather jump off a bridge than acknowledge that what Americans want is a party that will fight for meaningful material benefits in their standard of living as this implies meaningfully raising taxes and imposing costs or regulations on their businesses to ensure benefits for regular working class people who are struggling mightily.

    .







  • Yes, I do local host several models. Mostly the Qwen3 family stuff like 30b a3b etc. Have been trying GLM 4.5 a bit through OpenRouter and I’ve been liking the style pretty well. Interesting to know I could just pop in some larger RAM dimms potentially and run even larger models locally. The thing is OR is so cheap for many of these models and with zero data retention policies I feel a bit stupid for even buying a 24 GB VRAM GPU to begin with.