I'd love a way to do this locally -- pool all the PCs in our own office for in-office pools of compute. Any suggestions from anyone? We currently run ollama but manually manage the pools
If you set CPUSchedulingPolicy=idle Nice=19 IOSchedulingClass=idle in the ollama server configuration it should run in the background with lowest priority.
Seems like so much more work than "just" paying for https://huggingface.co or whichever other neocloud who already did all the setup for you and just waits for your credit card per minute/seconds/token.
Doubt this kind of workloads would agree to send data then to a cloud of randos devices, precisely when cloud providers to certify they aren't looking at clients data (Customer-managed encryption keys, CMEK).
I can attest to this. Ultimately I dont think it is possible to 10x output systems with AI and actually keep the traditional quality controls (yet.)
IMHO you just need two stacks -- systems where you can play fast and loose and 10x output. And systems where quality matters where you can perhaps 1.5 or 2x. That is still a lot of output.
>> I've had three main tracks that I've used for the past 8 months or so.
I've had several dozen songs (grown from ~5 in 1998) that I've used for almost 28yrs. They were originally mp3s, eventually cds, then apple music. I'm glad the artists have been getting royalties on the songs, i play them on loop sometimes for hours a day for decades on.
I play that song too while programming (along with several dozen others on a dedicated programming playlist). Eventually it goes into the background and just covers up outside noise. Some key moments are noticed -- i stop looking at my screen, repeat after the singer, and then go back to working five seconds later.
No idea if this is the case anymore, but many NY Public Libraries had "Stacks" where they kept lots of magazines going back to the 1970s. I havent checked for at least a decade, but that was a lot of fun -- we'd go there and look at old computer ads from the 1980s. They would have a binder per decade -- giant thick binders.
Ss it just me or did Microsoft never actually fix/figure out their account merge? I found that anyone who had a legacy skype/hotmail account basically got locked out once Skype/Hotmail/Outlook.com all merged. Multiple frustrated message threads online complained about this and from my personal experience it never got fixed. Basically two out of three accounts became inaccessable.
That was when I completely left that ecosystem, Office 365, everything. It was literally impossible to log in. Not surprisingly, the Office 365 bills continued to charge even though accounts were inaccessible. To this day, i'm far too scared to even attempt to use Azure on a personal account for this reason.
For a long time I used my Gmail account as my Microsoft account somehow. So my login ended in Gmail.com. At some point like 2015 I realized it had been merged with outlook or something and now I had an outlook mailbox that had a Gmail domain, along with my actual Gmail mailbox. I got locked out once and it took me days to figure it out.
Got so confused about it I decided to close that MS account and get an outlook one. I don’t even know if it’s active or what it was for anymore.
Well you are lucky if you were able to dump the account. For me, I had Skype credit, monthly billings, and tons of contacts -- all gone in a botched post-merger integration. Definitely makes me never go back to that ecosystem ever again.
No indy hedgefund algotrader gives away their golden goose, that would crowed out the trade.
reply