I won’t touch the proprietary junk. Big tech “free” usually means street corner data whore. I have a dozen FOSS models running offline on my computer though. I also have text to image, text to speech, am working on speech to text, and probably my ironman suit after that.
These things can’t be trusted though. It is just a next word statistical prediction system combined with a categorization system. There are ways to make an LLM trustworthy, but it involves offline databases and prompting for direct citations, these are different from Chat prompt structures.
I just got a Llama 2 70B LLM (offline chat AI) working on my laptop. That is a much larger (smarter) system than I thought was possible on a laptop. It takes every bit of 64GB of RAM, and it is about as fast as AOL instant messanger on bad 56k dialup, but it works.
I think I also fixed my problem that stopped me from using text to speech AI. Now I just need to figure out speech to text, get a few billion dollars, and make an iron man suit.
The best years of YT before 2017, there was an advanced maker and DIY tech culture revolving around people sharing projects and content just to share it. That died. This all pro CC thing has an up side to some extent, but it also lobotomized YT. Peertube might eventually get to the same kind of utility level, but it needs a lot of time and momentum to get there.
I loved Dread and Prime 2. I tried playing Super Metroid on switch, but the controls are just too poor to pull off the advanced combination moves with the slow low quality emulation. I’m disappointed that there are not a dozen Metroid titles on the switch. Everything in the Prime series should be ported.
I’m mostly referring to the long hiatus(es) before Dread, and all of the nonsense from developers other than Retro Studio. I understand they were probably in a funky position when it came to writing and coding for a new 3D engine after all of the Prime series had played out the life of the prior engine. IMO, the entire SDK for Nintendo hardware should account for key franchise titles like Metroid. These games should have story boards and plans from first light of new hardware. The plans should always include classic titles too. My biggest complaint about Nintendo is the low quality of most titles on the platform. They are too focused on recruiting developers instead of quality games. Sure there are some great games like BotW, TotK, and Dread, but I’m not going sifting through all the junk in their store to try and find anything else worth playing. I got a couple of titles that a lot of people recommended, and hated them with no recourse and they cost as much as good games. I would have paid for and played all of the Prime series if it had been ported, but Nintendo totally fails at maintaining their legacy titles effectively. It is this lack of availability now, and the stupid fumble of letting extra developers with their own forked vision into the franchise that I am calling a fumbled opportunity.
Yeah but MG is WAY older @ 1987 vs GoW in 2005 and ES in 1994.
Metal Gear Solid was one of the best games on the original PlayStation. I haven’t been into consoles since the PS2. Metal Gear Solid was so good compared to anything else at the time, the idea it is only at 60M now, seems like a major fumble and lack of management. I guess it is like Metroid for being underdeveloped or given to idiots “with a new vision” like in the case of Metroid.
Fire fox, Fire fox;
Fuck you Google;
We’re throwing rocks.
Alpha bet, Alpha bet;
Farming data is,
stalking/theft.
Have you seen the great gatspy with Wizard too? That’s what always comes up when mine goes too far. I’m working on compiling llama.cpp from source today. I think that’s all I need to be able to use some of the other models like Llama2-70B derivatives.
The code for llama.cpp is only an 850 line python file (not exactly sure how python=CPP yet but YOLO I guess, I just started reading the code from a phone last night). This file is where all of the prompt magic happens. I think all of the easy checkpoint model stuff that works in Oobabooga uses python-llama-cpp from pip. That hasn’t had any github repo updates in 3 months, so it doesn’t work with a lot of newer and larger models. I’m not super proficient with Python. It is one of the things I had hoped to use AI to help me learn better, but I can read and usually modify someone else’s code to some extent. It looks like a lot of the functionality (likely) built into the more complex chat systems like Tavern AI are just mixing the chat, notebook, and instruct prompt techniques into one ‘context injection’ (-if that term makes any sense).
The most information I have seen someone work with independently offline was using langchain with a 300 page book. So I know at least that much is possible. I have also come across a few examples of people using langchain with up to 3 PDF files at the same time. There is also the MPT model with up to 32k context tokens but it looks like it needs server machine ram in the hundreds of GB to function.
I’m having trouble with distrobox/conda/nvidia on Fedora Workstation. I think I may start over with Nix soon, or I am going to need to look into proxmox, virtualization or go back to an immutable base to ensure I can fall back effectively. I simply can’t track down where some dependencies are getting stashed and I only have 6 distrobox containers so far. I’m only barely knowledgeable enough in Linux to manage something like this well enough for it to function. - suggestions welcome
Pee-wee, Mr. Rogers, Sesame Street, Bozo, and Reading Rainbow are some of my fondest memories; when we were all Pee-wees, and he was Herman.
WizardLM 30B at 4 bits with the GGML version on Oobabooga runs almost as fast as Llama2 7B on just the GPU. I set it up with 10 threads on the CPU and ~20 layers on the GPU. That leaves plenty of room for a 4096 context with a batch size of 2048. I can even run a 2GB Stable Diffusion model at the same time with my 3080’s 16GBV.
Have you tried any of the larger models? I just ordered 64GB of ram. I also got kobold mostly working. I hope to use it to try Falcon 40. I really want to try a 70B model at 2-4 bit and see how its accuracy is.
This is how I use the internet.
Cookies are not needed. They are shifting the security onto the user. Secure the information on the server just like any other business. Offloading onto the client is wrong. It leads to ambiguity and abuses. Visiting a store and a business on the internet are no different. My presence gives no right to my person, searches, or tracking in the location or outside of it. Intentions are worthless. The only thing that matters is what is possible and practiced. Every loophole is exploited and should be mitigated. The data storage and coding practices must change.
Nah, it should be the default state of affairs. Data mining is stalking and theft. It centers around very poor logic and decisions.
Things like browser cookies are criminal garbage. Storing anything on a user’s computer is stalking. Draw the parallel here; if you want to shop in any local store, I want you to first tell me everything you are wearing and carrying in a way that I can tell every possible detail about it, tell where you came from before you visited this store, where you are going next. They also want to know everything you looked at, how you react to changes in items presented to you and changes in prices. They want enough information to connect you across stores based on your mode of transportation, and have enough data to connect your habits over the last two decades.
Your digital existence should not be subject to slavery either. Ownership over ourselves is a vital aspect of freedom. Privacy is about ownership and dominion. If you dislike all the digital rights management and subscription services nonsense, these exist now as a direct result of people neglecting ownership. In the big picture, this path leads all of humanity back into another age of feudalism. The only difference between a serf and a citizen is ownership over property and tools. Everything happening right now is a battle over a new age of slavery. “You will own nothing and you will be happy about it.” Eventually this turns into 'Your grandchildren will own nothing and say nothing or they will be dead about it." What you do about your privacy now will be a very big deal from the perspective of future generations.
Hey there Lionir. Thanks for the post. Can the Beehaw team please look into copying or getting the creator of this bot to work here? https://lemmy.world/u/PipedLinkBot@feddit.rocks
I think the person that created that bot is somehow connected to the piped.video project. I know the whole privacy consciousness thing isn’t for everyone, but this bot’s posts are quite popular elsewhere on Lemmy.
FYI, the main reason to use piped.video links is that it is setup as an alternative front end for YT that automatically routes all users through a bunch of VPNs to help mitigate Alphabet’s privacy abuses and manipulation.
It actually took me getting so sick from eating bad that stuff like fast food has become repulsive. I managed to keep the repulsion as a kind of mental block. I spent almost 2 years riding 300-400 miles a week. When you need ~4k+ calories just to break even every day, the quality of those calories starts to matter quite a lot. Anything low quality that tends to sit in the gut for too long will cause major issues long term. Like I could feel eating anything from Macdonald’s for 2-3 days. I don’t know how they are so bad but even a salad was bad news. The one that made me say never again was their frozen coffee drink thing. Even that cost me days of misery. My most fundamental food rule is to only eat stuff that looks like it grows.
Dairy seems far harder than it is in practice. If nothing else, try seeking out vegan deserts. They really can be just as good and in many cases better. They usually have much better quality ingredients and you’ll feel better for the subsequent day or two after, especially if you tend to have something sweat in the evening.
I discovered that just getting off of dairy made a massive difference in how I feel daily. It takes a few days after stopping dairy consumption for the difference to become noticeable, then a few weeks to a couple months before it makes major changes. The effects are probably difficult for most people to detect, unless they eat dairy and notice the effects directly after.
I am partially disabled from a barely-survived hit by a couple of cars while riding a bicycle to work. Unfortunately, I don’t have a single major physical failure point but instead a whole lot of scar tissue and vertebral bone damage. I’ve tried painkillers for years in the past without much effect, and this seems to have contributed to how I process dairy. However, my reason for mentioning it is that I am particularly sensitive to inflammation. Getting off of dairy completely made as much if not more of a difference for me than painkillers. Looking back at what I considered minor stomach issues and minor daily ups and downs of life before I was disabled, the low spots were likely impacted by dairy to a large extent.
The easiest way to get off of dairy is to realize the majority of the world population does not consume dairy. Therefore, it is quite easy to find good foods to try if you start exploring foreign foods. I started with Chinese food, and still cook fried rice weekly.
I am relatively young, still in my 30’s and I was an amateur bike racer before the last crash. I still ride nearly daily. The majority of damage to my back is thoracic, (between the shoulder blades and up), and I can setup a bike to keep that part of my back neutral. I just can’t turn my head to see over my shoulder…or hold standing, or sitting upright posture for more than 1 hour.
While I’m not the ideal end goal in my situation now. I managed to ride from 350lbs in 2009, to 190lbs by 2013. Commuting hardcore helped for sure, and lead to a lot of other healthy activities. That started because I was broke after a failed business and ditching a car saves a ton of money. The real secret to losing weight though is not exercise. All you need to do is negotiate with yourself to make better choices over time, and eat far more often, but far less at any point in time. In fact, I have trouble getting my weight under around 220lbs. The way I managed to do it in 2013 was to reduce my exercise regime and spend longer stretches with rigid consistency. In other words I stopped doing super long rides that caused my calorie requirements to fluctuate substantially.
The real trick to negotiating food with yourself is to assess your habits and try to either reduce consumption or make a shift to a healthier alternative. Maybe you eat oreos on the daily. How many. Can you work on one less every time. Okay, you’re down to your last two beloved oreos but only barely half satisfied. What if you traded you 2 oreos for 5 fig Newton’s in your routine… What if you traded an apple for those 2 fig Newton’s. Be a good negotiator on both sides. You are already, likely, subconsciously engaged in this internal debate. Consciously addressing and influencing the debate is the real key. No one gains the weight over night, and no one can lose it over night either. Weight is a matter of millions of choices over time and the only factor is a feather weight on the scale. Punishing yourself only instigates an internal rebellion. That negativity is useless. This is all a diet is; punishment and shaming. It is ineffective for many people. No one becomes a pro at anything just because they make a first attempt. Healthy eating is a skill too. It takes time. Expecting to flip a switch with a diet is dumb. In the real world, circumstances dictate appropriate behavior. Going to a party or wedding concerned about some arbitrary diet is idiotic. Considering your commitment to health as a failure because of one bad day or meal is equally dumb. The trick to losing weight is shifting a feather on a scale. It is an internal conscience philosophical commitment that only involves back burner awareness and minor adjustments. Do whatever you like with this info. It upsets some people when I have shared my musings on diets. I will say, I don’t count calories, I am 220lbs at 6’1" now and I have spent ~80% of every day laying in a bed since 2/26/2014. In my opinion, my experience of coming from being very overweight, losing so much, and keeping it off even under a worst case scenario should mean something.
Sorry if length offends. Hopefully it is interesting.
I just tried it a few hours ago. Indeed, it is quite good. I knew it when a NSFW prompt test on an uncensored model generated a stable diffusion picture of a robot skeleton and a snarky reply. Like, yay we finally have a bight spot with this one.
Not exactly. Stupid people with advanced tools make stupid outputs. Venture capital is pushing the propaganda sauce hard and a lot of stupid people are jumping on AI as a corporate trend. These are the idiots.
The tools are next level. We are on the edge of this tech becoming a really big deal. There are several research papers making breakthroughs regularly and making double digit percentile improvements on efficiency and accuracy. The reason it is a big deal is because you can have around 1/4 of the knowledge of the entire internet running on hardware as powerful as a current flagship phone. Sure it lies around 1/2 the time, but these are problems that are being solved. Like, the latest and greatest models are ancient history in a matter of 2-3 weeks. To be honest, have a casual conversation with an offline and uncensored LLM. You may know it is lying from time to time, but if you’re being objective, so are most humans you encounter under casual circumstances. The sociological function and potential value of this tech is pretty powerful medicine. Like if you need someone to talk to, or to talk out an issue in private, this is a way to make that happen.
What hardware does it take to run a 30B?
Endless Sky. The save game is a text file. Save a file on the mobile app (F-Droid), and on the PC (Flatpak), and note the last line. This is the line you must swap to transfer the save file. It is the first game I have played on both practically. The game mechanics are different between the two and you need to alter your strategy accordingly. On mobile, I travel with a ship setup for boarding pirate vessels and never target enemies directly; all of my guns are automatic turrets. I just use a fast ship and travel with a large group of fighters. It is more of a grind on mobile, but it can be used to build up resources and reserves. The game is much bigger than it first appears to be. You need to either check out a guide or explore very deep into the obscure pockets of the map.