• 0 Posts
  • 59 Comments
Joined 1 year ago
cake
Cake day: November 28th, 2023

help-circle






  • Tobberone@lemm.eetoMicroblog Memes@lemmy.worldfull circle
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    11
    ·
    23 days ago

    Ah, the kid brother defence. “But big brother did it, I had the right to!”

    Still wrong! Someone else being shitty and prejudiced does not in any way, shape or form excuse your prejudice. I’m sorry you’ve had to face prejudice, but this way you are paying it forward.





  • I’m just in the beginning, but my plan is to use it to evaluate policy docs. There is so much context to keep up with, so any way to load more context into the analysis will be helpful. Learning how to add excel information in the analysis will also be a big step forward.

    I will have to check out Mistral:) So far Qwen2.5 14B has been the best at providing analysis of my test scenario. But i guess an even higher parameter model will have its advantages.




  • Thanks! I actually picked up the concept of context window, and from there how to create a modelfile, through one of the links provided earlier and it has made a huge difference. In your experience, would a small model like llama3.2 with a bigger context window be able to provide the same output as a big modem L, like qwen2.5:14b, with a more limited window? The bigger window obviously allow more data to be taken into account, but how does the model size compare?