• altphoto@lemmy.today
    link
    fedilink
    English
    arrow-up
    2
    ·
    8 hours ago

    Okay here we go guys! Drink up!

    Feel anything yet? Let’s try another… Hold up! Wow, I can see 360!

    Dude! Gnarly! You got eyes in the back of y…dude I can see 360 too!

    Nah, I only see 360 pills. Where do you see the other two?

    Holy wakamoly! You got 360 eye balls!

    Experiment 00000000001… Failure…

  • MajinBlayze@lemmy.world
    link
    fedilink
    English
    arrow-up
    25
    ·
    edit-2
    1 day ago

    There really needs to be a rhetorical distinction between regular machine learning and something like an llm.

    I think people read this (or just the headline) and assume this is just asking grok “what interactions will my new drug flavocane have?” Where these are likely large models built on the mountains of data we have from existing drug trials

      • MajinBlayze@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        12 minutes ago

        ?

        Reproducibility of what we call LLM 's as opposed to what we call other forms of machine learning?

        Or are you responding to my assertion that these are different enough to warrant different language with a counterexample of one way in which they are similar?

    • holomorphic@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      18 hours ago

      Those models will almost certainly be essentially the same transformer architecture as any of the llms use; simply because they beat most other architectures in almost any field people have tried them. An llm is, after all, just classifier with an unusually large set of classes (all possible tokens) which gets applied repeatedly

      • MajinBlayze@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        11 hours ago

        I’m not talking about the specifics of the architecture.

        To the layman, AI refers to a range of general purpose language models that are trained on “public” data and possibly enriched with domain-specific datasets.

        There’s a significant material difference between using that kind of probabilistic language completion and a model that directly predicts the results of complex processes (like what’s likely being discussed in the article).

        It’s not specific to the article in question, but it is really important for people to not conflate these approaches.

        • holomorphic@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          9 hours ago

          Actually I agree. I guess I was just still annoyed after reading just previously about how llms are somehow not neural networks, and in fact not machine learning at all…

          Btw, you can absolutely finetune llms on classical regression problems if you have the required data (and care more about prediction quality than statistical guarantees.) The resulting regressors are often quite good.

      • FatCrab@slrpnk.net
        link
        fedilink
        English
        arrow-up
        3
        ·
        15 hours ago

        A quick search turns up that alpha fold 3, what they are using for this, is a diffusion architecture, not a transformer. It works more the image generators than the GPT text generators. It isn’t really the same as “the LLMs”.

        • holomorphic@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          9 hours ago

          I will admit didn’t check because it was late and the article failed to load. I just remember reading several papers 1-2years ago on things like cancer-cell segmentation where the ‘classical’ UNet architecture was beaten by either pure transformers, or unets with added attention gates on all horizontal connections.

        • MajinBlayze@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          10 hours ago

          I skimmed the paper, and it seems pretty cool. I’m not sure I quite follow the “diffusion model-based architecture” it mentioned, but it sounds interesting

          • FatCrab@slrpnk.net
            link
            fedilink
            English
            arrow-up
            1
            ·
            2 hours ago

            Diffusion models iteratively convert noise across a space into forms and that’s what they are trained to do. In contrast to, say, a GPT that basically performs a recursive token prediction in sequence. They’re just totally different models, both in structure and mode of operation. Diffusion models are actually pretty incredible imo and I think we’re just beginning to scratch the surface of their power. A very fundamental part of most modes of cognition is converting the noise of unstructured multimodal signal data into something with form and intention, so being able to do this with a model, even if only in very very narrow domains right now, is a pretty massive leap forward.

  • iAvicenna@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    edit-2
    17 hours ago

    Sure it helps with a bottle neck but it is not the only one. Until you gain biological and biochemical understanding of the disease no amount of throwing neural networks will help you. I am really sick and tired of AI people hyping up their stuff to get more investments. It even feels like all this “secretive” bullshit is also a part of the show.

  • rhombus@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    7
    ·
    23 hours ago

    I’m sure all the savings from accelerated/cheaper R&D will be passed on to the consumer…right?

  • TheFogan@programming.dev
    link
    fedilink
    English
    arrow-up
    31
    ·
    1 day ago

    I mean I hate AI in general… but to be honest… assuming no one is stupid enough to bypass the trials etc… I’m all for it, 90% of these problems already exist in the existing system, who owns it, can a corporation charge us to death.

    The only reasonable fear is, if they come out with more than they can develop trials for, and they lobby to lower standards in trials. Even that honestly is a more acceptable risk in the context of terminal diseases/severe cancers.

        • TheFogan@programming.dev
          link
          fedilink
          English
          arrow-up
          10
          ·
          1 day ago

          and it’s still a better system than anyone hired by RFK Jr manually reviewing the file.

          Which is kind of the point, idea fully agreed there’s a lot of risks and messed up stuff, but almost all of it, is at worse roughly equal to the already existing problems in our systems… I can’t quite think of any that are made worse.

  • Avid Amoeba@lemmy.ca
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    23 hours ago

    I think I lost neurons reading this. Other commenters in this thread had the resilience to explain what the problems with it are.