• delirious_owl@discuss.online
    link
    fedilink
    arrow-up
    0
    ·
    5 months ago

    Are you sure that you can reproduce the model, given the same inputs? Reproducibility is a difficult property to achieve. I wouldn’t think LLMs are reproduce.

    • sweng@programming.dev
      link
      fedilink
      arrow-up
      0
      ·
      edit-2
      5 months ago

      In theory, if you have the inputs, you have reproducible outputs, modulo perhaps some small deviations due to non-deterministic parallelism. But if those effects are large enough to make your model perform differently you already have big issues, no different than if a piece of software performs differently each time it is compiled.