• magic_lobster_party@kbin.run
    link
    fedilink
    arrow-up
    3
    ·
    edit-2
    5 months ago

    It’s true that each individual building block is easy to understand. It’s easy to trace each step.

    The problem is that the model is like a 100 million line program with no descriptive variable names or any comments. All lines are heavily intertwined with each other. Changing a single line slightly can completely change the outcome of the program.

    Imagine the worst code you’ve ever read and multiply it by a million.

    It’s practically impossible to use traditional reverse engineering techniques to make sense of the AI models. There are some techniques to get a better understanding of how the models work, but it’s difficult to get a full understanding.