Amazon has shut down an internal company leaderboard which ranked employees based on how much they used AI tools at work.

  • TheFogan@programming.dev
    link
    fedilink
    English
    arrow-up
    217
    arrow-down
    1
    ·
    1 day ago

    Whole concept of “how much AI you used”, is so flipping stupid of a metric I can’t even wrap my head around. I mean even if we assume it’s their own AI they are using… that’s their power etc… That’s like a leaderboard for most gas used up, or miles driven by your truck drivers.

    • Dultas@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      14 hours ago

      Like judging how good a driver is by the person with the longest distance a to b.

      • TheFogan@programming.dev
        link
        fedilink
        English
        arrow-up
        1
        ·
        14 hours ago

        I mean I can say it’s not quite as guaranteed to be bad. IE distance from A to B is inherently bad, Most distance driven COULD mean you made more stops and did more good… or it could mean you took a horrible route, got lost and wound up crossing through the wrong state.

        • mic_check_one_two@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          1
          ·
          6 hours ago

          And here we have our employee of the year! He accidentally turned left instead of right, and ended up circumnavigating the entire globe. While most of you only use 2 miles to go from A to B, he used 24899. Isn’t that incredible?

        • pinball_wizard@lemmy.zip
          link
          fedilink
          English
          arrow-up
          1
          ·
          12 hours ago

          or it could mean you took a horrible route, got lost and wound up crossing through the wrong state.

          We don’t need a map to guide us.

          Should it be snowing?

          Hey, I’ve never seen the sun come up in the West?!

    • wiccan2@thelemmy.club
      link
      fedilink
      English
      arrow-up
      109
      ·
      1 day ago

      It’s the old lines of code metric style of thinking.

      The people in charge only know line go up means better and bigger number is better.

      Its only when things go wrong and someone ELI5 for them that they listen. And even then it’ll wear off in a week and they’ll be on to their next make the number bigger obsession.

      • prime_number_314159@lemmy.world
        link
        fedilink
        English
        arrow-up
        22
        ·
        17 hours ago

        I’ve had to explain this to more executives than I wish to remember. Computer code is a recipe, not a cake. When you see a recipe that’s super long, and requires two kitchens worth of bakeware and tools, you probably think it’s a bad recipe. Short, elegant, easy to follow recipes with a little note in the margin from your grandmother about what to do when the dough is too sticky are the best recipes.

        Unfortunately, one learned the exact wrong lesson from this, and started measuring lower lines of code produced as better… Which worked for a while, but lead to a lot of weirdness around new features for no particular reason.

        • mic_check_one_two@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          3
          ·
          6 hours ago

          Unfortunately, one learned the exact wrong lesson from this, and started measuring lower lines of code produced as better… Which worked for a while, but lead to a lot of weirdness around new features for no particular reason.

          Hey boss, I just got that new feature submitted for review. I managed to get it all on a single line of code! No, that one line has like 5000 characters, why do you ask?

        • wonderingwanderer@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          5
          ·
          13 hours ago

          “Sorry, can’t add that feature. That would take at least another 20 lines of code and I can’t lose my leaderboard ranking. Not with Steven in second place…”

          I’ve said it for years: qualitative is better than quantitative. It’s just that it doesn’t look as nice and objective on reports. This obsession with numbers has been a bane on society for a long time.

    • Kissaki@feddit.org
      link
      fedilink
      English
      arrow-up
      11
      ·
      22 hours ago

      It only makes sense if

      • you want to drive up adoption because
        • you’re confident in usefulness already
        • want to find out about usefulness and need the userbase and usage for it
      • you have ulterior motives to push for AI adoption

      I can imagine leadership - disconnected from real work and any practical AI use experience - being misinformed and misguided into believing marketing and hype-cycle about gains. It also doesn’t seem implausible that leadership wants to drive up adoption to quickly gain feedback and results about usefulness and gains/loss.

      In good faith, it requires a certain mindset (no care about the waste or potential loss or risk) and distance from practice. Not implausible, though, in my eyes.

      • iocase@lemmy.zip
        link
        fedilink
        English
        arrow-up
        3
        ·
        19 hours ago

        personally oversaw a 300% increase in lines of code committed. 40% reduction in delays and 60% reduction in feature implementation design cycles. As a result, increased company revenue by 30%

        This is all the explanation you need on why they’re doing this bone headed shit. It’s not their problem in a few quarters when they jump ship after padding their resume on the company’s dime.

        • pinball_wizard@lemmy.zip
          link
          fedilink
          English
          arrow-up
          1
          ·
          edit-2
          12 hours ago

          Sure. But I haven’t seen credible evidence that any of this drove any revenue.

          Correct features, thoughtfully planned, and expertly executed, at the right time, sometimes drive new revenue.

          AI slop is about 99% orthogonal to anything that helps drive revenue.

          People will claim it helps with timing, but timing only works if the feature is correct and AI makes organizations that rarely got things correct in the first place even less likely to get things correct.

    • jordanlund@lemmy.world
      link
      fedilink
      English
      arrow-up
      58
      arrow-down
      2
      ·
      1 day ago

      Nobody is asking the question “If you have to use AI that much, doesn’t that mean you aren’t very good at your job? 🤔”

    • CosmoNova@lemmy.world
      link
      fedilink
      English
      arrow-up
      14
      ·
      1 day ago

      Right? How do you even cheat on a ruleset this dumb? You don‘t. It was a stupid contest from the start.

      • GalacticSushi@piefed.blahaj.zone
        link
        fedilink
        English
        arrow-up
        11
        ·
        22 hours ago

        If they’re ranking you based on AI usage, they’re going to use that when they make decisions about raises and promotions. It may be a stupid contest but the employees are part of it whether they like it or not.

        You can bet your ass I’d be trying to pad my numbers.

        • CovertOperative@piefed.zip
          link
          fedilink
          English
          arrow-up
          4
          ·
          22 hours ago

          If they’re ranking you based on AI usage, they’re going to use that when they make decisions about raises and promotions.

          By not promoting the people on top of the ranking who can’t do things without AI and waste a lot of resources, right?

          …right?

          • trolololol@lemmy.world
            link
            fedilink
            English
            arrow-up
            5
            ·
            15 hours ago

            Well they do stack ranking. The promotions are not guaranteed, but the firings for people at the bottom of the leaderboard are.

    • GreenCrunch@piefed.blahaj.zone
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      10
      ·
      1 day ago

      I mean miles driven is at least proportional to amount of useful work, more miles is more distance they’ve transported cargo. The AI usage leaderboard is useless.

      • TheFogan@programming.dev
        link
        fedilink
        English
        arrow-up
        17
        ·
        edit-2
        22 hours ago

        Only if you assume that all miles are correctly headed towards the destination. 2 drivers are given the same 3 places to deliver packages to.

        one drives 2000 miles, the other 50.

        Admitted though now that I actually think about it, I guess we already have that level of stupid assumptions. After all the normal system of pay for many jobs is by the hour. Which I suppose has all the same flaws.

        • pinball_wizard@lemmy.zip
          link
          fedilink
          English
          arrow-up
          1
          ·
          11 hours ago

          After all the normal system of pay for many jobs is by the hour. Which I suppose has all the same flaws.

          Yes! It does. I felt that I had to get out of hourly billing consultancy programming, because I code so fast I would have gone broke.