Happy weekend!

There has been a lot of news related to benchmarking lately, including an admission by Google that they blocked Play Store downloads of benchmarking apps during the Pixel 8 review embargo, as well as fresh chips coming down the pipeline by Qualcomm and MediaTek.

Discussion questions:

  • Do smartphone benchmarks matter?
  • Are they still a useful reference and do you consider them when shopping for an upgrade?

Reminder: If you haven’t already, be sure to subscribe to [email protected]!

  • vegetarian_pacemaker@lemmynsfw.comEnglish
    2·
    1 year ago

    Given the cost of phones lately, everything matters! I was seriously looking to buy a new phone since the one I have is showing its age at 4 years. I looked at specifications, performance and reviews. You can buy smartphones now for similar screen, cam & battery specs but widely different pricing. Benchmarks gives me a rough idea on how the performance of a lower priced smartphone will compare to what I have right now or a more pricer phone. Is it the only reason for me to choose a smartphone? No. Is it one of the points that I look at to see how much bang do I get for my hard earned money, absolutely! Given that phones have become outrageously expensive, I want to know how much more I am paying for a given “improvement”

  • unix_joe@lemmy.sdf.orgEnglish
    2·
    1 year ago

    Do smartphone benchmarks matter?

    Probably, but not for me.

    Are they still a useful reference and do you consider them when shopping for an upgrade?

    No.

      • I need NOS@lemm.eeEnglish
        1·
        1 year ago

        Battery life and screen quality first and foremost. They’re often related to each-other. Battery life because I feel it’s the one aspect that hasn’t improved very much at all over the past 10 years, and if I don’t have enough battery, I literally can’t use my phone. Screen quality because I look at the screen whatever I do with the phone, so if the screen is bad, everything else cannot make it a better phone.

  • henfredemars@infosec.pubEnglish
    1·
    1 year ago

    Do smartphone benchmarks matter?

    Benchmarks matter inasmuch as it reflects the user experience, which is to say, benchmark numbers taken alone are meaningless. However, if you tell me a game runs with specific characteristics of user experience such as quality settings and frame rate, that data describe what I can experience playing that game.

    Maybe I don’t play that game. Perhaps, I’m not a mobile gamer at all. Even then, benchmarks can provide value by describing what real world performance is attainable provided that benchmarks reflect real user experiences.

    I would say that benchmarks matter but only within the context of how benchmark numbers relate to a tangible thing you could experience with the phone. A CPU score? I think the value is questionable until you talk about how an app runs.

    Are they still a useful reference and do you consider them when shopping for an upgrade?

    I think benchmarks are more useful for enthusiasts to understand relative performance but are usually detached from the user experience that I really care about when making a purchase.

    I want to know the benchmarks, but these would not drive my purchasing decision. I want to hear from reviewers who actually used the phone… because I plan to use the phone to do phone things, not to run benchmarks.

    • hydroGEN@lemdro.idEnglish
      1·
      1 year ago

      These are good points. Storage and wifi speeds are two important ones for real world user experience but they’re overlooked by many reviewers.

  • limerod@reddthat.comMEnglish
    1·
    1 year ago

    They only matter when considering efficiency, throttling, and battery life. If the next SoC has throttling, efficiency issues, i would not consider buying it. Smartphone SoCs have become plenty fast for regular everyday tasks (even midrange ones). It’s not a matter of “If it can?” Anymore as much as, how long? If you don’t get the fastest flagship, it will still do whatever tasks you throw at it (barring heavy gaming/emulation) just that much slower.

    I have a smartphone with 6gb of ram and 6GB of virtual ram powered by dimensity 700. It’s still plenty fast for most tasks and light to medium gaming and does multitask well. It slows down, but only when throttling. The performance is sufficient. I will get another year out of this smartphone but will need to upgrade for security updates and increased ram(some LLMs need that much ram)

    Edit: typo