Tech blog AnandTech just published a very controversial article about the nature of benchmark testing in mobile devices. According to their well-researched information, practically all original equipment manufacturers (OEM) have technology in place to fake higher performance when a device’s processor benchmarks are being tested.
According to AnandTech, most hardware manufactures, including LG, HTC, Samsung, and more, have CPU optimizations that are triggered when a benchmark is detected. “With the exception of Apple and Motorola, literally every single OEM we’ve worked with ships (or has shipped) at least one device that runs this silly CPU optimization.”
According to testing that goes back to the first version of AndEBench performance testing data, AnandTech discovered that Samsung’s Galaxy Note 3, the company’s newest smartphone available in stores as of Oct. 2, receives a 4.4 percent boost in performance when a benchmark is detected.
Qualcomm’s CMO, Anand Chandrasekher recently told TechWorld that he thinks Apple’s claims of the A7 processor chip being twice as fast as its predecessor is just a marketing gimmick. He told TechWorld that consumers won’t benefit from the 64-bit processor because something that fast is only necessary for devices with 4GB of RAM or more. The iPhone 5s only has 1GB of RAM.
“Predominantly… you need it for memory addressability beyond 4GB. That’s it. You don’t really need it for performance, and the kinds of applications that 64-bit get used in mostly are large, server-class applications,” said Chandrasekher.
Qualcomm is one of the world’s largest suppliers of chipsets and the Snapdragon chips are used in Android and Windows based smart phones. According to AnandTech, “almost all Android OEMs are complicit in creating this (CPU optimization cheat) mess.”
Incidentally, Apple’s iPhone 5s, which does not play the benchmark games mentioned above, has been performance tested [via: MacWorld] and lives up to claims of being nearly twice as fast as its predecessor. The iPhone 5 GeekBench 3 Single-Core Score was 723.0 while the 5s’ score was 1393.0. The iPhone 5 Multi-Core Score was 1302 and the 5s’ reached 2485.0.
All of that speed and no benchmark cheating was involved. That’s some gimmick.