Researchers Struggle to Use Apple Watch in Studies Due to Sudden Algorithm Changes
Researchers are rethinking plans to use the Apple Watch in studies after finding inconsistencies in the data gathered by the device (via The Verge).
Inconsistencies in the Apple Watch's heart rate variability data are reportedly caused by Apple tweaking the device's algorithms, meaning that data from the same time period can change without warning. Associate professor of biostatistics at the Harvard T.H. Chan School of Public Health and developer of the Beiwe data platform, J.P. Onnela, told The Verge:
These algorithms are what we would call black boxes — they're not transparent. So it's impossible to know what's in them.
Research fellows at Brigham and Women's Hospital exported the heart rate data from Apple Watches for the same period of time, but several months apart. The data should have been identical, but since it is filtered through an algorithm prior to export it was drastically different.
Apple changes its algorithms regularly and without warning, so exporting the same data at different times may use different algorithms. Beyond heart rate variability, researchers looking into sleep tracking have experienced similar problems with changes to algorithms.
This mostly precludes commercial devices from being used by researchers, resulting in the need for devices specifically designed to collect data for scientific studies. While this is adequate for some studies, it heavily constrains research into the medical value of commercially available products for users. Some researchers say that Apple should publicize the changes it makes to algorithms or make the Apple Watch's raw data available.
Popular Stories
iOS 18 is expected to be the "biggest" update in the iPhone's history. Below, we recap rumored features and changes for the iPhone. iOS 18 is rumored to include new generative AI features for Siri and many apps, and Apple plans to add RCS support to the Messages app for an improved texting experience between iPhones and Android devices. The update is also expected to introduce a more...
Game emulator apps have come and gone since Apple announced App Store support for them on April 5, but now popular game emulator Delta from developer Riley Testut is available for download. Testut is known as the developer behind GBA4iOS, an open-source emulator that was available for a brief time more than a decade ago. GBA4iOS led to Delta, an emulator that has been available outside of...
The first approved Nintendo Entertainment System (NES) emulator for the iPhone and iPad was made available on the App Store today following Apple's rule change. The emulator is called Bimmy, and it was developed by Tom Salvo. On the App Store, Bimmy is described as a tool for testing and playing public domain/"homebrew" games created for the NES, but the app allows you to load ROMs for any...
Apple today said it removed Game Boy emulator iGBA from the App Store for violating the company's App Review Guidelines related to spam (section 4.3) and copyright (section 5.2), but it did not provide any specific details. iGBA was a copycat version of developer Riley Testut's open-source GBA4iOS app. The emulator rose to the top of the App Store charts following its release this weekend,...
Last September, Apple's iPhone 15 Pro models debuted with a new customizable Action button, offering faster access to a handful of functions, as well as the ability to assign Shortcuts. Apple is poised to include the feature on all upcoming iPhone 16 models, so we asked iPhone 15 Pro users what their experience has been with the additional button so far. The Action button replaces the switch ...
A week after Apple updated its App Review Guidelines to permit retro game console emulators, a Game Boy emulator for the iPhone called iGBA has appeared in the App Store worldwide. The emulator is already one of the top free apps on the App Store charts. It was not entirely clear if Apple would allow emulators to work with all and any games, but iGBA is able to load any Game Boy ROMs that...
Top Rated Comments
If the baseline data is changed via an algorithm update, you need to know how that algorithm was changed to account the data discrepancy.
Without the info, the data becomes useless.
It's both funny and sad that one of the few aspects of Steve Jobs Apple that Tim Cook has chosen not to change, the company's intense secrecy, continues to be its downfall in so many current and potential markets.
Apple is fortunate to be the only real player in the wearables market at the moment. Despite the complaints, I would imagine most researchers will continue to work with Apple for the time being as they're the only game in town. That said, just as in the pro and corporate markets, Apple will eventually struggle to retain research clients in the long run if it continues to cling to its asinine refusal to provide even a basic level of transparency.
If Apple wants to expand outside of the consumer market in a serious way it needs to understand that secrecy is not the asset it is there but a serious liability that many folks just aren't going to be willing or able to deal with.
Since Apple doesn't provide that information, the data collected is largely useless.
also Apple: lol psych thanks for the 400 bucks