Australia's largest carrier Telstra has announced that all of its Go Mobile plans now include data-free Apple Music streaming as of this week, enabling customers to listen to songs and albums without tapping into their monthly data allowance. Telstra's FairPlay policy regarding unreasonable usage applies. In tandem, it continues to offer free six-month Apple Music subscriptions to new customers.
Telstra also now includes a three-month subscription to popular streaming services Netflix, Stan, and Presto on select mobile plans. Additionally, all plans include a free 200GB OneDrive cloud storage subscription, free and unlimited Telstra Air hotspot data, and a NRL and AFL 2016 Footy Season Pass.
Many carriers offer free subscriptions to services like Apple Music or Spotify to attract new customers. Telstra became the first carrier to gift Apple Music with a mobile plan when it offered a 12-month subscription for free last August. German carrier Deutsche Telekom is similarly planning to offer new customers six months of Apple Music service for free starting in September, according to a recent report.
When the six-month Apple Music subscription ends, Telstra will automatically charge customers $11.99 per month until the plan is canceled, but data-free streaming will continue. The carrier has posted an Apple Music FAQ with more information about the offer, including how to sign up.
WhatsApp has updated its terms of service and privacy policy to reflect that it will begin sharing select data with Facebook, including the phone number a user verifies during the registration process and the last time a user accessed the service. Facebook, which acquired WhatsApp in 2014, will use the information to provide better friend suggestions and targeted ads and offers to users of its own service.
By coordinating more with Facebook, we'll be able to do things like track basic metrics about how often people use our services and better fight spam on WhatsApp. And by connecting your phone number with Facebook's systems, Facebook can offer better friend suggestions and show you more relevant ads if you have an account with them. For example, you might see an ad from a company you already work with, rather than one from someone you've never heard of.
WhatsApp ensures that nothing users share on the service, including messages, photos, and account information, will be publicly shared onto Facebook for others to see. The updated terms and privacy policy also state that the new data sharing measures will help WhatsApp more accurately count unique users, fight spam and abuse, and improve the overall experience of its messaging service.
Existing WhatsApp users can choose not to share their account information with Facebook. On the iPhone app, before you tap "Agree" to accept the updated terms, tap on "Read," scroll to the bottom, and toggle the control. Users that agree to the updated terms also have an additional 30 days to opt out by going to Settings > Account > Share My Account Info and toggling the appropriate control in the app.
WhatsApp remains committed to providing private communications. All messages sent through the service are not stored on its servers, and end-to-end encryption has been in place since April on the latest version of the app. The updated terms and privacy policy do not affect these security measures.
In a new FAQ about its updated terms and privacy policy, WhatsApp says it will still not allow third-party banner ads on the service.
Popular video platform YouTube is reportedly seeking to greatly expand its social features with a new section called "Backstage," where users can share photos, polls, links, text posts, and videos to anyone subscribed to their channel (via VentureBeat). According to internal sources at YouTube, Backstage will launch in the fall both on the company's mobile apps and desktop. The initial soft launch will only be for "select popular YouTube accounts" and include "limited features," however.
YouTube's social expansion is believed to be in response to the popularity of services like Facebook, Snapchat, and Twitter, which are increasingly improving their own video functionality -- particularly Facebook -- and pulling away users from sharing YouTube videos within each network. Posts shared on Backstage will curate in a reverse chronological order, and each user's content will be found next to the "Home" and "Video" tabs within a YouTuber's channel. Backstage posts will also be pushed to every subscription box, similar to any time a new video is posted, "making them highly visible to fans."
Backstage marks a pivotal shift for YouTube, whose sole focus on video and unsuccessful Google+ integration have left the door open for popular users to flock to competing services like Twitter and Facebook in order to better communicate with fans. By introducing new ways for users to converse, Backstage could reverse the historically one-way communication between stars and their fans. Video sharing and watching will remain the primary function of YouTube, but Backstage may help make YouTube a better place to talk about those videos, too.
It's not clear what will be initially available for the select users during Backstage's soft launch, but eventually YouTube wants to enable users to share both traditional videos and "Backstage-only" videos on the service. Although still unconfirmed, this could mean "more intimate" video-sharing abilities between users, potentially even ephemeral posts that disappear, similar to Snapchat and, now, Instagram Stories.
Down the line, the company wants to "spur new types of conversation" on the platform, allowing users to respond to Backstage posts with their own photos, videos, "and other types of comments." These response features are being referred to as "rich replies" by those close to the project. The company's goal is to keep YouTube watchers within its ecosystem to talk about videos, and not defecting to Twitter or Facebook to chat with friends, or even contact their favorite popular YouTuber. It wasn't mentioned whether Backstage would be exclusive to the company's premium paid YouTube Red subscription service or not.
The Backstage news comes at the same time of Apple's reported interest in creating its own video sharing app, with the hope of competing with existing social networks as well. YouTube's concerns undoubtedly stem from Facebook's focus on video, which began with a comment by CEO Mark Zuckerberg earlier in the year, and has expanded into MSQRD integration, an entirely new app, and the testing of autoplay videos with sound in its iOS and Android apps.
Apple is working on its own social networking app, in the style of Facebook and Snapchat, according to a new report from Bloomberg. The company, "seeking to capitalize on the popularity of social networks," will focus on video in the new app, letting users record a video, edit it, apply a filter, add doodles, and then send it out to friends. Apple's goal is said to make the app quick and easy to use, with one-handed controls and an interactive process that includes shooting, editing, and uploading videos "in less than one minute."
Apple and CEO Tim Cook are said to be looking to its services business to continue to increase profit as its hardware sales slow down amid a modest update year for its flagship iPhone line. In order to "remain relevant" on the software side of things, the company wants to aim the new app at younger users who are spending 50 minutes a day on Facebook's family of apps (including Instagram and Messenger), and 30 minutes a day on Snapchat.
The growth of Apple’s hardware business is slowing and Chief Executive Officer Tim Cook is looking to the company’s services business, such as the App Store and iCloud storage, as a way to generate increased revenue. Apple has failed to successfully launch social-media services in the past, including an iTunes-focused social network called Ping in 2010. Now as Snapchat and Facebook’s Instagram and Messenger apps grow atop Apple’s iOS mobile operating system, Apple is seeking to create its own features to remain relevant, particularly for younger users.
One of the prototype designs for the unnamed app was said to record video in a square-shape, like Instagram, according to a group of people close to the project. The current plans for the app are to offer it as a download via the App Store, but the company could pivot and bundle its proposed social network directly into the existing camera app in iOS. To help bolster its features, Apple is using the same team that created Final Cut Pro and iMovie to develop the social network.
The app is being developed in the same Apple department that developed Final Cut Pro and iMovie software, according to the people. Apple hired Joe Weil, the former president of a New York-based video production company, to lead the vision for the project, the people said. Weil, who co-developed a video blogging app called KnowMe, joined Apple in December 2015, according to his LinkedIn profile.
Ultimately, Apple hopes it can launch the new app sometime next year, but if it doesn't meet the company's expectations -- or if executives see potential problems, along the lines of Ping and Connect -- it could be scrapped.
Besides the proposed video app, Apple has also been working on "multiple social-related features" for iOS over the past year, none of which have launched. One proposed update includes consolidating every communication between a user and a specific contact on one screen, so "two friends could be able to see all text messages, e-mails, and social network interactions between each other in a single window."
No word was given on the launch of the social features not related to the video app, but a team within Apple that rules on the privacy implications of its software will ultimately decide when, and if, any of these experiences make it to a public release. As such, Apple's 2017 launch window for the video app could also be pushed back indefinitely. Still, it's interesting to see the company move to create its own social networking experience, instead of solely designing the hardware on which many people visit apps that may soon be its rivals, like Facebook and Snapchat.
Closer to a wide launch is the company's brand-new and revamped Messages application coming in iOS 10, which elevates the platform above a simple texting service thanks to the addition of features like handwritten messages, full-screen effects, photo doodling, and much more.
The first driverless taxi hit the roads of Singapore on Thursday, in a limited public trial taking place in a hi-tech business district in a western part of the country (via Reuters).
Developer nuTonomy invited a select group of people to download their ride hailing app and ride for free in its "robo-taxi", saying it hoped to get feedback ahead of a planned launch of the service in 2018.
"This is really a moment in history that's going to change how cities are built, how we really look at our surroundings," nuTonomy executive Doug Parker told Reuters.
The ongoing trial rides are taking place in Mitsubishi i-MiEv electric vehicles, with an engineer sitting behind the wheel to monitor how the system deals with the road and take control if necessary.
The company has partnered with the Singapore government on the project, and hopes to have 100 taxis working commercially in the Southeast Asian city state by 2018.
NuTonomy is one of several companies racing to launch self-driving vehicles, with new projects or alliances between automakers and technology firms being announced on an almost weekly basis.
Last week, Uber announced it would begin allowing customers in Pittsburgh to summon self-driving cars from within its ride-hailing app, while Ford announced plans to build a fleet of fully automated driverless cars for commercial ride-sharing by 2021. In June it was reported that Uber had held talks with Fiat Chrysler about a potential partnership involving self-driving car technology.
Apple has been the source of many self-driving automobile rumors since last year, but it's now thought the company's first entrance into the vehicle industry likely won't be autonomous, although later generations of its "Apple Car" would probably include the technology.
However, over the summer reports suggested that Apple is taking a "two-prong approach" to its car development, internally known as "Project Titan", and will focus more on creating its own autonomous driving system rather than manufacturing the vehicle.
The proposed system augments typical Touch ID verification by capturing and storing information about a potential thief after six fingerprint unlocking attempts have failed and the wrong passcode is inputted 10 times (after which a "cool down" period or a complete data wipe is activated, depending on user setting).
In another variation, a single failed authentication triggers the capture of fingerprint data and the device takes a picture of the user via the front-facing camera.
In yet other embodiments, the system can be configured by the user to enable or disable various triggers and scenarios in which the biometric capture protocols are activated. The patent also specifies how other data could be logged in the background to supplement the biometric capture, including time stamps, device location, speed, air pressure, audio data, and more.
Flowcharts illustrate different implementations of the security system.
After capture, the data is stored either locally on the device or sent to a remote server for evaluation, while purges of data are activated when the system determines that it is no longer required.
In suggested uses that are likely to be controversial, Apple describes how the server-side aspect of the system could potentially cross-reference the captured biometric and photo information with an online database containing information of known users. Currently, the fact that Touch ID fingerprint data is stored locally and not in a centralized database is considered to be a significant security benefit to users.
There's no reason to believe Apple will implement the forensic technology in an upcoming consumer product, but the patent does highlight Apple's continuing research into how to harden security on mobile devices beyond passcode screens and Touch ID.
Google today updated its iOS app of the same name, with increased support for 3D Touch on compatible devices.
The update expands on 3D Touch support originally introduced to the Google app in December, allowing iPhone 6s and 6s Plus owners to make more use of the devices' "peek" and "pop" gestures.
Deep pressing on a title or map in Google search results now offers a "peek" preview of the linked page, while pressing harder "pops" the page into fullscreen view.
Elsewhere, users can deep press on the "G" button to start a search from anywhere within the app. Users without a 3D Touch-supporting device can long press on the button instead for the same action.
Google for iOS can be downloaded from the App Store for free. [Direct Link]
Chinese mobile manufacturer Xiaomi announced a new smartphone today amid market research speculation that the Beijing-based company is struggling.
The successor to the popular Redmi Note 3, the new Note 4 has a unibody all-metal design with chamfered edges and a 5.5-inch 1080p curved-glass display.
The handset is powered by MediaTek's Deca-Core Helio X20 SoC (clocked up to 2.1GHz) and comes in 2GB/3GB RAM and 16GB/64GB storage capacity variants, with a 13-megapixel rear camera and a 5-megapixel front-facing one. The handset has a dual SIM slot with space for an SD card up to 128GB. A fingerprint scanner is also featured on the rear.
The Redmi Note 4 comes in silver, gold, and dark grey, while pricing is RMB 899 ($135) for the 16GB model and RMB 1199 ($180) for the 64GB device.
The smartphone goes on sale tomorrow in China, at a time when suggestions are emerging that the so-called "Apple of the East" is feeling the squeeze in an increasingly punishing mobile sector.
Between 2011 and 2015, Xiaomi managed to become the world's third largest smartphone distributor, competing with the likes of Lenovo, LG, Samsung, and Apple, but historically it has been difficult to know how many handsets Xiaomi sells because it doesn't release any data. However, global consumer technology researcher IDC recently estimated that its mobile shipments had fallen 38.4 percent in the April to June quarter of this year compared to 2015.
Information published by Counterpoint Research in April also showed the company's global market share shrinking, down more than 12 percent for Q1 this year compared to the same period last year. Xiaomi has disputed those numbers, and says that estimates from other research houses are more upbeat. In a statement given to the BBC, a Xiaomi spokesperson said:
We understand that different analyst firms have different calculation methods. There are many other third-party reports out there, including those by Strategy Analytics, Gartner and IHS that put our Q2 2016 numbers significantly above what IDC estimated, and those are much closer to our true sell-out number.
We are seeing very healthy demand, but also experiencing some challenges in the supply chain this year. We are ramping up and in June, we sold 6.94 million phones in just one month.
Two months ago, the company unveiled its first ever PC laptop, named the "Mi Notebook Air". Xiaomi has been forced to defend itself from copycat accusations in the past. Its devices have been publicly criticized for heavily borrowing design elements from Apple's iPhones and iPads and adopting marketing materials tactics similar to Apple's, leading Apple chief designer Jony Ive to call the company's antics "theft" and "lazy".
Apple today announced the artist lineup for its 2016 Apple Music Festival, the free annual concert series that takes place at the London Roundhouse theater from September to 18 to September 30.
Headliners at the festival's 10th anniversary this year will include Alicia Keys, Bastille, Britney Spears, Calvin Harris, Chance The Rapper, Elton John, Michael Bublé, OneRepublic, Robbie Williams and The 1975, Apple revealed.
"Over the past decade, the Festival has brought the biggest and best artists from all over the world to London and into the homes of millions of music fans," said Oliver Schusser, Apple's VP of International Content. "This year's Apple Music Festival builds on that incredible legacy and we couldn't be more excited to have another amazing lineup to celebrate our 10th birthday."
Prior to 2015, the event previously called the iTunes Festival lasted for a full 30 days, but was scaled down to 10 days with the revamp. Apple also now offers the music festival performances live and on-demand in the Apple Music App on iOS devices, as well as on Mac, PC, Apple TV, and Android phones.
Like last year, Apple is also set to offer special Apple Music Festival playlists, artist news, and backstage interviews via its subscription streaming music service.
As of today, Apple has stopped signing iOS 9.3.2 and iOS 9.3.3 for compatible iPhone, iPad, and iPod touch models, meaning users can no longer upgrade or downgrade to those versions of iOS using iTunes. Apple is now only signing iOS 9.3.4.
iOS 9.3.2, initially released to the public on May 16, 2016, was an update that initially bricked some 9.7-inch iPad Pro devices until an updated version was released on June 2.
iOS 9.3.2 was followed by iOS 9.3.3, released on July 18, and iOS 9.3.4, released on August 4. iOS 9.3.2 and iOS 9.3.3 were both compatible with the recent Pangu iOS jailbreak software, which is disabled by iOS 9.3.4.
Now that Apple has stopped signing iOS 9.3.2 and iOS 9.3.3, it is no longer possible to downgrade to a version of iOS that supports the Pangu jailbreak.
An Apple collector who was selling his vintage Apple software collection on eBay received a surprise earlier this month when Apple itself bought out much of his software inventory for its software archives (via MacGeneration).
According to seller "Marcoguy," he made several listings of various Apple CDs and received a message from someone asking to buy a dozen discs. When he went to ship the package, he noticed it was going to 1 Infinite Loop in Cupertino, California, Apple's corporate address. Upon asking the buyer about the purchase, he was told that Apple maintains a lab at its headquarters containing archived materials. "We were missing some of the disks that you placed on eBay," wrote the buyer.
So yeah, Apple bought some of their own software back from me. :) Feel free to post if you've had a similar experience, as I would love to hear about it. I knew Microsoft has a pretty robust archive of their history, but I wasn't aware Apple does too until this happened.
Just goes to show how necessary this community is. If is wasn't for collectors like us, so much software would just be lost, out of the grasp of even the companies that produced it.
It's not clear how much Apple paid to fill out its archives, but the seller lists his software at prices ranging from $9.95 to $19.95. It's also not known exactly what Apple purchased, but the seller is offering many rare CDs from the early 90s, including a beta version of Apple's System 7 operating system and a disc from WWDC in 1994.
Back in January, Samsung announced plans to add iOS support to its Gear S2 Smart Watch, and it appears the South Korean company is getting close to launching the promised iOS app.
Starting today, Samsung is launching a new beta testing program for the Gear iOS app (via SamMobile), which will run from Wednesday, August 24 to Monday, September 19, suggesting a release date that could come as early as late September.
The Gear iOS beta is only available to Samsung Gear S2, Gear S2 Classic, and Gear Fit 2 owners who are located in South Korea, so U.S. users will not be able to participate in the beta testing process. Participation in the beta program requires an Apple ID and an iPhone 5 or later running iOS 8.4 or later.
Samsung plans to use the feedback garnered from beta testers to make improvements to its upcoming iOS app. Details on the app, including screenshots, leaked out back in April. Based on that leaked information, the Gear S2 iOS app will be able to deliver notifications to the smart watch and it will be able to install and manage apps from the Gear store.
Aside from an end date of September 19 for the beta testing program, Samsung has given no hints on when iOS support will be officially implemented.
Code discovered within the macOS Sierra beta suggests the operating system will include support for second-generation USB 3.1 transfer speeds of up 10Gb/s, hinting at hardware upgrades that will be included in future Macs set to be released later this year.
Found in a localizable text string in macOS Sierra by 9to5Mac, the code points to support for "Super Speed Plus," another name for the faster 10Gb/s USB 3.1 Gen 2 specification. Current Macs (and OS X El Capitan) only support current-generation USB 3.1, capable of reaching transfer speeds of up to 5Gb/s, so the obvious conclusion is that Apple is planning to add USB 3.1 Gen 2 support to its upcoming Mac machines.
Apple's new Macs almost always include support for the latest USB and Thunderbolt specifications to maximize performance, so it should come as no surprise that Apple is planning the same upgrades for Macs to be released in 2016. Rumors have also previously suggested Thunderbolt 3, which includes support for 10Gb/s USB 3.1 and DisplayPort 1.2, will be introduced in Apple's most highly anticipated machine due for a refresh, the MacBook Pro, so the code found today is in line with what we'd expect to see.
There is no word on when Apple plans to debut its new MacBook Pro, and if there are other Mac updates in the works, but it is rumored to be debuting before the end of the year, perhaps at an event set to be held in October or November. The machine is said to feature a thinner, redesigned body with an OLED touch panel and Touch ID support.
Canadian songwriter and producer Alex Greggs, who has worked with several renowned artists such as Beyoncé, Lady Gaga, Justin Timberlake, and the late Michael Jackson, is suing Apple in a larger lawsuit filed against singer Ariana Grande, electronic artist David Guetta, publisher Universal Music Group, and others, according to court documents filed electronically this week.
Greggs claims that Grande's single "One Last Time" from 2014 infringes upon the 2011 single "Takes All Night" by Skye Stevens, said to be the subject of a valid pending U.S. copyright registration in Gregg's name. He added that the defendants had access to "Takes All Night" before composing "One Last Time," and that it's "highly likely" the songs were not created independently of one another.
Skye Stephens performed the song on tour and in live performances at festivals and in clubs throughout the United States and Canada in particular, and also appeared on numerous radio shows, in addition to promoting the song through social media. Moreover, the similarity between Takes All Night and One Last Time is so striking that it is highly likely the works were not created independently of one another.
Greggs accuses Apple, as the operator of iTunes, of failing to verify that Grande and the other defendants had reached copyright and synchronization license agreements, and other contractual agreements, with him prior to releasing "One Last Time" as a digital download on iTunes and for streaming on Apple Music. He filed a similar claim against Universal Music Group as distributor of the single.
Songwriter and producer Alex Greggs, left, and singer Ariana Grande
Greggs has demanded a jury trial with the U.S. District Court for Central California, and is seeking adequate monetary damages and a permanent injunction that would see "One Last Time" removed from iTunes, Apple Music, and other music distribution and streaming services. The complaint was filed in Santa Monica on Tuesday, and it will have to be accepted by a judge before proceeding.
German carrier Deutsche Telekom is planning to lure new customers by offering six months of Apple Music service for free, reports iPhone-ticker.de [Google Translate]. Aimed at customers who have not yet tried Apple Music, the offer will be announced at IFA in Berlin, set to take place from September 2 to September 7.
According to the report, new Apple Music subscribers on Deutsche Telekom will get the standard three-month free trial and then an additional three months of service paid for by the carrier.
Following the conclusion of the six month trial period, customers will be able to continue their subscriptions and pay for them via their personal phone bill, making it easier to maintain a subscription. It is not known if Deutsche Telekom will only be covering individual subscriptions or if customers are also eligible for family plans.
For its Apple Music service, Apple offers extended three month free trial periods in an effort to get people accustomed to using the service, a longer trial period than the one month offered by most streaming services. Apple's strategy has been somewhat successful, and as of June 2016, Apple Music had more than 15 million paying subscribers.
Just weeks before the European Commission is expected to make a decision in its landmark Apple tax probe, the U.S. Treasury department has criticized the Brussels-based body for "threatening international agreements on tax reform," and warned that a decision against the iPhone maker could "set an undesirable precedent."
Apple's offices in Cork, Ireland
According to Financial Times, the U.S. Treasury said the European Commission is becoming a "supranational tax authority," going beyond acceptable enforcement of competition and state aid law. The U.S. has previously called out Brussels for setting unfair and "disturbing" precedents and singling out U.S. companies.
Brussels has accused Apple of sheltering tens of billions of dollars in Ireland, partly in exchange for creating jobs in the country, a deal that could be considered illegal state aid. Apple operates multiple subsidiaries in Ireland to pay significantly less tax outside of the U.S., where it earns up to two-thirds of its revenue.
Apple's $64.1 billion in profits generated from 2004 to 2012 could be subject to a higher 12.5% tax rate, compared to the sub-2% it has paid in Ireland, in which case it could owe more than $8 billion in back taxes. Apple insists that it is the largest taxpayer in the world and pays every cent of tax it owes under current laws.
A decision in the tax probe is expected in September or October, according to Ireland's finance minister Michael Noonan. Apple CEO Tim Cook said last month that the company would appeal any unfavorable ruling against the company.
Note: Due to the political nature of the discussion regarding this topic, the discussion thread is located in our Politics, Religion, Social Issues forum. All forum members and site visitors are welcome to read and follow the thread, but posting is limited to forum members with at least 100 posts.
In the wake of the much-anticipated launch of Frank Ocean's new album "Blonde," Universal Music Group CEO Lucian Grainge has sent out an email to UMG executives, saying that the company is prohibiting the practice of exclusive music streaming moving forward (via The Lefsetz Letter). The email officially ends "all future exclusives with Universal artists," meaning popular artists like Kendrick Lamar, Taylor Swift, and The Weeknd could all be affected by the change since they each belong to labels owned by UMG.
The news was shared by Bob Lefsetz, a music industry analyst and critic, who penned a letter over the weekend in response to Blonde's exclusive home on Apple Music for the first two weeks of its release. Lefsetz said that the heavy reliance of streaming services on exclusive content, and how the practice is becoming increasingly normal among consumers, will ultimately hurt the industry in the long run. Halfway through, he particularly sets his sights on Apple:
Because there’s a conspiracy between Apple Music and the industry to change the game, to get everybody to pay for a subscription by putting hit content behind a paywall.
Apple should be investigated by the government for antitrust. How do you compete with the world’s richest company that’s got endless cash on hand? You can’t. It’d be like expecting hillbillies to get into Harvard if slots went to the highest bidder. The rich get richer and the rest of us…we’re left out, just like in America at large, [...] the usual suspects doing it for themselves have rigged the game in their favor, and now the music industry is trying to do this too.
According to Lefsetz, Apple's practices not only lock off entire albums to non-subscribers, but grant greater showcase to its exclusive artists -- like the Frank Ocean-centered carousel currently in the app -- consequently hurting the chances for indie musicians to break out. He calls Ocean "complicit" in Apple's schemes, and shames "everybody else who takes money from Apple and screws fans."
With exclusives popping up every few weeks over Apple Music's short fourteen-month lifespan, Kanye West even voiced frustration with the model, hoping to end the fight between Apple Music and Tidal and "let the kids have the music." Among recent artists with an exclusive Apple Music deal are Britney Spears, Frank Ocean, Katy Perry, and Drake.
Steven Levy has published an in-depth article about Apple's artificial intelligence and machine learning efforts, after meeting with senior executives Craig Federighi, Eddy Cue, Phil Schiller, and two Siri scientists at the company's headquarters.
Apple provided Levy with a closer look at how machine learning is deeply integrated into Apple software and services, led by Siri, which the article reveals has been powered by a neural-net based system since 2014. Apple said the backend change greatly improved the personal assistant's accuracy.
"This was one of those things where the jump was so significant that you do the test again to make sure that somebody didn’t drop a decimal place," says Eddy Cue, Apple’s senior vice president of internet software and services.
Alex Acero, who leads the Siri speech team at Apple, said Siri's error rate has been lowered by more than a factor of two in many cases.
“The error rate has been cut by a factor of two in all the languages, more than a factor of two in many cases,” says Acero. “That’s mostly due to deep learning and the way we have optimized it — not just the algorithm itself but in the context of the whole end-to-end product.”
Acero told Levy he was able to work directly with Apple's silicon design team and the engineers who write the firmware for iOS devices to maximize performance of the neural network, and Federighi added that Apple building both hardware and software gives it an "incredible advantage" in the space.
"It's not just the silicon," adds Federighi. "It's how many microphones we put on the device, where we place the microphones. How we tune the hardware and those mics and the software stack that does the audio processing. It's all of those pieces in concert. It's an incredible advantage versus those who have to build some software and then just see what happens."
Apple's machine learning efforts extend far beyond Siri, as evidenced by several examples shared by Levy:
You see it when the phone identifies a caller who isn’t in your contact list (but did email you recently). Or when you swipe on your screen to get a shortlist of the apps that you are most likely to open next. Or when you get a reminder of an appointment that you never got around to putting into your calendar. Or when a map location pops up for the hotel you’ve reserved, before you type it in. Or when the phone points you to where you parked your car, even though you never asked it to. These are all techniques either made possible or greatly enhanced by Apple’s adoption of deep learning and neural nets.
Another product born out of machine learning is the Apple Pencil, which can detect the difference between a swipe, a touch, and a pencil input:
In order for Apple to include its version of a high-tech stylus, it had to deal with the fact that when people wrote on the device, the bottom of their hand would invariably brush the touch screen, causing all sorts of digital havoc. Using a machine learning model for “palm rejection” enabled the screen sensor to detect the difference between a swipe, a touch, and a pencil input with a very high degree of accuracy. “If this doesn’t work rock solid, this is not a good piece of paper for me to write on anymore — and Pencil is not a good product,” says Federighi. If you love your Pencil, thank machine learning.
On the iPhone, machine learning is enabled by a localized dynamic cache or "knowledge base" that Apple says is around 200MB in size, depending on how much personal information is stored.
This includes information about app usage, interactions with other people, neural net processing, a speech modeler, and "natural language event modeling." It also has data used for the neural nets that power object recognition, face recognition, and scene classification.
"It's a compact, but quite thorough knowledge base, with hundreds of thousands of locations and entities. We localize it because we know where you are," says Federighi. This knowledge base is tapped by all of Apple's apps, including the Spotlight search app, Maps, and Safari. It helps on auto-correct. "And it's working continuously in the background," he says.
Apple, for example, uses its neural network to capture the words iPhone users type using the standard QuickType keyboard.
Other information Apple stores on devices includes probably the most personal data that Apple captures: the words people type using the standard iPhone QuickType keyboard. By using a neural network-trained system that watches while you type, Apple can detect key events and items like flight information, contacts, and appointments — but information itself stays on your phone.
Apple insists that much of the machine learning occurs entirely local to the device, without personal information being sent back to its servers.
"Some people perceive that we can't do these things with AI because we don't have the data," says Cue. "But we have found ways to get that data we need while still maintaining privacy. That's the bottom line."
"We keep some of the most sensitive things where the ML is occurring entirely local to the device," Federighi says. As an example, he cites app suggestions, the icons that appear when you swipe right.
The full-length article on Backchannel provides several more details about how machine learning and artificial intelligence work at Apple.