
Apple has finally responded in detail about its hidden location tracking file, and it only took a
class action lawsuit,
letters from a Senator and a Congressman, multiple investigations globally, and still more to get the oft-reticent firm to respond to questions about the consolidated.db file.
In a
Q&A posting on their website, Apple called the issues and furor over the file a result of bugs, but also confusion on the part of end users. They admitted that Apple, among others, has not been clear enough about their location tracking technologies.
The full statement is below, with our commentary.
1. Why is Apple tracking the location of my iPhone?
Apple is not tracking the location of your iPhone. Apple has never done so and has no plans to ever do so.
[This echoes the statement made by Apple CEO Steve Jobs in a tersely worded email to an end user, one he made a few days ago, when he said the same thing. However, that is in direct conflict with a letter that Apple general counsel Bruce Sewell (.PDF) sent to U.S. Representatives Edward Markey (D-Mass.) and Joe Barton (R-Texas) in 2010. In that letter, Sewell said that Apple does collect location information, and sends it back anonymized "intermittently," if location services are enabled.
This is a sort of marketing-ized response. Yes, Apple is tracking the location of your iPhone. If all goes well (no bugs), the data is de-personalized so no one can tell it's you. But saying it is not tracking your location, but that Google is, is misinformation.]
2. Then why is everyone so concerned about this?
Providing mobile users with fast and accurate location information while preserving their security and privacy has raised some very complex technical issues which are hard to communicate in a soundbite. Users are confused, partly because the creators of this new technology (including Apple) have not provided enough education about these issues to date.
[Indeed, this is true. Apple should make it clear, however, that by simply buying the iPhone and accepting the Terms of Service, users have agreed to let it capture location information.]
3. Why is my iPhone logging my location?
The iPhone is not logging your location. Rather, it’s maintaining a database of Wi-Fi hotspots and cell towers around your current location, some of which may be located more than one hundred miles away from your iPhone, to help your iPhone rapidly and accurately calculate its location when requested. Calculating a phone’s location using just GPS satellite data can take up to several minutes. iPhone can reduce this time to just a few seconds by using Wi-Fi hotspot and cell tower data to quickly find GPS satellites, and even triangulate its location using just Wi-Fi hotspot and cell tower data when GPS is not available (such as indoors or in basements). These calculations are performed live on the iPhone using a crowd-sourced database of Wi-Fi hotspot and cell tower data that is generated by tens of millions of iPhones sending the geo-tagged locations of nearby Wi-Fi hotspots and cell towers in an anonymous and encrypted form to Apple.
[Once again, this is marketing-speak. By tracking the location of hotspots and cell phone towers, it is essentially tracking you. If anyone were to get your phone or the database off your iTunes install, they would be able to track your behavior. In addition, maximum range for a cell tower, according to Wikipedia, is not "more than 100 miles." It is about 35km, or 21.7 miles. That is an ideal situation, and not one for New York City, say. For wi-fi, it's even smaller. A wi-fi hotspot set up outside, not inside a building like a Starbucks, has a maximum range of about 300 feet. Finally, both of these are affected by obstacles (buildings, walls, foliage) and interference.]
4. Is this crowd-sourced database stored on the iPhone?
The entire crowd-sourced database is too big to store on an iPhone, so we download an appropriate subset (cache) onto each iPhone. This cache is protected but not encrypted, and is backed up in iTunes whenever you back up your iPhone. The backup is encrypted or not, depending on the user settings in iTunes. The location data that researchers are seeing on the iPhone is not the past or present location of the iPhone, but rather the locations of Wi-Fi hotspots and cell towers surrounding the iPhone’s location, which can be more than one hundred miles away from the iPhone. We plan to cease backing up this cache in a software update coming soon (see Software Update section below).
[Obviously they can't store the entire database. So the cache is stored on the iDevice instead, and it may not apply to a user's personal locations.]
5. Can Apple locate me based on my geo-tagged Wi-Fi hotspot and cell tower data?
No. This data is sent to Apple in an anonymous and encrypted form. Apple cannot identify the source of this data.
6. People have identified up to a year’s worth of location data being stored on the iPhone. Why does my iPhone need so much data in order to assist it in finding my location today?
This data is not the iPhone’s location data—it is a subset (cache) of the crowd-sourced Wi-Fi hotspot and cell tower database which is downloaded from Apple into the iPhone to assist the iPhone in rapidly and accurately calculating location. The reason the iPhone stores so much data is a bug we uncovered and plan to fix shortly (see Software Update section below). We don’t think the iPhone needs to store more than seven days of this data.
7. When I turn off Location Services, why does my iPhone sometimes continue updating its Wi-Fi and cell tower data from Apple’s crowd-sourced database?
It shouldn’t. This is a bug, which we plan to fix shortly (see Software Update section below).
8. What other location data is Apple collecting from the iPhone besides crowd-sourced Wi-Fi hotspot and cell tower data?
Apple is now collecting anonymous traffic data to build a crowd-sourced traffic database with the goal of providing iPhone users an improved traffic service in the next couple of years.
9. Does Apple currently provide any data collected from iPhones to third parties?
We provide anonymous crash logs from users that have opted in to third-party developers to help them debug their apps. Our iAds advertising system can use location as a factor in targeting ads. Location is not shared with any third party or ad unless the user explicitly approves giving the current location to the current ad (for example, to request the ad locate the Target store nearest them).
10. Does Apple believe that personal information security and privacy are important?
Yes, we strongly do. For example, iPhone was the first to ask users to give their permission for each and every app that wanted to use location. Apple will continue to be one of the leaders in strengthening personal information security and privacy.
Software Update
Sometime in the next few weeks Apple will release a free iOS software update that:
- reduces the size of the crowd-sourced Wi-Fi hotspot and cell tower database cached on the iPhone,
- ceases backing up this cache, and
- deletes this cache entirely when Location Services is turned off.
In the next major iOS software release the cache will also be encrypted on the iPhone.
The software update will probably be numbered 4.3.3, which means it is a minor revision from teh current 4.3.2. Verizon iPhone 4's carry 4.2.7, so they will either finally be updated to 4.3.3 or receive 4.2.9.
By next major release, Apple is probably speaking of the iOS 5 release that they plan to discuss at WWDC later this year. That could mean the file will be unencrypted on the device for months. A recommendation for now, at least, is to make sure that the iTunes backups that are made when you sync your iDevice is encrypted.
To do so, once you have plugged in your device and allowed it to sync:
- Click on your iOS device in the sidebar on the left in iTunes, and ensure you are in the “Summary” section.
- Scroll down the screen displayed on the right to the bottom until you see a section entitled “Options.” From there you can check the checkbox that says "Encrypt iPhone [iPad] backup." This may be somewhat different from device to device and from iTunes version to iTunes version.
This furball began when two researchers publicized the hidden configuration.db file. While they said they believed it was new to iOS 4 and later, another researcher said he had detailed this file in 2007, the year the first iPhone was released.
The unencrypted nature of the file, along with the fact that it seemed to have no limit to its size, were among the greatest issues described by the researchers.