Anyone who gets hold of it can see where you’ve been. Here’s a tool to dump the info from your android handset and here’s one that will snoop through your backups and dump plot your travels on a map for iPhone.
These logs are much more interesting for snoops than for law enforcement. The government can compel your phone company to surrender this data for any phone given sufficient cause. The definition of “sufficient cause” varies by government, naturally.