Showing posts with label Data Mining. Show all posts
Showing posts with label Data Mining. Show all posts

May 9, 2016

New York City and Residents Show The Way Using Big Data to Improve Quality of Life



Big Data and sensor technology could help the city identify construction sites that violate noise regulations. 
MARY ALTAFFER/AP PHOTO

God bless the people who have the stamina to force government bureaucrat control freaks to provide access to data. Notice there is little mention of police and FBI, law enforcement in general providing information. No mention that for every report made by citizens another report is being collected on who did what, when. Big data has its downside as well. 

[From article]
New York City has been a Big Data pioneer for decades. In the early 1990s, the city launched the CompStat data-driven policing system, so that, in the words of former NYPD department chief Lou Anemone, officers could stop “just running around answering 911 calls” and start analyzing patterns to prevent crime. Thanks in part to CompStat, major crimes in the city have since fallen by 80 percent. During the Michael Bloomberg mayoral years, the city used data to pinpoint dangerous intersections and driving habits, cutting traffic deaths by nearly a third. Today, thanks to advances in data-storage capacity as well as the ubiquity of smartphones and broadband access, New York has an unprecedented number of facts to analyze and act upon, CompStat-style, across all areas of government—from building inspection to noise reduction. But [. . .] we still need old-fashioned political will.



Cities are in the middle of what Daniel Doctoroff, a Bloomberg-era deputy mayor, calls their fourth modern revolution. In the eighteenth century, cities got the first: the steam engine, which made possible the industrial age. In the nineteenth century, electricity gave cities the subways and elevators they needed to fit more people into small spaces. In the twentieth century, the automobile made it easier for residents and workers to leave dense urban areas. And now, in the twenty-first century, cities are getting the “networked revolution” of large-scale data collection, both human and automated, as well as continuous connectivity to transmit and store those data.
And with better transparency laws, much of this Big Data becomes open data: information that everyone can see and use. Consider how one area of data reporting and collection has exploded in just a decade: New Yorkers’ complaints, questions, and observations about their city. Last year, more than 30 million people called or went online to 311, the city’s information and complaint system. That’s nearly four times the city’s population, and four times the number of people who called in 2003,
[. . .]
One basic problem of even highly functional cities, Flowers notes, is “too big a body, too little blanket,” and the traditional answer to that problem, he says, is “let me hire more people.”
Instead, Flowers used data to help him perform a critical task: protecting New Yorkers from firetraps. “We were getting 20,000 complaints a year,” he says, many via 311, “about illegal [apartment] conversions”—that is, landlords or tenants subdividing their properties, creating dangerous conditions for poor tenants. But building inspectors, [. . .] regarded all buildings equally [. . .] Working with the fire department and buildings department to analyze historical information, Flowers’s team discovered which buildings were more likely to have critical violations resulting in destruction and death—and made it a priority to inspect those buildings. “What we basically did is reconstruct the inspection experience” to be risk-based, he says. Now, every building gets a risk grade, which inspectors use as guides. Fire deaths and injuries have never been so low.
Another success during the Bloomberg years: “end-to-end 911 analysis,” that is, integrating different city agencies’ systems to learn how long it takes for ambulances to respond to 911 calls and if response times could be improved. 
[. . .]
But, Flowers notes, he always kept in mind that his job was to use data to pursue “the mission of [a government] agency,” not to protect the bureaucracy.



New York’s worst natural disaster in recent memory—Superstorm Sandy— [. . .] created an environment where the city recognized the value of data sharing,” says Hidalgo. The Bloomberg administration then made sure that every location in the city has a single, consistent address, now available to the public. “Interagency cooperation on address location” is “fundamental to a city as dense as New York,” Hidalgo says. As data quality and sharing improve, firefighters responding at a particular address could someday receive a warning that police have gone to the home multiple times for domestic-violence incidents, or see that the building’s landlord had violations at other buildings for dividing them into illegal and unsafe apartments—and that the landlord might have been doing the same thing with the burning building.
Half a decade ago, the state-run Metropolitan Transportation Authority started making data feeds available for the public’s use. [. . .] The MTA is exploring other applications; it held a “hackathon” in early March so that volunteers vying for $2,000 in prizes could crunch data to help the authority speed up Staten Island bus times. 
[. . .]
Open data can be deployed not only to improve government but also to help business owners cope with the government agencies that regulate them. Aileen Gemma Smith, a local entrepreneur, saw that after Sandy, small-business owners wanted to know such things as when a certain street would reopen. She noted that this lack of information, though more acute after a disaster, was chronic even in normal times. Business owners showing up for work would be surprised that the city had closed their street for repairs—meaning lost customers and thus lost revenue. “I went to shopkeepers and said, ‘I’m building this for you, talk to me about what’s important,’ ” she says. The app she launched, called Mind My Business, crawls through hundreds of the city’s data sets to give subscribers practical information: “the MTA is closing the subway stop near your store this weekend,” or “the city is repairing the sidewalk that goes by your shop this week,” or “the previous owner of the restaurant space you own got fined four times for the following violations.” “Data aren’t just for privileged folks doing research,” Smith says. “Open data is how I help the local bodega guy, how I help the diner that’s been there for 25 years.” Mind My Business has 2,000 local subscribers.
Amateurs can mine Big Data to improve the quality of life in the city, too, even if they know nothing about software coding. Paul Vogel, a Prospect Heights resident, got a camera for his bike a few years back because he “had a couple of bad run-ins” with reckless car and truck drivers, “and I’m really bad at remembering license plates.” When he gets home after a ride, he sends pictures of taxis and other for-hire cars whose drivers have violated various laws to 311. “I was surprised that the 311 system for [taxi complaints] is so efficient . . . that I could get someone fined,” he says. Over a year or so, his self-described “hobby” has earned the city about $30,000 in revenue. More important, he may have saved some lives, by deterring drivers he got fined from parking in bike lanes or running red lights again. Vogel tweets his successes. “Putting it out on social media has raised awareness a little bit,” he says. Several other people have contacted him to let him know that they’ve done the same thing.
Wanted: Information
In 1974, the New York Public Interest Research Group, or NYPIRG, a good-government organization, helped prevail upon the state legislature and Governor Malcolm Wilson to pass the nation’s third freedom-of-information law. The FOIL law, as reporters know it, gave the press and public the right to obtain any government documents unless, among other restrictions, they violated private citizens’ confidentiality. A decade later, good-government groups persuaded the city council to establish the commission on public information and communications, which, in turn, published the city’s first public-data directory in 1993. New Yorkers could now access a list showing every publicly available data set that the city maintained, even if they couldn’t actually see the data without special software and expertise.
Public-information laws have never been perfect. Government agencies sometimes charge onerous fees for documents, and they often interpret their mandate to protect privacy too broadly, forcing petitioners to spend money and time suing for what they should get for free. But the laws gave a generation of civic researchers a valuable new tool. Steven Romalewski, director of CUNY’s mapping service and a long-time veteran of data collection who worked for NYPIRG for 22 years, says that he spent much of his time there “accessing data and putting it to use.”
In the 1990s, Romalewski used information he gleaned via the law to map toxic-waste sites on Long Island, showing the public: “Here’s how close they are to parks, here’s how close they are to schools.” [. . .] “Information transmission has dramatically changed” in recent years, though, says Romalewski, so that it’s become “almost trivial” to download a data set that once could have taken months to obtain.



During the Bloomberg years, civic-minded citizens got a legal update for the connectivity age: the 2012 open-data law, which requires the city to make certain data sets available on a free online portal. Today, city agencies offer 1,400 data sets to download and examine, with no tools needed besides spreadsheet software—now free, thanks to Google—and some patience. If you’re up late, upset about a barking dog, you can find out within an hour or so how many other people have had the same complaint over the last six years, and where they live—DIY data collection and analysis that were unfathomable even 15 years ago.
Those responsible for providing the data, however, often resist its dissemination. “The open-data law was pushed by the [city] council, not the mayor,” says John Kaehny, of the New York City Transparency Working Group. Though Bloomberg supported more open data, the problem persists in government. The issue isn’t cost—the city was already collecting all the data it now releases automatically to the public through its open-data portal—but accountability. “Data can equal embarrassment,” says Kaehny. More data can make more people aware that the city has a problem—whether with slow ambulance-response times or a rising street population.
Another drawback, from government’s perspective, is loss of control. Kaehny notes that city agencies have historically preferred to release their data selectively to “trusted users.” Open-data policies make such data “feeding” harder. If information is power, those who once enjoyed exclusive access but no longer do become less powerful.
The biggest danger in the Big Data and open-data worlds may be complacency. Just because the city releases 1,400 data sets doesn’t mean that we know everything that we need to know. We still need FOIL, as well as journalists and civic activists, to ask for data that the city hasn’t already collected or won’t give out because no journalist or researcher has asked for them. One thing hasn’t changed: information that is free and easy to get is often the only information that the government wants you to see.
At some point, though, Big Data and open data run into an old-fashioned problem: the city knows what the information suggests that it should do—but it won’t do it. For years now, residents of Battery Park City and the rest of the lower Hudson waterfront have suffered from incessant noise from tourist helicopters, says John Dellapontas of Stop the Chop, a residents’ advocacy group. “We have flight data that we got from FOIL,” he notes—referring to the freedom-of-information law (see box) by which his group has petitioned the city and state to reveal how many helicopter flights take off from a city-owned helipad. He could show “round trips, one every minute,” flying by residents’ apartment windows. Yet the company that runs helicopter tours used the lack of 311 data to say that residents didn’t mind the flights. “That is true, but meaningless,” Dellapontas says. “We started doing 311, [but] we’d get a form response saying that it’s perfectly legal, which it is.” Instead, Stop the Chop “circumvented the 311 system and had 5,000 members e-mail blast” local politicians. “We basically created a more effective 311 system.” Stop the Chop won the data battle but lost the war. The compromise that the mayor came up with reduced flights to every two minutes, from every one minute—and extended the tour-helicopter company’s lease.
Midtown residents have had similar difficulty in getting the city to rezone land so that developers can’t build 1,000-foot-plus condominium towers that cast large shadows across public spaces. The “sunshine task force” of Manhattan’s Community Board 5, the arm of local government that is supposed to be closest to citizens’ needs, has spent more than two years amassing and analyzing property-records data, zoning rules, and building permits, and working with other nonprofits to show the consequences of poorly conceived construction. The first problem that local residents have run into is that data released by the city are often difficult to understand and analyze. When sharing information on, say, the property-rights transfers necessary to build super-tall towers, the city doesn’t put out a simple weekly list of all such transfers. Residents looking to learn about such activity in their neighborhoods must crawl online through hundreds of individual property records to see what activity occurred at those properties. “The way the information is buried, it becomes unusable,” says Layla Law-Gisiko, chairperson of the task force.



Second, even when residents are able to do the difficult work of presenting incontrovertible, easy-to-understand data, it’s still easy for the city council and the mayor to ignore those data. [. . .] “It really makes no sense,” says Law-Gisiko. “It’s really putting our democratic system in jeopardy.”
On the plus side, data’s role in public decision making has become increasingly hard to ignore. Even in New York’s city council, which often makes headlines for greenlighting poorly considered ideas, at least some proposals go down to defeat when they’re not backed by sufficient information. 
[. . .]
In some cases, however, government finds itself outgunned by private-sector firms that manipulate data to circumvent laws meant to protect New Yorkers’ quality of life. Take the example of Airbnb, which allows New Yorkers to turn their apartments into hotel rooms for paying guests. Airbnb’s most lucrative service allows New Yorkers to rent out entire empty apartments to strangers. This business is illegal under state and city law: New Yorkers do not want their apartment buildings to become hotels or youth hostels. Enforcing the law, though, is difficult. The city must rely on 311 callers to report illegal apartment rentals; then it must dispatch enforcers who wait, sometimes for hours, to spot illegal activity. The city expends taxpayer resources to find out something that Airbnb already knows, from its internal databases: which rentals are illegal and which are not. Before releasing select data to reporters in December 2015, Airbnb scrubbed its listing of at least 1,000 illegal rentals, in order to make the data look better to journalists. Airbnb knows where and when its “hosts” are breaking the law; the city does not.
[. . .]
The city should also allow people to continue a 311 complaint when they think that the city hasn’t resolved it successfully, rather than force them to open new complaints. Doing this involves overcoming two political hurdles. The police department responds to many complaints, but police unions don’t want GPS data tracking cruisers’ movements, and providing such specific data might prove what complainants suspect: that officers and inspectors are often too overwhelmed to respond.
[. . .]
The city could also learn when a garbage can is full and needs emptying, or count how many people walk through a particular intersection at particular times, or count how many people, precisely, get into a subway car—and use that information to provide better services. Sensors could count how many cars and trucks are in Manhattan—and prohibit other vehicles from coming in until some leave.
And New Yorkers, of course, have urban problems that data won’t solve. On many subway lines now, riders can look at “countdown clocks” to see when the next train will arrive—but knowing that the Lexington Avenue line train is coming in two minutes doesn’t change the fact that not everyone waiting on the platform will fit onto that train. New Yorkers don’t need Big Data to tell them that the subways are too crowded. Without better, smarter investment in the assets that our second modern urban revolution—electricity—gave us, we can’t fully capitalize on Big Data’s potential.

http://city-journal.org/html/fourth-urban-revolution-14334.html

The Fourth Urban Revolution
How Big Data is changing life in cities, for governments and citizens alike
Nicole Gelinas
Spring 2016

March 25, 2016

Surveillance Of Everyone Getting Worse




[From article]
Hackers can hit OnStar and Ford SYNC, unlock doors, kill the engine, turn on the car’s microphone, listen to you, and even deactivate the ignition. It’s not science fiction -- live road tests have proven these wireless attacks can work.
Smart phones and Google Glass, the wearable computer that looks like something you’d expect to see on Mr. Spock, provides yet another platform for spying. For years, governments have been able to remotely access computer devices -- whether laptops, desktops, smartphones, or tablets -- and turn on cameras and you’d never know it. That’s easily defeated with a Post-it note slapped over the lens. But with your smart phone or Google Glass, governments theoretically have the ability to remotely turn on and see everything the wearer sees, does, or hears -- and exactly where it’s all happening, using the internal GPS without the user knowing it’s been activated. Are you in your home having a private conversation with your spouse? Not anymore. Imagine you’re in your office working on a sensitive project, or in a board meeting, or perhaps at a doctor’s appointment, or discussing legal issues with your attorney that are supposed to be protected by privilege -- all of that is potentially accessible. Imagine your fate if companies or bad guys accessed this information about you... well, panic, because if they want it, they can get it.
[. . .]



The surveillance state has been expanded not only beyond the borders, but within as well, in ways that people probably never expected. Unmanned aerial vehicles fly along the borders with Canada and Mexico scanning for illegal crossings. In most major cities, there are cameras on every intersection, in police cars, on light poles, and in buildings.
[. . .]
So unless you smear mud on your license plate, you’re never going to be able to drive free of surveillance again -- and that’s just what a local city can do; imagine what a nation is capable of pulling off.
[. . .]



Recall the movie No Country for Old Men when the killer used the captive bolt pistol to execute the first victim on the road by putting it against his forehead and firing it? Imagine how the guy looked right after that bolt hammers into his skull and he’s no longer alive but he doesn’t know he’s dead -- that’s your right to privacy today.

http://www.americanthinker.com/articles/2016/03/hacking_terrorists_and_you.html

March 25, 2016
Hacking Terrorists… and You
By Jamie Smith and Cole Smith

December 27, 2015

Growing Concern About Extreme Abuses of Technology




[From article]
Astra Taylor’s iPhone has a cracked screen. She has bandaged it with clear packing tape and plans to use the phone until it disintegrates. She objects to the planned obsolescence of today’s gadgetry, and to the way the big tech companies pressure customers to upgrade.
Taylor, 36, is a documentary filmmaker, musician and political activist. She’s also an emerging star in the world of technology criticism. She’s not paranoid, but she keeps duct tape over the camera lens on her laptop computer — because, as everyone knows, these gadgets can be taken over by nefarious agents of all kinds.
[. . .]
Political progressives once embraced the utopian promise of the Internet as a democratizing force, but they’ve been dismayed by the rise of the “surveillance state,” and the near-monopolization of digital platforms by huge corporations.
[. . .]
Techno-skeptics, or whatever you want to call them — “humanists” may be the best term — sense that human needs are getting lost in the tech frenzy, that the priorities have been turned upside down. They sense that there’s too much focus on making sure that new innovations will be good for the machines.
[. . .]
Start the class with “You Are Not a Gadget” (Jaron Lanier), move on to “The Internet Is Not the Answer” (Andrew Keen), and then, to scare the students silly, “Our Final Invention: Artificial Intelligence and the End of the Human Era” (James Barrat). Somewhere in the mix should be Astra Taylor’s “The People’s Platform: Taking Back Power and Culture in the Digital Age,” a clear-eyed reappraisal of the Internet and new media.
[. . .]
Our thoughts, friendships and basic urges are processed by computer algorithms and sold to advertisers. The machines may soon know more about us than we know about ourselves.
That information is valuable. A frequent gibe is that on Facebook, we’re not the customers, we’re the merchandise. Or to put it another way: If the service is free, you’re the product.
[. . .]
There are grave concerns that robots are taking the jobs of humans. And the robot issue leads inevitably to the most apocalyptic fear: that machine intelligence could run away from its human inventors, leaving us enslaved — or worse — by the machines we created.
[. . .]
Our technology today is so new that we haven’t had time to understand how to use it wisely.
[. . .]
Washington’s political establishment, however, has largely deferred to Silicon Valley.
[. . .]
For example, Gary Shteyngart’s “Super Sad True Love Story” is a tale of people struggling to find love and humanity in a world of Big Brother-like surveillance, societal breakdown and increasingly coarse social norms. The novel features gadgets that allow people to rate one another numerically on their sexual attractiveness.
[. . .]
Dave Eggers’s novel “The Circle” tells of a rising star at a Google-like company. She excels by answering thousands of e-mails a day, working at a frenetic pace. She lives with a camera around her neck that streams everything she sees onto the Internet.
[. . .]
[Pope] Francis sketched the dangers, writing that technological development hasn’t been matched by development in human values and conscience.
[. . .]
The pontiff is saying, with his special authority, what many others are saying these days: Machines are not an end unto themselves. Remember the humans.
[. . .]
Jaron Lanier. He’s a musician, composer, performer and pioneer of virtual-reality headsets that allow the user to experience computer-generated 3D environments. [. . .] He believes that Silicon Valley treats humans like electrical relays in a vast machine.
[. . .]
Lanier later wrote two books lamenting the way everyone essentially works for Facebook, Google, etc., by feeding material into those central processors and turning private lives into something corporations can mon­etize. He’d like to see people compensated for their data in the form of micropayments.
[. . .]
In our society there are two paths to success: One is to be good at computers and the other is to be a sociopath.”
[. . .]
The same technologies that empower individuals and enable protesters to organize also make it possible for governments to spy on their citizens. What used to be a phone now looks to many people like a tracking device.
Then there’s the question of who’s making money. Progressives are appalled by the mind-boggling profits of the big tech companies.
[. . .]
“Where do humans fit into this new economy?” [Douglas Rushkoff, whose new book is titled “Throwing Rocks at the Google Bus,”] said. “Really not as creators of value, but as the content. We are the content. We are the data. We are the media. As you use a smartphone, your smartphone gets smarter, but you get dumber.”
[. . .]
people are participating in that system willingly — if perhaps not entirely aware of what is happening to their data.
Taylor’s smartphone with the cracked screen clearly has been in heavy use. She knows these gadgets are addictive by design — “like Las Vegas slot machines in our pockets.” But she also has trouble living without one.

https://www.washingtonpost.com/classic-apps/techno-skeptics-objection-growing-louder/2015/12/26/e83cf658-617a-11e5-8e9e-dce8a2a2a679_story.html

Techno-skeptics’ objection growing louder
By Joel Achenbach
 December 26, 2015 at 5:40 PM

July 20, 2015

Updated: White House Collects Personal Data To Racially Change The Nation


Posted July 18, 2015 8:09 PM ET; Last updated July 20, 2015 8:14 PM ET



Considering how secure data bases are this will also make it extremely easy to fake data. As for statistics as if it wasn't bad enough. In the words of Mark Twain, "There are lies. Damn lies. And then there are statistics." Place these numbers in the hands of spin doctors, lawyers and politicians and it will be more deception, more lies and more abuses of white people. Why not just ban white people?

[From article]
If you happened to be a born white conservative, you were always a natural “racist” to the race-obsessed Obama. The only difference now is that he’s managed to make it official.
[. . .]
The Obama administration is profiling the entire population in a rigid new world where people will be catalogued as racists—not because they really are but all because their government tagged them that way.
It’s a system where innocence of the charge doesn’t count.

http://canadafreepress.com/article/73861

Obama’s secret database forces ‘racist’ smear on innocent citizens
By Judi McLeod
July 19, 2015

* * *

[From article]
A key part of President Obama’s legacy will be the fed’s unprecedented collection of sensitive data on Americans by race. The government is prying into our most personal information at the most local levels, all for the purpose of “racial and economic justice.”
Unbeknown to most Americans, Obama’s racial bean counters are furiously mining data on their health, home loans, credit cards, places of work, neighborhoods, even how their kids are disciplined in school — all to document “inequalities” between minorities and whites.
This Orwellian-style stockpile of statistics includes a vast and permanent network of discrimination databases, which Obama already is using to make “disparate impact” cases against: banks that don’t make enough prime loans to minorities; schools that suspend too many blacks; cities that don’t offer enough Section 8 and other low-income housing for minorities; and employers who turn down African-Americans for jobs due to criminal backgrounds.
[. . .]
The granddaddy of them all is the Affirmatively Furthering Fair Housing database, which the Department of Housing and Urban Development rolled out earlier this month to racially balance the nation, ZIP code by ZIP code. It will map every US neighborhood by four racial groups — white, Asian, black or African-American, and Hispanic/Latino — and publish “geospatial data” pinpointing racial imbalances.
The agency proposes using nonwhite populations of 50% or higher as the threshold for classifying segregated areas.
[. . .]
Through its mandatory Civil Rights Data Collection project, the Education Department is gathering information on student suspensions and expulsions, by race, from every public school district in the country. Districts that show disparities in discipline will be targeted for reform.
Those that don’t comply will be punished. Several already have been forced to revise their discipline policies, which has led to violent disruptions in classrooms.
[. . .]
Even if no one has complained about discrimination, even if there is no other evidence of racism, the numbers themselves will “prove” that things are unfair.

http://nypost.com/2015/07/18/obama-has-been-collecting-personal-data-for-a-secret-race-database/

Obama collecting personal data for a secret race database
By Paul Sperry
July 18, 2015 | 4:00pm

March 26, 2015

Corporations Conduct Surveillance Assisting Government, Book Excerpt




[From article]
If you have a Gmail account, you can check for yourself. You can look at your search history for any time you were logged in. It goes back for as long as you’ve had the account, probably for years. Do it; you’ll be surprised. It’s more intimate than if you’d sent Google your diary. And while Google lets you see it, you have no rights to delete anything you don’t want there.
There are other sources of intimate data and metadata. Records of your purchasing habits reveal a lot about who you are. Your tweets tell the world what time you wake up in the morning, and what time you go to bed each night. Your buddy lists and address books reveal your political affiliation and sexual orientation. Your email headers reveal who is central to your professional, social, and romantic life.

Excerpted from DATA AND GOLIATH: The Hidden Battles to Collect Your Data and Control Your World by Bruce Schneier. Copyright © 2015 by Bruce Schneier. With permission of the publisher, W.W. Norton & Company, Inc.

http://www.wired.com/2015/03/data-and-goliath-nsa-metadata-spying-your-secrets/
BRUCE SCHNEIER
SECURITY 03.25.15
4:22 PM
NSA DOESN’T NEED TO SPY ON YOUR CALLS TO LEARN YOUR Secrets

September 29, 2014

Popular Anti Facebook Social Network




[From article]
Created last year as a "private" social network, Ello (www.ello.co) recently opened its doors on an invitation-only basis.
[. . .]
Ello's policy states that the practice of collecting and selling personal data and mapping your social connections for profit "is both creepy and unethical."
"Under the guise of offering a 'free' service, users pay a high price in intrusive advertising and lack of privacy."
[. . .]
But former Ello collaborator Aral Balkan said Ello has already been compromised by taking $435,000 in venture capital funding.
A designer and founder of ind.ie, a privacy advocacy group, Balkan said he worked briefly for Ello but left when he learned of the venture investments.
"When you take venture capital, it is not a matter of if you're going to sell your users, you already have," says a blog post from Balkan.

http://news.yahoo.com/anti-facebook-social-network-gets-viral-surge-044242310.html;_ylt=AwrBJR.oMihUexoAqzjQtDMD

'Anti-Facebook' social network gets viral surge

By Rob Lever
September 28, 2014

September 4, 2014

Google Tried To Redact Court Decision To Hide How They Search Your Emails


[From article]
It turns out that Google, which bases its business on collecting and analyzing huge reams of data for advertising purposes, has been scanning users' emails even before users have a chance to open or read them, including email messages that are deleted without being opened. Google knows what's in your email before you do.
The revelation came in a now-settled legal dispute over Google's Gmail service. Dozens of the nation's largest newspapers and media companies fought to make sure that the case — and its wide-ranging implications for Internet users — received a full public airing.
[. . .]
Google tried, and failed, to redact information about its email scanning process from a transcript of a public court hearing. Last month, the judge in the case ruled that portions of the transcript from that February hearing could not be redacted retroactively, since that would be tantamount to closing a public courtroom.

http://www.usatoday.com/story/opinion/2014/09/04/google-spying-advertising-privacy-column/15051241/

The information Google doesn't want you to organize: Column
Thomas R. Burke and Jonathan Segal
10:17 a.m. EDT September 4, 2014

September 1, 2014

Homeland Employees Security Data Hacked



[From article]
USIS, the Department of Homeland Security’s contractor for conducting security clearance background checks, has had the personal records of at least 25,000 of its employees stolen because of hackers, and the hackers may have been from a foreign country, according to the Associated Press (AP).
AP’s source was an unnamed DHS official who told AP that Homeland Security would soon let employees know if their personal information had been stolen and encourage them to check their financial accounts.

http://www.breitbart.com/Big-Government/2014/08/31/Hackers-Steal-Security-Check-Data-from-25-000-DHS-Employees?utm_source=twitterfeed&utm_medium=twitter

HACKERS STEAL SECURITY CHECK DATA FROM 25,000+ DHS EMPLOYEES
by WILLIAM BIGELOW
31 Aug 2014

July 1, 2014

Public Schools Collect Personal Data of Students Without Consent


[From article]
dozens of states have adopted the BMI-snitching Fitnessgrams, which are marketed by an outfit called the Cooper Institute. The group contracts with New York, Texas, California and a total of nearly 70,000 schools across the country to provide training, administration, data collection and dissemination of its reports. Big Brother is big business.
One of the Cooper Institute's most prominent members of its board of directors: Big Government Republican Mike Huckabee, who spearheaded mandatory student BMI reports in 2003 while he was governor of Arkansas. Huckabee has sided with first lady Michelle Obama's meddling initiatives on childhood obesity — which he calls an "issue of national security." Public health bureaucrats use exactly such hyperbolic rhetoric to justify increasing their powers, budgets and control.

http://www.jewishworldreview.com/michelle/malkin053014.php3#.U7Iu-90--yM

Jewish World Review
May 30, 2014 / 1 Sivan, 5774
The Data-Mining Body Monitors in Our Schools
By Michelle Malkin

June 18, 2014

USPS Wants To Compete With NSA



[From article]
The idea was first raised at a January 28, 2014 meeting sponsored by the OIG and the Universal Postal Union. The "Internet of Things" concept is defined in the documents accompanying the OIG's solicitation as:
[T]he ability to embed sensors and other data collection technologies into physical objects, infrastructures, and the surroundings in which people live and businesses operate – is one of the latest technology revolutions that are affecting the nature of business.
The OIG acknowledges the issue of privacy and asks that respondents have "appropriate knowledge to assess the impact of privacy and transparency policies on the design of data strategies is also requested."

http://www.weeklystandard.com/blogs/postal-service-explores-sensors-data-collection-vehicles-mailboxes-machines-letter-carriers_795287.html

Postal Service Explores Sensors, Data Collection Via 'Vehicles, Mailboxes, Machines, Letter Carriers'
7:01 AM, JUN 18, 2014 • BY JERYL BIER

June 16, 2014

NYPD Officer Sentenced to Prison For Misuse of Computer Data



[From article]
Vargas admit ted that from April 2010 to May 2012, he paid a Los Angeles company specializing in email hacking to supply him with personal log-in credentials to help spy on his ex-lover.
The data included information on at least 20 of his NYPD colleagues, including his former girlfriend.
He admitted using the information to access the account of at least one person . Vargas also dug up personal information on two cops using the FBI’s National Crime Information Center, and accessed the phone records of another victim, authorities said.
[. . .]
Vargas was disciplined two years ago for allegedly stalking his ex, sources said. He was penalized five vacation days and was transferred from the 40th to the 44th Precinct, both in The Bronx.
The woman, who was not identified, complained at the time that she was being stalked, and said that Vargas had sent her harassing texts and called her names, the sources said.

http://nypost.com/2014/06/02/ex-cop-will-go-to-prison-for-hacking-nypd-over-love-triangle/

Ex-cop will go to prison for hacking NYPD over love triangle
By Kirstan Conley and Rich Calder
New York Post
June 2, 2014 | 2:19pm

May 1, 2014

Flawed Government Computer Data Base in New York City


[From article]
Because fingerprints are submitted at the time of arrest, the FBI database includes many people who ultimately were never charged with a crime or were found not guilty. In New York City, for example, 40% of people arrested eventually have their cases dismissed. But those people were already added to the FBI database, and there is no evidence that the FBI deletes the records of people who were never convicted.

http://www.nydailynews.com/opinion/obama-assault-immigrants-article-1.1769345?utm_source=Daily+News+2014&utm_medium=email&utm_campaign=DailyNews_2014_509433&utm_content=20191672&utm_term=_509433_509484

Obama’s assault on immigrants
An over-broad definition of "convicted criminal" leaves far too many law-abiding immigrants at risk
BY ROBERT M. MORGENTHAU
NEW YORK DAILY NEWS
Monday, April 28, 2014, 4:00 AM

March 30, 2014

Meta Data Reveals Personality Types






[From article]
A group of researchers from the MIT Media Lab found that your metadata — including, but not limited to, the way in which you use your phone, how you make calls, to whom, for how long, etc. — can serve as an indicator of your personality.
Here’s how they figured it out. The researchers, Yves-Alexandre de Montjoye, Jordi Quoidbach, Florent Robic and Sandy Pentland, had 100 students fill out surveys to determine their personality along five distinct personality types:



Neurotic: Defined roughly as a higher than normal tendency to experience unpleasant emotions
Open: Defined as broadly curious and creative
Extroverted: As in, looks toward others for stimulation
Agreeable: As in warm, compassionate, and cooperative
Conscientiousness: Self-disciplined organized and eager for success

http://www.defenseone.com/technology/2014/03/how-nsa-can-use-metadata-predict-your-personality/81538/?oref=d-topstory

How the NSA Can Use Metadata to Predict Your Personality
Patrick Tucker March 28, 2014

November 16, 2013

Federal Databases Available To Local Police, and To Public


[From article]
As Seattle perfects its massive surveillance system, the technology is likely to replicate nation-wide as more and more mesh network nodes pop up across major cities. While these networks could positively benefit certain first responders, the federal government’s involvement gives extra assurance that the system will be used against law-abiding Americans, as it already has.
With Homeland Security’s blatant targeting of peaceful American citizens, such as their labeling of military veterans as the number one terror threat, opposition to the illegal spy grid takeover has become more essential than ever.

http://www.infowars.com/new-mesh-network-documents-confirm-police-vehicles-real-time-access-to-dhs-spy-cameras/

New Mesh Network Documents Confirm Police Vehicle’s Real-Time Access To DHS Spy Cameras
Mikael Thalen
Infowars.com
November 16, 2013

September 10, 2013

Consumer Financial Protection Bureau Collecting Ten Years Of Personal Data

[From article]
Serious allegations are being raised in the legal community that the Consumer Financial Protection Bureau has recruited the U.S. Trustee Program to collect bankruptcy data on its behalf to aid a controversial data-mining program.
Documents obtained by the Washington Examiner describe efforts by the CFPB to collect a decade's worth of private financial data on the consumer behavior of five million American citizens without their knowledge or consent. The CFPB data-mining campaign has alarmed privacy watchdogs.

http://washingtonexaminer.com/article/2535482

Consumer agency threatens independence of bankruptcy office
BY RICHARD POLLOCK
SEPTEMBER 10, 2013 AT 10:54 AM

June 21, 2013

Gov't Can Collect and Keep Citizen Data Acquired by Mistake







[From article]
The secret U.S. court operating under the Foreign Intelligence Surveillance ACT (FISA) has given the National Security Agency a green light to use data collected 'inadvertently' from Americans while spying on foreign targets, it was revealed today.

http://www.dailymail.co.uk/news/article-2345477/Revealed-The-secret-rules-allow-NSA-spy-U-S-citizens-accidentally-collected-data-years-use-warrant.html

Revealed: The top secret rules that allow NSA to 'spy on U.S. citizens, keep accidentally collected data for five years and use it without a warrant'
By DAILY MAIL REPORTER
PUBLISHED: 18:43 EST, 20 June 2013 | UPDATED: 18:43 EST, 20 June 2013

June 12, 2013

Personal Data For Sale Cheap




[From article]
For $0.26 per person, LeadsPlease.com sells the names and mailing addresses of people suffering from ailments such as cancer, diabetes and clinical depression. The information includes specific medications including cancer treatment drug Methotrexate and Paxil, the antidepressant, according to price details viewed by the FT.

http://www.ft.com/intl/cms/s/0/f0b6edc0-d342-11e2-b3ff-00144feab7de.html#axzz2W2pDfnKW

June 12, 2013 8:11 pm
Companies scramble for consumer data
By Emily Steel in New York

April 7, 2013

ATF Wants To Create Massive Data Base of People and Connections




This sounds like what FaceBook, and Google do.

http://cnsnews.com/blog/gregory-gwyn-williams-jr/atf-seeks-massive-database-personal-info-assets-relatives-associates

ATF Seeks 'Massive' Database of Personal Info: 'Assets, Relatives, Associates and More'
April 6, 2013
By Gregory Gwyn-Williams, Jr.

February 12, 2013

Raytheon Has New Online Surveillance System


http://www.smh.com.au/digital-life/consumer-security/google-for-spies-draws-ire-from-rights-groups-20130211-2e75y.html#ixzz2KY9r4cJJ

'Google for spies' draws ire from rights groups
February 11, 2013
Sydney (Australia) Morning Herald
Ryan Gallagher

July 20, 2012

Vegas Casino Sues Over Data Breach, After Women Employee Files Sexual Harassment Complaint

http://www.boston.com/news/nation/articles/2012/07/20/vegas_casino_employee_took_high_roller_info/

Vegas casino: Employee took high-roller info
By Ken Ritter
Associated Press
Boston Globe
July 20, 2012