== Will Wall Street give us Terminator? Others weigh in ==
A few years ago, I posed a chilling hypothesis, that AGI — or “artificial general intelligence” that’s equivalent or superior to human — might “evolve-by-surprise,” perhaps even suddenly, out of advanced computational systems. And yes, that’s the garish-Hollywood “Skynet” scenario leading to Terminator.
Only I suggested a twist — that it would not be military or government or university computers that generate a form of intelligence, feral and self-interested and indifferent to human values. Rather, that a dangerous AI might emerge out of the sophisticated programs being developed by Wall Street firms, to help them game (many might say cheat) our economic system.
Indeed, more money is being poured into AI research by Goldman-Sachs alone than by the top five academic centers, put together, and all of it helping to engender systems with a central ethos of predatory opportunism and parasitic amorality.Oh, and did I mention it’s all in secret? The perfect Michael Crichton scenario.
Now comes a book by documentary filmmaker James Barrat — Our Final Invention: Artificial Intelligence and the End of the Human Era — reviewed here on the ThinkAdvisor site — Are Killer Robots the Next Black Swan? — in which Barrat discusses a scenario sketched out by Alexander Wissner-Gross, a scientist-engineer with affiliations at Harvard and MIT, that seems remarkably similar to mine. Opines Wissner-Gross:
“If you follow the money, finance has a decent shot at being the primordial ooze out of which AGI emerges.”
Barrat elaborates: : “In other words, there are huge financial incentives for your algorithm to be self-aware—to know exactly what it is and model the world around it.”
The article is well-worth a look, though it leaves out the grand context — that “emergent-evolving” AGI make up only one category out of six different general varieties of pathways that might lead to AI. To be honest, I don’t consider it to be the most likely.
But that has not bearing on what we — as a civilization — should be doing, which is taking reasonable precautions. Looking ahead and pondering win-win ways that we can move forward while evading the most obviously stupid mistakes.
Secret schemes of moohlah masters — that’s no recipe for wisdom. Far better to do it all in the light.
== Everything leaks ==
Heartbleed: Yes It’s Really That Bad. So says the Electronic Frontier Foundation (EFF). Heartbleed exploits a critical flaw in OpenSSL, which is used to secure hundreds of thousands of websites including major sites like Instagram, Yahoo, and Google. This article in WIRED also suggests that you can redouble your danger by rushing to trust fly by night third parties offering to fix the flaw… and meanwhile, “big boys” of industry aren’t offering general solutions, only patches to their own affected systems.
The crux? (1) change your passwords on sites where financial or other vital info is dealt-with, then gradually work your way through the rest, as each site offers you assurances. (2) try not to have the passwords be the same. (3) help ignite political pressure for the whole world of online password security to have a rapid-response component (not dominance) offered by a neutral agency… one that is totally transparent, neutral and separate from all law or espionage “companies.” And…
…and (4) might I ask if you’ve noticed that this kind of event happens about twice a year? And it has been that way since the 1980s? Each of the events a scandal in its own right… hackers grab half a million Target card numbers… or Microsoft springs a leak… or Goldman Sachs… or Equifax… or Chelsea Manning and Julian Assange and Edward Snowden rip off veils of government secrecy… and pundits howl and the public quakes and no one ever seems to draw the correct conclusion —
– that everything eventually leaks! And that maybe the entire password/secrecy model is inherently flawed. Or that there is another, different model that is inherently far more robust, that has only ever been mentioned in a few places, so far.
Here is one of those places.
Meanwhile, whistleblowers remain a vital part of reciprocal accountability. I would like to see expanded protections that simultaneously expand reciprocal accountability and citizen sousveillance… while allowing our intitutions to function in orderly ways.
Now this announcement that the Project of Government Oversight (POGO) install SecureDrop… a new way for whistle blowers to deposit information anonymously and shielded from authorities trying to root out leakers. As author of The Transparent Society, I sometimes surprise folks by straddling this issue and pointing out that the needs of the bureaucracy should not be discounted completely! Or by reflex. Whistle blowing falls across a very wide spectrum and if we are sophisticated citizens we will admit that the revealers of heinous-illegal plots deserve more protection than mewling attention junkies.
Still, there is a real role to be played by those pushing the envelope. Read more about Pogo here.
Then again… Facebook can now listen in on your activities with a new audio recognition feature for its mobile app that can turn on smartphones’ microphones to “hear” what songs or television shows are playing in the background. Sounds cool… um, not.
== Brandeis the Seer ==
The famous dissent in Olmstead v. United States (1928)To , by Justice Louis Brandeis, is a vital mirror to hold up to our times. Take the most famous part of eloquent dissent, regarding a seminal wiretapping case:
“Our Government is the potent, the omnipresent teacher,” Brandeis concluded. “For good or for ill, it teaches the whole people by its example. Crime is contagious. If the Government becomes a lawbreaker, it breeds contempt for law; it invites every man to become a law unto himself; it invites anarchy. To declare that in the administration of the criminal law the end justifies the means — to declare that the Government may commit crimes in order to secure the conviction of a private criminal — would bring terrible retribution.”
Which brings us to Andrew O’Hehir’s article on Salon, recently, using Brandeis as a foil to discuss – and denounce – some recent polemics against Edward Snowden and his journalist outlet, Glenn Greenwald. To be honest, I found O’Hehir tendentious and sanctimonious, but there were some cogent moments that made the article worthwhile, especially when he shone some light on the incredible prescience Brandeis showed, in his 1928 dissent:
“If Brandeis does not literally predict the invention of the Internet and widespread electronic surveillance, he comes pretty close,” for Brandeis wrote, “The progress of science in furnishing the Government with means of espionage is not likely to stop with wire-tapping …Ways may someday be developed by which the Government, without removing papers from secret drawers, can reproduce them in court, and by which it will be enabled to expose to a jury the most intimate occurrences of the home.” Brandeis even speculated that psychiatrists of the future may be able to read people’s “unexpressed beliefs, thoughts and emotions” as evidence. O’Hehir notes, “…as far as I know we haven’t reached that dystopian nightmare yet. (But if that’s the big final revelation from the Snowden-Greenwald trove of purloined NSA secrets, you read it here first.)”
== Transparency media ==
Anyone care to review this for us? Post-Privacy and Democracy: Can there be Moral and Democratic Development in a Totally Transparent Society? by Patrick Held. It provides arguments why the end of privacy or at least secrecy might be inevitable given our individual demand for technology.