Big Data on Flipboard

By Sanjana Hattotuwa | Articles on Big and Open Data, with a focus on rights & privacy.

Unstructured Data: The Other Side of Analytics

Everyone is obsessed with “analytics.” I cannot keep up with what the technology pundits and consultants are telling me about analytics, no matter how hard I try. (I just Googled “big data analytics” and got 107,000,000 results in 0.29 seconds.)

If you listen to these people, you will absolutely, …

Unstructured Data

Big video data could change how we do everything — from catching bad guys to tracking shoppers

GUEST:

Everyone takes pictures and video with their devices. Parents record their kids’ soccer games, companies record employee training, police surveillance cameras at busy intersections run 24/7, and drones monitor pipelines in the desert.

With vast amounts of video growing vaster at a rate faster …

Q&A: The UN Global Pulse director on big data’s future

In this audio interview, Robert Kirkpatrick highlights the challenges ahead for data and sustainable development.

Big Data

Big data: 8 ideas to watch

A look at the major forces shaping the data world.

By Ben Lorica

This story was originally published on O’Reilly Radar as part of our exploration of big

12 data maps that sum up London

A new collection of data maps of London reveals a city heaving with information.

A quick quiz question for you. How many football pitches could fit inside the Greater London boundary? Well, 220,000 of them would fill the space between Cockfosters and Croydon, Heathrow and Hornchurch.

That statistic …

Using Big Data To Fight Pandemics

Editor’s note: Nuria Oliver is a scientific director at Telefonica looking at how the use of big data can help to fight pandemics such as Ebola and bird flu.

Last year, I gave a talk at WIRED 2013​ on how anonymous and aggregated mobile phone data can be used to understand and combat the spread of …

Big Data

Big Data: Putting Heat on the Hate

Five years ago, President Obama signed the Matthew Shepard and James Byrd Jr. Hate Crimes Prevention Act.

That law, enacted in memory of two people brutally killed in hate crimes, has generated important police training and outreach to prevent crimes rooted in hate-filled discrimination and bigotry. …

London police trial gang violence 'predicting' software

Police in London have tested software designed to identify which gang members are most likely to commit violent crimes.

The 20-week pilot study is thought to have been the first of its kind in the UK, although similar experiments have been carried out elsewhere.

It used five years worth of historic …

Policing

Riding with the Stars: Passenger Privacy in the NYC Taxicab Dataset

In my previous post, Differential Privacy: The Basics, I provided an introduction to differential privacy by exploring its definition and discussing …

Maps

TED: Susan Etlinger: What do we do with all this big data? - Susan Etlinger (2014)

Does a set of data make you feel more comfortable? More successful? Then your interpretation of it is likely wrong. In a surprisingly moving talk, …

Big Data

See Your Life Through The Lens Of History With This Data Viz Site From BBC Earth

As part of the expansion of the BBC Earth platform, the broadcaster creates an interactive data viz that allows users to see their lives in historical context.

Ever wondered the distance you've traveled since you were born? How many meters a coast redwood has grown in your lifetime? Or the number of …

Historical Photography

Sir Tim Berners-Lee speaks out on data ownership

The data we create about ourselves should be owned by each of us, not by the large companies that harvest it, the Tim Berners-Lee, the inventor of the world wide web, said today.

Berners-Lee told the IPExpo Europe in London’s Excel Centre that the potential of big data will be wasted as its current …

Tim Berners-Lee

How big data is fueling a new age in space exploration

GUEST POST

In 2018, a group of organizations from all of the world will begin construction of the largest radio telescope ever built, the Square Kilometre Array (SKA).

With one million square meters of collecting area and enough optical fiber to wrap around the Earth twice, this marvel of modern …

The tricky business of acting on live data before it’s too late

For all the talk about big data and how it can help us track down needles in haystacks, there’s still a lot of work to when it comes to issues like public health. When successful intervention might require timelines of minutes or hours rather than days, it takes a might keen eye to monitor lots of …

Data

Scientists Can Now Predict Where People Will Run When An Earthquake Strikes

Based on travel patterns logged in your phone, one model shows how disaster response teams can see whether you’ll flee to a shelter, a friend’s, or your mom’s house.

University of Tokyo professor Xuan Song cracks open his laptop and shows me a birds-eye view of Japan's capital city on the day of the …

Earthquakes

For Big-Data Scientists, ‘Janitor Work’ Is Key Hurdle to Insights

Technology revolutions come in measured, sometimes foot-dragging steps. The lab science and marketing enthusiasm tend to underestimate the bottlenecks to progress that must be overcome with hard work and practical engineering.

The field known as “big data” offers a contemporary case study. The …

Janitor

What does big data say about Sri Lanka?

On 8th August 2014, LIRNEasia held an event titled “Big data for development: Responsible use of mobile meta-data to support public purposes” in …

Sri Lanka

US bots flagged Ebola before outbreak announced

1,323 And Rising: Illustrating The Human Toll Of The Israel-Palestine Conflict

That includes more than 200 children.

More than a thousand people have died in the conflict over Gaza since tensions flared at the beginning of July, including over 200 children. This simple, but powerful, interactive visualization from the Washington Post plots the deaths, illustrating each …

War

The Social Laboratory

Singapore is testing whether mass surveillance and big data can not only protect national security, but actually engineer a more harmonious society.

Google Wants To Improve Its Translations Through Crowdsourcing

Over the years, Google Translate has gotten significantly better at giving its users (relatively) legible translations for most commonly used languages. It’s still far off from being perfect, though, and today Google announced a new initiative that aims to get more input from its users to improve …

Google

How IBM is using big data to fix Beijing’s pollution crisis

Of China’s major cities, Beijing’s pollution problem is probably the worst, causing thousands of premature deaths every year. Its residents are fed up. The growing outrage has forced leaders to declare a “war on pollution,” including the goal of slashing Beijing’s PM2.5— the concentration of the …

Beijing

n=all: Presentation on big data for United Nations Department of Political Affairs (DPA)

The UN General Assembly in December 2014 approved the UN ...more

On 20-21 January 2015, the ICT4Peace Foundation organised a workshop hosted …

United Nations

Unlocking Big Data's Value Potential Through Design with Small Data

Co-written by Finn Birger Lie

Big Data is perceived as the next value opportunity for corporations to innovate and grow. To be of any real value, however, Big Data has to become more accessible and understandable to non-specialist users and leave the domain of the data specialists.

The advent of …

Data

Ushahidi's CrisisNet Aims to Provide Usable Crisis Data "Within Seconds"

Open source technology-maker Ushahidi only made their new crisis data tool public this week, but there are already several neat examples of potential …

Ushahidi

We're all being mined for data – but who are the real winners?

It's exactly a year since Edward Snowden's revelations about NSA and GCHQ surveillance began to reach the public domain. As a result, we now know quite a lot about the ways the NSA and its overseas franchises have mastered "big data" technology to hoover up our metadata and monitor our clickstreams …

Surveillance

Medicine’s Big Problem with Big Data: Information Hoarding

Researchers at IBM, Berg Pharma, Memorial Sloan Kettering, UC Berkeley and other institutions are exploring how artificial intelligence and big data can be used to develop better treatments for diseases (as we explored in a separate story on Saturday).

But one of the biggest challenges for making …

Big Data knows you're sick, tired and depressed

From the diseases you battle to the pills you pop, your most personal health information could be for sale.

That's because some data brokers are collecting information from the surveys you take, websites you visit, products you buy and mobile apps you use to create lists of consumers with certain …

Big Data