Big Data

By Sanjana Hattotuwa | Articles on Big and Open Data, with a focus on rights & privacy.

Google wants to show you all the data it's collected about your online habits

The web giant's new tool lets you review the sites you visit, the searches you make and the videos you watch, among other things.<p>It's common …

Google

How Big Data Harms Poor Communities

Surveillance and public-benefits programs gather large amounts of information on low-income people, feeding opaque algorithms that can trap them in poverty.<p>Big data can help solve problems that are too big for one person to wrap their head around. It’s helped businesses cut costs, cities plan new …

Big Data

These Beautiful Maps Let You Explore How Your City Sounds

The urban aural landscape has a huge impact on our lives—from the roar of traffic and clatter of jackhammer, to the groove of music and lullaby of …

Maps

Scientists are asking the wrong questions of big data

Big Data is changing the way we do science today. Traditionally, data were collected manually by scientists making measurements, using microscopes or surveys. These data could be analyzed by hand or using simple statistical software on a PC.<p>Big Data has changed all that. These days, tremendous …

Big Data

Spies Sans Frontières?

A months-long investigation by IRIN into the secretive intelligence-linked firm Palantir, reveals a cosying up to aid organisations large and small, …

World

Pathways Project

This Beautiful Timeline Lets You Explore Wikipedia's World History

GIF<p>This amazing visualization brings together the world’s history from Wikipedia into an interactive timeline stuffed with information and images. If …

World History

Follow the world's mass transit on this live map

Sure, it's not hard to learn when your bus is likely to show up, but have you wondered where everyone else's bus is at any given moment? You now have an easy way to find out. GeOps and the University of Freiburg have rolled out TRAVIC (Transit Visualization Client), a map that shows the real-time …

Maps

If Algorithms Know All, How Much Should Humans Help?

Armies of the finest minds in computer science have dedicated themselves to improving the odds of making a sale. The Internet-era abundance of data and clever software has opened the door to tailored marketing, targeted advertising and personalized product recommendations.<p>Shake your head if you …

Computer Science

UN bodies present projects showing how ‘Big Data’ can save lives, fight hunger

9 April 2015 – Anonymized data – information from which the identity of the sender has been stripped – from mobile telephone usage could provide …

United Nations

These 6 Art Projects Make Urban Data More Accessible For The Rest Of Us

It turns out that air pollution and traffic jams make for some fascinating data-inspired art.<p>As big data in cities gets bigger, with growing numbers of sensors tracking everything from air pollution to traffic jams, the resulting piles of information aren't necessarily easy for people living in …

Big data can make South Asian cities more authoritarian

Nalaka Gunewardene has an interesting article on smart cities published on Scidev.net, in which he makes the case our cities today are just too …

Big Data

Unstructured Data: The Other Side of Analytics

Everyone is obsessed with “analytics.” I cannot keep up with what the technology pundits and consultants are telling me about analytics, no matter how hard I try. (I just Googled “big data analytics” and got 107,000,000 results in 0.29 seconds.)<p>If you listen to these people, you will absolutely, …

Analytics

Big video data could change how we do everything — from catching bad guys to tracking shoppers

Everyone takes pictures and video with their devices. Parents record their kids’ soccer games, companies record employee training, police surveillance cameras at busy intersections run 24/7, and drones monitor pipelines in the desert.<p>With vast amounts of video growing vaster at a rate faster than …

Satellite Imagery

Q&A: The UN Global Pulse director on big data’s future

Big Data

Big data: 8 ideas to watch

A look at the major forces shaping the data world.<p><i>This story was originally published on</i> <i>O’Reilly Radar</i> <i>as part of our exploration of big data’s big</i> …

Data Mining

12 data maps that sum up London

<b>A new collection of data maps of London reveals a city heaving with information.</b><p>A quick quiz question for you. How many football pitches could fit inside the Greater London boundary? Well, 220,000 of them would fill the space between Cockfosters and Croydon, Heathrow and Hornchurch.<p>That statistic …

London

Using Big Data To Fight Pandemics

<b>Editor’s note:</b> <i>Nuria Oliver is a scientific director at Telefonica looking at how the use of big data can help to fight pandemics such as Ebola and bird flu.</i><p>Last year, I gave a talk at WIRED 2013​ on how anonymous and aggregated mobile phone data can be used to understand and combat the spread of …

Big Data

London police trial gang violence 'predicting' software

<b>Police in London have tested software designed to identify which gang members are most likely to commit violent crimes.</b><p>The 20-week pilot study is …

Policing

Riding with the Stars: Passenger Privacy in the NYC Taxicab Dataset

In my previous post, Differential Privacy: The Basics, I provided an introduction to differential privacy by exploring its definition and discussing …

Privacy

What do we do with all this big data?

Does a set of data make you feel more comfortable? More successful? Then your interpretation of it is likely wrong. In a surprisingly moving talk, …

Big Data

See Your Life Through The Lens Of History With This Data Viz Site From BBC Earth

As part of the expansion of the BBC Earth platform, the broadcaster creates an interactive data viz that allows users to see their lives in historical context.<p>Ever wondered the distance you've traveled since you were born? How many meters a coast redwood has grown in your lifetime? Or the number of …

BBC

Sir Tim Berners-Lee speaks out on data ownership

The data we create about ourselves should be owned by each of us, not by the large companies that harvest it, the Tim Berners-Lee, the inventor of the world wide web, said today.<p>Berners-Lee told the IPExpo Europe in London’s Excel Centre that the potential of big data will be wasted as its current …

Tim Berners-Lee

How big data is fueling a new age in space exploration

In 2018, a group of organizations from all of the world will begin construction of the largest radio telescope ever built, the Square Kilometre Array (SKA).<p>With one million square meters of collecting area and enough optical fiber to wrap around the Earth twice, this marvel of modern engineering …

Space

The tricky business of acting on live data before it’s too late

Advertisement<p>3 Comments<p>Credit: GDELT<p>For all the talk about big data and how it can help us track down needles in haystacks, there’s still a lot of …

Big Data

Scientists Can Now Predict Where People Will Run When An Earthquake Strikes

Based on travel patterns logged in your phone, one model shows how disaster response teams can see whether you’ll flee to a shelter, a friend’s, or your mom’s house.<p>University of Tokyo professor Xuan Song cracks open his laptop and shows me a birds-eye view of Japan's capital city on the day of the …

For Big-Data Scientists, ‘Janitor Work’ Is Key Hurdle to Insights

Technology revolutions come in measured, sometimes foot-dragging steps. The lab science and marketing enthusiasm tend to underestimate the bottlenecks to progress that must be overcome with hard work and practical engineering.<p>The field known as “big data” offers a contemporary case study. The …

Big Data

What does big data say about Sri Lanka? » LIRNEasia - a regional ICT policy and regulation think tank active across the Asia Pacific

On 8th August 2014, LIRNEasia held an event titled “Big data for development: Responsible use of mobile meta-data to support public purposes” in …