MIT project turns your inbox into an infographic

Researchers at MIT's Media Lab use e-mail metadata to create infographics of users' correspondences.

Immersion screenshot
The Immersion data visualization project creates a web of e-mail interactions using metadata.

There is a saying: Show me a man’s friends, and I will show you the man. A recent project at the Massachusetts Institute of Technology’s Digital Media Lab takes a new spin on this adage: Show me a man’s metadata, and I will show you the man.

Two master’s students at MIT devised a computer program that allows users to see a “visual inbox” using scraps of information from their e-mail accounts.

Nearly a year before leaks about the National Security Agency’s data collection and surveillance program were splashed across the front pages, two students at MIT began working on a project with their advisor that shows the wealth of information that can be pieced together from metadata.

Cesar Hidalgo, a professor at MIT’s Media Lab, had wanted to create an infographic using metadata from e-mail addresses, but never had an opportunity to work on the project. Last September, Mr. Hidalgo decided to turn over the idea to two of his students: Daniel Smilkov and Deepak Jagdish. Mr. Smilkov had a strong background in math and analytics, and Mr. Jagdish brought in several years of art and design experience, writes Hidalgo in a blog entry about the project’s conception.  

Throughout the fall semester, the pair crafted a computer program that could sweep through an e-mail account in a matter of minutes and create a visual representation of the account’s correspondences.

The “Immersion” project runs from a website that uses a technology called OAuth to securely access a user's Gmail account information. Neither the e-mail address, nor the password is visible to Immersion because of the security behind the log-in page.

Using metadata – the “from,” “to,” “Cc,” and timestamp of e-mails – Immersion creates an infographic of the account’s correspondences.

In about a minute, circles and dots – some interconnected and some floating by themselves – appear on the screen. Each circle is representative of a person, and has a name at the bottom of the screen. The larger the circle, the more e-mails exchanged with that person. Lines connect different e-mail accounts, and people in the same e-mail web have the same colored dots. The colors of the dots are randomly generated.

On the right-hand side of the website, there are graphs of e-mails sent, received, and the number of new collaborators. There is also an option to view "top collaborators" within different time ranges. A time-slider at the bottom of the screen lets users slide through their e-mail accounts to watch as circles shrink, grow, emerge and disappear.

To test Immersion, Jagdish, Smilkov, and Hidalgo set up a small exhibit in MIT’s Media Lab lobby and presented the system in April. “It was...then that we started to realize the emotional reactions that Immersion was able to generate,” writes Hidalgo. Even the bare bones of e-mail correspondences (the metadata) created a kind of “social nudity,” exposing webs of interactions.

“It was moving,” says Jagdish in an interview with the Monitor. For him, the time-slider was the most important part of the experiment. Jagdish was cursorily aware of with whom he keeps in touch, but he says, until he used Immersion, it was hard to really conceptualize how his patterns of correspondence have changed over the years. Jagdish’s group of friends began joking about who ranked highest on the list of collaborators, and how big each others dots were, to determine who was closest to whom.   

Smilkov had similar experiences after the site launched. With Immersion, users are “likely to see ... old relationships in a different mindset,” he says. Both Smilov and Jagidsh got back into touch with old acquaintances who appeared on their webs.

When the project debuted at the end of June, the website received so much traffic that it crashed within several days. After the sites re-launch on July 4, it received 60,000 visits the next day.   

While the infographic is a demonstration of patterns in e-mail interactions, it is also a testament to just how much information is available from metadata.

“For the press, [Immersion] was the tool that allowed you to Prism yourself,” writes Hidalgo. “Immersion made a dent in the discussion of the government’s use of metadata, and has given a new meaning to the ‘it’s just metadata’ argument voiced by governments.”

Smilkov and Jagidsh’s project allows users to erase all of their metadata from the MIT servers, and the website states that the researchers do not access other parts of your e-mail accounts. The data collected is “zero information, just interaction,” says Smilkov.

You've read  of  free articles. Subscribe to continue.

Dear Reader,

About a year ago, I happened upon this statement about the Monitor in the Harvard Business Review – under the charming heading of “do things that don’t interest you”:

“Many things that end up” being meaningful, writes social scientist Joseph Grenny, “have come from conference workshops, articles, or online videos that began as a chore and ended with an insight. My work in Kenya, for example, was heavily influenced by a Christian Science Monitor article I had forced myself to read 10 years earlier. Sometimes, we call things ‘boring’ simply because they lie outside the box we are currently in.”

If you were to come up with a punchline to a joke about the Monitor, that would probably be it. We’re seen as being global, fair, insightful, and perhaps a bit too earnest. We’re the bran muffin of journalism.

But you know what? We change lives. And I’m going to argue that we change lives precisely because we force open that too-small box that most human beings think they live in.

The Monitor is a peculiar little publication that’s hard for the world to figure out. We’re run by a church, but we’re not only for church members and we’re not about converting people. We’re known as being fair even as the world becomes as polarized as at any time since the newspaper’s founding in 1908.

We have a mission beyond circulation, we want to bridge divides. We’re about kicking down the door of thought everywhere and saying, “You are bigger and more capable than you realize. And we can prove it.”

If you’re looking for bran muffin journalism, you can subscribe to the Monitor for $15. You’ll get the Monitor Weekly magazine, the Monitor Daily email, and unlimited access to