In trying to finish a Storify on a long-gone event, I did some research into digging up old tweets. Twitter is a moving target and most of the information I found is incomplete or outdated. So I thought I'd share what I've been able to figure out.

The problem

Twitter has done well. Really well: to succeed as well as it has is probably the dream of every tech start-up, every internet entrepreneur, every venture capitalist in social media. But Twitter has its wrinkles. You can't use the site for long without being familiar with the Fail Whale, for example. 

One of Twitter's weaknesses is its search. If you've ever used it, you probably have realized it's limited. And if you have saved searches for uncommon hashtags, you're familiar with results you got only days ago disappearing. 

Apparently, the underlying design of the site doesn't allow the site to search back more than a week or so, although Twitter has vowed to improve it. And the API — the way external sites, like Storify, grab or post tweets — only allows access to the past 3200 tweets of a user.

Some here and now solutions

Not to worry, you still have a few tricks up your sleeve. Google, unsurprisingly, works okay. I can retrieve a small sample of the tweets during October 2011 that include '#JOUR1550,' the hashtag used for one of my journalism classes, with this search. I know there were far more tweets than that, but it's better than nothing. To limit by date like I did, go to the sidebar on the left and choose your preferred span or type in a specific range using "Custom..."

Better than Google for finding old tweets is Topsy. It turns up more results than Google for the searches I've done. Using the advanced search, you can also limit results to a date range. When searching an individual's stream, the results are good: it found all my tweets over this past summer.

Snapbird is good for searching a particular user, including yourself. The best use of this may be to get more tweets from users you've identified as tweeting what you want. So if you can identify a few users who tweeted an event more or less constantly, you should be able to dig up their entire feed for the day you're interested in.

I found three other services that look promising, but really aren't that useful. Google has a customized search that is less useful than the previous Google trick — it's harder than just going to Google's webpage and doesn't have the date selection feature. Another is FriendFeed which might find tweets others don't, but it's in a very confusing format. Finally, we have TweetScan, which, in my tests, doesn't turn up much of anything.

But what about the future?

It turns out, if you plan to use tweets in advance, you have a lot more options. (Shocker, right?) For one thing, you can favorite tweets or add them to a curation tool like Storify. You could also copy and paste the link to the tweets into a file (click the date underneath the tweet, then copy the URL). Those links are permanent: People have dug up functioning links to tweets from 2006.

You can also archive your own tweets. The problem is that this only saves the tweets available when you start archiving, although if you have few enough tweets, that could be all of them. There are many of these, so I'm going to dedicate an entire post to them.

Over the long term, your tweets are safe. Even though they can't be found by search, all tweets are available via link (see the one above), so Twitter isn't deleting them. I suspect it will eventually improve its search or allow users to access all of their own tweets. Even if Twitter destroys all its data or goes bankrupt, the Library of Congress has an archive of the site. It isn't searchable right now, but I imagine they will be eventually.

In a medium that's all about the immediate, it isn't a surprise it's so hard to find things older than a week. But several tools do a pretty good job of finding past tweets anyway. Topsy, Snapbird and Google are the best bets at the moment. The future will probably bring more and better options, but for now the best option is to be proactive — archive tweets as soon as you know you want to keep them.

Ryan Ellerbusch and I chose Next Door Foundation for our story's focus and for the first part, profiled its executive director. For the second part we looked at a beneficiary, Stephanie Williams.
 
I have experienced both stories that seemingly fell into my lap — a few phone calls and I was done — and those that seemed to stretch on forever — weeks of trying to get in contact with the right person. This project was on the longer side of things. As nice as it is when things just click, the challenges present a great opportunity to learn.

So what did I learn? Well, I feel that I have a better idea of how to keep in contact with your editor. I had some idea from my classes so far, but this project probably demanded so much in that area, it taught me more about the topic than any of my actual classes. 

I likewise learned quite a bit about communicating with my partner. Keeping each other informed of what you're doing and what you plan to do is important. That might sound obvious and it is, but knowing what and when to communicate is important too and that I learned as well.

In the end, I am happy with how the story and video came out. Neither is perfect, but they represent my partner and I persevering and, in the end, producing a publishable story we can put in our portfolios.

As a part of this semester of Digital Journalism II, I completed a profile on Next Door Foundation's executive director, Carol Keintz. Getting the interview took a lot of legwork, partly due to some communication mishaps.

The assignment wasn't just for the class, however. It is due to be published, along with the second half, on Milwaukee Neighborhood News Service's website. So I've gotten the chance to work with the organization's editor, Sharon McGowan and get some valuable feedback.

Keintz told us a number of interesting details about her and her organization's work. Selecting only the most important information was a challenge. In the end, I'm happy with the story Ryan and I produced.

MSNBC's political blog First Read shares the field with some strong contenders, such as NPR's It's All Politics and the New York Times' The Caucus. Such blogs offer a mix of analysis and updates. And recently they have been transfixed by the campaign for the GOP nomination.

How transfixed, you ask? Out of the eleven stories on the First Read's front page at the time of writing, only three aren't related to the campaign. And two of those three relate to the Obama campaign for president in 2012. As a comparison, let's look at the Wisconsin State Journal's "Daily politics briefing," which has enough resemblance to a blog, and yet isn't in a position to focus on the GOP race. It has eight stories, and three relate to elections. One relates to redistricting for the state legislature and the other two relate to.


I'm not blaming First Read for its focus on the campaign. I'm blaming it for focusing on the campaign at the exclusion of everything else. Certainly, MSNBC has a general politics section, which picks up some of the slack. But don't people want to hear about what politicians are doing when they're not campaigning, but governing?