StackOverflowBlog posts tagged: twitter
News and other things I find interesting
Twitter accounts for all StackOverflow users by reputation
Last modified: Friday, April 22, 2011
Wondering who to follow on twitter to keep up to date on technology?
I mined the latest StackOverflow (SO) data dump for all users with twitter accounts, then calculated each user's top tags based on most votes, and finally sorted the lists by user reputation.
The end result is that you can now easily stay connected with the people in your Stack Exchange community.
Here is a screenshot of what the SO list looks like, containing over 2300 Twitter accounts:
If you'd like to have your account listed in the directories, simply make sure your twitter account is linked somewhere in your profile, and I'll update these lists again on a future data dump.
I also mined the available Stack Exchange data dumps and extracted those twitter accounts as well.
You can view the lists here:
- StackOverflow
- ServerFault
- SuperUser
- Game Development
- Webmasters
- Web Applications
- Ubuntu
- Statistical Analysis
- StackApps
- Photography
- Mathematics
- Cooking
- Gaming
Updates:
- Created real twitter lists which are self updating via the Twitter API. You can access these twitter lists from the lists linked above. Note: Twitter has a limit of 500 users per list so I include only the top 500 users.
- Removed some meta tags for the "Known By" list such as "mistakes" so that I don't show anyone as being known for mistakes :)
- Fixed a bug with non StackOverflow sites linking to the StackOverflow user pages.
- Added better parsing to find twitter URLs
- Added filtering of bad twitter URLs
- Removed invalid twitter accounts that don't actually exist anymore
- Added followers count, following count, last tweet date, and twitter description
Tags: stackoverflow twitter data-analysis stackexchange
Add a new comment | 15 comment(s)
|
Would it be possible to add the description and profile from each Twitter account? That would add a bit of personality to the otherwise-dry list. |
|
I want to keep the list as small as possible, I have the "known for" to show you what they do. Otherwise it's harder to focus on what the list is for. |
|
Fantastic use of the data dump! I followed a bunch of Stack Overflow users today, and now Twitter's "Who to Follow" algorithm is starting to auto-find more for me. :) |
|
You can approximate this with the SO API. Benefit of it being in real time. Mild annoyance it having to deal with request limits and quotas (which I completely punt on in my example). Example (The actual javascript is garbage I threw together, the important parts are the API calls) http://api.stackoverflow.com/1.0/help /users (sort=reputation) & /users/{id}/tags are the important ones for this. |
|
Thanks everyone. I added real twitter lists now too for each user list, you can access the lists in each page linked above. |
|
Wow that's a terrific job, thanks. |
|
Taking what Kevin did above, I added a few features to the API version here: http://jsfiddle.net/nick_craver/crvth/2/embedded/result,js,html,css/ granted, there's a lot more data that can be exposed this way, and it's live as well. |
|
Implemented some new additions today: - Added better parsing to find twitter URLs Links are updated as per the above list links. |
|
How did you get the gravatar's for the users? Was that a by product of parsing out the twitter information? I thought you had to have an email to resolve the gravatar but I don't believe StackOverflow provides that in their data dump, thus my curiosity. |
|
@Chris: StackOverflow data dumps include the email hash of each user. This hash is used to obtain the gravatar. As for all of the meta twitter info, that is obtained with the Twitter API. |
|
I'm completely gutted because I'd be in the top 100 if I'd added Twitter (@skilldrick) to my bio :P |
|
This is an excellent use of the data dump, I am seeing more and more constructive uses information to assist actual engineers (as opposed to it being just a vehicle to advertise) http://www.redmonk.com for example I was suprised stackoverflow doesn't provide specific profile fields for twitter. I guess it may result in answers not being published to those interested. |
|
@whatsthebeef I requested this in the past but they didn't implement it. I asked to have an attribute and value of rel="me" for twitter accounts etc. By the way there is a newer blog post for this topic but also including linked in and facebook account lists here: http://brianbondy.com/blog/id/107/twitter-linkedin-and-facebook-stackoverflow-user-lists-sorted-by-reputation |
|
Brian, Anyway you can make an online utility of typing in *any* tag and getting an on-the-fly generated list of the top 10 people by reputation under that tag? Then make this a standard feature in twitter clients? I'm surprises such a powerful feature is not an everyday feature for everyone by now. |
|
Hi @Paul, Ya I plan on putting it in an SQL db so at that point it'll be a simple query. |
