kottke.org posts about Digg
Writing for Wired, Matt Homan Mat Honan on Betaworks’ race to build a replacement for Google Reader in just 90 days. If you are interested in a 35,000-ft view on how Web-based software is built, read this.
McLaughlin saw a blog post in the Fall of 2012 speculating that Google Reader, choked of resources, was shutting down. He sent a teasing note to a friend at Google offering to “take it off their hands.” To his surprise, he got a serious reply. Google, his friend replied, had concluded that it couldn’t sell the name, user data, or code base (which would only run on their servers) and so there was nothing to actually buy.
The following February, McLaughlin, now full-time at Digg, bumped into this same pal at a TED conference. The friend warned him to act fast if he really did want to develop a Reader. “He said ‘I’m not telling you anything, but we’re not going to keep this thing around forever and maybe you want to have something ready by the end of the year.”
But instead of year’s end Google announced plans to shutter Google Reader on July 1. That same night, Digg put up a blog post announcing that it was going to build a replacement. The Internet went crazy.
Loved seeing ye olde kottke.org represented in the Digg Reader mockups, and I’m looking forward to checking out the service when it launches.
A mere six weeks after the purchase of “the core assets” of Digg by Betaworks, the first version of the revamped Digg has launched. Here’s the front page. I like it, aside from the Pinterestness of the layout, which, when the hell are people going to learn?
Look out Digg and 4chan, here comes Reddit! Or more accurately, Reddit has been been here for awhile, why have we been ignoring it?
Both of these sites are being replaced by Reddit, a four-year-old news forum with far more educated, better-behaved users than either, but with a culture that somehow rides the middle between Digg’s slavery to the mainstream tastes of America’s teen males and 4chan’s obsession with inscrutable in-jokes and anti-humor.
Reddit got almost 300 million pageviews in July, compared to the 200 million Digg views in July that Digg founder Kevin Rose reported on his blog. So says an infographic posted on Reddit by Alexis Ohanian, one of the site’s founders, who also asks why the media continually call Reddit “tiny” and “dwarfed” by Digg. What’s more, traffic at Reddit, according to their Google Analytics, is up 24% in the last two months.
Digg policies from Lifehacker and Gizmodo, which state that the only Digg-worthy posts of theirs are those with “original content, new reporting, treatment, or photos” because “it’s not fair when we get the Digg for someone else’s work.” This seems inconsistent on the part of Gawker Media. One of their main innovations (if you’d like to call it that) regarding the blog format was the idea of linking to things in such a way that readers don’t need to actually leave the site to get the full (or nearly full) story. Why let all those readers (and the associated ad revenue) go to some other site to read the story…they might never return. Due in part to Gawker’s influence as first mover in the pro blog space, this practice is unfortunately standard procedure for most similar blogs.
- Pruning the list of RSS feeds I follow.
- Digging.
- Writing about hoes.
- Keeping deer out of the
s.
- Growing my traffic.
- Worrying about bees.
- (Com)posting links?
- Weeding out spam from comment threads.
- ^s.
- There’s never enough thyme.
- Wondering about the weather.
My post about eyetracking and men looking at crotches in photos got a bunch of attention on Digg, by far the most inbound links I’ve gotten from Digg for kottke.org post. Which kinda proves the point of the eyetracking post: that Digg’s predominantly male audience was very interested in clicking on a story about how men are interested in looking at other men’s crotches (and then commenting about how gay they aren’t for doing so). It’s perfect really.
I don’t typically write about many new Web 2.0 products, but Do The Right Thing is doing something interesting. The site works on a modified Digg model. If you see a story you like, you click a button to declare your interest in it. But then you also rate the social impact of the subject of the story, either positive or negative. Over time and given enough users, you can look at all the stories about a company like Starbucks and see how they’re doing. This is something that people do when reading the news anyway — e.g. “I feel worse about Exxon Mobil because they outsourced 20,000 jobs to India” — and having them explicitly rate stories like this is a quick way of taking the temperature of the social climate around issues & companies and recording the results for all to see.
It would be interesting to see if people would be willing to specify some demographic information (provided that it’s not sold to a third party) like sex, age, race, religion, political party affiliation, and income bracket…that would allow the social impact data to be sliced and diced in interesting ways. Even without that data, the opportunities for data analysis are intriguing…like graphs of a company’s social impact over time.
Buzzfeed: the new Digg? Note: I’m a Buzzfeed advisor.
Jonah Peretti, late of Eyebeam and currently of Huffington Post, and his fine team have launched Buzzfeed. From the about page:
BuzzFeed distinguishes what is actually interesting from what is merely hyped. We only feature movies, music, fashion, ideas, technology, and culture that are on the rise and worth your time.
The content territory that Buzzfeed aims to fill is an interesting one. The site is not Digg with 125 new items to read on the front page every day. Neither is it an historical record of what people thought was interesting at a certain point in time. It’s more like a water cooler conversation with velocity, a moving snapshot of what the media and blogosphere is talking about. As a result, the stuff you see on Buzzfeed is not the absolute newest, freshest thing…there’s no truly breaking news on the site because to have buzz around something, people already need to be talking about it somewhere. But unless you’re completely obsessive about keeping up with everything going on in all corners of the world, it’s likely that Buzzfeed will show you something new and interesting every day, especially if it’s in an area you don’t normally pay attention to. That’s the goal, anyway.
I think it’s a great approach, an attempt to cut through a bit of the hype and look past the memes you might chuckle at and then completely forget about and instead, as the about page says, “aggregate authentic excitement that captures what real people are saying about the things they find most interesting”. The Borat trend is an example of something that really works with this approach. Unlike most films released these days, there’s a surprising number of different things around Borat to talk about. There’s the movie itself. There’s the surprise popularity of it. And the almost universal great reviews. Then came the lawsuits. Now there’s a bit of a backlash. And there’s the Snakes on a Plane angle…Borat is a movie that succeeded through viral marketing where SoaP largely failed. A bit of something for everyone there, even for the hardcare Borat fan.
Warning Disclosure: I am an advisor to Buzzfeed.
Accidental Tech Entrepreneurs Turn Their Hobbies Into Livelihoods, including Dooce, the Trotts, Josh Schachter, and the Digg folks.
People are trying to figure out why the Alexa statistics for a bunch of sites (including kottke.org) jumped sharply in mid-April. I don’t buy the Digg explanation (for one thing, the timeline is off by a month)…it’s gotta be some partnership or something that kicked in. Or how about Alexa’s “facelift” on April 11?
Two weeks ago, I wrote:
In terms of editorial and quality, I am unconvinced that a voting system like Digg’s can produce a quality editorial product.
Lloyd Shepherd, Deputy Director of Digital Publishing at Guardian Unlimited, has been thinking along similar lines:
Everything we do to “edit” the [Guardian Unlimited] site seeks to keep a balance between editorial instinct and the desires of the audience, and that, in doing that, we may be reflecting the “community” more fairly, both mathematically and ethically, than the likes of digg.
So how do you reflect the community more fairly? Paging Mr. Surowiecki:
In order for a crowd to be smart, [Surowiecki] says it needs to satisfy four conditions: 1. Diversity, 2. Independence, 3. Decentralization, and 4. Aggregation.
Much of the online media we’re familiar with uses a mix of humans and automated systems to perform the aggregating task. Human editors choose the stories that will run in the newspaper (drawing from a number of sources of information as Lloyd illustrated), blog authors select what links and posts to put on their blog (by reading other blogs & media outlets, listening to reader feedback, and sifting through already aggregated sources like del.icio.us or Digg), and the editors of Slashdot filter through hundreds of reader submissions a day to create Slashdot’s front page. Google News uses technology to decide which stories are important, based primarily on what the publishers are publishing. Digg and del.icio.us rely almost entirely on the crowd to submit and determine by a simple vote what stories go on its front page.
Some of these methods work better than others for different tasks. The product of 50,000 diverse, independent, decentralized bloggers is probably more editorially interesting, fair, and complete than that of 50,000 diverse, independent, decentralized Digg users, but the Digg vote & tally approach is less time-intensive for all concerned and the information flows faster. A site like Slashdot sits in the middle…it’s a little slower than Digg but offers a more consistent editorial product. A hybrid Digg+Slashdot approach (which is not unlike the one used by individual bloggers) would be for Digg to produce a “Digg digest”, a human selected (could use simple voting or let the most highly respected community members choose) collection of the best stories of the day that incorporates what was said in the comments and around the web as well. Actually, I think if you wanted to start a blog that did this, it would do very well.
[This is a semi-regular feature following up on stuff I’ve posted here recently.]
As expected, the Digg vs. Slashdot post got featured on Digg but not on Slashdot. In my analysis, I noted:
The Digg link happened late Saturday night in the US and the Slashdot link occurred midday on Sunday. Traffic to sites like Slashdot and Digg are typically lower during the weekend than during the weekday and also less late at night. So, Digg might be at somewhat of a disadvantage here and this is perhaps not an apples to apples comparison.
Several folks complained about this, some saying that it invalided the whole thing. The Digging of the DvS piece gives us another look at the Digg effect, from right in the middle of a weekday. Digg #2 was dugg 1441 times, got 98 comments, and sent around 10,200 people to kottke.org. By contrast, Digg #1 was dugg 1387 times, garnered 65 comments, and sent ~20,000 people to kottke.org. Digg #1 was actually more successful in driving traffic to kottke.org on a Saturday night than Digg #2 on a Thursday afternoon. Here’s a graph that compares the three events:
It’s hard to see the exact effect of Digg #2 on this graph (I forgot to grab a screenshot of the bandwidth graph when it happened, so all I have is the historical wide view), but it doesn’t stand out that much from what happened the previous day (each one of those “bumps” is a day) and didn’t have much of an effect beyond the initial spike. However, judging from the traffic that the individual Digg pages drove to kottke.org (Digg #1: 4525 people; Digg #2: 2668 people), it looks like the iPod feature was more interesting to the Digg audience than the Digg v. Slashdot post (which makes sense). So, still not exactly a fair comparison and raises more questions than provides answers.
The James Frey thread ended up with almost 950 comments before I shut it down because of redundancy and a lot of nastiness on the part of a few participants. The kottke.org record for most comments on a post is nearly 1800 on this post about The Matrix Reloaded (continued here)….that conversation, while nerdy, was a lot more civil.
After reading some of those comments and other things written about the controversy (but without having read the book), my take on Frey is that memories are subjective and readers need to cut authors some slack on that when writing memoirs. However, Frey stepped over the line in manufacturing situations that didn’t happen and deserves the backlashing he’s now receiving. My favorite observation on this whole deal was made by Stephen on a mailing list we’re both on. In a 2003 interview for The Observer, Frey said:
I don’t give a fuck what Jonathan Safran whatever-his-name or what David Foster Wallace does. I don’t give a fuck what any of those people do. I don’t hang out with them, I’m not friends with them, I’m not part of the literati…A book [Eggers’ AHBWOSG] that I thought was mediocre was being hailed as the best book written by the best writer of my generation. Fuck that. And fuck him and fuck anybody who says that. I don’t give a fuck what they think about me.
To Oprah on Larry King last week, Frey had this to say:
I admire you tremendously and thank you very much for your support. And, you know, it’s — I’m still incredibly honored to be associated with you, and I will for the rest of my life. Thank you.
The man knows who buttered his bread, that’s for sure. Oh, and The Onion’s take is good too. “Accounts of assault with a deadly weapon, narcotics possession, and incitement of riot actually happened during 2002 Grand Theft Auto session.”
Several folks picked up on the year in cities meme…check out the trackbacks on my post and on IceRocket for a bunch of other people’s lists.
Many didn’t realize that my letter to Apple Support was a joke. Sure, I had post-MacWorld gadget lust, but my new Powerbook is great, does everything I want, and I don’t really want the new one. Besides, everyone knows you don’t buy the first version of new Apple hardware…I’m waiting until they work all the kinks out. Here’s a not-so-positive review of the MacBook Pro announcement at Unsanity.
More chatter about the new corporate logos for Kodak, Intel, UPS, and AT&T.
There’s been lots of talk on the web lately about Digg being the new Slashdot. Two months ago, a Digg reader noted that according to Alexa, Digg’s traffic was catching up to that of Slashdot, even though Slashdot has been around for several years and Digg is just over a year old. The brash newcomer vs. the reigning champ, an intriguing matchup.
Last weekend, a piece on kottke.org (50 Fun Things to Do With Your iPod) was featured on Digg and Slashdot[1] and the experience left behind some data that presents a interesting comparison to the Alexa data.
On 1/7 at around 11:00pm ET (a Saturday night), the 50 Things/iPod link appeared on Digg’s front page. It’s unclear exactly what time the link fell off the front page, but from the traffic pattern on my server, it looks like it lasted until around 2am Sunday night (about 3 hours). As of 10pm ET on 1/11, the story had been “dugg” 1387 times[2], garnered 65 comments, and had sent ~20,000 people to kottke.org.
On 1/8 at around 5pm ET (a Sunday afternoon), the 50 Things/iPod link appeared on Slashdot’s front page and was up there for around 24 hours. As of 10pm ET on 1/11, the story has elicited 254 comments and sent ~84,100 people to kottke.org.
Here’s a graph of my server’s traffic (technically, it’s a graph of the bandwidth out in megabits/second) during the Digg and Slashdot events. I’ve overlaid the Digg trend on the Slashdot one so you can directly compare them:
That’s roughly 18 hours of data…and the scales of the two trends are the same. Here’s a graph that shows the two events together on the same trend, along with a “baseline” traffic graph of what the bandwidth approximately would have been had neither site linked to kottke.org:
That’s about 4.5 days of data. Each “bump” on the baseline curve is a day[3].
The two events are separated by just enough time that it’s possible to consider them more or less separately and make some interesting observations. Along with some caveats, here’s what the data might be telling us:
- The bandwidth graphs represent everything that was happening on the kottke.org server during the time period in question. That means that bandwidth from all other outgoing traffic is on there, mixed in with that caused just by the Digg and Slashdot traffic. According to my stats, no other significant events happened during the period shown that would cause unusual amounts of bandwidth to be consumed. Including the baseline traffic (from mid-December actually) on the second graph is an attempt to give you an idea of what it looks like normally and so you can see what effect the two sites had on the traffic.
- The Digg link happened late Saturday night in the US and the Slashdot link occurred midday on Sunday. Traffic to sites like Slashdot and Digg are typically lower during the weekend than during the weekday and also less late at night. So, Digg might be at somewhat of a disadvantage here and this is perhaps not an apples to apples comparison.
- I’m pretty sure that the person who submitted this link to Slashdot got it from Digg or at least from a site that got it from Digg. Bottom line: if the iPod thing, which is several months old, hadn’t been Dugg, it would not have appeared on Slashdot the next day.
- If you look at the first 16-18 hours of the link being both sites (first graph), you’ll see that the traffic from Slashdot was initially larger and stayed large longer than that from Digg. Stories appear to stay on the front page of Slashdot for about a day, but the churn is much faster on Digg…it only lasted three hours and that was late on a Saturday night.
- Slashdot sent roughly 4 times the traffic to kottke.org than Digg did since Saturday.
- If you look at the second graph, Slashdot appears to have a significant “aftershock” effect on the traffic to kottke.org. The traffic went up and stayed up for days. In contrast, the traffic from Digg fell off when the link dropped off the front page and increased traffic a little the next day (compared to the baseline) before Slashdot came and blew the doors off at 4pm. Some of this difference is due to the late hour at which the link was Dugg and how much longer the link remained on the Slashdot front page. But that doesn’t account for the size and duration of the aftershock from Slashdot, which is going on three days now.
- The traffic from the Slashdot link obscures any secondary Digg effect beyond 16-18 hours. But the bump in traffic (if any) from Digg on Sunday afternoon pre-Slashdot was not that large and was declining as the afternoon wore on, so any possible Digg aftershock that’s obscured by the Slashdot link is minimal and short-lived.
- I’m guessing the Slashdot aftershock is due to 1) traffic from links to kottke.org from other blogs that got it from Slashdot (from blogs that got it from those blogs, etc.), 2) people passing the link around via email, etc. after getting it from Slashdot, 3) Slashdot visitors returning to kottke.org to check out other content, and 4) an embedded Digg mini-aftershock of linkers, emailers, and repeat visitors. The del.icio.us page for the 50 ways/iPod link shows that before 1/8, only a few del.icio.us users per day were bookmarking it, but after that it was dozens per day.
In terms of comparing this with the Alexa data, it’s not a direct comparison because they’re measuring visitors to Digg and Slashdot, and I’m measuring (roughly) visitors from each of those sites. From the kottke.org data, you can infer how many people visit each site by how many people visited from each site initially…the bandwidth burst from Slashdot was roughly about 1.8 times as large as Digg’s. That’s actually almost exactly what Alexa shows (~1.8x).
But over a period of about 4 days, Slashdot has sent more than 4 times the number of visitors to kottke.org than Digg — despite a 18-hour headstart for Digg — and the aftershock for Slashdot is much larger and prolonged. It’s been four days since the Slashdotting and kottke.org is still getting 15,000 more visitors a day than usual. This indicates that although Digg may rapidly be catching up to Slashdot traffic-wise, it has a way to go in terms of influence[4].
Slashdot is far from dying…the site still wields an enormous amount of influence. That’s because it’s been around so long, it’s been big, visible, and influential for so long, and their purpose is provide their audience with 20-25 relevant links/stories each day. The “word-of-mouth” network that Slashdot has built over the years is broad and deep. When a link is posted to Slashdot, not only do their readers see it, it’s posted to other blogs (and from there to other blogs, etc.), forwarded around, etc. And those are well-established pathways.
In contrast, Digg’s network is not quite so broad and certainly less deep…they just haven’t been around as long. Plus Digg has so much flow (links/day) that what influence they do have is spread out over many more links, imparting less to each individual link. (There are quite a few analogies you can use somewhat successfully here…the mafia don who outsmarts a would-be usurper because of his connections and wisdom or the aging rock group that may currently be less popular than the flavor of the month but has collectively had a bigger influence on pop music. But I’ll leave making those analogies as an exercise to the reader.)
What all this suggests is that if you’re really interested in how influence works on the web, just looking at traffic or links doesn’t tell you the whole story and can sometimes be quite misleading. Things like longevity, what the social & linking networks look like, and how sites are designed are also important. The Alexa data suggests that Digg has half the traffic of Slashdot, but that results in 4x the number of visitors from Slashdot and a much larger influence afterwards. The data aside, the Digg link was fun and all but ultimately insignificant. The Slashdot link brought significantly more readers to the site, spurred many other sites to link to it, and appears to have left me with a sizable chunk of new readers. As an online publisher, having those new long-term readers is a wonderful thing.
Anyway, lots of interesting stuff here just from this little bit of data…more questions than conclusions probably. And I didn’t even get into the question of quality that Gene brings up here[5] or the possible effect of RSS[6]. It would be neat to be a researcher at someplace like Google or Yahoo! and be able to look more deeply into traffic flows, link propagation, different network topologies, etc. etc. etc.
[1] The way I discovered the Digging and Slashdotting was that I started getting all sorts of really stupid email, calling me names and swearing. One Slashdot reader called me a “fag” and asked me to stop talking about “gay ipod shit”. The wisdom of the crowds tragedy of the commons indeed.
[2] On Digg, a “digg” is a like a thumbs-up. You dig?
[3] That’s the normal traffic pattern for kottke.org and probably most similar sites…a nearly bell-shaped curve of traffic that is low in the early morning, builds from 8am to the highest point around noon, and declines in the afternoon until it’s low again at night (although not as low as in the morning).
[4] The clever reader will note here that Slashdot got the link from Digg, so who’s influencing who here? All this aftershock business…the Slashdotting is part of the Digg aftershock. To stick with the earthquake analogy though, no one cares about the 5.4 quake if it’s followed up by a 7.2 later in the day.
[5] Ok, twist my arm. Both Digg and Slashbot use the wisdom of crowds to offer content to their readers. Slashdot’s human editors post 25 stories a day suggested by individual readers while Digg might feature dozens of stories on the front page per day, collectively voted there by their readers. In terms of editorial and quality, I am unconvinced that a voting system like Digg’s can produce a quality editorial product…it’s too much of an informational firehose. Bloggers and Slashdot story submitters might like drinking from that hose, but there’s just too much flow (and not enough editing) to make it an everyday, long-term source of information. (You might say that, duh, Digg doesn’t want to be a publication like Slashdot and you’d probably be right, in which case, why are people comparing the two sites in the first place? But still, in terms of influence, editing matters and if Digg wants to keep expanding its influence, it’s gotta deal with that.)
[6] Digg might be more “bursty” than Slashdot because a higher percentage of its audience reads the site via RSS (because they’re younger, grew up with newsreaders in their cribs, etc.). Brighter initial burn but less influence over time.
Stay Connected