How curation automation is going to disrupt content consumption

The best content curators have extensive topic knowledge and a knack for reader interests and preferences. That sounds like something only a living, breathing human can do, right? While that’s largely the case today, I believe technology will drive the biggest advancements in content curation tomorrow.

Narrative Science is a terrific example. I met Kris Hammond of Narrative Science a few years ago when he spoke at a Tools of Change conference I helped produce. If you’re not familiar with them, Narrative Science is one of those companies that develop tools to automate story writing.

You may have read a computer-generated article or two this week and never even realized it. Think you can tell the difference between human- and auto-generated content? Stick around and take the quiz at the end of this article… 

Data is at the heart of the stories generated by Narrative Science but what exactly is “data”? In the current model, data typically consists of numbers, tables and other highly structured information. For example, the narrative summary of last night’s baseball game could be auto-generated using nothing more than the game’s box score, the data from the event.

As platforms like Narrative Science’s evolve, so will the definition of data. 

Last week I wrote an article about why all-you-can-read subscriptions need curation. We’re drowning in a sea of content and we need better tools to help us uncover and consume the must-read content. There’s a big difference between what you and I consider must-read though and that’s where the curation element comes into play.

A number of industry pundits criticized my thinking and pointed out the high cost of this sort of curation. I agree. Curation today almost always requires human intervention. But what happens when that’s no longer the case?

What happens when an application is able to rewrite and summarize the sea of daily content that’s most important to you? What happens when this tool, which knows your interests, your job responsibilities, etc., is able to deliver a fully-automated Cliffs Notes version of everything you need to read that day?

I think that will be a game-changer and will become an extremely important, real world application for artificial intelligence. Will it put writers out of business? No, not necessarily. After all, most of the original content still has to be written by someone. But it will help amplify the content that needs to be read, enabling it to rise above all the noise that surrounds it. 

Still think this is nothing more than sci-fi and wishful thinking? Take this short quiz and see if you can figure out whether each of these excerpts were human-generated or computer-generated.


Debunking the discovery problem

Ever since ebooks gained traction the publishing industry has obsessed with what’s typically referred to as “the discovery problem.” The common wisdom is that discovery of the content will lead to fame and fortune.

What's next, now that ebook sales are flattening? Join me at a free webinar on April 28 to see how to drive revenue growth. Click here to register.

I believe digital content’s main challenge is more about efficiency, less about discovery, and my inspiration for this point of view comes from a totally unrelated business: the coffee industry.

A recent Businessweek article noted that single-serve pods (e.g., Keurig) have eliminated coffee’s biggest consumer: the kitchen sink. (Btw, Businessweek apparently doesn’t worry about content discovery as that article can’t be found on their website; it’s only in the print edition but I found a related version of it here.)

It turns out that with Mr. Coffee and other drip systems a great deal of product ends up going to waste. The net result is that as the single-serve devices gain momentum we’re creating a climate where total consumption is lower and excess inventories are leading to lower prices for coffee beans.

In short, the article notes that while Americans still drink a lot of coffee, they do it more efficiently. Each cup in the single-serve model is more expensive but in total we’re consuming and wasting far less coffee now.

What in the world does this have to do with digital content?

I don’t think anyone would argue with the fact that we have an excessive amount digital content today. A great deal of it is being produced but in many cases nobody is reading it. This has led to an overabundance of free and cheap content which is being both professionally published as well as self-published.

Wasted coffee goes down the drain but wasted content simply goes unread. In some cases, hoarders like myself have moved the content from online to local devices, but much of that content is never actually consumed.

Here’s a parallel from yet another completely unrelated industry: service provider recommendations. My wife and I recently cancelled our Angie’s List subscription because we discovered the Nextdoor social network. As you may already know, Angie’s List is battling allegations of fraudulent and deceptive practices and its reviews are typically posted by complete strangers. Meanwhile, Nextdoor offers reviews and advice from people you know or could easily introduce yourself to: your next-door neighbors. I’ve found these local reviews on Nextdoor to be much more reliable. In fact, I’ve hired two service providers in the past week based on Nextdoor recommendations. Best of all, Nextdoor is totally free.

Compared to Angie’s List, Nextdoor feels like a more highly curated and relevant service. Discussions and recommendations come from people you might already know and everyone lives right there in your neighborhood. In fact, many of Nextdoor’s members are going through the same situations you are (e.g., hail storm, wind damage, down trees, etc.)

Nextdoor offers what I refer to as a better “content efficiency” experience than Angie’s List. It’s what I’m looking for and the content is presented when I need it.

Just as nobody walks into a bookstore asking for the latest book from Macmillan, nobody is sitting around saying, “gee, I wish I could discover more content.” What we really need is more efficient delivery of content that’s highly relevant to our specific needs and interests. 

We’ve mostly given up on RSS feeds and let’s face it…Twitter is yet another fire hose that’s next to impossible to effectively manage.

At some point content efficiency will improve. I’ve referred to this before as the need for a “content concierge”, resulting in much better recommendations, tailored content streams and, yes, it will come at a higher price, just like the single-serving coffee pods.

We may end up spending just as much time reading efficiently delivered content but it will be highly targeted and we’ll pay more for the privilege of others (human curators and well-tuned, automated algorithms) helping us find the precious needles in the overwhelming haystacks.


Content, technology and the digital scrapbook of your life

Every year it seems our cell phones take on new roles in our lives. Long ago flip phones merely enabled you to make calls. Today’s smartphones are loaded with sensors to do everything from track your health to tell you about a sale at a local store.

I think it’s time for our phones to do even more and this involves the convergence of content and technology to automatically create the digital story of your life.

Imagine an app that constantly monitors your phone’s location to do the following:

  • Log where you were today and make assumptions about what you did in each location,
  • Gather and organize content relevant to where you’ve been,
  • Build it all into a living, growing record that you can edit and share with others.

Sounds fairly straightforward, right? Now let’s think about the results of this.

One day you went to see the Reds play the Pirates in Pittsburgh at PNC Park. The app logs the event and pulls in the box score along with a couple of noteworthy articles about the game from the Cincinnati and Pittsburgh newspapers. It also saves the weather information (e.g., “partly cloudy, 61 degrees at first pitch with a high of 68 degrees”) and provides interesting factoids about what happened in sports on that same day 5 years ago, 10 years ago, etc.

On another day you attend your child’s college graduation ceremony. The app checks the school’s calendar and determines you were indeed at the ceremony. This information is logged and because the school was kind enough to expose the graduation program to the app, it too has now been digitally preserved in your stream.

By the way, this imaginary app also offers a user network. So it knows that you went with a friend to that baseball game, and your friend is part of the app’s network. This tidbit is also preserved along with all the great pictures you both took at the stadium. No longer do you have to worry about uploading or emailing photos; your app settings were already configured for two-way sharing between you and the friend who accompanied you at the game. The same goes for the graduation ceremony; now all your friends and family who are members of this service all have access to each other’s pictures.

We could, of course, extend this even further… If you ordered food at that baseball game the information could be logged so you could easily track your diet. In short, any transaction that takes place on your phone could be wired into this app as well. Those transactions that aren’t made with your phone could still be easily integrated: just take pictures of the receipt and the phone does the rest.

The app’s goal is to provide every user with a digital scrapbook of their life. The key is to automate as much of this process as possible. Let your phone and the app figure out what to collect and you can always go in and tweak it later if you want.

There’s also an enormous content opportunity here. I mentioned how the app pulls in content from newspapers but, of course, the feeds could come from anywhere. Ultimately this is a way to redeploy content based on context and preserve it for years and years. After all, one of the reasons you want to gather this information is to remember and relive the events of last week or last year. It’s also an interesting way to build the story of your life, one that can be passed on from one generation to the next. I’d love to have this kind of information about my parents and grandparents, for example.

A variety of business models could be used here including free, advertising/sponsor-based and premium. Ancestry.com and other genealogy services have proven the interest we have in our past. People spend hours and hours sifting through all that historical data, making assumptions about family connections, how people met, etc. An app like this eliminates the guesswork and tells the life story you want to communicate with your friends and future generations.


How digital can be a companion for print

Congratulations, print publishers. You dealt with enormous disruption these past several years and you managed to avoid the same fate as your music industry counterparts. For example, most book publishers still generate 70-80% of their revenue from print. How many music labels can say they generate anywhere near that percentage from CDs?

Is the survival of print a good thing or a bad thing? Rather than worrying about that one, here’s the question we really need to think about: Why do we treat these two formats as mutually exclusive?

Depending on what they’re doing, why do consumers tend to use either print or digital but almost never use print and digital for the same product?

I’ll use myself as an example... Believe it or not, my wife and I still subscribe to our local print newspaper, the Indianapolis Star. Our subscription plan includes a digital version as well as print. When I’m at home I always read print and never bother opening the digital edition; when I’m on the road, of course, I’m limited to a digital-only experience.

Why do I never bother opening the digital edition when I’m home? Because it’s just a digital replica of the print edition I read over breakfast. OK, there might be a few extra bells and whistles in the digital edition but they’re not significant enough to get me to open the app after I’ve read the print edition.

The same is true for books and magazines. Digital simply replaces print, so there’s no reason to use both formats for any given title.

I think it’s time to reimagine digital as a companion to print, not simply a replacement for it.

Today’s digital editions are nothing more than print-under-glass. They’re digital replicas of the print product. As a result, we tend to buy one format or the other, but rarely both.

I used to publish technology books for IT professionals. Many of those books on programming languages and productivity tools had companion websites. The websites offered additional content, sample files and other goodies that didn’t come with the book. These sites also represented a way for the publisher to dynamically extend the original content with additional elements and coverage, some of which might not have been available when the book was originally published.

I’d love to see the industry evolve to the point where each print product has a digital companion, not just a print replacement. The digital companion would extend and enhance the print experience and would be an optional add-on to the print product. Some of these digital companions could be free but the more valuable ones could have a price.

Btw, publishers could offer these companions exclusively on their websites, converting print customers who bought from Amazon and elsewhere into direct customers. Promote them in the print product and bring those customers to your website where you can build a direct relationship, up-sell, cross-sell, etc.

A couple of weeks ago I wrote an article called Why Johnny doesn’t like e-textbooks. Maybe Johnny doesn’t want the print-under-glass digital edition of the textbook, but I’ll bet he’d be interested in a digital companion for the print textbook featuring notes from other students, cheat sheets for test prep, sample quizzes, slide decks from class lectures and better explanations of key topics from other students and teachers.

Textbooks aren’t the only products that could be further monetized with digital companions. Just about any type of content lends itself to digital extension and enhancement. We just need publishers and authors to start thinking of digital as a companion for print, not simply a replacement.


Finding the optimal streaming content value proposition

Have you paid much attention to the various pricing options used in the streaming content space? A recent article on re/code talks about the challenges the music industry faces as it wrestles with free, ad-subsidized streaming services. In short, the article says free is bad and paid is good. I’d add that’s true for everyone but the consumer, of course.

The problem isn’t perhaps so much about making free go away but rather making the paid options much more compelling.

For example, I’m a big fan of Spotify. At first I just used the free, ad-based version and created a bunch of playlists. The ads didn’t seem too intrusive but when I saw the opportunity to try a three-month, 99-cent trial of the paid version I couldn’t resist. For less than a dollar I could eliminate the ads and download as much music as I want to each of my devices.

I use Spotify much more frequently now but the three-month trial is about to end. Am I so hooked on the Spotify Premium that I’m ready to fork over $9.99 per month going forward?

No way.

Even though $9.99 sounds like a bargain that’s still about $120 per year, much more than I’m willing to spend for the service. Spotify would have better luck converting a freeloader like me if they offered something in between. For example, I’d sign up for $2.99/month for an ad-free version with no download capability. And I’d consider signing up for $4.99/month for downloads and no ads. They’ll probably never see another nickel from me as long as the options are limited to free and $9.99 though.

Spotify’s problem is the free version is just too darned good, at least for me.

This challenge isn’t limited to the music world though. My wife and I share a Premium subscription to Next Issue, the all-you-can-read digital magazine service. We pay $14.99/month for unlimited access to more than 140 magazines. At first it seemed like a great deal but I’m opening the app less frequently every month and $180/year is starting to feel quite expensive. The other challenge here is that with the right combination of bookmarks, alerts, newsletter subscriptions and RSS feeds, it’s possible to gain free access to most of the content I’m paying for via Next Issue. As a result, our Next Issue subscription is likely to end soon.

Let’s compare that to Oyster, the all-you-can-read ebook service. Once again, my wife and I share a $9.95 subscription and we couldn’t be happier. I’d probably be willing to pay even more than that and I figure the price will go up before too long because Oyster’s business model isn’t sustainable at $9.95/month. But there’s no legal free alternative to this ebook content, so Oyster has much more leverage than Next Issue when it comes to the threat of “free” cannibalizing “paid.”

If you’re thinking of jumping into the streaming content marketplace, be sure to study the results of comparable existing products and make sure your free option isn’t so good that most consumers will never consider upgrading.