Content Flooding

I just came across this nice article on content flooding, which is about how the same sort of content “floods” us from all possible sources. All newspapers and news website (not to mention news TV), at any point in time, are “flooding” us with articles about the same thing. This quote from the article possibly makes the point:

Ravi Somaiya wrote in the Columbia Journalism Review last year. In the cacophony of content and conversation around that content, the most familiar voices at the largest, fastest, trendiest outlets carry the farthest; according to SimilarWeb, which tracks website statistics, only five sites dominatearound 50 percent of the share of newspaper traffic in the U.S. CJR also reports that newspapers online, now with a borderless audience, publish more than twice as many stories as they used to, often with a much smaller staff. So what you get are dailies that operate like news channels, dissecting stories (sometimes even original ones) for ratings, which basically means they cover more of less . “Faced with a sea of headlines, in every permutation,” wrote Somaiya, “even the most determined mind rebels and begins to dismiss it all as noise.”

(ed: emphasis added)

Now I don’t intent to reinforce flooding, but I’ve written about this topic before, about how Twitter is like Times Now. However, in the last month or so, when I’ve been mostly off social media, one primary reason why I went off was to avoid flooding. Rather than getting lots of news about the same topic from all sorts of sources I want to learn about a variety of things.

And I’ve tried to tune my media consumption to try and avoid this kind of flooding. I’m off social media now, for there everyone talks about the same topic of the day most of the time. I haven’t watched news TV for some 10-15 years now. I get my article and blog content from RSS feeds (if you have any RSS feeds you think I might like, do share!), and from a bunch of newsletters I’m subscribed to (the article shared at the beginning of this post came from a newsletter by the Guardian).

And by myself being not part of the flooding monoculture (on twitter), I end up writing about stuff that other people may not be writing about at that point in time. And that’s my little contribution to reduce flooding in the world!

 

News

I wake up early on weekdays nowadays, so go the first two hours of the day without really knowing what is happening in the world. As you might know, I’m on a social media break, so that source of news is cut off. And it’s only around 7 am by when a copy of the Business Standard gets delivered to my door.

Until last month, a copy of the Deccan Herald would arrive at home as well, but I stopped it after I found it to be largely useless. A lot of stories in that newspaper were written as they might have been 20 or 30 years ago. There was little distinction between reporting and analysis and opinion. A lot of news couldn’t be simply consumed without the accompanying (and sometimes patronising) opinion.

The Business Standard, which I started reading in 2005, is still a very good paper. The editorials continue to be first-rate (though their quality had dipped in the 2011-14 period). The analysis pieces and columns cover a variety of topics that simply don’t make it to social media (since they aren’t really “sensational”). And the newspaper is “crisp” and quickly tells you what’s going on in India.

For two years, when I lived in London, I lived without a daily newspaper, and it was a struggle. Online newspapers have simply not been able to provide the same kind of product as offline newspapers. And the reason is that online newspapers are “flat” – all the contextualising and prioritising that a dead-tree paper can do is completely absent in the online version.

In a dead-tree newspaper, you know how important a piece of news is based on the page it appears, the size of the headline, the size of the column and so on. Based on where it appears, you know if it is news or analysis or opinion. In case it is opinion, you can easily see who has written it before you “click through” (start reading it). You can easily how big a piece is (and how much of your time it will take) before deciding to invest time in it.

All this is absent from an online newspaper. Check out, for example, the homepage of the Business Standard, that I so fulsomely praised earlier in this post.

It is impossible to know what’s the important stuff here. If I have only five minutes to read, I don’t know what to focus on. I don’t know which of this is opinion and which is news. Before I click through, I don’t know how big a piece is or who has written it or if it has been syndicated.

Unless the link has come from a qualified source (such as Twitter) I don’t know much about it, and so don’t know how to consume it. This might explain to you why a lot of online news sources are losing revenues to the likes of Google or Facebook – the latter do the important job of putting the news in context!

Finally, I’m glad I now consume news only once a day (from the physical paper). Sometimes, what is news intra-day would have ceased to be news by nightfall. So when you consume news at a reasonable interval (such as daily), what comes to you is “qualified” real stuff. A piece of news should have been important enough for a day to make it to the next day’s newspapers. And once a day is also a reasonable interval to get to know of what is happening in the world.

Mass marketing and objective journalism

This is a fascinating essay by Antonio García Martinez on the history and future of journalism (possibly paywalled). The money paragraph is this:

The bigger switch happened as a national market for consumer goods opened after the Civil War, when purveyors like department stores wanted to reach large urban audiences. Newspapers responded by increasing the number of ads relative to content, and switched to models that went light on the political partisanship in the interest of expanding circulation. This move was driven not exclusively by lofty ideals but also by mercenary greed. And it worked. Newspapers used to make lots of money. Mountains of money.

Basically, the move to objective journalism came in the late 1800s when advertisers such as Macy’s wanted to take out full page ads, and wanted to do so in newspapers that served the largest sections of the market. And when a newspaper had to reach a large section of the market, it inevitably had to tone down the partisanship, and become more objective.

Over the last decade, we have been witnessing (across the world) the decline of objective media. All media is “#paidmedia” based on which side of the political spectrum you stand on. There aren’t that many truly objective papers around, and social media is bombarded left and right by extremely politicised reporting that goes as “news”.

It is perhaps no coincidence that this period has coincided with a time when print circulation has been dropping steadily (in the developed world at least), and where online advertising can be highly targeted.

In theory, mass marketing is inefficient. When you pay to put up a hoarding somewhere, you’re possibly paying a small amount for each person who sees the hoarding, but not all of them might find it interesting. Consequently, this reflects in a depressed per-person price of the hoarding implying the owner of that real estate can’t make as much as she could if the hoarding were to be more “targeted”.

When you can target your advertisements more precisely, everybody wins. You as the marketer know that your advertisement is only being shown to your intended audience. The owner of the real estate where you put your advertisement can thus charge you more for your advertisement. Even the customer will be less pained by the advertisement if it is highly relevant to her.

Another way of seeing it is – an advertisement shown to a customer who doesn’t want to see it is wasted. The monetary cost of this waste are borne by the owner of the real estate and the advertiser, and the non-monetary cost is borne by the customer (being forced to see something she didn’t want to see). And so one of the biggest technological problems of today is on how we can target advertisements better so that we can minimise such costs – and in the last decade and half, we’ve made significant progress on that front.

The problem with greater efficiency, however, is that it comes with the side-effect of biased media. When Nike knows that it can precisely target an advertisement at American leftwingers, it makes an ad with Colin Kaepernick and shows them to American leftwingers to sell them more shoes.

This doesn’t however, mean that Nike only sells to left-wingers. The same company can make another advertisement targeted precisely at right-wingers and use it to sell shoes to them!

So now that you can make left-wing and right-wing ads, and you have the ability to target them, you want to cut the waste and place the ads so that you can target as best as possible. In other words, you want to place your left-wing ads in places that only left-wingers want to see, and right-wing ads only in places that right-wingers will see. And so you prefer to advertise in CNN and Fox rather than in a hypothetical “broad market” media outlet.

And the reason you created the politically charged ads in the first place was because there were some outlets (Facebook, for example) where you could precisely target people based on their political orientation. And so you see the vicious cycle – that you can target in some places means you want other places where you can target and that creates demand for more polarised media.

It was the opposite cycle that took effect in the late 1800s and early 1900s. There was no way brands could target (also, when you make physical advertisements, with 1900s technology, each advertisement is costly and you don’t want to make one per segment) too effectively, and so they went mass market in their communication.

And this meant advertising in the outlets that could get them the maximum number of eyeballs. When you can’t discriminate between a “right” and a “wrong” eyeball, you pay based on the number of eyeballs. And the way for media organisations to grow then was to cater to everyone. Which meant less less bias and more objectivity and more “features”.

Sadly that cycle is now behind us.

The problem with online media

… is that there is no ending. There is no sense of having “finished the newspaper”.

And there is no context. You see the homepage of a major newspaper, and you see a bunch of headlines leading to links. Occasionally there are section headers that tell you which broad section of the newspaper they come from (news/opinion), but that context is usually far inferior to what you see in print.

So addressing the issues one by one, the first “issue” with online media which no website (AFAIK) can solve is that online news is an online process (apologies for the pun) – as news comes in it needs to be displayed on the website, without really waiting for “editions”. This means there is a conflict between “importance” and “recency” – what kind of news do you show near the top and in bold? Stuff that came in latest or stuff that you think is important?

This means that you need a “live editor” (might be replaced by a bot very soon) all the time who takes a call on what comes on top. Yet, if I’m checking the news after a day, what might be “important” for me is very different from what might be important for you who is checking the news after half an hour. You most definitely want the latest stuff, while I possibly want to know everything that’s happened in the day. And a simple news website cannot cater to both.

The other problem is the lack of context and information before clicking through. In an offline newspaper, there is a large amount of information you have before you “click through” to an article. There is the page it appears on – if you are a regular reader of the paper, you know the kind of articles that appear on each page.

There is the author – you have most definitely built a model over time on which authors to not miss and whom to avoid. There is the length of the article. And there are articles that appear around it. And all these put together provide you enough information on whether it might be worth reading the content on an article.

Most of this is missing in online media, where you need to make your decision to read on headlines. Which can sometimes be click-baity and not all that informative. And so the chances of regret having clicked through to an article is high. Which means that you need some sort of external cues to make you want to click through and read an article.

And so you start consuming news through social media – articles that your friends recommend, with possibly some more information and context on what it’s about. This information and context would have in an offline world been given to you by the newspaper itself.

And so as you consume more and more news from social media, you have the usual problems of echo chambers, and not even glancing through the headlines of news you don’t like (notice how a traditional offline newspaper makes you go through most headlines, whether you like it or not!).

Finally, in an online newspaper there is no concept of having “finished” the paper, of having consumed all the news. As you keep consuming news, you find new pieces of information being thrown at you. Not knowing when to stop, you simply give up!

Context sensitive and context free journalism

My wife thinks that most of my writing for Mint is incredibly boring, and of a significantly inferior quality to what I publish on this blog. Initially I thought it was because I was taking myself too seriously for Mint (a national newspaper and all that), but despite my attempts to “loosen up”, and write my Mint articles “in flow”, the criticism continues.

Now thinking about it, one reason why my writing for Mint might be boring is that in the beginning of each piece I try hard to provide context. I write without assuming that my readers know exactly what I’m writing about, and so I spend some time giving sufficient background so that my readers appreciate my articles (and most of my pieces appear with minimal edits).

This, I realise now, is not how Indian journalism usually works, for in a large majority of pieces it is assumed that the reader has context. Many a time I find myself reading a piece and not being able to make the head or tail of it, and then going back and trying to figure out the context. The point of several articles I’ve read has become clear only in retrospect, when I’ve found something else that this article was referencing (but didn’t link to).

On the other hand, a “newspaper” like The Economist mostly does context-free journalism. Every piece comes with sufficient background for the reader to know what is happening. There may not be links to find out more, but the limited context provided is enough to understand the point of the piece. Maybe that they are a weekly, and cover news from all over the world makes them want to provide context?

In any case, I find context-sensitive journalism (like what most daily newspapers practice) irritating. Or maybe it is that they haven’t really made the transition from print to digital? Print is a medium where the publisher controls what articles are seen together by a reader, and so one article can provide the required context to an adjacent article.

There is no such “togetherness” in digital. This strengthens my belief that journalism is still yet to “get” digital.

TV Punditry

Those of you who might be following me on social media (Twitter/Facebook/LinkedIN) might know that I’ve started a career in TV Punditry over the last week. Well, it’s not that much of a career – I still need to figure out how to get paid for it.

Anyway, so I was on News9 once on Saturday (analysing exit polls) and again on Tuesday (analysing the election results). It happened pretty much at random, from a random twitter conversation:

And so Mathang (who I’d first met in 2004 when he had interviewed me for Education Times) set me up with Anil Kumar from News9, who presently asked me for my number. A couple of twitter DMs, a couple of emails and a couple of phone calls later, I had been asked to come to the News9 studio at 5pm on Saturday.

Saturday’s session was really enjoyable, and I spoke a fair bit on the process of conducting an exit poll, the importance of sample sizes and representative samples, the process of converting votes to seats, etc. A 5 minute monologue on sampling process got the anchors interested in me, and they kept coming back to me. As is my wont, I summarised the import of my arguments for Mint.

And so I got invited again for Tuesday’s post-counting session, and I’m not sure I enjoyed it that much. As the elections threw up a hung assembly, the politicians on the panel spent their time shouting at each other. I was seated in an inappropriate place – right between a loud JDS spokesperson and a loud BJP spokesperson. I recused myself from much of the discussion and was only brought in because the anchors probably thought I should be “given some lines” – an opportunity I used to comment on the parties’ election strategies.

So two TV appearances later, I must say I quite like the format – it’s good footage (literally) if not anything else, but it can be a bit painful. Writing is easy in the sense that you just collect your thoughts and deliver them at a time.

Video means that you are virtually participating in a group discussion, and need to butt in to make your point. You might have something insightful to say, but need to wait for an opportune time to interject. You might be in the middle of a long point but get interrupted by another panellist. You might wait for ages to say something but the opportunity never comes. At other times, you might get a question that you’re not prepared for.

The worst thing as an analytical guy on TV is that you need to keep referring to your data, and your analysis. So there was one occasion on each session when the anchors asked me a question to answer which I’d to write some code to answer. So each time I mumbled something and bent down to my laptop, and got bailed out by the anchor who got someone else’s view in the time I took to get the requisite data.

In any case, I want to do more of this. I also hope that like with my writing, I can some day hope to get paid for TV appearances – this is a hard job since panellists representing political parties don’t charge anything – it’s in their parties’ interests to be represented on the show.

But, some day..

Algorithmic curation

When I got my first smartphone (a Samsung Galaxy Note 2) in 2013, one of the first apps I installed on it was Flipboard. I’d seen the app while checking out some phones at either the Apple or Samsung retail outlets close to my home, and it seemed like a rather interesting idea.

For a long time, Flipboard was my go-to app to check the day’s news, as it conveniently categorised news into “tech”, “business” and “sport” and learnt about my preferences and fed me stuff I wanted. And then after some update, it suddenly stopped working – somehow it started serving too much stuff I didn’t want to read about, and when I tuned (by “following” and “unfollowing” topics) my feed, it progressively got worse.

I stopped using it some 2 years back, but out of curiosity started using it again recently. While it did throw up some nice articles, there is too much unwanted stuff in the app. More precisely, there’s a lot of “clickbaity” stuff (“10 things about Narendra Modi you would never want to know” and the like) in my feed, meaning I have to wade through a lot of such articles to find the occasional good ones.

(Aside: I dedicate about half a chapter to this phenomenon in my book. The technical term is “congestion”. I talk about it in the context of markets in relationships and real estate)

Flipboard is not the only one. I use this app called Pocket to bookmark long articles and read later. A couple of years back, Pocket started giving “recommendations” based on what I’d read and liked. Initially it was good, and mostly curated from what my “friends” on Pocket recommended. Now, increasingly I’m getting clickbaity stuff again.

I stopped using Facebook a long time before they recently redesigned their newsfeed (to give more weight to friends’ stuff than third party news), but I suspect that one of the reasons they made the change was the same – the feed was getting overwhelmed with clickbaity stuff, which people liked but didn’t really read.

Basically, there seems to be a widespread problem in a lot of automatically curated news feeds. To put it another way, the clickbaity websites seem to have done too well in terms of gaming whatever algorithms the likes of Facebook, Flipboard and Pocket use to build their automated recommendations.

And more worryingly, with all these curators starting to do badly around the same time (ok this is my empirical observation. Given few data points I might be wrong), it suggests that all automated curation algorithms use a very similar algorithm! And that can’t be a good thing.

Why Twitter is like Times Now

One reason I stopped watching news television about a decade back is because of its evolution into a “one issue channel”. On each day, a channel basically picks a “topic of the day”, and most discussion on that day is regarding that particular topic.

In that sense, these “news channels” hardly provide news (unless you bother to follow the tickers at the bottom) – they only provide more and more discussion about the topic du jour (ok I’m feeling all pseud about using French on my blog!). If you’re interested in that topic, and willing to consume endless content about it, great for you. If not, you better look for your news elsewhere (like the <whatever> o’clock news on the government-owned channel which at least makes a pretence of covering all relevant stuff).

One thing that made Twitter attractive soon after I joined it in 2008 was the diversity of discussions. Maybe it was the nature of the early users, but the people I followed provoked thought and provided content on a wide array of topics, at least some of which I would find interesting. And that made spending time on twitter worthwhile.

It’s still true on a lot of days nowadays, but I find that Twitter is increasingly becoming like a modern news channel such as Times Now. When there are certain events, especially of a political nature, it effectively becomes a one-topic channel, with most of the timeline getting filled with news and opinion about the event. And if it is either an event you don’t care about, or if you’ve moved on from the event, Twitter effectively becomes unusable on such days.

In fact, a few of my twitter breaks in the last 2-3 years have followed such periods when Twitter has turned into a “one issue channel”. And on each of these occasions, when I’ve joined back, I’ve responded by unfollowing many of these “one-issue tweeters” (like this guy who I don’t follow any more because he has a compulsive need to livetweet any game that Arsenal is playing).

That Twitter becomes a one-topic channel occasionally is not surprising. Basically it goes like this – there are people who are deeply passionate or involved in the topic, and they show their passion by putting out lots of tweets on the topic. And when the topic is a current event, it means that several people on your timeline might feel passionately about it.

People not interested in the topic will continue to tweet at their “usual rate”, but that gets effectively drowned out in the din of the passionate tweeters. And when you look at your linear timeline, you only see the passion, and not the diverse content that you use Twitter for.

Some people might suggest a curated algorithmic feed (rather than a linear feed) as a solution for this – where a smart algorithm learns that you’re not interested in the topic people are so passionate about and shows you less of that stuff. I have a simpler solution.

Basically the reason I’m loathe to unfollow these passionate tweeters is that outside of their temporary passions, they are terrific people and tweet about interesting stuff (else I wouldn’t follow them in the first place). The cost of this, however, is that I have to endure their passions, which I frequently have no interest in.

The simple solution is that you should be able to “temporarily unfollow” people (Twitter itself doesn’t need to allow this option – a third party client that you use can offer this at a higher layer). This is like WhatsApp where you can mute groups for just a day, or a week. So you can unfollow these passionate people for a day, by which time their passion will subside, and you can see their interesting selves tomorrow!

Of course it’s possible to manually implement this, but I know that if I unfollow them today I might forget to follow them back tomorrow. And there are countless examples of people in that category – who I unfollowed when they were passionate and have thus missed out on their awesomeness.

 

The problem with premium ad-free television

I watched snippets of the just-concluded ICC WorldT20 final using an illegal streaming service, which streamed content drawn from SkySports2.  The horrible quality of the streaming aside (the server seemed to have terrible bandwidth issues), the interesting thing to note was that it was completely devoid of advertisements.

With the quality of cricket coverage in India currently being abysmal due to the frequent cutting for advertisements (I remember getting thoroughly pissed off with the cuts for advertisements before the replay of a wicket was shown during the India-Australia series earlier this year), it made me think about the economics of a separate premium service that is ad-free.

The infrastructure for delivery is in place, given that internet-based legal streaming services are fairly common now (the likes of HotStar). Internet-based delivery also makes it easy to charge pay per view, so payment is also not a problem. This raises the question of whether it is a good idea for channels to monetise the demand for ad-free cricket by providing the service through online streaming, leaving the mainstream broadcast to be monetised via advertisements.

While in theory this appears like a good idea, the problem is with the kind of people who will migrate to the new service – they will be people who have the ability and willingness to pay for a higher quality broadcast. Such people are likely to belong to two overlapping categories – loyal fans of the game and people who can afford to pay a premium.

It is unlikely that the union of these two sets will comprise of too high a proportion of the overall viewership of the game, but the point is that these are the two groups who are likely to be most lucrative to advertisers – the loyal fans watch regularly and the people who are able to pay have more disposable income.

Moving such customers to an ad-free online channel might reduce the supply of advertisements which can be used to reach them, and this might not make advertisers happy. And given that television channels have cosy relationships with advertisers (or at least media buyers), they are unlikely to piss them off by moving the most lucrative customers to a premium platform.

Of course if this segmentation (between ad-free and free broadcasts) is implemented, it will also impact the price of advertisements in the free broadcast. That will need to be taken as an input while setting prices for the ad-free service. In other words, pricing is going to be a challenge!

If some television channel wants to work on this, I’m available for hire as a consultant. I’ve done a fair amount of prior work on pricing and dynamic pricing, am pretty good at quantitative methods and am in the course of writing a popular economics book.

Bleg: News sources

I’ve decided to take yet another social media sabbatical (long time readers know I do this once in a while), and since I’m currently living abroad, one of the downsides of this is that I now have no direct access to news (social media did provide news, but came along with extremely fierce commentary and outrage).

I use Flipboard to curate some news, but the way I’ve been curating it of late means that I don’t get much news about India. Online editions of newspapers are there, but I find that most simply use them to archive stories, and the curation that is present in newspapers is missing.

So I’m basically looking towards curated sources of news that i can read and be satisfied that I know what’s happening in this world. I currently subscribe to two newsletters – the Economist Espresso that arrives in the morning and tells me all that’s happening in the world, and Matt Levine’s newsletter that arrives in the afternoon (Europe time) and tells me everything that’s happening in world markets.

Do any Indian newspapers have good curated content in the form of newsletters? Or any third party newsletter aggregators in India? Do let me know (by leaving a comment here or reaching me directly – if you don’t have my contact details, you can use the contact form on this blog). Thanks in advance.