Reining in the Oligarchies

From Hillsdale College’s  Imprimus:

Who Is in Control? The Need to Rein in Big Tech

Allum Bokhari

The following is adapted from a speech delivered at Hillsdale College on November 8, 2020, during a Center for Constructive Alternatives conference on Big Tech.

In January, when every major Silicon Valley tech company permanently banned the President of the United States from its platform, there was a backlash around the world. One after another, government and party leaders—many of them ideologically opposed to the policies of President Trump—raised their voices against the power and arrogance of the American tech giants. These included the President of Mexico, the Chancellor of Germany, the government of Poland, ministers in the French and Australian governments, the neoliberal center-right bloc in the European Parliament, the national populist bloc in the European Parliament, the leader of the Russian opposition (who recently survived an assassination attempt), and the Russian government (which may well have been behind that attempt).

Common threats create strange bedfellows. Socialists, conservatives, nationalists, neoliberals, autocrats, and anti-autocrats may not agree on much, but they all recognize that the tech giants have accumulated far too much power. None like the idea that a pack of American hipsters in Silicon Valley can, at any moment, cut off their digital lines of communication.

I published a book on this topic prior to the November election, and many who called me alarmist then are not so sure of that now. I built the book on interviews with Silicon Valley insiders and five years of reporting as a Breitbart News tech correspondent. Breitbart created a dedicated tech reporting team in 2015—a time when few recognized the danger that the rising tide of left-wing hostility to free speech would pose to the vision of the World Wide Web as a free and open platform for all viewpoints.

This inversion of that early libertarian ideal—the movement from the freedom of information to the control of information on the Web—has been the story of the past five years.

***

When the Web was created in the 1990s, the goal was that everyone who wanted a voice could have one. All a person had to do to access the global marketplace of ideas was to go online and set up a website. Once created, the website belonged to that person. Especially if the person owned his own server, no one could deplatform him. That was by design, because the Web, when it was invented, was competing with other types of online services that were not so free and open.

It is important to remember that the Web, as we know it today—a network of websites accessed through browsers—was not the first online service ever created. In the 1990s, Sir Timothy Berners-Lee invented the technology that underpins websites and web browsers, creating the Web as we know it today. But there were other online services, some of which predated Berners-Lee’s invention. Corporations like CompuServe and Prodigy ran their own online networks in the 1990s—networks that were separate from the Web and had access points that were different from web browsers. These privately-owned networks were open to the public, but CompuServe and Prodigy owned every bit of information on them and could kick people off their networks for any reason.

In these ways the Web was different. No one owned it, owned the information on it, or could kick anyone off. That was the idea, at least, before the Web was captured by a handful of corporations.

We all know their names: Google, Facebook, Twitter, YouTube, Amazon. Like Prodigy and CompuServe back in the ’90s, they own everything on their platforms, and they have the police power over what can be said and who can participate. But it matters a lot more today than it did in the ’90s. Back then, very few people used online services. Today everyone uses them—it is practically impossible not to use them. Businesses depend on them. News publishers depend on them. Politicians and political activists depend on them. And crucially, citizens depend on them for information.

Today, Big Tech doesn’t just mean control over online information. It means control over news. It means control over commerce. It means control over politics. And how are the corporate tech giants using their control? Judging by the three biggest moves they have made since I wrote my book—the censoring of the New York Post in October when it published its blockbuster stories on Biden family corruption, the censorship and eventual banning from the Web of President Trump, and the coordinated takedown of the upstart social media site Parler—it is obvious that Big Tech’s priority today is to support the political Left and the Washington establishment.

Big Tech has become the most powerful election-influencing machine in American history. It is not an exaggeration to say that if the technologies of Silicon Valley are allowed to develop to their fullest extent, without any oversight or checks and balances, then we will never have another free and fair election. But the power of Big Tech goes beyond the manipulation of political behavior. As one of my Facebook sources told me in an interview for my book: “We have thousands of people on the platform who have gone from far right to center in the past year, so we can build a model from those people and try to make everyone else on the right follow the same path.” Let that sink in. They don’t just want to control information or even voting behavior—they want to manipulate people’s worldview.

Is it too much to say that Big Tech has prioritized this kind of manipulation? Consider that Twitter is currently facing a lawsuit from a victim of child sexual abuse who says that the company repeatedly failed to take down a video depicting his assault, and that it eventually agreed to do so only after the intervention of an agent from the Department of Homeland Security. So Twitter will take it upon itself to ban the President of the United States, but is alleged to have taken down child pornography only after being prodded by federal law enforcement.

***

How does Big Tech go about manipulating our thoughts and behavior? It begins with the fact that these tech companies strive to know everything about us—our likes and dislikes, the issues we’re interested in, the websites we visit, the videos we watch, who we voted for, and our party affiliation. If you search for a Hannukah recipe, they’ll know you’re likely Jewish. If you’re running down the Yankees, they’ll figure out if you’re a Red Sox fan. Even if your smart phone is turned off, they’ll track your location. They know who you work for, who your friends are, when you’re walking your dog, whether you go to church, when you’re standing in line to vote, and on and on.

As I already mentioned, Big Tech also monitors how our beliefs and behaviors change over time. They identify the types of content that can change our beliefs and behavior, and they put that knowledge to use. They’ve done this openly for a long time to manipulate consumer behavior—to get us to click on certain ads or buy certain products. Anyone who has used these platforms for an extended period of time has no doubt encountered the creepy phenomenon where you’re searching for information about a product or a service—say, a microwave—and then minutes later advertisements for microwaves start appearing on your screen. These same techniques can be used to manipulate political opinions.

I mentioned that Big Tech has recently demonstrated ideological bias. But it is equally true that these companies have huge economic interests at stake in politics. The party that holds power will determine whether they are going to get government contracts, whether they’re going to get tax breaks, and whether and how their industry will be regulated. Clearly, they have a commercial interest in political control—and currently no one is preventing them from exerting it.

To understand how effective Big Tech’s manipulation could become, consider the feedback loop.

As Big Tech constantly collects data about us, they run tests to see what information has an impact on us. Let’s say they put a negative news story about someone or something in front of us, and we don’t click on it or read it. They keep at it until they find content that has the desired effect. The feedback loop constantly improves, and it does so in a way that’s undetectable.

What determines what appears at the top of a person’s Facebook feed, Twitter feed, or Google search results? Does it appear there because it’s popular or because it’s gone viral? Is it there because it’s what you’re interested in? Or is there another reason Big Tech wants it to be there? Is it there because Big Tech has gathered data that suggests it’s likely to nudge your thinking or your behavior in a certain direction? How can we know?

What we do know is that Big Tech openly manipulates the content people see. We know, for example, that Google reduced the visibility of Breitbart News links in search results by 99 percent in 2020 compared to the same period in 2016. We know that after Google introduced an update last summer, clicks on Breitbart News stories from Google searches for “Joe Biden” went to zero and stayed at zero through the election. This didn’t happen gradually, but in one fell swoop—as if Google flipped a switch. And this was discoverable through the use of Google’s own traffic analysis tools, so it isn’t as if Google cared that we knew about it.

Speaking of flipping switches, I have noted that President Trump was collectively banned by Twitter, Facebook, Twitch, YouTube, TikTok, Snapchat, and every other social media platform you can think of. But even before that, there was manipulation going on. Twitter, for instance, reduced engagement on the President’s tweets by over eighty percent. Facebook deleted posts by the President for spreading so-called disinformation.

But even more troubling, I think, are the invisible things these companies do. Consider “quality ratings.” Every Big Tech platform has some version of this, though some of them use different names. The quality rating is what determines what appears at the top of your search results, or your Twitter or Facebook feed, etc. It’s a numerical value based on what Big Tech’s algorithms determine in terms of “quality.” In the past, this score was determined by criteria that were somewhat objective: if a website or post contained viruses, malware, spam, or copyrighted material, that would negatively impact its quality score. If a video or post was gaining in popularity, the quality score would increase. Fair enough.

Over the past several years, however—and one can trace the beginning of the change to Donald Trump’s victory in 2016—Big Tech has introduced all sorts of new criteria into the mix that determines quality scores. Today, the algorithms on Google and Facebook have been trained to detect “hate speech,” “misinformation,” and “authoritative” (as opposed to “non-authoritative”) sources. Algorithms analyze a user’s network, so that whatever users follow on social media—e.g., “non-authoritative” news outlets—affects the user’s quality score. Algorithms also detect the use of language frowned on by Big Tech—e.g., “illegal immigrant” (bad) in place of “undocumented immigrant” (good)—and adjust quality scores accordingly. And so on.

This is not to say that you are informed of this or that you can look up your quality score. All of this happens invisibly. It is Silicon Valley’s version of the social credit system overseen by the Chinese Communist Party. As in China, if you defy the values of the ruling elite or challenge narratives that the elite labels “authoritative,” your score will be reduced and your voice suppressed. And it will happen silently, without your knowledge.

This technology is even scarier when combined with Big Tech’s ability to detect and monitor entire networks of people. A field of computer science called “network analysis” is dedicated to identifying groups of people with shared interests, who read similar websites, who talk about similar things, who have similar habits, who follow similar people on social media, and who share similar political viewpoints. Big Tech companies are able to detect when particular information is flowing through a particular network—if there’s a news story or a post or a video, for instance, that’s going viral among conservatives or among voters as a whole. This gives them the ability to shut down a story they don’t like before it gets out of hand. And these systems are growing more sophisticated all the time.

***

If Big Tech’s capabilities are allowed to develop unchecked and unregulated, these companies will eventually have the power not only to suppress existing political movements, but to anticipate and prevent the emergence of new ones. This would mean the end of democracy as we know it, because it would place us forever under the thumb of an unaccountable oligarchy.

The good news is, there is a way to rein in the tyrannical tech giants. And the way is simple: take away their power to filter information and filter data on our behalf.

All of Big Tech’s power comes from their content filters—the filters on “hate speech,” the filters on “misinformation,” the filters that distinguish “authoritative” from “non-authoritative” sources, etc. Right now these filters are switched on by default. We as individuals can’t turn them off. But it doesn’t have to be that way.

The most important demand we can make of lawmakers and regulators is that Big Tech be forbidden from activating these filters without our knowledge and consent. They should be prohibited from doing this—and even from nudging us to turn on a filter—under penalty of losing their Section 230 immunity as publishers of third party content. This policy should be strictly enforced, and it should extend even to seemingly non-political filters like relevance and popularity. Anything less opens the door to manipulation.

Our ultimate goal should be a marketplace in which third party companies would be free to design filters that could be plugged into services like Twitter, Facebook, Google, and YouTube. In other words, we would have two separate categories of companies: those that host content and those that create filters to sort through that content. In a marketplace like that, users would have the maximum level of choice in determining their online experiences. At the same time, Big Tech would lose its power to manipulate our thoughts and behavior and to ban legal content—which is just a more extreme form of filtering—from the Web.

This should be the standard we demand, and it should be industry-wide. The alternative is a kind of digital serfdom. We don’t allow old-fashioned serfdom anymore—individuals and businesses have due process and can’t be evicted because their landlord doesn’t like their politics. Why shouldn’t we also have these rights if our business or livelihood depends on a Facebook page or a Twitter or YouTube account?

This is an issue that goes beyond partisanship. What the tech giants are doing is so transparently unjust that all Americans should start caring about it—because under the current arrangement, we are all at their mercy. The World Wide Web was meant to liberate us. It is now doing the opposite. Big Tech is increasingly in control. The most pressing question today is: how are we going to take control back?

 

What’s Going On?

Vampire Squid
This is an excellent interview with technology culture guru Jaron Lanier, author of some very insightful books on the clashes between technology and humanism. See comments and highlights below…

And then when you move out of the tech world, everybody’s struggling…

It’s not so much that they’re doing badly, but they have only labor and no capital. Or the way I used to put it is, they have to sing for their supper, for every single meal. It’s making everyone else take on all the risk. It’s like we’re the people running the casino and everybody else takes the risks and we don’t. That’s how it feels to me. It’s not so much that everyone else is doing badly as that they’ve lost economic capital and standing, and momentum and plannability. It’s a subtle difference.

‘One Has This Feeling of Having Contributed to Something That’s Gone Very Wrong’

By Noah Kulwin April 17, 2018 New York Magazine

Over the last few months, Select All has interviewed more than a dozen prominent technology figures about what has gone wrong with the contemporary internet for a project called “The Internet Apologizes.” We’re now publishing lengthier transcripts of each individual interview. This interview features Jaron Lanier, a pioneer in the field of virtual reality and the founder of the first company to sell VR goggles. Lanier currently works at Microsoft Research as an interdisciplinary scientist. He is the author of the forthcoming book Ten Arguments for Deleting Your Social Media Accounts Right Now.

You can find other interviews from this series here.

Jaron Lanier: Can I just say one thing now, just to be very clear? Professionally, I’m at Microsoft, but when I speak to you, I’m not representing Microsoft at all. There’s not even the slightest hint that this represents any official Microsoft thing. I have an agreement within which I’m able to be an independent public intellectual, even if it means criticizing them. I just want to be very clear that this isn’t a Microsoft position.

Noah Kulwin: Understood.
Yeah, sorry. I really just wanted to get that down. So now please go ahead, I’m so sorry to interrupt you.

In November, you told Maureen Dowd that it’s scary and awful how out of touch Silicon Valley people have become. It’s a pretty forward remark. I’m kind of curious what you mean by that.
To me, one of the patterns we see that makes the world go wrong is when somebody acts as if they aren’t powerful when they actually are powerful. So if you’re still reacting against whatever you used to struggle for, but actually you’re in control, then you end up creating great damage in the world. Like, oh, I don’t know, I could give you many examples. But let’s say like Russia’s still acting as if it’s being destroyed when it isn’t, and it’s creating great damage in the world. And Silicon Valley’s kind of like that.

We used to be kind of rebels, like, if you go back to the origins of Silicon Valley culture, there were these big traditional companies like IBM that seemed to be impenetrable fortresses. And we had to create our own world. To us, we were the underdogs and we had to struggle. And we’ve won. I mean, we have just totally won. We run everything. We are the conduit of everything else happening in the world. We’ve disrupted absolutely everything. Politics, finance, education, media, relationships — family relationships, romantic relationships — we’ve put ourselves in the middle of everything, we’ve absolutely won. But we don’t act like it.

We have no sense of balance or modesty or graciousness having won. We’re still acting as if we’re in trouble and we have to defend ourselves, which is preposterous. And so in doing that we really kind of turn into assholes, you know?

How do you think that siege mentality has fed into the ongoing crisis with the tech backlash?

One of the problems is that we’ve isolated ourselves through extreme wealth and success. Before, we might’ve been isolated because we were nerdy insurgents. But now we’ve found a new method to isolate ourselves, where we’re just so successful and so different from so many other people that our circumstances are different. And we have less in common with all the people whose lives we’ve disrupted. I’m just really struck by that. I’m struck with just how much better off we are financially, and I don’t like the feeling of it.

Personally, I would give up a lot of the wealth and elite status that we have in order to just live in a friendly, more connected world where it would be easier to move about and not feel like everything else is insecure and falling apart. People in the tech world, they’re all doing great, they all feel secure. I mean they might worry about a nuclear attack or something, but their personal lives are really secure.

And then when you move out of the tech world, everybody’s struggling. It’s a very strange thing. The numbers show an economy that’s doing well, but the reality is that the way it’s doing well doesn’t give many people a feeling of security or confidence in their futures. It’s like everybody’s working for Uber in one way or another. Everything’s become the gig economy. And we routed it that way, that’s our doing. There’s this strange feeling when you just look outside of the tight circle of Silicon Valley, almost like entering another country, where people are less secure. It’s not a good feeling. I don’t think it’s worth it, I think we’re wrong to want that feeling.

It’s not so much that they’re doing badly, but they have only labor and no capital. Or the way I used to put it is, they have to sing for their supper, for every single meal. It’s making everyone else take on all the risk. It’s like we’re the people running the casino and everybody else takes the risks and we don’t. That’s how it feels to me. It’s not so much that everyone else is doing badly as that they’ve lost economic capital and standing, and momentum and plannability. It’s a subtle difference.

There’s still this rhetoric of being the underdog in the tech industry. The attitude within the Valley is “Are you kidding? You think we’re resting on our laurels? No! We have to fight for every yard.”

There’s this question of whether what you’re fighting for is something that’s really new and a benefit for humanity, or if you’re only engaged in a sort of contest with other people that’s fundamentally not meaningful to anyone else. The theory of markets and capitalism is that when we compete, what we’re competing for is to get better at something that’s actually a benefit to people, so that everybody wins. So if you’re building a better mousetrap, or a better machine-learning algorithm, then that competition should generate improvement for everybody.

But if it’s a purely abstract competition set up between insiders to the exclusion of outsiders, it might feel like a competition, it might feel very challenging and stressful and hard to the people doing it, but it doesn’t actually do anything for anybody else. It’s no longer genuinely productive for anybody, it’s a fake. And I’m a little concerned that a lot of what we’ve been doing in Silicon Valley has started to take on that quality. I think that’s been a problem in Wall Street for a while, but the way it’s been a problem in Wall Street has been aided by Silicon Valley. Everything becomes a little more abstract and a little more computer-based. You have this very complex style of competition that might not actually have much substance to it.

You look at the big platforms, and it’s not like there’s this bountiful ecosystem of start-ups. The rate of small-business creation is at its lowest in decades, and instead you have a certain number of start-ups competing to be acquired by a handful of companies. There are not that many varying powers, there’s just a few.
That’s something I’ve been complaining about and I’ve written about for a while, that Silicon Valley used to be this place where people could do a start-up and the start-up might become a big company on its own, or it might be acquired, or it might merge into things. But lately it kind of feels like both at the start and at the end of the life of a start-up, things are a little bit more constrained. It used to be that you didn’t have to know the right people, but now you do. You have to get in with the right angel investors or incubator or whatever at the start. And they’re just a small number, it’s like a social order, you have to get into them. And then the output on the other side is usually being acquired by one of a very small number of top companies.

There are a few exceptions, you can see Dropbox’s IPO. But they’re rarer and rarer. And I suspect Dropbox in the future might very well be acquired by one of the giants. It’s not clear that it’ll survive as its own thing in the long term. I mean, we don’t know. I have no inside information about that, I’m just saying that the much more typical scenario now, as you described, is that the companies go to one of the biggies.

I’m kind of curious what you think needs to happen to prevent future platforms, like VR, from going the way of social media and reaching this really profitable crisis state.

A lot of the rhetoric of Silicon Valley that has the utopian ring about creating meaningful communities where everybody’s creative and people collaborate and all this stuff — I don’t wanna make too much of my own contribution, but I was kind of the first author of some of that rhetoric a long time ago. So it kind of stings for me to see it misused. Like, I used to talk about how virtual reality could be a tool for empathy, and then I see Mark Zuckerberg talking about how VR could be a tool for empathy while being profoundly nonempathic, using VR to tour Puerto Rico after the storm, after Maria. One has this feeling of having contributed to something that’s gone very wrong.

So I guess the overall way I think of it is, first, we might remember ourselves as having been lucky that some of these problems started to come to a head during the social-media era, before tools like virtual reality become more prominent, because the technology is still not as intense as it probably will be in the future. So as bad as it’s been, as bad as the election interference and the fomenting of ethnic warfare, and the empowering of neo-Nazis, and the bullying — as bad as all of that has been, we might remember ourselves as having been fortunate that it happened when the technology was really just little slabs we carried around in our pockets that we could look at and that could talk to us, or little speakers we could talk to. It wasn’t yet a whole simulated reality that we could inhabit.

Because that will be so much more intense, and that has so much more potential for behavior modification, and fooling people, and controlling people. So things potentially could get a lot worse, and hopefully they’ll get better as a result of our experiences during this era.

As far as what to do differently, I’ve had a particular take on this for a long time that not everybody agrees with. I think the fundamental mistake we made is that we set up the wrong financial incentives, and that’s caused us to turn into jerks and screw around with people too much. Way back in the ’80s, we wanted everything to be free because we were hippie socialists. But we also loved entrepreneurs because we loved Steve Jobs. So you wanna be both a socialist and a libertarian at the same time, and it’s absurd. But that’s the kind of absurdity that Silicon Valley culture has to grapple with.

And there’s only one way to merge the two things, which is what we call the advertising model, where everything’s free but you pay for it by selling ads. But then because the technology gets better and better, the computers get bigger and cheaper, there’s more and more data — what started out as advertising morphed into continuous behavior modification on a mass basis, with everyone under surveillance by their devices and receiving calculated stimulus to modify them. So you end up with this mass behavior-modification empire, which is straight out of Philip K. Dick, or from earlier generations, from 1984.

It’s this thing that we were warned about. It’s this thing that we knew could happen. Norbert Wiener, who coined the term cybernetics, warned about it as a possibility. And despite all the warnings, and despite all of the cautions, we just walked right into it, and we created mass behavior-modification regimes out of our digital networks. We did it out of this desire to be both cool socialists and cool libertarians at the same time.

This dovetails with something you’ve said in the past that’s with me, which is your phrase Digital Maoism. Do you think that the Digital Maoism that you described years ago — are those the people who run Silicon Valley today?

I was talking about a few different things at the time I wrote “Digital Maoism.” One of them was the way that we were centralizing culture, even though the rhetoric was that we were distributing it. Before Wikipedia, I think it would have been viewed as being this horrible thing to say that there could only be one encyclopedia, and that there would be one dominant entry for a given topic. Instead, there were different encyclopedias. There would be variations not so much in what facts were presented, but in the way they were presented. That voice was a real thing.

And then we moved to this idea that we have a single dominant encyclopedia that was supposed to be the truth for the global AI or something like that. But there’s something deeply pernicious about that. So we’re saying anybody can write for Wikipedia, so it’s, like, purely democratic and it’s this wonderful open thing, and yet the bizarreness is that that open democratic process is on the surface of something that struck me as being Maoist, which is that there’s this one point of view that’s then gonna be the official one.

And then I also noticed that that process of people being put into a global system in which they’re supposed to work together toward some sort of dominating megabrain that’s the one truth didn’t seem to bring out the best in people, that people turned aggressive and mean-spirited when they interacted in that context. I had worked on some content for Britannica years and years ago, and I never experienced the kind of just petty meanness that’s just commonplace in everything about the internet. Among many other places, on Wikipedia.

On the one hand, you have this very open collective process actually in the service of this very domineering global brain, destroyer of local interpretation, destroyer of individual voice process. And then you also have this thing that seems to bring out this meanness in people, where people get into this kind of mob mentality and they become unkind to each other. And those two things have happened all over the internet; they’re both very present in Facebook, everywhere. And it’s a bit of a subtle debate, and it takes a while to work through it with somebody who doesn’t see what I’m talking about. That was what I was talking about.

But then there’s this other thing about the centralization of economic power. What happened with Maoists and with communists in general, and neo-Marxists and all kinds of similar movements, is that on the surface, you say everybody shares, everybody’s equal, we’re not gonna have this capitalist concentration. But then there’s some other entity that might not look like traditional capitalism, but is effectively some kind of robber baron that actually owns everything, some kind of Communist Party actually controls everything, and you have just a very small number of individuals who become hyperempowered and everybody else loses power.

And exactly the same thing has happened with the supposed openness of the internet, where you say, “Isn’t it wonderful, with Facebook and Twitter anybody can express themselves. Everybody’s an equal, everybody’s empowered.” But in fact, we’re in a period of time of extreme concentration of wealth and power, and it’s precisely around those who run the biggest computers. So the truth and the effect is just the opposite of what the rhetoric is and the immediate experience.

A lot of people were furious with me over Digital Maoism and felt that I had betrayed our cause or something, and I lost some friends over it. And some of it was actually hard. But I fail to see how it was anything but accurate. I don’t wanna brag, but I think I was just right. I think that that’s what was going on and that’s what’s happening in China. But what’s worse is that it’s happening elsewhere.

The thing is, I’m not sure that what’s going on in the U.S. is that distinct from what’s going on in China. I think there are some differences, but they’re in degree; they’re not stark. The Chinese are saying if you have a low social rating you can’t get on the subway, but on the other hand, we’re doing algorithmic profiling that’s sending people to jail, and we know that the algorithms are racist. Are we really that much better?

I’m not really sure. I think it would be hard to determine it. But I think we’re doing many of the same things; it’s just that we package them in a slightly different way when we tell stories to ourselves.

This is something I write about, you know I have another book coming out shortly?

Yeah, that was gonna be where I took this next.

One of the things that I’ve been concerned about is this illusion where you think that you’re in this super-democratic open thing, but actually it’s exactly the opposite; it’s actually creating a super concentration of wealth and power, and disempowering you. This has been particularly cruel politically. Every time there’s some movement, like the Black Lives Matter movement, or maybe now the March for Our Lives movement, or #MeToo, or very classically the Arab Spring, you have this initial period where people feel like they’re on this magic-carpet ride and that social media is letting them broadcast their opinions for very low cost, and that they’re able to reach people and organize faster than ever before. And they’re thinking, Wow, Facebook and Twitter are these wonderful tools of democracy.

But then the algorithms have to maximize value from all the data that’s coming in. So they test use that data. And it just turns out as a matter of course, that the same data that is a positive, constructive process for the people who generated it — Black Lives Matter, or the Arab Spring — can be used to irritate other groups. And unfortunately there’s this asymmetry in human emotions where the negative emotions of fear and hatred and paranoia and resentment come up faster, more cheaply, and they’re harder to dispel than the positive emotions. So what happens is, every time there’s some positive motion in these networks, the negative reaction is actually more powerful. So when you have a Black Lives Matter, the result of that is the empowerment of the worst racists and neo-Nazis in a way that hasn’t been seen in generations. When you have an Arab Spring, the result ultimately is the network empowerment of ISIS and other extremists — bloodthirsty, horrible things, the likes of which haven’t been seen in the Arab world or in Islam for years, if ever.

Black Lives Matter has incredible visibility, but the reality is that even though it has had an enormous effect on the discursive level, and at making the country fixated on this conversation, that’s distinct from political force necessary to effect that change. What do you think about the sort of gap between what Silicon Valley platforms have promised in that respect and then the material reality?

That observation — that social-media politics is all talk and no action or something, or that it’s empty — is compatible with, but a little bit different from, what I was saying. I’m saying that it empowers its opposite more than the original good intention. And those two things can both be true at once, but I just wanna point out that they’re two different explanations for why nothing decent seems to come out in the end.

I want to be wrong. I especially wanna be wrong about the March for Our Lives kids. I really wanna be wrong about them. I want them to not fall into this because they’re our hope, they’re the future of our country, so I very deeply, profoundly wanna be wrong. I don’t want their social-media data to empower the opposite movement that ends up being more powerful because negative emotions are more powerful. I just wanna be wrong. I so wanna be telling you bullshit right now.

So far it’s been right, but that doesn’t mean it will continue to be. So please let me be wrong.

Platforms seem trapped in this fundamental tension, and I’m just not sure how they break out of that.

My feeling is that if the theory is correct that we got into this by trying to be socialist and libertarian at the same time, and getting the worst of both worlds, then we have to choose. You either have to say, “Okay, Facebook is not going to be a business anymore. We said we wanted to create this thing to connect people, but we’re actually making the world worse, so we’re not gonna allow people to advertise on it; we’re not gonna allow anybody to have any influence on your feed but you. This is all about you. We’re gonna turn it into a nonprofit; we’re gonna give it to each country; it’ll be nationalized. We’ll do some final stock things so all the people who contributed to it will be rich beyond their dreams. But then after that it’s done; it’s not a business. We’ll buy back everybody’s stock and it’s done. It’s over. That’s it.”

[Blogger note: this choice between socialism and libertarianism is a highly interesting and crucial question, but I don’t think there’s one answer. Facebook strikes me as a dysfunctional idea from the beginning. Social interaction doesn’t scale, data networks scale. A global gossip network like Facebook makes almost no sense. I suspect FB will be competed down to many different functional social media models rather than one concentrated behemoth. Something like search. or Wikipedia seems rather different in nature. Google Search looks more and more like a public good, which means it is likely to become a regulated public utility. It’s not exactly clear how search works as a public utility, but I think the political imperative is there.]

That’s one option. So it just turns into a socialist enterprise; we let it be nationalized and it’s gone. The other option is to monetize it. And that’s the one that I’m personally more interested in. And what that would look like is, we’d ask those who can afford to — which would be a lot of people in the world, certainly most people in the West — to start paying for it. And then we’d also pay people who provide data into it that’s exceptionally valuable to the network, and it would become a source of economic growth. And we would outlaw advertising on it. There would no longer be third parties paying to influence you.

Because as long as you have advertising, you have this perverse incentive to make it manipulative. You can’t have a behavior-modification machine with advertisers and have anything ethical; it’s not possible. You could get away with it barely with television because television wasn’t as effective at modifying people. But this, there’s no ethical way to have advertising.

So you’d ban advertising, and you’d start paying people, a subset of people; a minority of people would start earning their living because they just do stuff that other people love to look at over Facebook or the other social networks, or YouTube for that matter. And then most people would pay into it in the same way that we pay into something like Netflix or HBO Now.

And one of the things I wanna point out is that back at the time when Facebook was founded, the belief was that in the future there wouldn’t be paid people making movies and television because armies of unpaid volunteers organized through our network schemes would make superior content, just like what happened with Wikipedia. But what actually happened is, when people started paying for Netflix, we got what we call Peak TV — things got much better as a result of it being monetized.

So I think if we had a situation where people were paying for something like Facebook, and being paid for it, and advertising was absolutely outlawed, the only customer would be the user, there would be no other customer. If we got into that situation, I think we have at least a chance of achieving Peak Social Media, just like we achieved Peak TV. We might actually see things improve a great deal.

So that’s the solution that I think is better. But we can’t do this combination of libertarian and communist ideology. It just doesn’t work. You have to choose one.

You’ve written this book, Ten Arguments for Deleting Your Social Media Accounts. I don’t want to make you summarize the whole book, but I want to ask what you thought was the most urgent argument, and to explain why.
Okay. By the way, it’s … For Deleting Your Social Media Accounts Right Now.

Right now! So the whole thing is already urgent, so which of these urgent pleas do you believe to be the most pressing?

There’s one that’s a little complicated, which is the last one. Because I have the one about politics, and I have the one about economics. That it’s ruining politics, it’s empowering the most obnoxious people to be the most powerful inherently, and that’s destroying the world. I have the one about economics, how it’s centralizing wealth even while it seems to be democratizing it. I have the one about how it makes you feel sad; I have all these different ones.

But at the end, I have one that’s a spiritual one. The argument is that social media hates your soul. And it suggests that there’s a whole spiritual, religious belief system along with social media like Facebook that I think people don’t like. And it’s also fucking phony and false. It suggests that life is some kind of optimization, like you’re supposed to be struggling to get more followers and friends. Zuckerberg even talked about how the new goal of Facebook would be to give everybody a meaningful life, as if something about Facebook is where the meaning of life is.

It suggests that you’re just a cog in a giant global brain or something like that. The rhetoric from the companies is often about AI, that what they’re really doing — like YouTube’s parent company, Google, says what they really are is building the giant global brain that’ll inherit the earth and they’ll upload you to that brain and then you won’t have to die. It’s very, very religious in the rhetoric. And so it’s turning into this new religion, and it’s a religion that doesn’t care about you. It’s a religion that’s completely lacking in empathy or any kind of personal acknowledgment. And it’s a bad religion. It’s a nerdy, empty, sterile, ugly, useless religion that’s based on false ideas. And I think that of all of the things, that’s the worst thing about it.

I mean, it’s sort of like a cult of personality. It’s like in North Korea or some regime where the religion is your purpose to serve this one guy. And your purpose is to serve this one system, which happens to be controlled by one guy, in the case of Facebook.

It’s not as blunt and out there, but that is the underlying message of it and it’s ugly and bad. I loathe it, and I think a lot of people have that feeling, but they might not have articulated it or gotten it to the surface because it’s just such a weird and new situation.

On the other hand, there’s a rising backlash that may end the platforms before they have the opportunity to take root and produce yet another vicious problem.

I’m in my late 50s now. I have an 11-year-old daughter, and the thing that bothers me so much is that we’re giving them a world that isn’t as good as the world we received. We’re giving them a world in which their hopes for being able to create a decent, happy, reasonably low-stress life, where they can have their own kids, it’s just not as good as what we were given. We have not done well by them.

And then to say that observing our own mistakes means that you’re old and don’t get it is profoundly counterproductive. It’s really just a way of evading our own responsibility. The truth is that we totally have screwed over younger generations. And that’s a bigger story than just the social-media and tech thing, but the social-media and tech thing is a big part of it. We’ve created a scammy society where we concentrate wealth in ways that are petty and not helpful, and we’ve given them a world of far fewer options than we had. There’s nothing I want more than for the younger people to create successful lives and create a world that they love. I mean, that’s what it’s all about. But to say that the path to that is for them to agree with the thing we made for them is just so self-serving and so obnoxiously narcissistic that it makes me wanna throw up.

This interview has been edited and condensed for length and clarity.

From Disruption to Dystopia

Very interesting article by Joel Kotkin, who researches the economics and politics of cities. It portrays a future that resembles feudalism more than free market democratic capitalism. I’d optimistically venture there will eventually be a more humanist backlash against the future dominance of technology.

From Disruption to Dystopia: Silicon Valley Envisions the City of the Future

The unaffordable Bay Area, Google’s new neighborhood ‘built from the internet up,’ and China’s police state each offer glimpses of what the tech giants plan to sell the rest of us.

by Joel Kotkin

The tech oligarchs who already dominate our culture and commerce, manipulate our moods, and shape the behaviors of our children while accumulating capital at a rate unprecedented in at least a century want to fashion our urban future in a way that dramatically extends the reach of the surveillance state already evident in airports and on our phones.

The drive to redesign our cities, however, is not really the end of the agenda of those who Aldous Huxley described as the top of the “scientific caste system.” The oligarchy has also worked to make our homes, our personal space, “connected” to their monitoring and money machines. This may be a multibillion-dollar market soon, but many who have employed such devices at home—appliances that track our activities and speak to us like loyal servants—find them “creepy,” as they should, given that their daily activities are fed back to enrich the high-tech hive mind. Both the city and house the future may owe more to Brave New World than Better Homes and Gardens.

This is a vision of the urban future in which the tech companies’ own workers and whatever other people with skills the machines haven’t yet replaced are a new class of urban serfs living in small apartments, along with a much larger class of dependent persons living on “income maintenance” and housing or housing subsidies provided by the state. “Bees exist on Earth to pollinate flowers, and maybe humans are here to build the machines,” observes professor Andrew Hudson-Smith, from University College London’s Centre for Advanced Spatial Analysis. “The city will be one big joined-up urban machine, and humans’ role on Earth will be done.”

Read more

Tech Dystopia?

Below are excerpts from a fascinating series of articles by The Guardian (with links). The articles address many of the ways that Internet 2.0 network media models such as Google, Facebook, YouTube, Instagram, etc. are transforming, and in many cases undermining, the foundations of a democratic humanistic society. These issues motivate us at tuka to design solutions to the great question of life’s meaning.

Personally, I don’t believe this dystopia will come to pass because humans are quite resilient as a species and eventually our humanist qualities will dominate our biological urges and economic imperatives. We have free will and ultimately, we choose correctly.

Perhaps that is an overly optimistic opinion, but Internet (or Web) 3.0 technology is rewriting the script with applications that reassert human control over the data universe. We will build more humanistic social communities that employ technology, with the emphasis always on the human. We see this now with the growing refusal to surrender to Web 2.0 by tech insiders.

See excerpts and comments below.

“If politics is an expression of our human will, on individual and collective levels, then the attention economy is directly undermining the assumptions that democracy rests on.” If Apple, Facebook, Google, Twitter, Instagram, and Snapchat are gradually chipping away at our ability to control our own minds, could there come a point, I ask, at which democracy no longer functions?

‘Fiction is outperforming reality’: how YouTube’s algorithm distorts truth

Paul Lewis February 2, 2018

There are 1.5 billion YouTube users in the world, which is more than the number of households that own televisions. What they watch is shaped by this algorithm, which skims and ranks billions of videos to identify 20 “up next” clips that are both relevant to a previous video and most likely, statistically speaking, to keep a person hooked on their screen.

Company insiders tell me the algorithm is the single most important engine of YouTube’s growth. In one of the few public explanations of how the formula works – an academic paper that sketches the algorithm’s deep neural networks, crunching a vast pool of data about videos and the people who watch them – YouTube engineers describe it as one of the “largest scale and most sophisticated industrial recommendation systems in existence”.

We see here the power of AI data algorithms to filter content. The Google response has been to “expand the army of human moderators.” That’s a necessary method of reasserting human judgment over the network

The primary focus of the article then turns to politics and the electoral influences of disinformation:

Much has been written about Facebook and Twitter’s impact on politics, but in recent months academics have speculated that YouTube’s algorithms may have been instrumental in fuelling disinformation during the 2016 presidential election. “YouTube is the most overlooked story of 2016,” Zeynep Tufekci, a widely respected sociologist and technology critic, tweeted back in October. “Its search and recommender algorithms are misinformation engines.”

Apparently, the sensationalism surrounding the Trump campaign caused YT’s AI algorithms to push more video feeds favorable to Trump and damaging to Hillary Clinton. One doesn’t need to be a partisan to recognize this was probably true for this particular media channel and its business model that values more views more than anything else.

However, this reality can also be distorted to present a particular conspiracy narrative of its own:

Trump won the electoral college as a result of 80,000 votes spread across three swing states. There were more than 150 million YouTube users in the US. The videos contained in Chaslot’s database of YouTube-recommended election videos were watched, in total, more than 3bn times before the vote in November 2016.

This, unfortunately, is cherry-picking statistical inferences concerning the margin of voting support. What was significant in determining the 2016 election outcome was not 80,000 votes across three states, but a run of popular vote wins in 2,623 of 3,112 counties across the U.S. This 85% share could not be an accident, nor could it be due to the single influence of disinformation, Russian or otherwise. The true difference in the election was not revealed by the popular vote total or the Electoral College vote, but by the geographical distribution of support. One can argue about which is more critical to democratic governance, but this post is about electronic media content, not political analysis.

The next article further addresses how technology is influencing our individual behaviors.

‘Our minds can be hijacked’: the tech insiders who fear a smartphone dystopia

Paul Lewis October 6, 2017

Justin Rosenstein had tweaked his laptop’s operating system to block Reddit, banned himself from Snapchat, which he compares to heroin, and imposed limits on his use of Facebook. But even that wasn’t enough. In August, the 34-year-old tech executive took a more radical step to restrict his use of social media and other addictive technologies.

A decade after he stayed up all night coding a prototype of what was then called an “awesome” button, Rosenstein belongs to a small but growing band of Silicon Valley heretics who complain about the rise of the so-called “attention economy”: an internet shaped around the demands of an advertising economy.

The extent of this addiction is cited by research that shows people touch, swipe or tap their phone 2,617 times a day!

There is growing concern that as well as addicting users, technology is contributing toward so-called “continuous partial attention”, severely limiting people’s ability to focus, and possibly lowering IQ. One recent study showed that the mere presence of smartphones damages cognitive capacity – even when the device is turned off. “Everyone is distracted,” Rosenstein says. “All of the time.”

“The technologies we use have turned into compulsions, if not full-fledged addictions,” Eyal writes. “It’s the impulse to check a message notification. It’s the pull to visit YouTube, Facebook, or Twitter for just a few minutes, only to find yourself still tapping and scrolling an hour later.” None of this is an accident, he writes. It is all “just as their designers intended”.

Tristan Harris, a former Google employee turned vocal critic of the tech industry points out that… “All of us are jacked into this system. All of our minds can be hijacked. Our choices are not as free as we think they are.”

“I don’t know a more urgent problem than this,” Harris says. “It’s changing our democracy, and it’s changing our ability to have the conversations and relationships that we want with each other.” 

Harris believes that tech companies never deliberately set out to make their products addictive. They were responding to the incentives of an advertising economy, experimenting with techniques that might capture people’s attention, even stumbling across highly effective design by accident.

“Smartphones are useful tools,” says Loren Brichter, a product designer. “But they’re addictive. Pull-to-refresh is addictive. Twitter is addictive. These are not good things. When I was working on them, it was not something I was mature enough to think about.”

The two inventors listed on Apple’s patent for “managing notification connections and displaying icon badges” are Justin Santamaria and Chris Marcellino. A few years ago Marcellino, 33, left the Bay Area and is now in the final stages of retraining to be a neurosurgeon. He stresses he is no expert on addiction but says he has picked up enough in his medical training to know that technologies can affect the same neurological pathways as gambling and drug use. “These are the same circuits that make people seek out food, comfort, heat, sex,” he says.

“The people who run Facebook and Google are good people, whose well-intentioned strategies have led to horrific unintended consequences,” he says. “The problem is that there is nothing the companies can do to address the harm unless they abandon their current advertising models.

But how can Google and Facebook be forced to abandon the business models that have transformed them into two of the most profitable companies on the planet?

This is exactly the problem – they really can’t. Newer technology, such as distributed social networks tracked by blockchain technology, must be deployed to disrupt the dysfunctional existing technology. New business models will be designed to support this disruption. Human behavioral instincts are crucial to successful new designs that make us more human, rather than less.

James Williams does not believe talk of dystopia is far-fetched. …He says his epiphany came a few years ago when he noticed he was surrounded by technology that was inhibiting him from concentrating on the things he wanted to focus on. “It was that kind of individual, existential realization: what’s going on?” he says. “Isn’t technology supposed to be doing the complete opposite of this?”

The question we ask at tuka is: “What do people really want from technology and social interaction? Distraction or meaning? And how do they find meaning?” Our answer is self-expression through creativity, sharing it, and connecting with communities.

Williams and Harris left Google around the same time and co-founded an advocacy group, Time Well Spent, that seeks to build public momentum for a change in the way big tech companies think about design. 

“Eighty-seven percent of people wake up and go to sleep with their smartphones,” he says. The entire world now has a new prism through which to understand politics, and Williams worries the consequences are profound.

The same forces that led tech firms to hook users with design tricks, he says, also encourage those companies to depict the world in a way that makes for compulsive, irresistible viewing. “The attention economy incentivizes the design of technologies that grab our attention,” he says. “In so doing, it privileges our impulses over our intentions.”

That means privileging what is sensational over what is nuanced, appealing to emotion, anger, and outrage. The news media is increasingly working in service to tech companies, Williams adds, and must play by the rules of the attention economy to “sensationalize, bait and entertain in order to survive”.

In the wake of Donald Trump’s stunning electoral victory, many were quick to question the role of so-called “fake news” on Facebook, Russian-created Twitter bots or the data-centric targeting efforts that companies such as Cambridge Analytica used to sway voters. But Williams sees those factors as symptoms of a deeper problem.

It is not just shady or bad actors who were exploiting the internet to change public opinion. The attention economy itself is set up to promote a phenomenon like Trump, who is masterly at grabbing and retaining the attention of supporters and critics alike, often by exploiting or creating outrage.

Orwellian-style coercion is less of a threat to democracy than the more subtle power of psychological manipulation, and “man’s almost infinite appetite for distractions”.

“The dynamics of the attention economy are structurally set up to undermine the human will,” Williams says. “If politics is an expression of our human will, on individual and collective levels, then the attention economy is directly undermining the assumptions that democracy rests on.” If Apple, Facebook, Google, Twitter, Instagram, and Snapchat are gradually chipping away at our ability to control our own minds, could there come a point, I ask, at which democracy no longer functions?

Our politics will survive and democracy is only one form of governance. The bigger question is how does human civilization survive if our behavior becomes self-destructive and meaningless?

The Death of Culture?

Designing a Sustainable Creative Ecosystem

Too Much information = The Death of Culture?

The major creative industries of music, photography, print, and video have all been disrupted by digital technology. We know this. As Chris Anderson has argued in his book Free, the cost of digital content has been driven towards zero. How could this be a bad thing? Well, TMI (Too Much Information — in this case, Too Much Content) is the curse of the Digital Age. It means creators make no money and audiences can’t find quality content amidst all the noise.

The end result will be a staleness of content and stagnant creative markets, i.e., the slow death of culture. So, how did this happen and what do we do about it?

View the rest of the story on Medium.

Vampire Squids?

 

likenolike

I would say this essay by Franklin Foer is a bit alarmist, though his book is worth reading and taking to heart. We are gradually becoming aware of the value of our personal data and I expect consumers will soon figure out how to demand a fair share of that value, else they will withdraw.

Technology is most often disrupted by newer technology that better serves the needs of users. For Web 2.0 business models, our free data is their lifeblood and soon we may be able to cut them off. Many hope that’s where Web 3.0 is going.

tuka is a technology model that seeks to do exactly that for creative content providers, their audiences, and promoter/fans.

How Silicon Valley is erasing your individuality

Washington Post, September 8, 2017

 

Franklin Foer is author of “World Without Mind: The Existential Threat of Big Tech,” from which this essay is adapted.

Until recently, it was easy to define our most widely known corporations. Any third-grader could describe their essence. Exxon sells gas; McDonald’s makes hamburgers; Walmart is a place to buy stuff. This is no longer so. Today’s ascendant monopolies aspire to encompass all of existence. Google derives from googol, a number (1 followed by 100 zeros) that mathematicians use as shorthand for unimaginably large quantities. Larry Page and Sergey Brin founded Google with the mission of organizing all knowledge, but that proved too narrow. They now aim to build driverless cars, manufacture phones and conquer death. Amazon, which once called itself “the everything store,” now produces television shows, owns Whole Foods and powers the cloud. The architect of this firm, Jeff Bezos, even owns this newspaper.

Along with Facebook, Microsoft and Apple, these companies are in a race to become our “personal assistant.” They want to wake us in the morning, have their artificial intelligence software guide us through our days and never quite leave our sides. They aspire to become the repository for precious and private items, our calendars and contacts, our photos and documents. They intend for us to turn unthinkingly to them for information and entertainment while they catalogue our intentions and aversions. Google Glass and the Apple Watch prefigure the day when these companies implant their artificial intelligence in our bodies. Brin has mused, “Perhaps in the future, we can attach a little version of Google that you just plug into your brain.”

More than any previous coterie of corporations, the tech monopolies aspire to mold humanity into their desired image of it. They think they have the opportunity to complete the long merger between man and machine — to redirect the trajectory of human evolution. How do I know this? In annual addresses and town hall meetings, the founding fathers of these companies often make big, bold pronouncements about human nature — a view that they intend for the rest of us to adhere to. Page thinks the human body amounts to a basic piece of code: “Your program algorithms aren’t that complicated,” he says. And if humans function like computers, why not hasten the day we become fully cyborg?

To take another grand theory, Facebook chief Mark Zuckerberg has exclaimed his desire to liberate humanity from phoniness, to end the dishonesty of secrets. “The days of you having a different image for your work friends or co-workers and for the other people you know are probably coming to an end pretty quickly,” he has said. “Having two identities for yourself is an example of a lack of integrity.” Of course, that’s both an expression of idealism and an elaborate justification for Facebook’s business model.

There’s an oft-used shorthand for the technologist’s view of the world. It is assumed that libertarianism dominates Silicon Valley, and that isn’t wholly wrong. High-profile devotees of Ayn Rand can be found there. But if you listen hard to the titans of tech, it’s clear that their worldview is something much closer to the opposite of a libertarian’s veneration of the heroic, solitary individual. The big tech companies think we’re fundamentally social beings, born to collective existence. They invest their faith in the network, the wisdom of crowds, collaboration. They harbor a deep desire for the atomistic world to be made whole. (“Facebook stands for bringing us closer together and building a global community,” Zuckerberg wrote in one of his many manifestos.) By stitching the world together, they can cure its ills.

Rhetorically, the tech companies gesture toward individuality — to the empowerment of the “user” — but their worldview rolls over it. Even the ubiquitous invocation of users is telling: a passive, bureaucratic description of us. The big tech companies (the Europeans have lumped them together as GAFA: Google, Apple, Facebook, Amazon) are shredding the principles that protect individuality. Their devices and sites have collapsed privacy; they disrespect the value of authorship, with their hostility toward intellectual property. In the realm of economics, they justify monopoly by suggesting that competition merely distracts from the important problems like erasing language barriers and building artificial brains. Companies should “transcend the daily brute struggle for survival,” as Facebook investor Peter Thiel has put it.

When it comes to the most central tenet of individualism — free will — the tech companies have a different way. They hope to automate the choices, both large and small, we make as we float through the day. It’s their algorithms that suggest the news we read, the goods we buy, the paths we travel, the friends we invite into our circles. [Blogger Note: As computers can’t write music like humans, algorithms cannot really define tastes. Our sensibilities are excited by serendipity, innovation, and surprise.]

It’s hard not to marvel at these companies and their inventions, which often make life infinitely easier. But we’ve spent too long marveling. The time has arrived to consider the consequences of these monopolies, to reassert our role in determining the human path. Once we cross certain thresholds — once we remake institutions such as media and publishing, once we abandon privacy — there’s no turning back, no restoring our lost individuality.

***

Over the generations, we’ve been through revolutions like this before. Many years ago, we delighted in the wonders of TV dinners and the other newfangled foods that suddenly filled our kitchens: slices of cheese encased in plastic, oozing pizzas that emerged from a crust of ice, bags of crunchy tater tots. In the history of man, these seemed like breakthrough innovations. Time-consuming tasks — shopping for ingredients, tediously preparing a recipe and tackling a trail of pots and pans — were suddenly and miraculously consigned to history.

The revolution in cuisine wasn’t just enthralling. It was transformational. New products embedded themselves deeply in everyday life, so much so that it took decades for us to understand the price we paid for their convenience, efficiency and abundance. Processed foods were feats of engineering, all right — but they were engineered to make us fat. Their delectable taste required massive quantities of sodium and sizable stockpiles of sugar, which happened to reset our palates and made it harder to satehunger. It took vast quantities of meat and corn to fabricate these dishes, and a spike in demand remade American agriculture at a terrible environmental cost. A whole new system of industrial farming emerged, with penny-conscious conglomerates cramming chickens into feces-covered pens and stuffing them full of antibiotics. By the time we came to understand the consequences of our revised patterns of consumption, the damage had been done to our waistlines, longevity, souls and planet.

Something like the midcentury food revolution is now reordering the production and consumption of knowledge. Our intellectual habits are being scrambled by the dominant firms. Giant tech companies have become the most powerful gatekeepers the world has ever known. Google helps us sort the Internet, by providing a sense of hierarchy to information; Facebook uses its algorithms and its intricate understanding of our social circles to filter the news we encounter; Amazon bestrides book publishing with its overwhelming hold on that market.

Such dominance endows these companies with the ability to remake the markets they control. As with the food giants, the big tech companies have given rise to a new science that aims to construct products that pander to their consumers. Unlike the market research and television ratings of the past, the tech companies have a bottomless collection of data, acquired as they track our travels across the Web, storing every shard about our habits in the hope that they may prove useful. They have compiled an intimate portrait of the psyche of each user — a portrait that they hope to exploit to seduce us into a compulsive spree of binge clicking and watching. And it works: On average, each Facebook user spends one-sixteenth of their day on the site.

In the realm of knowledge, monopoly and conformism are inseparable perils. The danger is that these firms will inadvertently use their dominance to squash diversity of opinion and taste. Concentration is followed by homogenization. As news media outlets have come to depend heavily on Facebook and Google for traffic — and therefore revenue — they have rushed to produce articles that will flourish on those platforms. This leads to a duplication of the news like never before, with scores of sites across the Internet piling onto the same daily outrage. It’s why a picture of a mysteriously colored dress generated endless articles, why seemingly every site recaps “Game of Thrones.” Each contribution to the genre adds little, except clicks. Old media had a pack mentality, too, but the Internet promised something much different. And the prevalence of so much data makes the temptation to pander even greater.

This is true of politics. Our era is defined by polarization, warring ideological gangs that yield no ground. Division, however, isn’t the root cause of our unworkable system. There are many causes, but a primary problem is conformism. Facebook has nurtured two hive minds, each residing in an informational ecosystem that yields head-nodding agreement and penalizes dissenting views. This is the phenomenon that the entrepreneur and author Eli Pariser famously termed the “Filter Bubble” — how Facebook mines our data to keep giving us the news and information we crave, creating a feedback loop that pushes us deeper and deeper into our own amen corners.

As the 2016 presidential election so graphically illustrated, a hive mind is an intellectually incapacitated one, with diminishing ability to tell fact from fiction, with an unshakable bias toward party line. The Russians understood this, which is why they invested so successfully in spreading dubious agitprop via Facebook. And it’s why a raft of companies sprouted — Occupy Democrats, the Angry Patriot, Being Liberal — to get rich off the Filter Bubble and to exploit our susceptibility to the lowest-quality news, if you can call it that.

Facebook represents a dangerous deviation in media history. Once upon a time, elites proudly viewed themselves as gatekeepers. They could be sycophantic to power and snobbish, but they also felt duty-bound to elevate the standards of society and readers. Executives of Silicon Valley regard gatekeeping as the stodgy enemy of innovation — they see themselves as more neutral, scientific and responsive to the market than the elites they replaced — a perspective that obscures their own power and responsibilities. So instead of shaping public opinion, they exploit the public’s worst tendencies, its tribalism and paranoia.

***

During this century, we largely have treated Silicon Valley as a force beyond our control. A broad consensus held that lead-footed government could never keep pace with the dynamism of technology. By the time government acted against a tech monopoly, a kid in a garage would have already concocted some innovation to upend the market. Or, as Google’s Eric Schmidt, put it, “Competition is one click away.” A nostrum that suggested that the very structure of the Internet defied our historic concern for monopoly.

As individuals, we have similarly accepted the omnipresence of the big tech companies as a fait accompli. We’ve enjoyed their free products and next-day delivery with only a nagging sense that we may be surrendering something important. Such blitheness can no longer be sustained. Privacy won’t survive the present trajectory of technology — and with the sense of being perpetually watched, humans will behave more cautiously, less subversively. Our ideas about the competitive marketplace are at risk. With a decreasing prospect of toppling the giants, entrepreneurs won’t bother to risk starting new firms, a primary source of jobs and innovation. And the proliferation of falsehoods and conspiracies through social media, the dissipation of our common basis for fact, is creating conditions ripe for authoritarianism. Over time, the long merger of man and machine has worked out pretty well for man. But we’re drifting into a new era, when that merger threatens the individual. We’re drifting toward monopoly, conformism, their machines. Perhaps it’s time we steer our course.