A short while ago a story related to the four year long drought in California was the lead of story on news shows across the country. This story's time at the top of the charts was short lived. In most markets it was a one day wonder. But for that one day it was literally red hot. The key to this story's dominance of the news cycle was, what else, spectacular video. There was no blood but there was something that was almost better, pictures of burning cars and trucks including at least one 18 wheeler. A wildfire had swept across the I-15 interstate highway and set a bunch of vehicles on fire. There were flames shooting out of some vehicles while others had already been reduced to burned out hulks. A movie special effects crew with a big budget couldn't have done a better job.
And this happened in the L.A. TV market. All the local stations there have helicopters equipped with high tech video cameras. This meant that there was plenty of superb video for everyone. And everyone used all the video they could shoehorn into their shows. But by the next day the novelty had worn off and it was time to move on to the next shiny object. If this was the only "water shortage" story out there it would have been one thing. But there have been enough "water shortage" stories out there for long enough that most people are at least vaguely aware that something is going on. So what's up?
As Coleridge opined in "The Rime of the Ancient Mariner": "water, water, everywhere nor any drop to drink". In one sense there is no water shortage. The oceans are full of it. As are several other large bodies of water like the Mediterranean Sea. The problem is that the Med, the oceans, and these other large bodies of water contain salt water. It is not potable (drinkable) water so for many purposes it is useless. The "water shortage" is in reality a shortage of potable water. But a shortage of potable water is not a new problem.
Civilization used to be traced back to the valleys of the Tigris and Euphrates rivers in what is now Iraq. A key to development of this "first" (modern archeology now traces our roots much further back in time and to completely different places) civilization was the development of irrigation. Irrigation makes more potable water available and makes it available in more places and for longer periods of time. Controlling the spring flood of the Nile river performed a similar role in the development of the early Egyptian civilization. Various water management capabilities also played a similar role in allowing societies in ancient China and in its neighbor India to support dense populations for thousands of years. I could continue but let me instead skip to the near present.
One of the key drivers of the spectacular technological advance of the twentieth century has been giant water projects. I live in "the West". Dams, irrigation canals, and other large "water works" are literally everywhere. The Southern California we now know would be impossible without the many projects that bring water from hundreds of miles away to slake the thirst of the people, industry, and agriculture of the region. The region is still growing but it has now been decades since the last large water project was completed in the area. This has caused a lot of people to ask "are we at the end of our ability to find more water"? And by "water" they mean potable water.
If it was just Southern California it would be one thing. They have been getting their hands on water from somewhere else for more than a century now. People are often slow but they do eventually wise up. And the areas that Southern California historically has gone to for water have now also been growing quickly for decades. So they are much less interested in shipping water to Southern California. More importantly, they now have enough power and wealth to be able to resist advances by the "outsiders" from Southern California.
But it's not just Southern California. You now hear "we are running out of water" from pretty much everywhere. So is there a real crisis? Yes. If we keep going as we have then we are in big trouble. But the key phrase is "if we keep going as we have". It turns out that we have options. The problems are primarily not technological. We don't need some new gee whiz gadget or technological breakthrough. Instead the fixes we need are primarily political and psychological. If we can fix the politics and the psychology we have plenty of potable water. So what's the deal?
This is one of those "victims of our own success" things. The technology we deployed in the twentieth century enabled massive growth in our consumption of potable water. That technology primarily made more water available. It also did so very inexpensively. Most of the "new" water cost users very little. But there is no more new super-cheap water out there. We have to look elsewhere for solutions. The fact that the twentieth century produced so much cheap water caused us to get lazy. And by lazy I mean it caused us to get into the habit of using water very inefficiently.
The current poster child for inefficient water use is the Almond. We, or at least I, have recently learned that it takes a gallon of water to produce a single Almond. That seems like a lot and it is. That's why Almond producers have recently gotten a lot of flack. Yet on a per-Almond basis, Almonds in the supermarket are cheap. Amazon sells Blue Diamond Almonds, a premium name brand, for roughly a buck an ounce. I don't know how many Almonds are in an ounce but it is several. So at retail Almonds cost a few cents each.
And this price includes all kinds of non-water costs like the land, labor, Almond trees, packaging, shipping, marketing and distribution costs, etc. So there is at most a penny's worth of water in an Almond. And Almond production is up because it is a profitable product and the farmers seem to be able to find water somewhere. So they grow more Almonds. And they do so in Southern California where they are in the fourth year of a historic drought. Whatever Almond farmers are paying for water, it is not high enough to cause them to switch to a less water intensive crop. And maybe Almond farmers use water very efficiently. But a lot of farmers don't.
The Israelis have been critically short of water for many decades now. There is very little water in Israel. This makes what water there is very valuable. This has caused them to be world leaders in the field of efficient water use in agriculture. Even if it is used efficiently, water in Israel is still expensive. Any additional increase in efficiency can save farmers there a lot of money. So Israeli farmers do what they can to drive their already high level of efficiency even higher because that's what makes sense for them to do.
If water was cheap a farmer would be a fool to invest in expensive technology to increase efficiency. And for many farmers in the U.S. water is cheap so they use cheap inefficient water use practices. And they will keep doing so as long as they have access to cheap plentiful water. The same is true of industry. The "home" market for water in the U.S. constitutes a very small portion of the overall market. Most of it is used in agriculture and industry.
In California, for instance, 80% of all water usage in the state is by agriculture. What that means is that if you cut non-agricultural use by 10% you will only save one fourth as much as if you cut agricultural water use by 10%. When you factor in industrial use residential water use in a state like California is probably less than 10% of total consumption. So it is good PR to go after residential use. It convinces the average voter that the problem is real. But it does little to address the real problem.
I have now been going on about all this cheap water for some time now. What am I talking about? How much does water cost? To an extent that is astonishing the answer is "it depends". Water is a commodity isn't it? Shouldn't the price of water work like other commodities like Oil? It should but it doesn't. Let's start with a look at the pricing of Crude Oil as price information for it is easily found on the Internet. A quick search will turn up a number of different prices, a price for say "WTI" (West Texas Intermediate). or for "Brent" (basically oil from the North Sea). Each price quote will differ from the others. What's going on? Each quote is actually for a different grade of Crude Oil.
Oil varies from "light" (contains a high percentage of "volatiles", components that evaporate easily) to "heavy" (low percentage of volatiles). It can also be "sour" (contains a high amount of Sulfur contaminants) or "sweet" (contains a low amount of Sulfur). Light oil is easier to refine. Sour oil is more expensive to refine because the Sulfur must be removed. This is hard and, therefore, expensive. So the market likes and will pay more for light sweet crude (WTI and Saudi oil). It pays less for oil that is heavier and/or more sour like Brent oil.
In a similar manner there are grades of cotton, wheat, and many other commodities. If you stick to the same grade, however, everybody pays pretty much the same price. This is how commodity pricing works. If I can get the same thing somewhere else cheaper, I will. So prices for the same thing in different markets quickly even out. Now let's take a look at water, specifically potable water. There are gradations of potable water but the differences are small. So price variation is small, right? Let's see.
If I buy house brand bottled water online from Amazon it costs about $8/gallon. There are about 8 gallons in a cubic foot so that figures out to about sixty-odd dollars per cubic foot. But this is a retail price for water. How about wholesale? Usually there is a big markup between retail and wholesale. So the price difference might be something like two to one or four to one. The retail price is twice or four times the wholesale price. That would translate to a $30 (two to one) or $15 (four to one) wholesale price of water.
Because it is convenient I am going use the price of the water I get for my house from the municipal utility run by the city of Seattle as a proxy for the wholesale price of water. Now there is no packaging, advertising, etc. costs. There is the pipe to my house and the meter but all of that has a useful life of decades. So maybe this price is more similar to a farm price. Farm prices are lower than wholesale prices so let's apply another four to one factor to be on the safe side. This admittedly crude analysis would predict a "farm" price for water for my house of around $4 per cubit foot. What do we actually see? Depending on whether it is the summer or not and depending on my usage (they price to discourage high usage) I pay between 5 cents and 12 cents per cubit foot. So the actual retail to "farm" price ratio is roughly 600 to 1 instead of my calculated ratio of 16 to 1. That's quite a difference.
And so far I have only crudely estimated what a farmer pays for water. What do farmers actually pay? It should be about the same as I pay, right? Nope! They actually pay a lot less. But how much less varies wildly from farmer to farmer. Again, why? It's complicated but let me hit the high spots. Most farmers get their water one of three ways. They can draw "surface water" from a river, stream, lake, etc., that is on or adjacent to their land. I am going to call this drawn water. Farmers in the U.S. have been doing this since before the country was founded. In a lot of cases this right to draw water is considered an inherent right that goes with the land. Other than the cost of the pump, etc. this water is often free.
A more modern variation of this idea, dating back at least to the nineteenth century, involves pumping water from under the land they own, what I am going to call "pumped" water. Think of the squeaky windmill that features in lots of western movies. The windmill is connected to a water pump. Again in many cases pumped water is considered a right that comes with the land and is free except for the cost of the pump, etc.
In both of these cases the law is slowly evolving. You may now need a permit draw or pump water. It is still rare but it is becoming more common to "meter" (measure) how much water is drawn and to charge farmers some volume based fee. Before moving on let me add one more wrinkle. In the "western movie" scenario only shallow water, water ten or twenty feet down was accessible. Modern technology allows farmers to go much deeper and access large lakes of underground water called aquifers.
The most famous one is the Ogallala Aquifer. It stretches from Texas to Nebraska in the central U.S. Water in this Aquifer is from two to six million years old. (The water in other aquifers may be of much more recent origin.) The Ogallala was filled from rain and other sources literally millions of years ago. When farmers figured out it was there they started tapping it. Initially they were able to inexpensively tap it because the top of the aquifer was not very far down. But it should come as no surprise that the top of the Ogallala has been dropping as farmers pump it out while nothing is refilling it. There is a lot of water there but the amount is finite and farmers use a lot of water when it is essentially free.
The top has been dropping for decades now. Farmers have had to drill deeper (and more expensive) wells and to install increasingly sophisticated (and expensive) pumping systems. In many areas the top of the Ogallala and other aquifers is now more than 200 feet down. It is easy to lift water 33 feet because that is how high normal atmospheric pressure can lift water. But every additional 33 feet means you need to push with an additional 15 pounds per square inch of pressure to get the water out of the ground. Systems for lifting water hundreds of feet are not only very expensive to install. They are very expensive to operate when compared with their short lift brethren. So pumping the Ogallala and other aquifers is getting more expensive as they are drained down. But it is still very cheap compared to the alternatives.
The third and most recent method was is to get water through some kind of agricultural water district. In this case the water district sells farmers metered water and the farmer is charged a volume based fee. But each district does things their own way for their own purposes. And while the purposes, in general are similar, the specifics are unique to each district. These districts were created to build and operate a dam or other large water project.
Dams have been built all over the western U.S. Many people think the federal government just coughed up all the money and built them. Actually many of them were built and operated by some state or local entity or even by completely private entities. But all of the big projects, regardless of who built and operated them, were financed with bonds. In the federal case the bonds were backed by the federal government (an indirect subsidy) but in all cases revenue to support the bonds came from fees charged farmers and based on the volume of water used. These dams and other big water projects were built starting in the late nineteenth century and continuing through the latter part of the twentieth century.
To make the bond scheme work Wall Street had to be convinced that there was sufficient revenue to cover the interest and principal. Say you wanted to build a ten million dollar dam. Then there needed to be a revenue source that would pay off those bonds (with interest) in say thirty years. The water rates were set to just cover the water district expenses. And the expenses consisted of money to pay off the bonds and to operate and maintain everything. There was literally no reason to set rates any higher and every reason to keep them as low as possible. Farmers would sign up to use water from the reservoir behind the dam to irrigate their crops. As soon as enough farmers signed up and promised to pay enough money for the water, everybody was happy.
Agricultural water is typically measured in acre-feet. An acre-foot is enough water to fill up an acre of land to a depth of one foot. It is a little less than 50,000 cubic feet. It turned out that the cost per acre-foot necessary to generate enough revenue to cover water district costs was not very much. And district costs dropped precipitously the day the bonds were paid off. At that point the per acre-foot rate for water could be and was cut drastically. Where I can find rate information it looks like farmers in water districts pay roughly the same amount of money for an acre-foot of water as I pay for a hundred cubic feet of water. (Rates for drawn or pumped water are even lower.) So the cost ration between a farmer and me is often in the neighborhood of 500 to 1. But it may be much higher as actual rates may be lower, in some cases much lower, than the rate I used in this calculation.
Sticking with 500 to 1 for the moment, this ratio is roughly the same as that between bottled water and tap water. The ratio between the cost of bottled water and farm water is roughly 300,000 to 1. My estimate of maybe a cent for the cost of the water to make an Almond turns out to be way high. The cost of water is not a factor in a farmer's decision as to whether or not to increase Almond production. And that's a problem. But wait. There's more! It turns out that a lot of bottled water is produced in that very same drought stricken Southern California. Why? Because, like Almond farmers, the price of water does not figure into the business calculations of bottled water manufacturers. Finally, remember that a lot of farmers pay even less for water. It just does not make any sense for them to put any time or money into using water more efficiently so they don't.
And that's the fundamental factor driving water use and driving very inefficient water use. The same kind of logic drives industrial water usage. There is no incentive to use it efficiently and every incentive to use it inefficiently. And more than 80% of all potable water goes into agriculture or industry. The obvious fix to this problem is to change the incentive structure by making water more expensive. This would make market forces part of the solution instead of part of the problem. And in many cases large increases in efficiency are available very inexpensively.
So why hasn't this happened? There are literally thousands of water districts. They operate as they do because of contracts. Long ago contracts were created to make sure the bonds got retired on time. That was the objective. But the contracts were written so that the basic system would remain in place in perpetuity. Farmers would still need the water after the dam was paid off. There seemed no reason at the time not to lock a farmer's water rights into place forever. It didn't cost the dam builders or Wall Street anything to put "forever" language in the contract so they did. And now all of us are forced to deal with the forever language written into these old contracts, some created more than a hundred years ago. Times have changed but the contract language hasn't.
Powerful people with lots of money have been litigating contracts against equally powerful people with lots of money for a very long time. The result is that lawyers have long known how to write "iron clad" and "bullet proof" contracts of this type. This knowledge dates back to well before the time the first water district was set up. There will be no successful legal challenge to these contracts based on some flaw or loop hole in the contract. Congress could pass laws to negate these contracts. But it would run up against a lot of lobbying clout. Anyone associated with any of these water districts would weigh in. But legislative action of this type would also be fiercely opposed by anyone interested I the idea that "a contract is a contract". And unfortunately this latter group includes pretty much all of the rich and powerful. So a legislative fix is extremely unlikely.
Another path would be to buy the farmers in question out. But this would be extremely expensive. Farmers would be giving up not only whatever the water is currently worth but also whatever the water might be worth in the future. Any farmer who could not figure this out on their own would be quickly clued in by a friend, neighbor, passing stranger, somebody. And in a water short future world just how much might water come to be worth? That's a guess but speculation would start at "a lot" and go up from there. Asking taxpayers to pony up the cost of a mass water rights purchase program is a hard sell. And the more money farmers see in the kitty the more they are likely to hold out for.
So we are locked in one of those all too common political gridlocks. Market pressure could change behavior if market forces could be applied. And the cost of making the changes necessary to substantially improve efficiency are known and known to be inexpensive in many cases. But there is currently no incentive for the players to change their behavior so they don't. Moving ahead by changing the pricing structure or by buying farmers out over farmer objections is theoretically easy to do. But real world political considerations make it nearly impossible. Do we have any other things we can do?
We do but they will not be nearly as effective as efficiency improvements. And the benefit potential of the alternatives are much more modest. The key idea to keep in mind is that "all water is recycled". Geological and cosmological processes gave us the water we have. Most, perhaps all of the water on earth dates back billions of years. Since then it has cycled and recycled through various hydraulic systems. Heat from the sun evaporates water from the oceans. It eventually comes back to earth as rain. The rain may land high on a mountain. From there it moves through the soil to rivers. Rivers eventually deliver it back to the ocean. This description gives you the general idea but leaves out some key steps that have been involved for at least the last half billion years. And this is where the problem comes in.
The problem can be succinctly described by quoting a common aphorism: don't drink the water - fish fuck in it. But it's not just the fish. Another aphorism asks: do bears shit in the woods? Indeed bears do. These, and many other processes, some "all natural" and others not so much, affect the water situation in the following way. A lot of people believe that yucky things happen to water and they don't want to drink water that has been yucked up. This is good as far as it goes. The problem is that many people believe that there is magical source of non-yucked up water. They believe that rain water or natural spring water or water from some other source is not yucked up. But the truth is that all water has been yucked up over and over and is yucked up now. There is no such thing as the water equivalent of immaculate conception.
All water is yucked up to a greater or lesser extent. It is never completely yuck-free. Rain water can pick up air pollution and lots of other nasty things that happen to be airborne while the rain is falling. Alpine spring water can contain bacteria that will put you in the hospital if you don't take the proper precautions. The wrong question is "where did it come from"? The right question is: "is it safe to use for the purpose I intend to put it to"?
People have a misplaced faith in the ability of certain "natural" processes to produce de-yucked water. This matched by a misplaced distrust in the ability of "artificial " processes to produce de-yucked water. So they want nothing to do with water that comes out of even the best sewerage treatment plant, for instance. But if this yucky water is put into the Mississippi River (there's a reason it's nickname is "the big muddy") and allowed to travel a few miles downstream, all of a sudden it's fine. And it's fine even if pesticide runoff and who knows what else has been added to the river as the water makes its magical journey from upstream sewerage outfall to downstream water system intake.
The yuck factor is a potent political force. If people come to the opinion that certain water is yucky they tend to throw roadblocks in the way of worthy projects. If they come to the opinion that water is not yucky they tend to believe that water should just be left alone. This can get in the way of necessary steps being taken. From here on I am going to focus on the worthy projects.
Potable water gets used for many purposes. If it is being used for drinking water it needs to meet high standards of safety, clarity, etc. But there are many uses for which a lower standard is just fine. Historically it has been hard to put multiple systems in place to handle multiple grades of water. Why spend the extra money if, as used to be the case, high quality water is available cheaply. But times have changed. Now there are real opportunities that make sense both technically and financially to go to multi-grade water systems. Continue to maintain the highest standard and grade for drinking water. But go to grades and standards that are appropriate for what the water will actually be used for.
This multi-grade system offers real opportunities to expand from an "all drinking quality all the time" system to a more flexible one delivering more usable water at a lower cost. The more flexible system (irrigation quality water for the golf course, cleaning quality water for the plant that needs to keep equipment clean, etc.) increases the amount of usable water. There are many situations where cost is not a problem because this is the cheapest alternative. But that still leaves the problem of the many people who look at such a system and go "yuck". That is a difficult but manageable problem. Assuming the "yuck" problem can be fixed going to a multi-grade system is a good idea. It won't be as effective at increasing the effective water supply as fixing our dysfunctional pricing system but it will help.
Finally there are some technological fixes. One of them is desalinization. Salt water from oceans and seas can be turned into potable water. Here too the Israelis have been pioneers. And the technology has improved substantially over the past half century. But it is still very expensive. The underlying scientific principles tell us that the process will always require a lot of energy. That means it will always be expensive. Gulf states have little water and lots of energy. They can also afford to subsidize the process. There are some other situations where it makes sense. But the process will never be cheap so it will always be a niche solution.
So there it is. We don't really have a shortage of water. We have a shortage of potable water. And we can free up a lot of potable water by increasing efficiencies, particularly in agriculture and industry. The way we price water is the primary impediment to progress on this front. Contracts are the principal impediment to using market forces (price increases) to drive improvements. But to stand a chance of making progress here the political environment must change to the point where these contracts can be modified or eliminated. Unfortunately, there seems little chance of this happening any time soon.
The next best approach is to move toward a multi-grade approach to water use. Here the big problem is the "yuck" factor. Some progress is being made in some areas and more progress is possible. There is probably a multiplier factor here. If the "yuck" factor can be overcome in some places then those successes can probably be leveraged to achieve progress in other places. As more and more people get comfortable with the idea opposition will fade. But this approach does not have anywhere near the potential of the efficiency approach.
Finally there are technological assists like desalinization. But these kinds of things have only limited applicability so their contribution will be modest and will be restricted to a few special situations.
We really don't have any long term choice but to increase efficiency. It has tremendous potential but frankly I do not know how to solve the political problems that make it presently infeasible.
Thursday, July 30, 2015
Wednesday, July 15, 2015
The Donald
This blog has been organized around the idea that I have a contribution to make to public discourse. I try to find topics where what I have to say is different and hopefully more informative than what you can find elsewhere. But this post is an indulgence. I am doing it because I want to. At best it will contain a few gems but I would characterize them as semi-precious at best. This is substantially below the standard I try to hold myself to when I am writing a post But I just can't stop myself. I have to remark on the fact that Donald J. Trump has entered the race on the Republican side for the nomination to become the next President of the United States.
Various pieces of legislation have been facetiously characterized at "the Accountant full employment act" or "the Lawyer full employment act". The Donald's entry into the race can be and has been characterized as "the Comedian full employment act". As just one example, David Letterman, who only recently retired from his CBS "The Late Show" gig, popped up on stage a few days ago. He said that The Donald's announcement had convinced him that his decision to retire was a mistake. He then read off a The Donald oriented "Top Ten List". One of the things I am really bad at is comedy so that's all I am going to have to say in a comedic vein.
I welcome The Donald's announcement. It represents the culmination of a trend that is more than 50 years in the making. It dates back to at least the 1960 election. That year John F. Kennedy and Richard M. Nixon squared off in the first presidential debate to be carried live on television. On paper Nixon was the much better qualified of the two. He had served in the House of Representative before moving on to the Senate. From there he moved on to become Vice President for two terms. Along the way he acquired considerable expertise on both foreign and domestic issues. Kennedy, on the other hand, had spent only a short time in the Senate and had no obvious in depth expertise on either foreign or domestic issues. So if the contest was a "battle of the resumes" Nixon should have won in a walk.
But it was not a battle of the resumes. And conventional wisdom is that in a very close race the deciding factor was Kennedy's performance in the debates and, more specifically, on TV. The debates were covered simultaneously on both TV and radio. The consensus among the radio audience was that Nixon won in a relatively close contest. However, the TV audience rated Kennedy a clear winner.
We saw pretty much of a rerun in 1992 with George H. W. Bush, a man with a long and distinguished resume that was capped by a term as President. He was challenged by a small state Governor named William Jefferson Clinton with no obvious national credentials. Again, a battle of the resumes would have put Bush well ahead. But Clinton impressed the TV audience (by this time no one paid attention to radio any more) and went on to unseat him.
We saw the same sort of thing in 2000 when a Governor with a weak resume (George W. Bush) squared off against a man with a resume almost as impressive as that of Nixon or George H. W. Bush (Al Gore). To a lesser extent we saw the same thing in 2008. Obama had an extremely thin resume. And while McCain's resume was not as impressive as others I have mentioned it was definitely more impressive than Obama's. We definitely do NOT pick our Presidents based on who has the best resume. So how do we pick the winner?
Back in the day the story was "by some kind of deal between the power brokers in a smoke filled room". The Primary system was put in place to do away with that system. We would have a separate mini-election for each party in each state using the Primary system. A small vestige of the "smoke filled room" system is present in the Caucus system. The party faithful meet but no longer in secret in a smoke filled room. Instead a long series of meetings are held in public where everyone can watch and many can participate. After a winnowing process a public state convention selects delegates pledged to specific candidates that go on to the national convention. At the national convention the first candidate to 50% plus 1 gets the party nomination. This complicated process requires a large expert staff, it is said, that knows all the ins and outs of each step so that at each stage the candidate's interests can be protected.
So ok, this is a complex system but at heart it is just a bunch of elections. How does a candidate win these elections? It turns out this has been complex too. You need money to hire all that expert staff. But you also need more money and more staff to identify supporters and people who can be convinced to become your supporters. Then you need more money and more staff to engage in an elaborate advertising campaign. You design, print, and mail targeted messages. You design produce and air TV commercials. In the old days you also needed newspaper and radio ads but they have become far less important. Finally, there is GOTV (Get Out The Vote). You need more money and more staff to get your supporters to the caucus or primary and make sure they support your candidate. But what about volunteers? If you are lucky, you have a large and energetic volunteer organization. Aren't they free? Volunteers are free but you need more money and more staff to organize and direct them. That's how it is supposed to work.
What is interesting is that so far The Donald has done none of this. He personally has a lot of money. But I expect that it will turn out that he is spending very little of it. And he is not raising money. "I'm rich. I don't need to fund raise.", he says. And there is no evidence so far of any kind of serious fund raising effort by his campaign. So what about the rest of it? Does he have an organization, consultants, a "ground game" operation, ads up on TV, and so on? Nope! None of it. So he is doomed to failure, right? Again, nope! He is doing fine, actually better than fine. He went from being down at one or two percent in the polls and well back in the field to about 15% in the polls and in second or first place. So what's happening?
I talked above about this candidate or that candidate having a great resume. It turns out that The Donald has a terrible resume as measured by the standards of yesteryear (experience, expertise, etc.). Instead what he has is a great resume as measured by modern standards. He is a whiz at marketing and particularly at marketing himself and most particularly at marketing himself on TV. He is not doing all the things candidates did (and most candidates still do) to get themselves the nomination (and presumably eventually win the general election). He is instead "the very model of a modern major candidate", to paraphrase Gilbert and Sullivan.
We have been going down this path for a long time. I quoted example after example above where the most qualified candidate lost out. In every case the winner beat out his more qualified (at least on paper) opponent by coming over better on TV. People just liked (or at least trusted) the winner more than they liked the other guy. Over time this had a profound influence on how the political media acted. In the olden days you had a cadre of political reporters who prided themselves on their expertise. It might have been policy expertise ("so and so has a good/bad foreign policy because of . . .") or electioneering expertise ("so and so is winning/losing the farm/blue collar/etc. vote because of . . ."). This has been totally replaced by "horse race" coverage ("so and so is up/down in the polls"). And the "because of" part has been dropped as being boring.
The fact that "because of" is no longer part of the coverage has had a perverse effect. Politicians can say whatever they want. The question is not whether it is true or not but whether it moves the polls in the right direction or not. The modern definition of "truth" in a political context is "if it moves the polls in the right direction it is true; if it moves them in the wrong direction it is false".
Now let me state the obvious. Politicians have always lied. The '50s featured a lot of talk about a non-existent "bomber gap". This was replaced in the '60s by talk of an equally non-existent "missile gap". I pick these examples because one (bomber gap) was successfully used by Republicans against Democrats while the other (missile gap) was successfully used by Democrats against Republicans. Politicians on both sides of the aisle could only occasionally get away with an outright lie. They could get away with lying about these particular issues because in both cases the evidence that would have exposed the lie was highly classified. In other words, the truth would not, and in this case did not, come out until well after the election. But situations like this used to be fairly rare.
And that's how the game used to be played. Mostly politicians would exaggerate or cherry pick the evidence. Only occasionally would they flat out lie. They only lied if they were confident they could get away with it. And these safe situations were a fairly rare occurrence. Mostly they felt that if they strayed too far or too consistently from the truth they would eventually be caught out and pay the price by losing the next election. That started to change when it became more and more obvious that the press had completely abandoned any interest in content. In that environment you could tell almost any lie you wanted to and be pretty sure you would be able to get away with it.
The mission of the political press had changed from knowing what was going on and reporting it to the much narrower mission of knowing who was up and who was down and what the trend was. Now their responsibility to the truth started and ended with verifying that the quotation was accurate and that the poll numbers were correct. So who was now responsible for pointing out any lies or exaggerations? The other side. But the other side was just another bunch of politicians. They were susceptible to the "don't believe them because they are just trying to score political points" tactic. All disagreements quickly devolved into "he said - she said" because there was no longer a credible referee around.
We have seen an increasing number of instances of politicians taking advantage of their newfound freedom from accountability. Wildly untrue charges are now a dime a dozen. Still most politicians have felt the need for at least some restraint. But the Donald is not a politician. He is a "reality" star on TV who is famous mostly for being famous. In short he is a celebrity. He has had a couple of decades to hone his craft. He has exited (at least temporarily) his old reality TV gig in order to move on to his new gig, being a Presidential Candidate. He made the switch when he was at the top of his game. And he is applying the very same rules that worked so well for him for so long to his new gig. So far that has turned out to be a very smart move. The cardinal rule of being a celebrity is "always be entertaining". Truth doesn't enter into the equation.
And a recent change to the traditional rules of the political game has played straight into The Donald's hand. You used to have to run a long complicated gauntlet to get your party's nomination. You still do. The first gauntlet you needed to surmount used to be as to make a big splash in the "early" states. It still is. Iowa and New Hampshire have adroitly maneuvered to position themselves as "critical early states". First comes the Iowa Caucus. Next comes the New Hampshire Primary. If you don't have enough success in at least one of those two events you are dead. (After these two events it is a free for all with South Carolina maneuvering vigorously to maintain its "first of the rest" position.)
Iowa and New Hampshire have convinced everyone that any candidate that does not spend a lot of time in state doing small one-on-one "retail" events is doomed to failure. They have turned the associated circus into a nice tidy little industry in each state. And, of course, voters in each state love the extra attention. It doesn't matter if it is true that you must do well in one or both states to have a chance. It only matters that candidates and their staff believe it. And historically everyone has believed it. It is an article of faith that a successful candidate absolutely must shake hands and kiss babies for months in Iowa, New Hampshire, or both. So serious candidates "do what you gotta do". Any candidate that doesn't is branded as "not serious".
It is only possible to do this kind of retail politics in a few small states. For the rest of us it's seeing the candidates on TV. And one of the most popular TV shows for this has been the candidate "debates". (The events rarely feature any actual serious debate.) Heretofore this didn't change the overall trajectory because you still had to win in Iowa and/or New Hampshire. A bad debate performance could hurt and a good debate performance could help but sufficient "shoe leather" effort in the early states was critical. In fact, a good or bad showing in one or both states could balance out a bad or good debate performance. The Donald has now called this received wisdom into question and he has gotten a big assist in doing this from Fox TV and the GOP.
The Iowa Caucus is the traditional kick-off event for the official election process. It typically takes place in February of the election year. That means February, 2016 this time around. But there will be several debates before then. The first one is set for August 6, 2015. It will be televised on Fox TV and Fox has decided to restrict the number of candidates that will make it on stage to 10. But there are at least 15 "serious" candidates on the GOP side. If you are not on stage you may be out before Iowa.
How is Fox deciding who to put on stage? By averaging "national polls". All of a sudden spending a lot of time in Iowa or New Hampshire is a bad idea. Instead you want to raise your profile with the general public so that they will select you an a poll. You need to spend your time in New York City or Los Angeles because that's where the national media is. You need to be all over the interview shows. And not just the Sunday politics shows. Now you need to be on The Today Show or The View or even the even the late night shows like Kimmel or Fallon. And the more appearances on the more shows the better.
These shows reach millions of viewers at a time giving them real impact. In a typical retail stop in an early state you may get in front of a dozen or so people. That's not going to move a national poll . Any viewer in any part of the country might be polled. And what's the secret of getting on these shows? Be good for ratings. Now who has spent literally decades mastering the skills necessary to have a high national profile? The Donald. And it shows. He has been all over the TV machine. Why? Because he knows how to get shows a ratings bump that is tied directly to his appearance. At this point he has more invitations than he has time to accept.
We have already seen The Donald's strategy work to perfection. Before he made his tightly choreographed announcement in the major media market of New York City he was sitting at one or two percent in the polls. He wouldn't have made the cut. I think part of this was that frankly no one thought he would actually run. The announcement made his candidacy real. And what did he do next? It was not spending time in Iowa or New Hampshire. They are small media markets.
Instead he made and continues to make the rounds of all the national media. And he made sure to make outrageous statements at every opportunity. That's what a reality star does. Would anyone watch "real housewives of wherever" if those ladies didn't regularly do outrageous things? No! Does anyone care whether what they say is true? Of course not! Any fool knows that's not how reality TV works and The Donald is not a fool. He just plays one on TV.
There used to be something called "free media". This was news coverage by the major TV networks. It is now called "earned media". How do you earn coverage on earned media? By being outrageous. The Donald has gotten more earned media that all his competitors combined. He deserves the coverage. He has worked hard for it and performed at the top of his game.
Any producer of a reality TV show knows that you must understand your audience. You have to provide outrage they want to watch. They have to be entertained without actually being outraged. (Fake outrage is just part of the fun.) The Donald has done his homework here too. His outrageous statements have been carefully crafted to be exactly what his target audience wants to hear. The proof that The Donald has done his homework is in his jump in ratings, ah, er, polls. And his polls are through the roof. So far The Donald has not put a single foot wrong.
I am not a fan of dishonesty in politics. I would be a hypocrite it I did not acknowledge that Democrats frequently engage in dishonesty. But I think that Republicans have raised the bar on dishonesty to a new level, one far higher than Democrats have even aspired to. What The Donald has done is to blast past the previous exalted mark set by Republicans and put the bar into orbit.
As a result of his superior work I want to finish up this post by enthusiastically endorsing The Donald. I am one million percent behind Donald J. Trump in his quest for the Republican nomination for the job of President of the United States. He is a shining beacon illuminating the core values of the modern Republican party. What more can we ask from a candidate?
Various pieces of legislation have been facetiously characterized at "the Accountant full employment act" or "the Lawyer full employment act". The Donald's entry into the race can be and has been characterized as "the Comedian full employment act". As just one example, David Letterman, who only recently retired from his CBS "The Late Show" gig, popped up on stage a few days ago. He said that The Donald's announcement had convinced him that his decision to retire was a mistake. He then read off a The Donald oriented "Top Ten List". One of the things I am really bad at is comedy so that's all I am going to have to say in a comedic vein.
I welcome The Donald's announcement. It represents the culmination of a trend that is more than 50 years in the making. It dates back to at least the 1960 election. That year John F. Kennedy and Richard M. Nixon squared off in the first presidential debate to be carried live on television. On paper Nixon was the much better qualified of the two. He had served in the House of Representative before moving on to the Senate. From there he moved on to become Vice President for two terms. Along the way he acquired considerable expertise on both foreign and domestic issues. Kennedy, on the other hand, had spent only a short time in the Senate and had no obvious in depth expertise on either foreign or domestic issues. So if the contest was a "battle of the resumes" Nixon should have won in a walk.
But it was not a battle of the resumes. And conventional wisdom is that in a very close race the deciding factor was Kennedy's performance in the debates and, more specifically, on TV. The debates were covered simultaneously on both TV and radio. The consensus among the radio audience was that Nixon won in a relatively close contest. However, the TV audience rated Kennedy a clear winner.
We saw pretty much of a rerun in 1992 with George H. W. Bush, a man with a long and distinguished resume that was capped by a term as President. He was challenged by a small state Governor named William Jefferson Clinton with no obvious national credentials. Again, a battle of the resumes would have put Bush well ahead. But Clinton impressed the TV audience (by this time no one paid attention to radio any more) and went on to unseat him.
We saw the same sort of thing in 2000 when a Governor with a weak resume (George W. Bush) squared off against a man with a resume almost as impressive as that of Nixon or George H. W. Bush (Al Gore). To a lesser extent we saw the same thing in 2008. Obama had an extremely thin resume. And while McCain's resume was not as impressive as others I have mentioned it was definitely more impressive than Obama's. We definitely do NOT pick our Presidents based on who has the best resume. So how do we pick the winner?
Back in the day the story was "by some kind of deal between the power brokers in a smoke filled room". The Primary system was put in place to do away with that system. We would have a separate mini-election for each party in each state using the Primary system. A small vestige of the "smoke filled room" system is present in the Caucus system. The party faithful meet but no longer in secret in a smoke filled room. Instead a long series of meetings are held in public where everyone can watch and many can participate. After a winnowing process a public state convention selects delegates pledged to specific candidates that go on to the national convention. At the national convention the first candidate to 50% plus 1 gets the party nomination. This complicated process requires a large expert staff, it is said, that knows all the ins and outs of each step so that at each stage the candidate's interests can be protected.
So ok, this is a complex system but at heart it is just a bunch of elections. How does a candidate win these elections? It turns out this has been complex too. You need money to hire all that expert staff. But you also need more money and more staff to identify supporters and people who can be convinced to become your supporters. Then you need more money and more staff to engage in an elaborate advertising campaign. You design, print, and mail targeted messages. You design produce and air TV commercials. In the old days you also needed newspaper and radio ads but they have become far less important. Finally, there is GOTV (Get Out The Vote). You need more money and more staff to get your supporters to the caucus or primary and make sure they support your candidate. But what about volunteers? If you are lucky, you have a large and energetic volunteer organization. Aren't they free? Volunteers are free but you need more money and more staff to organize and direct them. That's how it is supposed to work.
What is interesting is that so far The Donald has done none of this. He personally has a lot of money. But I expect that it will turn out that he is spending very little of it. And he is not raising money. "I'm rich. I don't need to fund raise.", he says. And there is no evidence so far of any kind of serious fund raising effort by his campaign. So what about the rest of it? Does he have an organization, consultants, a "ground game" operation, ads up on TV, and so on? Nope! None of it. So he is doomed to failure, right? Again, nope! He is doing fine, actually better than fine. He went from being down at one or two percent in the polls and well back in the field to about 15% in the polls and in second or first place. So what's happening?
I talked above about this candidate or that candidate having a great resume. It turns out that The Donald has a terrible resume as measured by the standards of yesteryear (experience, expertise, etc.). Instead what he has is a great resume as measured by modern standards. He is a whiz at marketing and particularly at marketing himself and most particularly at marketing himself on TV. He is not doing all the things candidates did (and most candidates still do) to get themselves the nomination (and presumably eventually win the general election). He is instead "the very model of a modern major candidate", to paraphrase Gilbert and Sullivan.
We have been going down this path for a long time. I quoted example after example above where the most qualified candidate lost out. In every case the winner beat out his more qualified (at least on paper) opponent by coming over better on TV. People just liked (or at least trusted) the winner more than they liked the other guy. Over time this had a profound influence on how the political media acted. In the olden days you had a cadre of political reporters who prided themselves on their expertise. It might have been policy expertise ("so and so has a good/bad foreign policy because of . . .") or electioneering expertise ("so and so is winning/losing the farm/blue collar/etc. vote because of . . ."). This has been totally replaced by "horse race" coverage ("so and so is up/down in the polls"). And the "because of" part has been dropped as being boring.
The fact that "because of" is no longer part of the coverage has had a perverse effect. Politicians can say whatever they want. The question is not whether it is true or not but whether it moves the polls in the right direction or not. The modern definition of "truth" in a political context is "if it moves the polls in the right direction it is true; if it moves them in the wrong direction it is false".
Now let me state the obvious. Politicians have always lied. The '50s featured a lot of talk about a non-existent "bomber gap". This was replaced in the '60s by talk of an equally non-existent "missile gap". I pick these examples because one (bomber gap) was successfully used by Republicans against Democrats while the other (missile gap) was successfully used by Democrats against Republicans. Politicians on both sides of the aisle could only occasionally get away with an outright lie. They could get away with lying about these particular issues because in both cases the evidence that would have exposed the lie was highly classified. In other words, the truth would not, and in this case did not, come out until well after the election. But situations like this used to be fairly rare.
And that's how the game used to be played. Mostly politicians would exaggerate or cherry pick the evidence. Only occasionally would they flat out lie. They only lied if they were confident they could get away with it. And these safe situations were a fairly rare occurrence. Mostly they felt that if they strayed too far or too consistently from the truth they would eventually be caught out and pay the price by losing the next election. That started to change when it became more and more obvious that the press had completely abandoned any interest in content. In that environment you could tell almost any lie you wanted to and be pretty sure you would be able to get away with it.
The mission of the political press had changed from knowing what was going on and reporting it to the much narrower mission of knowing who was up and who was down and what the trend was. Now their responsibility to the truth started and ended with verifying that the quotation was accurate and that the poll numbers were correct. So who was now responsible for pointing out any lies or exaggerations? The other side. But the other side was just another bunch of politicians. They were susceptible to the "don't believe them because they are just trying to score political points" tactic. All disagreements quickly devolved into "he said - she said" because there was no longer a credible referee around.
We have seen an increasing number of instances of politicians taking advantage of their newfound freedom from accountability. Wildly untrue charges are now a dime a dozen. Still most politicians have felt the need for at least some restraint. But the Donald is not a politician. He is a "reality" star on TV who is famous mostly for being famous. In short he is a celebrity. He has had a couple of decades to hone his craft. He has exited (at least temporarily) his old reality TV gig in order to move on to his new gig, being a Presidential Candidate. He made the switch when he was at the top of his game. And he is applying the very same rules that worked so well for him for so long to his new gig. So far that has turned out to be a very smart move. The cardinal rule of being a celebrity is "always be entertaining". Truth doesn't enter into the equation.
And a recent change to the traditional rules of the political game has played straight into The Donald's hand. You used to have to run a long complicated gauntlet to get your party's nomination. You still do. The first gauntlet you needed to surmount used to be as to make a big splash in the "early" states. It still is. Iowa and New Hampshire have adroitly maneuvered to position themselves as "critical early states". First comes the Iowa Caucus. Next comes the New Hampshire Primary. If you don't have enough success in at least one of those two events you are dead. (After these two events it is a free for all with South Carolina maneuvering vigorously to maintain its "first of the rest" position.)
Iowa and New Hampshire have convinced everyone that any candidate that does not spend a lot of time in state doing small one-on-one "retail" events is doomed to failure. They have turned the associated circus into a nice tidy little industry in each state. And, of course, voters in each state love the extra attention. It doesn't matter if it is true that you must do well in one or both states to have a chance. It only matters that candidates and their staff believe it. And historically everyone has believed it. It is an article of faith that a successful candidate absolutely must shake hands and kiss babies for months in Iowa, New Hampshire, or both. So serious candidates "do what you gotta do". Any candidate that doesn't is branded as "not serious".
It is only possible to do this kind of retail politics in a few small states. For the rest of us it's seeing the candidates on TV. And one of the most popular TV shows for this has been the candidate "debates". (The events rarely feature any actual serious debate.) Heretofore this didn't change the overall trajectory because you still had to win in Iowa and/or New Hampshire. A bad debate performance could hurt and a good debate performance could help but sufficient "shoe leather" effort in the early states was critical. In fact, a good or bad showing in one or both states could balance out a bad or good debate performance. The Donald has now called this received wisdom into question and he has gotten a big assist in doing this from Fox TV and the GOP.
The Iowa Caucus is the traditional kick-off event for the official election process. It typically takes place in February of the election year. That means February, 2016 this time around. But there will be several debates before then. The first one is set for August 6, 2015. It will be televised on Fox TV and Fox has decided to restrict the number of candidates that will make it on stage to 10. But there are at least 15 "serious" candidates on the GOP side. If you are not on stage you may be out before Iowa.
How is Fox deciding who to put on stage? By averaging "national polls". All of a sudden spending a lot of time in Iowa or New Hampshire is a bad idea. Instead you want to raise your profile with the general public so that they will select you an a poll. You need to spend your time in New York City or Los Angeles because that's where the national media is. You need to be all over the interview shows. And not just the Sunday politics shows. Now you need to be on The Today Show or The View or even the even the late night shows like Kimmel or Fallon. And the more appearances on the more shows the better.
These shows reach millions of viewers at a time giving them real impact. In a typical retail stop in an early state you may get in front of a dozen or so people. That's not going to move a national poll . Any viewer in any part of the country might be polled. And what's the secret of getting on these shows? Be good for ratings. Now who has spent literally decades mastering the skills necessary to have a high national profile? The Donald. And it shows. He has been all over the TV machine. Why? Because he knows how to get shows a ratings bump that is tied directly to his appearance. At this point he has more invitations than he has time to accept.
We have already seen The Donald's strategy work to perfection. Before he made his tightly choreographed announcement in the major media market of New York City he was sitting at one or two percent in the polls. He wouldn't have made the cut. I think part of this was that frankly no one thought he would actually run. The announcement made his candidacy real. And what did he do next? It was not spending time in Iowa or New Hampshire. They are small media markets.
Instead he made and continues to make the rounds of all the national media. And he made sure to make outrageous statements at every opportunity. That's what a reality star does. Would anyone watch "real housewives of wherever" if those ladies didn't regularly do outrageous things? No! Does anyone care whether what they say is true? Of course not! Any fool knows that's not how reality TV works and The Donald is not a fool. He just plays one on TV.
There used to be something called "free media". This was news coverage by the major TV networks. It is now called "earned media". How do you earn coverage on earned media? By being outrageous. The Donald has gotten more earned media that all his competitors combined. He deserves the coverage. He has worked hard for it and performed at the top of his game.
Any producer of a reality TV show knows that you must understand your audience. You have to provide outrage they want to watch. They have to be entertained without actually being outraged. (Fake outrage is just part of the fun.) The Donald has done his homework here too. His outrageous statements have been carefully crafted to be exactly what his target audience wants to hear. The proof that The Donald has done his homework is in his jump in ratings, ah, er, polls. And his polls are through the roof. So far The Donald has not put a single foot wrong.
I am not a fan of dishonesty in politics. I would be a hypocrite it I did not acknowledge that Democrats frequently engage in dishonesty. But I think that Republicans have raised the bar on dishonesty to a new level, one far higher than Democrats have even aspired to. What The Donald has done is to blast past the previous exalted mark set by Republicans and put the bar into orbit.
As a result of his superior work I want to finish up this post by enthusiastically endorsing The Donald. I am one million percent behind Donald J. Trump in his quest for the Republican nomination for the job of President of the United States. He is a shining beacon illuminating the core values of the modern Republican party. What more can we ask from a candidate?
Friday, June 26, 2015
Science and Race
Any regular reader of this blog will have figured out by now that I am a big fan of science. But "race" is a subject that I think Science gets wrong. And when I say "science gets it wrong" I am not talking about the actual scientific study of the subject or of the results derived therefrom. Instead, I am talking about how scientists talk about "race" when they are engaging with the public. The Twiter version of their message is "there is no such thing as race". I get where they are coming from and why they say it but I think they do themselves, the general business of science, and the specific subject a disservice. So why do they do it?
First, let me talk about what their scientific justifications for their position. They usually make a couple of points. They note that, genetically speaking (and genetics is what underpins the whole discussion) we are 98% the same as Chimpanzees. That's true but it is also irrelevant. Then they say that the variation from individual to individual is so great that it swamps "so called" racial differences. That's also true and also irrelevant. So while they are saying what they are saying what are they not saying and why are they not saying it?
Let's go right at it. Does something called "race" exist in any kind of scientific sense? The answer is yes. There's a company called 23andMe. Send them some money, about a hundred bucks. They will send you a kit. You use the kit to swab the inside of your cheek. You send the swab back to them and wait a few weeks. Back will come ancestry information. That's code for "race". 23andMe's results are repeatable. And there are other companies that offer a similar service for a similar price. If you go through the same routine with them you will get roughly the same answer as the 23andMe one. What's going on is exactly what the general public has in mind when they think "race" in a science context. And what's going on with 23andMe is broadly known to the public. So when some spokesman says "there is no such thing as race" people throw their hands up and say "are you nuts?" That's not good for scientific credibility.
From a scientific point of view what we have here is a "the signal and the noise" problem. It is similar to the problem of trying to pick out a single conversation at a noisy cocktail party. Most of what you hear is not the conversation you are interested in. You have to filter out the large amount of background "noise" before you can pick out the conversation "signal". All this "same genes as chimpanzees" and "random variation from person to person" stuff is the noise. But science is very good at extracting a small signal from a large amount of noise. It's a problem scientists deal with on a daily basis. So, from a scientific perspective, the question is "can science pick the 'race' signal out of the 'genetic variation' noise"? The obvious answer is yes. 23andMe and those other companies do it profitably thousands of times per day. So can scientists. How?
Before modern times almost no one traveled more than 25 miles from their birth place during their entire life. People intermarried and had children with people who lived close to where they did. Mutations happen. The population of any one small area is small. This allows mutations to build up and spread around in this small population over time. If you could identify the mutations unique to a small community then you could identify descendants of that community by searching for those mutations. The same is true over larger areas if more time is allowed to pass. The larger the area the more time will generally be necessary for unique mutations to arise and spread around. Science (and companies like 23andMe) have had the ability to pick a single mutation out a person's genetic material for some time now.
The 23andMe people have built up a large database of these geographically specific mutations. They grind all this information down with a lot of computer power. There are about 3 billion "base pairs" and about 20,000 genes in the genetic material of one person. So it takes a lot of computer grinding but computers are now cheap. They concentrate on the unique mutation "signal" and put everything else in the "noise" bucket. What pops out is a geographical profile of where and to what extent your genetic information comes from. This is tech talk for your racial profile. Scientists know this. They developed all the technology that 23andMe uses. So why do they pretend that they don't?
The problem is more cultural than anything else. Why do people want to know a person's race and what do they want to do with it? In short, they want to be able to jump to unwarranted conclusions. That's bad. But what is worse is that they want to use those unwarranted conclusions to advance economic, social, and political goals. The "black" experience in the U.S. is typical of how this works in the real world. Let's start with the desired outcome and work backward.
The desired outcome is cheap labor to perform difficult, dangerous, unpleasant tasks. Working in cotton fields in the heat of summer definitely falls into this category. You can always find someone to do a job if you are willing to pay enough. But cotton is a commodity. You need low production costs to be able to sell it inexpensively at a profit. Labor is a large component of production costs so cheap labor is critical. What is cheaper than a slave? They are subjected to poor working and living conditions and are paid literally nothing. The whole system is architected to make their labor as cheap as possible. The slaves know this so they desperately want to escape their situation.
Now if we enslave people who look like us they can escape easily, disguise their identity, and get away with impersonating a free person. (Making a cotton field escape proof would be expensive and the whole point of slavery is to keep things cheap.) With the technology available 200 years ago this made a really effective slave system hard to pull off. But what if instead of focusing on individuals you selected an easily identifiable population group and designated all of them as slaves? That's what was done with dark skinned people of African descent who were imported into a society run by "whites", people with light skin. Generally speaking, the rule was "white - free; black - slave). This was a simple to enforce rule.
There was such a thing as freed black people but it was common for them to be re-enslaved by unscrupulous people. The obvious physical difference that skin color represented made the system easy and cheap to implement and maintain. But how do you justify enslaving people based on their skin color? It turns out that in some situations a light skin color is advantageous and a dark one disadvantageous. But in other situations the reverse is true. So the fundamental differentiator, skin color, is not enough by itself. What do you do? You jump to unwarranted conclusions, the next step in the chain.
If the population you wish to enslave is of low intelligence, is "lazy and shiftless", is violent and inherently immoral then it is far easier to make the case that "those people deserve to be enslaved". And the people you need to convince are obviously not part of the group you want to enslave. So that's what was done. But from the current scientific perspective the conclusions are completely unwarranted.
Modern science is still mystified by the genetic basis of intelligence. It is obvious that there is a genetic component to intelligence but science has yet to find it. Characteristics like laziness are even more problematic. Here there is not even any kind of consensus on how to identify the congenitally lazy or even if such a thing exists. We are all lazy sometimes and energetic other times. I know that if I was enslaved I would quickly become as lazy as I could get away with. It would not be driven by genetics. It would simply be the sensible thing to do. And so it goes for other "moral shortcomings" attributed to the enslaved by the enslavers.
So why is science so reluctant to speak out? Well, there is an additional problem. Science's hands are not clean on the subject. Roughly a hundred years ago there was a "scientific" movement called eugenics. This was considered good science at the time. Proponents published learned papers in all the best scientific journals "proving" that black people were of low intelligence, had bad moral character, etc. "There is scientific justification for according black people an inferior position in society", the argument went. All of the research has since been discredited. Scientists try to learn from the mistakes of the past so they are now bending over backward to avoid repeating the "eugenics" mistake.
What's really going on is that a lot of scientists just want to steer clear of the whole area in any kind of public situation. The science is in an unsettled state, can't tell us much with authority, and in the recent past science screwed up in this area. So for all those reasons avoiding the subject as best as is possible seems at first to be a good idea. But I don't think it is. People take in the Twitter summary of the whole thing and decide since science is obviously wrong about this they are justified in believing it is wrong on other issues (evolution, global warming), I believe science needs to go where the facts lead. So where do they lead?
It is important to emphasize that scientific understanding of this area is evolving rapidly. A little over a decade ago the first complete genome of a human was decoded. We now have complete genomes for thousands of people and doing a full genetic sequence is getting cheaper at an astonishing pace. At the time of this first genetic sequence more than 90% of the sequenced DNA was characterized as "junk", DNA that apparently served no purpose at all. We now know that a lot of that "junk" actually serves useful and even critical purposes. But we are just at the beginning of figuring out what those purposes are.
For a time people thought that a "gay" gene would be discovered. There does not seem to be a single "gay" gene. And scientists thought that many "genetic" diseases would be nailed down to a single "bad" gene. That idea has also pretty much evaporated. And so it goes. The idea that if we can read the genetic sequence out we will know all now looks badly mistaken. Everything is much more complicated than we used to think and everything is intertwined with everything else in complex and poorly understood ways. Just as a single example, we now know there is a whole complex mechanism for turning genes on and off. This means that the mere presence of a certain version of a certain gene is not the end of the story. Presently we know the mechanism exist but we know very little beyond that. Science is at just the beginning of understanding area after area after area of what used to be lumped together as genetics.
Fundamentally, what science can tell us about race does not deliver the result people who think race should be important desire. It most specifically does not deliver a reason to enslave a "race" or even relegate them to a lower social position. The current scientific "state of the art" on race mostly consists of being able to determine where our ancestors lived. And even this information often shatters people's preconceived notions of their ancestry. It is common to find out that we don't have relatives where we thought we did and that we do have relatives where we thought we didn't. The descendants of Thomas Jefferson have had to wrestle with the fact that Jefferson fathered children with Sally Hemmings, a slave, for instance.
Still I think it is counterproductive for scientists speaking to the general public to say things like "there is no such thing as race". The statement "race isn't what you think it is" is of roughly the same length and is far more accurate.
First, let me talk about what their scientific justifications for their position. They usually make a couple of points. They note that, genetically speaking (and genetics is what underpins the whole discussion) we are 98% the same as Chimpanzees. That's true but it is also irrelevant. Then they say that the variation from individual to individual is so great that it swamps "so called" racial differences. That's also true and also irrelevant. So while they are saying what they are saying what are they not saying and why are they not saying it?
Let's go right at it. Does something called "race" exist in any kind of scientific sense? The answer is yes. There's a company called 23andMe. Send them some money, about a hundred bucks. They will send you a kit. You use the kit to swab the inside of your cheek. You send the swab back to them and wait a few weeks. Back will come ancestry information. That's code for "race". 23andMe's results are repeatable. And there are other companies that offer a similar service for a similar price. If you go through the same routine with them you will get roughly the same answer as the 23andMe one. What's going on is exactly what the general public has in mind when they think "race" in a science context. And what's going on with 23andMe is broadly known to the public. So when some spokesman says "there is no such thing as race" people throw their hands up and say "are you nuts?" That's not good for scientific credibility.
From a scientific point of view what we have here is a "the signal and the noise" problem. It is similar to the problem of trying to pick out a single conversation at a noisy cocktail party. Most of what you hear is not the conversation you are interested in. You have to filter out the large amount of background "noise" before you can pick out the conversation "signal". All this "same genes as chimpanzees" and "random variation from person to person" stuff is the noise. But science is very good at extracting a small signal from a large amount of noise. It's a problem scientists deal with on a daily basis. So, from a scientific perspective, the question is "can science pick the 'race' signal out of the 'genetic variation' noise"? The obvious answer is yes. 23andMe and those other companies do it profitably thousands of times per day. So can scientists. How?
Before modern times almost no one traveled more than 25 miles from their birth place during their entire life. People intermarried and had children with people who lived close to where they did. Mutations happen. The population of any one small area is small. This allows mutations to build up and spread around in this small population over time. If you could identify the mutations unique to a small community then you could identify descendants of that community by searching for those mutations. The same is true over larger areas if more time is allowed to pass. The larger the area the more time will generally be necessary for unique mutations to arise and spread around. Science (and companies like 23andMe) have had the ability to pick a single mutation out a person's genetic material for some time now.
The 23andMe people have built up a large database of these geographically specific mutations. They grind all this information down with a lot of computer power. There are about 3 billion "base pairs" and about 20,000 genes in the genetic material of one person. So it takes a lot of computer grinding but computers are now cheap. They concentrate on the unique mutation "signal" and put everything else in the "noise" bucket. What pops out is a geographical profile of where and to what extent your genetic information comes from. This is tech talk for your racial profile. Scientists know this. They developed all the technology that 23andMe uses. So why do they pretend that they don't?
The problem is more cultural than anything else. Why do people want to know a person's race and what do they want to do with it? In short, they want to be able to jump to unwarranted conclusions. That's bad. But what is worse is that they want to use those unwarranted conclusions to advance economic, social, and political goals. The "black" experience in the U.S. is typical of how this works in the real world. Let's start with the desired outcome and work backward.
The desired outcome is cheap labor to perform difficult, dangerous, unpleasant tasks. Working in cotton fields in the heat of summer definitely falls into this category. You can always find someone to do a job if you are willing to pay enough. But cotton is a commodity. You need low production costs to be able to sell it inexpensively at a profit. Labor is a large component of production costs so cheap labor is critical. What is cheaper than a slave? They are subjected to poor working and living conditions and are paid literally nothing. The whole system is architected to make their labor as cheap as possible. The slaves know this so they desperately want to escape their situation.
Now if we enslave people who look like us they can escape easily, disguise their identity, and get away with impersonating a free person. (Making a cotton field escape proof would be expensive and the whole point of slavery is to keep things cheap.) With the technology available 200 years ago this made a really effective slave system hard to pull off. But what if instead of focusing on individuals you selected an easily identifiable population group and designated all of them as slaves? That's what was done with dark skinned people of African descent who were imported into a society run by "whites", people with light skin. Generally speaking, the rule was "white - free; black - slave). This was a simple to enforce rule.
There was such a thing as freed black people but it was common for them to be re-enslaved by unscrupulous people. The obvious physical difference that skin color represented made the system easy and cheap to implement and maintain. But how do you justify enslaving people based on their skin color? It turns out that in some situations a light skin color is advantageous and a dark one disadvantageous. But in other situations the reverse is true. So the fundamental differentiator, skin color, is not enough by itself. What do you do? You jump to unwarranted conclusions, the next step in the chain.
If the population you wish to enslave is of low intelligence, is "lazy and shiftless", is violent and inherently immoral then it is far easier to make the case that "those people deserve to be enslaved". And the people you need to convince are obviously not part of the group you want to enslave. So that's what was done. But from the current scientific perspective the conclusions are completely unwarranted.
Modern science is still mystified by the genetic basis of intelligence. It is obvious that there is a genetic component to intelligence but science has yet to find it. Characteristics like laziness are even more problematic. Here there is not even any kind of consensus on how to identify the congenitally lazy or even if such a thing exists. We are all lazy sometimes and energetic other times. I know that if I was enslaved I would quickly become as lazy as I could get away with. It would not be driven by genetics. It would simply be the sensible thing to do. And so it goes for other "moral shortcomings" attributed to the enslaved by the enslavers.
So why is science so reluctant to speak out? Well, there is an additional problem. Science's hands are not clean on the subject. Roughly a hundred years ago there was a "scientific" movement called eugenics. This was considered good science at the time. Proponents published learned papers in all the best scientific journals "proving" that black people were of low intelligence, had bad moral character, etc. "There is scientific justification for according black people an inferior position in society", the argument went. All of the research has since been discredited. Scientists try to learn from the mistakes of the past so they are now bending over backward to avoid repeating the "eugenics" mistake.
What's really going on is that a lot of scientists just want to steer clear of the whole area in any kind of public situation. The science is in an unsettled state, can't tell us much with authority, and in the recent past science screwed up in this area. So for all those reasons avoiding the subject as best as is possible seems at first to be a good idea. But I don't think it is. People take in the Twitter summary of the whole thing and decide since science is obviously wrong about this they are justified in believing it is wrong on other issues (evolution, global warming), I believe science needs to go where the facts lead. So where do they lead?
It is important to emphasize that scientific understanding of this area is evolving rapidly. A little over a decade ago the first complete genome of a human was decoded. We now have complete genomes for thousands of people and doing a full genetic sequence is getting cheaper at an astonishing pace. At the time of this first genetic sequence more than 90% of the sequenced DNA was characterized as "junk", DNA that apparently served no purpose at all. We now know that a lot of that "junk" actually serves useful and even critical purposes. But we are just at the beginning of figuring out what those purposes are.
For a time people thought that a "gay" gene would be discovered. There does not seem to be a single "gay" gene. And scientists thought that many "genetic" diseases would be nailed down to a single "bad" gene. That idea has also pretty much evaporated. And so it goes. The idea that if we can read the genetic sequence out we will know all now looks badly mistaken. Everything is much more complicated than we used to think and everything is intertwined with everything else in complex and poorly understood ways. Just as a single example, we now know there is a whole complex mechanism for turning genes on and off. This means that the mere presence of a certain version of a certain gene is not the end of the story. Presently we know the mechanism exist but we know very little beyond that. Science is at just the beginning of understanding area after area after area of what used to be lumped together as genetics.
Fundamentally, what science can tell us about race does not deliver the result people who think race should be important desire. It most specifically does not deliver a reason to enslave a "race" or even relegate them to a lower social position. The current scientific "state of the art" on race mostly consists of being able to determine where our ancestors lived. And even this information often shatters people's preconceived notions of their ancestry. It is common to find out that we don't have relatives where we thought we did and that we do have relatives where we thought we didn't. The descendants of Thomas Jefferson have had to wrestle with the fact that Jefferson fathered children with Sally Hemmings, a slave, for instance.
Still I think it is counterproductive for scientists speaking to the general public to say things like "there is no such thing as race". The statement "race isn't what you think it is" is of roughly the same length and is far more accurate.
Monday, June 22, 2015
Bob Lee and Reby Boys
This post is motivated by the recent slaughter of nine innocent people in Charleston, South Carolina. Among the many horrific aspects of this event is the fact that it follows directly out of "southern culture". This aspect and what "southern culture" stands for is getting an airing in the media, finally. The more you look at it the worse it gets. But it has persisted for centuries. And most specifically it has persisted and grown in the wake of the Civil War. Well, actually, if you immerse yourself in southern culture you will find that "Civil War" is some kind of evil northern plot. The proper name for the event is the "War of Northern Aggression". And so it goes. As my contribution to pushing back against southern culture I want to directly attack two tropes that are commonly held by its adherents. They are both closely associated with the Civil War. Here goes.
Bob Lee is almost always given his full name and frequently accorded his title. So he becomes General Robert E. Lee, by inference an esteemed figure. And there is no doubt that he was a great (as in effective) leader of men and a brilliant general. But does he really deserve his esteem which extends far beyond his military exploits?
Lee claimed to be generally apolitical before the war. As a senior military officer he spent what one commentator has called his "contemplative years", those between 1831 and 1856, outside the heart of slave territory. This supposedly contributed to his moderate views. But he married Mary Custis in 1831. She was from a wealthy family that owned a lot of slaves. There was a belief among many that when Mary's father died and Lee took control of the Custis holdings the slaves would be freed. But, as with many other similar situations, this did not happen. If Lee harbored anti-slavery beliefs he never spoke or acted on them with sufficient vigor to put him in conflict with his friends or community, for the most part supporters of southern culture. But the telling decision was the one he took at the start of the war.
Southern culture claims that its adherents are "100% all American patriots". It frequently denigrates people it doesn't like for not being sufficiently patriotic. A typical example of this is the criticism that President Obama was somehow disloyal or un-American because he did not wear an American flag lapel pin when he was out in public for the early part of his term in office. (He quickly decided that this wasn't worth fighting over and has since worn his pin.) Flags are definitely important to these people.
So these people could be accurately described as "America first" people, right? Wrong! When given a choice between putting America first and the state of Virginia first, Lee chose Virginia. And, in general, southerners loyalty starts with southern culture, then descends to their states and only then descends to cover America. The flag they care the most about is not the American flag. It is the Confederate Battle Flag the "stars and bars". As I write this the American flag is flying at half mast over the capitol of South Carolina while the stars and bars is at full staff. These people in general and Bob Lee in particular are not "100% all American patriots". They are perhaps "60% somewhat American and sort of patriots when it suits them". The only thing they are "all out 100%" about is being southern. They are the last people we should turn to as judges of who is a true American patriot and who isn't.
The next issue I want to cover is that of bravery. Southerners are also 100% behind our brave boys in uniform and by "our brave boys" they mean confederate army soldiers. And, of course, they were the bravest of the brave. That's their opinion but it is true? I think not and here's why?
Many people consider the Civil War the first "modern" war. Now this is definitely one of those things where opinions differ but let's take a look at why this opinion is popularly held. And, if you don't try to push things too hard, the idea holds up pretty well. The Civil War saw a lot of innovation introduced that were later broadly adopted. The biggest of these was a complete overhaul of standard military tactics. For a long time before the Civil War the best way to fight a big battle was to put your soldiers into colorful matching uniforms, line them up in rows, and have them have at it. The reason for this was "volley fire". If your army fired volleys of synchronized fire then it pretty much destroyed any army not employing the same tactics. The uniforms and lines were necessary to organize and coordinate the firing of volleys.
But that's not how the Civil War was fought. Why? The Civil War was the first war fought between armies where the average soldier was equipped with a musket with a rifled barrel. The rifling made the gun a lot more accurate. It meant that its effective killing distance was increased by a factor of about three. Before the Civil War standard tactics called for a set of volleys to be fired. This was followed up with a charge that finished the other side off. With unrifled muskets enough charging soldiers could make it across the gap to the other army's line to have a good chance of winning. But the greater accuracy of rifled muskets meant that the soldiers had to begin charging from much further away.
The now much longer distance the charging soldiers had to cover meant that far more of them could be cut down before they reached the other line. In effect the standing soldiers had enough time to thin the lines to the point that the charge was ineffective. Charges no longer worked. And the best defense was no longer a good offense. Instead it consisted of hiding behind something like a tree or a fence and firing from there. In the absence of a handy tree or fence you could go down. The term "fox hole" dates from this period.
To his credit Lee figured all this out early in the war. So he tried to arrange things so that his soldiers were "dug in" behind some kind of cover and the Union soldiers had to march across and then charge across an open area. It took most of the war for the northern generals to figure this out. And being in a position to use the right tactics made a tremendous difference. The battle of Gettysburg proves just how important this difference was.
On the Southern side you had Lee at the height of his powers surrounded by his revered general staff, also at the height of their powers. On the Northern side you had a much inferior general supported by an undistinguished staff. How inferior was the northern general? I'm not going to tell you his name because it doesn't matter. (Look his name up if you care.) What I will tell you is that he was put in charge of the Northern forces a relatively short time before the battle and fired for incompetence not long after the battle. So on one side you have the person most people characterize as the best general of the war and on the other side you have a third rater. So Lee won easily, right? Even the southern culture people know that Lee lost. The battle took three days and was a spectacular defeat for the "Army of Northern Virginia". Oh yes, that's what Lee's army was called. It was not "The Confederate Army". So even in this oh so important matter and at this oh so important time southerners couldn't quite get completely behind the idea of a country.
So why did Lee lose at Gettysburg? Because almost by accident the Northerners held the high ground and were dug in. This caused the Southerners to have to charge uphill across open territory. Southern leadership and southern valor were not enough to overcome the disadvantage of a superior northern position even though the northern army was at best mediocrely led. Lee never made that mistake again. But northern generals frequently did both before and after Gettysburg. Grant even did it at least once late in the war.
And what does this have to do with the valor of the common foot soldier? Their lives were on the line. That caused them to be acutely aware of what was going on. It was no secret that the northern armies were frequently poorly led while the southern armies were generally well led. Soldiers in battle are, of necessity, a fatalistic lot. "When your time is up it's up". Still soldiers in both armies were keenly aware that Bob Lee was a better general than the long line of men that Lincoln put in charge of the northern armies before Grant. So the northern soldiers knew that when they went into battle the battlefield would be tilted, often literally tilted, in favor of the guys on the other side.
But the northern soldiers did their duty in large numbers anyhow all through the war. It is much easier to be brave when you can have faith that your commanding officers know what they are doing and are not wasting the lives of you and your fellow soldiers by doing something stupid. That is how things looked for southern soldiers. Northern soldiers marched into battle over and over knowing that the people in charge had routinely snatched defeat from the jaws of victory. It is far harder to be brave in these circumstances.
When Grant was finally put in charge late in the war he spent lives profligately. But so had his predecessors. The difference was that Grant won where his predecessors had lost. Soldiers know that war involves bloodshed, a lot of it. It says something about the human condition that soldiers have always known this but they march to war and do their duty anyhow. But northern soldiers did not begrudge Grant his blood because Grant got results. And what about southern soldiers, those Reby Boys of my title? Well, late in the war when Lee started losing a lot of them went home. The case is clear. Northern soldiers were a lot braver than their southern counterparts.
Update (added June 24, 2015):
The "confederate flag" has all of a sudden became a subject of intense interest. As a result I now know a lot more about the subject than I did 24 hours ago. And it turns out that some of what I wrote above is incorrect.
For instance, the "Stars and Bars" does not refer to what I called the "Confederate Battle Flag". Instead it refers to the first iteration of the official flag of the Confederate States of America. That design consisted of a blue box in the upper left corner with a circle of white stars in it. The initial design featured seven stars. As additional states joined the confederacy more stars were added. The final total was 13. The rest of the flag, in this iteration, remained constant. It consisted to three equal width horizontal bars. The top and bottom bars were red and the center bar was white. This is certainly a design I am not very familiar with. In fact, I think most people including southerners are unfamiliar with it.
The flag we now most closely associate with the confederacy is based at one remove on what I referred to above as the "Confederate Battle Flag". But it turns out that is not the whole story either. There was no "Confederate Battle Flag". Instead there were separate battle flags for each of the various confederate armies. The most well known of these flags was the one belonging to the Army of Northern Virginia, Bob Lee's Army. And Lee's flag featured a design that differs slightly from what we now think of as the "confederate flag". Lee's flag was a square flag with two blue diagonals that together formed an "X". On the diagonals were a number of white stars. The number varied in a manner similar to that of the Stars and Bars. The rest of the flag was red.
The modern "confederate flag" is identical to another battle flag, that of the Army of Tennessee. The Tennessee battle flag was identical to the Lee flag except that the outline was changed to a rectangle. As far as I can tell, neither of these designs ever acquired a nickname along the lines of "stars and bars". Tennessee's appropriation of the Lee design for its army is indicative of how well known and popular the design was at the time.
But, rather than being adopted wholesale as in the Tennessee case, instead the Lee design was used as a component of a larger design. For instance, the second version of the Confederate Flag incorporated it in the upper left corner as a replacement for the blue box with the circle of stars. In this version the rest of the flag was solid white. The third version of the Confederate flag took the second version as a starting point and added a vertical red bar down the right side of the flag. The Lee flag was also used during the war as a component of various confederate naval ensign designs. (These designs, especially the ensign designs, are even more obscure than that of the stars and bars.) After the war Lee's flag was occasionally used as a component of some state flags, most notably that of Mississippi.
The modern "confederate flag", but actually the battle flag of the army of Tennessee, mostly dates from the '60s and was a reaction to the civil rights movement. And it should be obvious now, but it bears repeating, the design featured so prominently these days was only the flag of one of the various armies, and not even the most prominent one, that fought on the side of the confederacy in the Civil War. It was never a symbol of southern culture more broadly nor of the geographic area we think of as "the south".
When I originally wrote this piece I assumed, silly me, that the people who lie so often about so many things were actually telling the truth, or at least something close to the truth, about something they claim to hold near and dear. I should have known better. My bad.
Bob Lee is almost always given his full name and frequently accorded his title. So he becomes General Robert E. Lee, by inference an esteemed figure. And there is no doubt that he was a great (as in effective) leader of men and a brilliant general. But does he really deserve his esteem which extends far beyond his military exploits?
Lee claimed to be generally apolitical before the war. As a senior military officer he spent what one commentator has called his "contemplative years", those between 1831 and 1856, outside the heart of slave territory. This supposedly contributed to his moderate views. But he married Mary Custis in 1831. She was from a wealthy family that owned a lot of slaves. There was a belief among many that when Mary's father died and Lee took control of the Custis holdings the slaves would be freed. But, as with many other similar situations, this did not happen. If Lee harbored anti-slavery beliefs he never spoke or acted on them with sufficient vigor to put him in conflict with his friends or community, for the most part supporters of southern culture. But the telling decision was the one he took at the start of the war.
Southern culture claims that its adherents are "100% all American patriots". It frequently denigrates people it doesn't like for not being sufficiently patriotic. A typical example of this is the criticism that President Obama was somehow disloyal or un-American because he did not wear an American flag lapel pin when he was out in public for the early part of his term in office. (He quickly decided that this wasn't worth fighting over and has since worn his pin.) Flags are definitely important to these people.
So these people could be accurately described as "America first" people, right? Wrong! When given a choice between putting America first and the state of Virginia first, Lee chose Virginia. And, in general, southerners loyalty starts with southern culture, then descends to their states and only then descends to cover America. The flag they care the most about is not the American flag. It is the Confederate Battle Flag the "stars and bars". As I write this the American flag is flying at half mast over the capitol of South Carolina while the stars and bars is at full staff. These people in general and Bob Lee in particular are not "100% all American patriots". They are perhaps "60% somewhat American and sort of patriots when it suits them". The only thing they are "all out 100%" about is being southern. They are the last people we should turn to as judges of who is a true American patriot and who isn't.
The next issue I want to cover is that of bravery. Southerners are also 100% behind our brave boys in uniform and by "our brave boys" they mean confederate army soldiers. And, of course, they were the bravest of the brave. That's their opinion but it is true? I think not and here's why?
Many people consider the Civil War the first "modern" war. Now this is definitely one of those things where opinions differ but let's take a look at why this opinion is popularly held. And, if you don't try to push things too hard, the idea holds up pretty well. The Civil War saw a lot of innovation introduced that were later broadly adopted. The biggest of these was a complete overhaul of standard military tactics. For a long time before the Civil War the best way to fight a big battle was to put your soldiers into colorful matching uniforms, line them up in rows, and have them have at it. The reason for this was "volley fire". If your army fired volleys of synchronized fire then it pretty much destroyed any army not employing the same tactics. The uniforms and lines were necessary to organize and coordinate the firing of volleys.
But that's not how the Civil War was fought. Why? The Civil War was the first war fought between armies where the average soldier was equipped with a musket with a rifled barrel. The rifling made the gun a lot more accurate. It meant that its effective killing distance was increased by a factor of about three. Before the Civil War standard tactics called for a set of volleys to be fired. This was followed up with a charge that finished the other side off. With unrifled muskets enough charging soldiers could make it across the gap to the other army's line to have a good chance of winning. But the greater accuracy of rifled muskets meant that the soldiers had to begin charging from much further away.
The now much longer distance the charging soldiers had to cover meant that far more of them could be cut down before they reached the other line. In effect the standing soldiers had enough time to thin the lines to the point that the charge was ineffective. Charges no longer worked. And the best defense was no longer a good offense. Instead it consisted of hiding behind something like a tree or a fence and firing from there. In the absence of a handy tree or fence you could go down. The term "fox hole" dates from this period.
To his credit Lee figured all this out early in the war. So he tried to arrange things so that his soldiers were "dug in" behind some kind of cover and the Union soldiers had to march across and then charge across an open area. It took most of the war for the northern generals to figure this out. And being in a position to use the right tactics made a tremendous difference. The battle of Gettysburg proves just how important this difference was.
On the Southern side you had Lee at the height of his powers surrounded by his revered general staff, also at the height of their powers. On the Northern side you had a much inferior general supported by an undistinguished staff. How inferior was the northern general? I'm not going to tell you his name because it doesn't matter. (Look his name up if you care.) What I will tell you is that he was put in charge of the Northern forces a relatively short time before the battle and fired for incompetence not long after the battle. So on one side you have the person most people characterize as the best general of the war and on the other side you have a third rater. So Lee won easily, right? Even the southern culture people know that Lee lost. The battle took three days and was a spectacular defeat for the "Army of Northern Virginia". Oh yes, that's what Lee's army was called. It was not "The Confederate Army". So even in this oh so important matter and at this oh so important time southerners couldn't quite get completely behind the idea of a country.
So why did Lee lose at Gettysburg? Because almost by accident the Northerners held the high ground and were dug in. This caused the Southerners to have to charge uphill across open territory. Southern leadership and southern valor were not enough to overcome the disadvantage of a superior northern position even though the northern army was at best mediocrely led. Lee never made that mistake again. But northern generals frequently did both before and after Gettysburg. Grant even did it at least once late in the war.
And what does this have to do with the valor of the common foot soldier? Their lives were on the line. That caused them to be acutely aware of what was going on. It was no secret that the northern armies were frequently poorly led while the southern armies were generally well led. Soldiers in battle are, of necessity, a fatalistic lot. "When your time is up it's up". Still soldiers in both armies were keenly aware that Bob Lee was a better general than the long line of men that Lincoln put in charge of the northern armies before Grant. So the northern soldiers knew that when they went into battle the battlefield would be tilted, often literally tilted, in favor of the guys on the other side.
But the northern soldiers did their duty in large numbers anyhow all through the war. It is much easier to be brave when you can have faith that your commanding officers know what they are doing and are not wasting the lives of you and your fellow soldiers by doing something stupid. That is how things looked for southern soldiers. Northern soldiers marched into battle over and over knowing that the people in charge had routinely snatched defeat from the jaws of victory. It is far harder to be brave in these circumstances.
When Grant was finally put in charge late in the war he spent lives profligately. But so had his predecessors. The difference was that Grant won where his predecessors had lost. Soldiers know that war involves bloodshed, a lot of it. It says something about the human condition that soldiers have always known this but they march to war and do their duty anyhow. But northern soldiers did not begrudge Grant his blood because Grant got results. And what about southern soldiers, those Reby Boys of my title? Well, late in the war when Lee started losing a lot of them went home. The case is clear. Northern soldiers were a lot braver than their southern counterparts.
Update (added June 24, 2015):
The "confederate flag" has all of a sudden became a subject of intense interest. As a result I now know a lot more about the subject than I did 24 hours ago. And it turns out that some of what I wrote above is incorrect.
For instance, the "Stars and Bars" does not refer to what I called the "Confederate Battle Flag". Instead it refers to the first iteration of the official flag of the Confederate States of America. That design consisted of a blue box in the upper left corner with a circle of white stars in it. The initial design featured seven stars. As additional states joined the confederacy more stars were added. The final total was 13. The rest of the flag, in this iteration, remained constant. It consisted to three equal width horizontal bars. The top and bottom bars were red and the center bar was white. This is certainly a design I am not very familiar with. In fact, I think most people including southerners are unfamiliar with it.
The flag we now most closely associate with the confederacy is based at one remove on what I referred to above as the "Confederate Battle Flag". But it turns out that is not the whole story either. There was no "Confederate Battle Flag". Instead there were separate battle flags for each of the various confederate armies. The most well known of these flags was the one belonging to the Army of Northern Virginia, Bob Lee's Army. And Lee's flag featured a design that differs slightly from what we now think of as the "confederate flag". Lee's flag was a square flag with two blue diagonals that together formed an "X". On the diagonals were a number of white stars. The number varied in a manner similar to that of the Stars and Bars. The rest of the flag was red.
The modern "confederate flag" is identical to another battle flag, that of the Army of Tennessee. The Tennessee battle flag was identical to the Lee flag except that the outline was changed to a rectangle. As far as I can tell, neither of these designs ever acquired a nickname along the lines of "stars and bars". Tennessee's appropriation of the Lee design for its army is indicative of how well known and popular the design was at the time.
But, rather than being adopted wholesale as in the Tennessee case, instead the Lee design was used as a component of a larger design. For instance, the second version of the Confederate Flag incorporated it in the upper left corner as a replacement for the blue box with the circle of stars. In this version the rest of the flag was solid white. The third version of the Confederate flag took the second version as a starting point and added a vertical red bar down the right side of the flag. The Lee flag was also used during the war as a component of various confederate naval ensign designs. (These designs, especially the ensign designs, are even more obscure than that of the stars and bars.) After the war Lee's flag was occasionally used as a component of some state flags, most notably that of Mississippi.
The modern "confederate flag", but actually the battle flag of the army of Tennessee, mostly dates from the '60s and was a reaction to the civil rights movement. And it should be obvious now, but it bears repeating, the design featured so prominently these days was only the flag of one of the various armies, and not even the most prominent one, that fought on the side of the confederacy in the Civil War. It was never a symbol of southern culture more broadly nor of the geographic area we think of as "the south".
When I originally wrote this piece I assumed, silly me, that the people who lie so often about so many things were actually telling the truth, or at least something close to the truth, about something they claim to hold near and dear. I should have known better. My bad.
Thursday, May 21, 2015
Robot cars - an update
I last addressed this subject back in 2011. Here's the link: http://sigma5.blogspot.com/2011/03/robot-cars.html. In reviewing what I wrote then I must say I did a very good job. I first covered potential alternatives to the car (the alternatives work less well than many think they will). Then I addressed engines and fuels (I think gasoline powered hybrids will be the best choice for a long time to come). If you want to know more about either subject I refer you to my earlier post. The last subject I covered then was the one mentioned in the title of both that post and this one. I made some predictions about robot cars then that are looking pretty good now. In this post I am going expand on what I said about robot cars then and add some new predictions about how things will develop.
Not a lot of time has passed since my previous post. But cars are now evolving at warp speed compared to the historical norm. The first car I drove was a 1950 Plymouth. It was one of the first cars to sport a new and, at the time "cutting edge", feature. Most cars built even a year earlier required you to stomp on a button on the floor to get the engine to turn over and start. This car contained a technological advance. You could make the engine turn over and start by giving the ignition key an extra bit of twist. The car my dad bought was the cheapest Plymouth on the lot. That car did have the new feature but it did not sport what were then options including electric turn signals, a clock, or a radio. But many other cars of that time did come equipped with all three. So, if you had bought one of those other models it would have driven just like any "stick shift" car made in the next 50 years.
While I was in college in the late '60s I drove a '58 Pontiac. It had an automatic transmission (and turn signals, a clock and a radio). It turns out that driving that car was pretty similar to driving any "automatic" produced in the next 50 years too. But in roughly the last decade cars have started changing quickly. A couple of years ago I drove a car that literally had a push button. You push the button to tell the computer that you want to start driving (or that you are done). That's a really different experience than the old "put the key in the ignition and go through the rest of the rigmarole necessary to get the engine to start" routine. In fact with many cars now you don't even have to put the key in the ignition at all. As long as it's in your pocket you are good to go.
And that's not even the current cutting edge. A friend of mine has a Toyota Prius. It has the same push button (and key in the pocket) setup but what happens when you push the button is now radically different. Now he no longer controls what is happening with the engine. The computer does. He pushes down on the "gas pedal" but now all that does is tell the computer you want to go faster. The computer figures out how to make it so. What's going on?
I recently saw a story about a $9 computer. The basic package does not include everything. There's no power supply or keyboard or monitor. But the same people that sell the $9 computer will sell you an add on that includes all this stuff and it costs $15. So you can get the whole package for about $25. Why does that matter? Because that $9 device includes a CPU, RAM, a solid state disk, and a number of standard ports you can plug stuff into. It is powerful enough to run real computer programs. And it costs $9 if you buy them one at a time. My point is that large amounts of computer power is now really cheap.
That means that car companies can afford to put a powerful computer in your car. And that computer has access to power and it will be designed to get inputs from things like the gas pedal or various sensors scattered round the car and it will be designed to send outputs to things like controls on the engine or actuators on the transmission or whatever. So to add a computer to a car costs the car maker $9 or possibly quite a bit less. And, if you can use the computer to replace something like the old complex machinery that figured out when to shift automatic transmissions you can save the cost of the components you are replacing. In fact, replacing components with a computer can actually save a lot of money. The computer has a negative "cost".
The tipping point on all this was reached about 10 years ago. I currently drive a '99. It has a limited amount of computer capability. But the same make and model of car made only five years later has several much more powerful computers, each dedicated to a different task. That is now just the cheapest way to go for the car companies. And computers keep getting even cheaper and even more powerful.
I talked about the DARPA challenge that kicked this whole "robot car" thing into high gear in my previous piece. To pull that off then contestants had to jam many thousands of dollars of expensive computer and sensor equipment into the cars. It was hard getting everything to just fit and function. But car companies have gotten better and better at integrating computers into cars. And the sensors have gotten incredibly small, incredibly cheap, and incredibly frugal in their power consumption. Why? Because in many cases what we are talking about are smartphone components.
Smartphones are small and have tiny batteries that don't work very well. So cell phone components have to be small and have to be very frugal when it comes to power consumption. They are still relatively expensive. If you bought an iPhone 6 without most of its cost being hidden in your monthly phone bill it would cost about $600. That's a far cry from $9. But you can now get a phone with the capability of an iPhone 1, introduced in 2007, for perhaps $100. It would look pretty wimpy and pathetic sitting next to an iPhone 6. But the iPhone 6 costs now what the iPhone 1 cost then. The big difference is that the new components that are so much more powerful and so much more capable now cost what the iPhone 1 components cost then. The price of this sort of thing is plummeting at an astounding rate. And it is going to keep plummeting.
This is reflected in the features you find on new cars today. The capabilities that were available on perhaps one or two high end cars in 2011 included sophisticated cruise control, blind spot detection, collision avoidance, and collision alert when you are backing up. All of these features and more are now available on mid-priced cars. But the "same" features on these new cars work much better now than they did then. These include the ability for the car to find the lane markers and keep you in your lane and a feature that tries to figure out if you have nodded off behind the wheel. And, as the late night infomercials have it, "but wait - there's more". Car makers are rolling out new and improved features like they are in the fashion business.
One thing I pointed out in my previous post was the importance of cars talking to each other. That looked like a problem then. But the Federal Government stepped in recently and is now coordinating a project to standardize inter-car communication. That problem got solved before most people even knew there might be a problem. The rate at which cars are gaining intelligence is astonishing. And perhaps most astonishing is that several car makers have announced that they will be selling robot cars by 2020. That's only five years from now. Even more astonishing is the fact that it looks like they will hit their target date.
There is always someone willing to try to scare people. With respect to robot cars the standard line is "what if a robot car goes berserk and kills a bunch of people?" It could happen. But look at Google's experience. I was able to report in 2011 that a Google car had been in an accident. I can now report that Google cars have been in 11 accidents. And something surprising, at least to the "kill a bunch of people" crowd has happened. In all but one of those accidents it was obviously the fault of the other person. The accident that was not caused by the other driver happened while the car was being driven by a person not the automation.
The most common accident scenario has been where the Google car is stopped at a stop sign or a traffic light and someone rear ends them. The accidents were not the result of the stop. The Google car had been stopped for a while when it was hit. The other driver was just not paying attention. And all the logs and readouts were able to unambiguously and with great detail and specificity tell the tale of exactly what happened and who was at fault. The attention of robot cars does not wander. They do not text while driving. Or, if they do, they are able to multitask so the quality of their driving does not suffer. It is very likely that robot cars will make the roads safer, much safer. Robot cars also do not drive drunk. By far the most difficult problem the robot car people have had to cope with is other cars being driven by people.
I am sure that when robot cars first become available they will not be for most people. For one thing they will be expensive. And a lot of people will be unwilling to trust their lives and those of their friends and loved ones to a robot. I expect that concern to disappear pretty quickly. The cost problem will take longer. I expect the first robot cars that hit the road to be quite sophisticated. But I think they will follow the iPhone model. The first iPhone blew everybody away. Until, that is, the iPhone 2 came out. Apple has succeeded in making each generation of the iPhone more cool than the previous one.
I expect to see the same thing with robot cars. With the iPhone Apple saw how people were using them and that suggested improvements. Also, so many iPhones were sold that the parts manufacturers were able to figure out how to make the same part more cheaply or a better part for the same cost. So later iPhones had better hardware. Apple turned that into new features or old features that worked better.
I don't expect robot cars to sell in the numbers iPhones do. But advances in smart phones will help car makers out as will experience gained as many cars hit the road. I think robot car 2.0 will be much better than robot car 1.0. And then 3.0 and 4.0, etc. will all be a big improvement on the previous generation model. iPhones have been around for less than ten years. Every time a new model rolls out people ask "how can they make the new model better than the old one"? So far Apple, and the other smart phone makers, have figured out an answer that generates an incredible volume of sales. At some point this will stop. But I have no idea when it will be. I think it will take longer for robot cars to get to the point where the new models don't not seem like that much of an improvement over the old one. But I am not going to try to guess how long that will take. Instead I am going to apply my crystal ball to a other related issues.
As I covered more thoroughly in the previous article there are people that think cars are the root of all evil. I think like an engineer. Engineers don't think "cars are evil". Instead they think "what are the problems with cars?" Then, if they agree that this or that actually is a problem they go on to ask "what is the best solution?" If the best or only way to fix the problem is "get rid of cars" then "get rid of cars" becomes the engineer's solution of choice. But the focus is on solving the problem and not some moral judgment about whether cars are good or bad. We live in a world where people like to fixate on the moral judgment to the exclusion of trying to find the best solution to the problem. But instead of doing that I am going to apply the engineer's perspective to a couple of problems associated with cars. I am going to skip over the "is it a real problem" part because I think both of these are real problems.
The two issues I want to address are pollution and streets. Let me start with pollution. Cars turn gasoline into several different nasty things. One of them used to be smog. Smog is smoky, smelly, and unhealthy stuff hanging around in the air. It is unpleasant. It blocks our ability to see blue sky and fluffy clouds. It also just smells bad. So it is an aesthetic disaster. But it also turns out to be a health disaster. It does terrible things to your lungs. Smog in the US is mostly a thing of the past.
Changes to the formulation of gasoline and to how cars work got rid of the problem. Some places still have a smog problem some of the time but for most of us it is pretty much a thing of the past. The guts of a car (and the chemistry of gasoline) are now quite different than they used to be but it turned out to be possible to fix cars so that they did not create smog. China has a terrible smog problem. And some of this is caused by cars. But most of it is caused by coal fired power plants. And modern designs for cars and gasoline would take care of the car part of the problem. So China can fix its smog problem. It just has to decide to fix it and then do so.
That's an example of where the solution was not to get rid of cars but to make changes so that the problem went away. If smog was the whole problem we would be done. But it isn't. It was just the most visible and the easiest problem to fix. The big problem that everyone knows about is carbon dioxide (CO2). If you have a gas (or diesel) car it is going to make lots of CO2. There is just no getting around this. If you switch to Natural Gas as a fuel the amount of CO2 goes down but it is not eliminated. If you switch to Hydrogen you can eliminate the CO2 problem. But I indicated in 2011 what the problems with Hydrogen are. I still think they are insoluble so I don't see Hydrogen ever going anywhere.
The best you can do is to manage the problem to minimize it. There is plenty of room to make cars much more efficient. That's why I am a fan of hybrids. I think you can get the amount of CO2 per mile way down from where it currently is. A car's basic purpose is to move around. To make this work you need a way to have a large amount of stored energy move around with the car. A gas tank full of gas represents an unbelievably large amount of stored energy. It is so vastly superior in this role to anything currently available that I frankly have trouble imagining an alternative. But we can do a lot better at getting the most out of what is there. In almost all cases burning generates CO2. And lots of the burning we do does not have mobility issues. So I think there are lots of ways to drastically cut the amount of CO2 produced in these situations where mobility is not involved.
Now I would be delighted if I could justify tossing out the entire preceding paragraph out. If someone comes up with a decent battery, a device that can store and release a lot of energy at a small cost in terms of volume, weight, and money, then I would be all for all electric cars. A good battery would make all kinds of approaches to CO2 reduction possible. That would mean that we could ditch the whole hybrid thing for something much better. The good news is that between 2011 and now there has been some progress in battery technology. The bad news is that the amount of progress has been very modest. Batteries still suck. And I see nothing currently on the horizon that looks promising in terms of a large improvement in batteries. We should do what we can to reduce CO2 emissions from cars and other vehicles but we are not going to get it to zero or anywhere near zero. I wish I had better news on this front but I don't. The same is not true about the other issue.
I know a couple of people that know a lot about urban planning and that sort of thing. Both of them do not like how much of a city ends up as pavement (streets and parking). In actual use streets are very inefficient. We get in our car and drive somewhere. On both ends there has to be someplace to park the car. And we go to several places. So we don't need two places, on average, to park our car. We need more like ten. Now if you drive to the mall today but don't tomorrow the parking place you use today can be used by someone else tomorrow. But you don't go to two or ten places in your car. You go to hundreds or thousands. So, on average, many parking places have to be provided for things to work. That means vast amounts of land devoted to parking.
Then there are the streets that connect everything together. First, there has to be a street to wherever you might want to go even if you don't do it very often. Then there has to be enough capacity so that you can go there when you want. It doesn't matter if the street is wide open at three in the morning if you want to go there at three in the afternoon. So in the same way that there needs to be lots of parking spaces for each car there needs to be lots of streets to handle the traffic. So here too the average utilization is low. And that bugs the urban planners. They like alive and green not paved and barren. And most people agree with them. It seams reasonable to be unhappy about the amount of land area in a city devoted to streets and parking. It seems reasonable because it is.
The standard urban planner solution is to replace cars with feet or bicycles or mass transit. I looked at those options previously too. So now let me focus on how robot cars can make things better, possibly a lot better. I am going to start with a simple idea: If a car can drive itself it can park itself. Ok, how does this help? Consider the present situation. When you are home where's your car. It's in the garage or on the street. Why? Because you don't want to have to hike a long distance to get from your car to your home. But the need for close in parking goes away if the car can drive itself. It can be waiting close at hand when you want to go somewhere but it can be somewhere else the rest of the time. It can also drop you off then go away when you return. You don't need to have an attached garage or on street parking any more.
As long as the car is reasonably close, say within a mile, it can get to your door in almost no time. An application on your phone to summon it a minute or so before you need it is not hard to implement. Your phone, if you have a smartphone, already has much more complex applications running on it now. So that takes care of the home end. On street or on premises parking is no longer needed where you live. And the same kind of approach also works at the other end. As long as you car can be summoned quickly it does not need to be parked within a few steps of your destination. Then there's the in between part.
There are expectations about how close you will stick to the car in front of you. They are based on an average plus a margin. On average a driver can react to changing circumstances in a certain period of time. You need to be far enough away so you don't hit something while you are in the process of reacting. On top of that a margin needs to be built in because this is not the kind of thing where "mostly right" is ok. Enough margin needs to be built in so that it is extremely unlikely that two vehicles will hit each other. That means that even the most obnoxious tailgater leaves considerable space. And the timid may leave a ridiculously large amount of space.
A standard number for the capacity of a highway car lane is 2000 cars per hour. That translates to a bumper to bumper distance between cars of about 160 feet. I drive a big beast of a car. It is almost 20 feet long. If all the cars on the road are about 20 feet long that means that following each car is 7 car's worth of empty space. If we could somehow jam cars bumper to bumper the same freeway lane could handle 8 times as much traffic. With cars driven by people you can't do that. The situation on city streets is not as bad. The cars are, on average, much closer together. But the idea is the same. And then there are those pesky traffic lights. I spend a lot of time stopped waiting for traffic lights. And I can't tell you how much of that time I have spent stopped even though there is no one coming.
Remember the part where cars will soon be talking to each other. Well how about putting a "car" at each intersection. It wouldn't actually be a car. It would instead be the traffic light system. It could tell my robot car when the light was going to change. That might help. But much more is possible. Most traffic lights are connected to sensors in the road that detect cars. Pretty much the only thing this information seems to currently be used for is to decide whether or not to cycle the "left only" signal. Smart traffic lights could also use the information to retime the light cycle on the fly. This should allow the lights to cycle in a more efficient pattern.
The sensors in the road can also be used to continuously monitor the amount and timing of traffic. This would allow the signal duration to be dynamically adjusted to allow for increases or decreases in traffic no matter when or why they happen. Many lights now have a "night" pattern or a "rush hour" pattern. But these are hard wired in and only infrequently changed. It is very expensive to gather the data and make the changes so it is rarely done. And patterns are set for average or expected or typical conditions rather than actual current conditions.
So we can get the traffic lights to work better. We can have the signal let the cars know when the signal is going to change. The information can also flow in the other direction. My car can also tell the signal when it needs the "left turn" cycle activated or that it is going to be making a right turn so there doesn't need to be a "through" cycle if it's only for my car. That sort of thing effectively increases the capacity of streets. And, where it makes sense, increasing speed limits also increases capacity. If the separation between cars doesn't need to be increased then a higher speed limit increases the capacity of the street. Computers in cars do not become inattentive and they can react very quickly. So once most cars on the road are robot cars we can substantially increase (double? triple?) the effective capacity of streets. This means the same streets can handle a lot more traffic or the same amount of traffic can be handled by a far more modest street system.
And then there is this. Most people now want a car that is their own. Part of it has to do with the fact that a car is a statement. Forty year old men driving a muscle car are making a statement. But so are twenty-five year old women driving a cute pink car. The auto industry has come up with pretty much whatever kind of vehicle you need to make whatever kind of statement you want to make. Then there is the fact that some people haul a lot of stuff around. They need a car of their own because it needs to have their stuff in it. And so it goes. But then there are other people who just don't care. If they want to make a statement they want to do it some other way. Or they see a car as basic transportation. If you can get them to where they want to go they don't care how it is done. At present most of us find a car to be the most practical option. But what if that were not true? What if there were other practical options?
Some people manage to get along without a car. One trick they employ is to occasionally use a taxi. If you only need a car once in a while it is cheaper and may be more convenient to cab it. And we now have Lyft and Uber. They provide what is essentially a taxi service but it is cheaper and more convenient. At least that's their story. But we can go a lot further in this direction in a robot car environment. What if you don't own the car you summon? Say some of the cars in that garage we were talking about before are pool cars. They are available for anyone to use. If an appropriate car shows up and gets you to where you want to go does it have to be a car your own? For some people it does but for others that is not a requirement.
Robot cars allows us to take the taxi/uber/lyft model even farther. Presumably the direct cost per mile would be higher. But the purchase and maintenance costs would be zero so that actual cost would be lower. And now the number of cars it takes to make everybody happy drops substantially so the demand for parking drops and the urban planners get to reduce the amount of pavement. That makes them happy and us happy because all of us like more greenery in out lives.
And lots of people currently buy more car than they routinely need. I have a big beast. But most of the time there is only me so it is overkill. If I could summon a small car when that's all I need but get a big car for those few times that I need one then I will, on average, be in a smaller, more efficient car, than what I now use. Yet I will have something that in a practical sense works better than what I now have. This will not work for everyone. But it will work for a lot of people.
If you are an "I hate cars - period." person none of this will be persuasive. But if you are in an "I hate cars for the following specific reasons" person or if you are an "I have and use a car because there is really no practical alternative" person then I have shown you a future that looks pretty good. And it looks like robot cars will arrive sooner than I expected them to. And that's even better. I, for one,. can't wait.
Not a lot of time has passed since my previous post. But cars are now evolving at warp speed compared to the historical norm. The first car I drove was a 1950 Plymouth. It was one of the first cars to sport a new and, at the time "cutting edge", feature. Most cars built even a year earlier required you to stomp on a button on the floor to get the engine to turn over and start. This car contained a technological advance. You could make the engine turn over and start by giving the ignition key an extra bit of twist. The car my dad bought was the cheapest Plymouth on the lot. That car did have the new feature but it did not sport what were then options including electric turn signals, a clock, or a radio. But many other cars of that time did come equipped with all three. So, if you had bought one of those other models it would have driven just like any "stick shift" car made in the next 50 years.
While I was in college in the late '60s I drove a '58 Pontiac. It had an automatic transmission (and turn signals, a clock and a radio). It turns out that driving that car was pretty similar to driving any "automatic" produced in the next 50 years too. But in roughly the last decade cars have started changing quickly. A couple of years ago I drove a car that literally had a push button. You push the button to tell the computer that you want to start driving (or that you are done). That's a really different experience than the old "put the key in the ignition and go through the rest of the rigmarole necessary to get the engine to start" routine. In fact with many cars now you don't even have to put the key in the ignition at all. As long as it's in your pocket you are good to go.
And that's not even the current cutting edge. A friend of mine has a Toyota Prius. It has the same push button (and key in the pocket) setup but what happens when you push the button is now radically different. Now he no longer controls what is happening with the engine. The computer does. He pushes down on the "gas pedal" but now all that does is tell the computer you want to go faster. The computer figures out how to make it so. What's going on?
I recently saw a story about a $9 computer. The basic package does not include everything. There's no power supply or keyboard or monitor. But the same people that sell the $9 computer will sell you an add on that includes all this stuff and it costs $15. So you can get the whole package for about $25. Why does that matter? Because that $9 device includes a CPU, RAM, a solid state disk, and a number of standard ports you can plug stuff into. It is powerful enough to run real computer programs. And it costs $9 if you buy them one at a time. My point is that large amounts of computer power is now really cheap.
That means that car companies can afford to put a powerful computer in your car. And that computer has access to power and it will be designed to get inputs from things like the gas pedal or various sensors scattered round the car and it will be designed to send outputs to things like controls on the engine or actuators on the transmission or whatever. So to add a computer to a car costs the car maker $9 or possibly quite a bit less. And, if you can use the computer to replace something like the old complex machinery that figured out when to shift automatic transmissions you can save the cost of the components you are replacing. In fact, replacing components with a computer can actually save a lot of money. The computer has a negative "cost".
The tipping point on all this was reached about 10 years ago. I currently drive a '99. It has a limited amount of computer capability. But the same make and model of car made only five years later has several much more powerful computers, each dedicated to a different task. That is now just the cheapest way to go for the car companies. And computers keep getting even cheaper and even more powerful.
I talked about the DARPA challenge that kicked this whole "robot car" thing into high gear in my previous piece. To pull that off then contestants had to jam many thousands of dollars of expensive computer and sensor equipment into the cars. It was hard getting everything to just fit and function. But car companies have gotten better and better at integrating computers into cars. And the sensors have gotten incredibly small, incredibly cheap, and incredibly frugal in their power consumption. Why? Because in many cases what we are talking about are smartphone components.
Smartphones are small and have tiny batteries that don't work very well. So cell phone components have to be small and have to be very frugal when it comes to power consumption. They are still relatively expensive. If you bought an iPhone 6 without most of its cost being hidden in your monthly phone bill it would cost about $600. That's a far cry from $9. But you can now get a phone with the capability of an iPhone 1, introduced in 2007, for perhaps $100. It would look pretty wimpy and pathetic sitting next to an iPhone 6. But the iPhone 6 costs now what the iPhone 1 cost then. The big difference is that the new components that are so much more powerful and so much more capable now cost what the iPhone 1 components cost then. The price of this sort of thing is plummeting at an astounding rate. And it is going to keep plummeting.
This is reflected in the features you find on new cars today. The capabilities that were available on perhaps one or two high end cars in 2011 included sophisticated cruise control, blind spot detection, collision avoidance, and collision alert when you are backing up. All of these features and more are now available on mid-priced cars. But the "same" features on these new cars work much better now than they did then. These include the ability for the car to find the lane markers and keep you in your lane and a feature that tries to figure out if you have nodded off behind the wheel. And, as the late night infomercials have it, "but wait - there's more". Car makers are rolling out new and improved features like they are in the fashion business.
One thing I pointed out in my previous post was the importance of cars talking to each other. That looked like a problem then. But the Federal Government stepped in recently and is now coordinating a project to standardize inter-car communication. That problem got solved before most people even knew there might be a problem. The rate at which cars are gaining intelligence is astonishing. And perhaps most astonishing is that several car makers have announced that they will be selling robot cars by 2020. That's only five years from now. Even more astonishing is the fact that it looks like they will hit their target date.
There is always someone willing to try to scare people. With respect to robot cars the standard line is "what if a robot car goes berserk and kills a bunch of people?" It could happen. But look at Google's experience. I was able to report in 2011 that a Google car had been in an accident. I can now report that Google cars have been in 11 accidents. And something surprising, at least to the "kill a bunch of people" crowd has happened. In all but one of those accidents it was obviously the fault of the other person. The accident that was not caused by the other driver happened while the car was being driven by a person not the automation.
The most common accident scenario has been where the Google car is stopped at a stop sign or a traffic light and someone rear ends them. The accidents were not the result of the stop. The Google car had been stopped for a while when it was hit. The other driver was just not paying attention. And all the logs and readouts were able to unambiguously and with great detail and specificity tell the tale of exactly what happened and who was at fault. The attention of robot cars does not wander. They do not text while driving. Or, if they do, they are able to multitask so the quality of their driving does not suffer. It is very likely that robot cars will make the roads safer, much safer. Robot cars also do not drive drunk. By far the most difficult problem the robot car people have had to cope with is other cars being driven by people.
I am sure that when robot cars first become available they will not be for most people. For one thing they will be expensive. And a lot of people will be unwilling to trust their lives and those of their friends and loved ones to a robot. I expect that concern to disappear pretty quickly. The cost problem will take longer. I expect the first robot cars that hit the road to be quite sophisticated. But I think they will follow the iPhone model. The first iPhone blew everybody away. Until, that is, the iPhone 2 came out. Apple has succeeded in making each generation of the iPhone more cool than the previous one.
I expect to see the same thing with robot cars. With the iPhone Apple saw how people were using them and that suggested improvements. Also, so many iPhones were sold that the parts manufacturers were able to figure out how to make the same part more cheaply or a better part for the same cost. So later iPhones had better hardware. Apple turned that into new features or old features that worked better.
I don't expect robot cars to sell in the numbers iPhones do. But advances in smart phones will help car makers out as will experience gained as many cars hit the road. I think robot car 2.0 will be much better than robot car 1.0. And then 3.0 and 4.0, etc. will all be a big improvement on the previous generation model. iPhones have been around for less than ten years. Every time a new model rolls out people ask "how can they make the new model better than the old one"? So far Apple, and the other smart phone makers, have figured out an answer that generates an incredible volume of sales. At some point this will stop. But I have no idea when it will be. I think it will take longer for robot cars to get to the point where the new models don't not seem like that much of an improvement over the old one. But I am not going to try to guess how long that will take. Instead I am going to apply my crystal ball to a other related issues.
As I covered more thoroughly in the previous article there are people that think cars are the root of all evil. I think like an engineer. Engineers don't think "cars are evil". Instead they think "what are the problems with cars?" Then, if they agree that this or that actually is a problem they go on to ask "what is the best solution?" If the best or only way to fix the problem is "get rid of cars" then "get rid of cars" becomes the engineer's solution of choice. But the focus is on solving the problem and not some moral judgment about whether cars are good or bad. We live in a world where people like to fixate on the moral judgment to the exclusion of trying to find the best solution to the problem. But instead of doing that I am going to apply the engineer's perspective to a couple of problems associated with cars. I am going to skip over the "is it a real problem" part because I think both of these are real problems.
The two issues I want to address are pollution and streets. Let me start with pollution. Cars turn gasoline into several different nasty things. One of them used to be smog. Smog is smoky, smelly, and unhealthy stuff hanging around in the air. It is unpleasant. It blocks our ability to see blue sky and fluffy clouds. It also just smells bad. So it is an aesthetic disaster. But it also turns out to be a health disaster. It does terrible things to your lungs. Smog in the US is mostly a thing of the past.
Changes to the formulation of gasoline and to how cars work got rid of the problem. Some places still have a smog problem some of the time but for most of us it is pretty much a thing of the past. The guts of a car (and the chemistry of gasoline) are now quite different than they used to be but it turned out to be possible to fix cars so that they did not create smog. China has a terrible smog problem. And some of this is caused by cars. But most of it is caused by coal fired power plants. And modern designs for cars and gasoline would take care of the car part of the problem. So China can fix its smog problem. It just has to decide to fix it and then do so.
That's an example of where the solution was not to get rid of cars but to make changes so that the problem went away. If smog was the whole problem we would be done. But it isn't. It was just the most visible and the easiest problem to fix. The big problem that everyone knows about is carbon dioxide (CO2). If you have a gas (or diesel) car it is going to make lots of CO2. There is just no getting around this. If you switch to Natural Gas as a fuel the amount of CO2 goes down but it is not eliminated. If you switch to Hydrogen you can eliminate the CO2 problem. But I indicated in 2011 what the problems with Hydrogen are. I still think they are insoluble so I don't see Hydrogen ever going anywhere.
The best you can do is to manage the problem to minimize it. There is plenty of room to make cars much more efficient. That's why I am a fan of hybrids. I think you can get the amount of CO2 per mile way down from where it currently is. A car's basic purpose is to move around. To make this work you need a way to have a large amount of stored energy move around with the car. A gas tank full of gas represents an unbelievably large amount of stored energy. It is so vastly superior in this role to anything currently available that I frankly have trouble imagining an alternative. But we can do a lot better at getting the most out of what is there. In almost all cases burning generates CO2. And lots of the burning we do does not have mobility issues. So I think there are lots of ways to drastically cut the amount of CO2 produced in these situations where mobility is not involved.
Now I would be delighted if I could justify tossing out the entire preceding paragraph out. If someone comes up with a decent battery, a device that can store and release a lot of energy at a small cost in terms of volume, weight, and money, then I would be all for all electric cars. A good battery would make all kinds of approaches to CO2 reduction possible. That would mean that we could ditch the whole hybrid thing for something much better. The good news is that between 2011 and now there has been some progress in battery technology. The bad news is that the amount of progress has been very modest. Batteries still suck. And I see nothing currently on the horizon that looks promising in terms of a large improvement in batteries. We should do what we can to reduce CO2 emissions from cars and other vehicles but we are not going to get it to zero or anywhere near zero. I wish I had better news on this front but I don't. The same is not true about the other issue.
I know a couple of people that know a lot about urban planning and that sort of thing. Both of them do not like how much of a city ends up as pavement (streets and parking). In actual use streets are very inefficient. We get in our car and drive somewhere. On both ends there has to be someplace to park the car. And we go to several places. So we don't need two places, on average, to park our car. We need more like ten. Now if you drive to the mall today but don't tomorrow the parking place you use today can be used by someone else tomorrow. But you don't go to two or ten places in your car. You go to hundreds or thousands. So, on average, many parking places have to be provided for things to work. That means vast amounts of land devoted to parking.
Then there are the streets that connect everything together. First, there has to be a street to wherever you might want to go even if you don't do it very often. Then there has to be enough capacity so that you can go there when you want. It doesn't matter if the street is wide open at three in the morning if you want to go there at three in the afternoon. So in the same way that there needs to be lots of parking spaces for each car there needs to be lots of streets to handle the traffic. So here too the average utilization is low. And that bugs the urban planners. They like alive and green not paved and barren. And most people agree with them. It seams reasonable to be unhappy about the amount of land area in a city devoted to streets and parking. It seems reasonable because it is.
The standard urban planner solution is to replace cars with feet or bicycles or mass transit. I looked at those options previously too. So now let me focus on how robot cars can make things better, possibly a lot better. I am going to start with a simple idea: If a car can drive itself it can park itself. Ok, how does this help? Consider the present situation. When you are home where's your car. It's in the garage or on the street. Why? Because you don't want to have to hike a long distance to get from your car to your home. But the need for close in parking goes away if the car can drive itself. It can be waiting close at hand when you want to go somewhere but it can be somewhere else the rest of the time. It can also drop you off then go away when you return. You don't need to have an attached garage or on street parking any more.
As long as the car is reasonably close, say within a mile, it can get to your door in almost no time. An application on your phone to summon it a minute or so before you need it is not hard to implement. Your phone, if you have a smartphone, already has much more complex applications running on it now. So that takes care of the home end. On street or on premises parking is no longer needed where you live. And the same kind of approach also works at the other end. As long as you car can be summoned quickly it does not need to be parked within a few steps of your destination. Then there's the in between part.
There are expectations about how close you will stick to the car in front of you. They are based on an average plus a margin. On average a driver can react to changing circumstances in a certain period of time. You need to be far enough away so you don't hit something while you are in the process of reacting. On top of that a margin needs to be built in because this is not the kind of thing where "mostly right" is ok. Enough margin needs to be built in so that it is extremely unlikely that two vehicles will hit each other. That means that even the most obnoxious tailgater leaves considerable space. And the timid may leave a ridiculously large amount of space.
A standard number for the capacity of a highway car lane is 2000 cars per hour. That translates to a bumper to bumper distance between cars of about 160 feet. I drive a big beast of a car. It is almost 20 feet long. If all the cars on the road are about 20 feet long that means that following each car is 7 car's worth of empty space. If we could somehow jam cars bumper to bumper the same freeway lane could handle 8 times as much traffic. With cars driven by people you can't do that. The situation on city streets is not as bad. The cars are, on average, much closer together. But the idea is the same. And then there are those pesky traffic lights. I spend a lot of time stopped waiting for traffic lights. And I can't tell you how much of that time I have spent stopped even though there is no one coming.
Remember the part where cars will soon be talking to each other. Well how about putting a "car" at each intersection. It wouldn't actually be a car. It would instead be the traffic light system. It could tell my robot car when the light was going to change. That might help. But much more is possible. Most traffic lights are connected to sensors in the road that detect cars. Pretty much the only thing this information seems to currently be used for is to decide whether or not to cycle the "left only" signal. Smart traffic lights could also use the information to retime the light cycle on the fly. This should allow the lights to cycle in a more efficient pattern.
The sensors in the road can also be used to continuously monitor the amount and timing of traffic. This would allow the signal duration to be dynamically adjusted to allow for increases or decreases in traffic no matter when or why they happen. Many lights now have a "night" pattern or a "rush hour" pattern. But these are hard wired in and only infrequently changed. It is very expensive to gather the data and make the changes so it is rarely done. And patterns are set for average or expected or typical conditions rather than actual current conditions.
So we can get the traffic lights to work better. We can have the signal let the cars know when the signal is going to change. The information can also flow in the other direction. My car can also tell the signal when it needs the "left turn" cycle activated or that it is going to be making a right turn so there doesn't need to be a "through" cycle if it's only for my car. That sort of thing effectively increases the capacity of streets. And, where it makes sense, increasing speed limits also increases capacity. If the separation between cars doesn't need to be increased then a higher speed limit increases the capacity of the street. Computers in cars do not become inattentive and they can react very quickly. So once most cars on the road are robot cars we can substantially increase (double? triple?) the effective capacity of streets. This means the same streets can handle a lot more traffic or the same amount of traffic can be handled by a far more modest street system.
And then there is this. Most people now want a car that is their own. Part of it has to do with the fact that a car is a statement. Forty year old men driving a muscle car are making a statement. But so are twenty-five year old women driving a cute pink car. The auto industry has come up with pretty much whatever kind of vehicle you need to make whatever kind of statement you want to make. Then there is the fact that some people haul a lot of stuff around. They need a car of their own because it needs to have their stuff in it. And so it goes. But then there are other people who just don't care. If they want to make a statement they want to do it some other way. Or they see a car as basic transportation. If you can get them to where they want to go they don't care how it is done. At present most of us find a car to be the most practical option. But what if that were not true? What if there were other practical options?
Some people manage to get along without a car. One trick they employ is to occasionally use a taxi. If you only need a car once in a while it is cheaper and may be more convenient to cab it. And we now have Lyft and Uber. They provide what is essentially a taxi service but it is cheaper and more convenient. At least that's their story. But we can go a lot further in this direction in a robot car environment. What if you don't own the car you summon? Say some of the cars in that garage we were talking about before are pool cars. They are available for anyone to use. If an appropriate car shows up and gets you to where you want to go does it have to be a car your own? For some people it does but for others that is not a requirement.
Robot cars allows us to take the taxi/uber/lyft model even farther. Presumably the direct cost per mile would be higher. But the purchase and maintenance costs would be zero so that actual cost would be lower. And now the number of cars it takes to make everybody happy drops substantially so the demand for parking drops and the urban planners get to reduce the amount of pavement. That makes them happy and us happy because all of us like more greenery in out lives.
And lots of people currently buy more car than they routinely need. I have a big beast. But most of the time there is only me so it is overkill. If I could summon a small car when that's all I need but get a big car for those few times that I need one then I will, on average, be in a smaller, more efficient car, than what I now use. Yet I will have something that in a practical sense works better than what I now have. This will not work for everyone. But it will work for a lot of people.
If you are an "I hate cars - period." person none of this will be persuasive. But if you are in an "I hate cars for the following specific reasons" person or if you are an "I have and use a car because there is really no practical alternative" person then I have shown you a future that looks pretty good. And it looks like robot cars will arrive sooner than I expected them to. And that's even better. I, for one,. can't wait.
Subscribe to:
Posts (Atom)