Saturday, September 30, 2017

The Winds of War

"The Winds of War" was a TV phenomenon when it aired on ABC as a miniseries in 1983.  It was over 14 hours long.  Its seven episodes were broadcast over an eight day period (as close as you could come to binge watching back then).  Each broadcast attracted an average of 80 million viewers.  Something like that is impossible today because, to quote the cliché, things were different then.  We didn't have the internet so streaming was impossible at the time.  And there were a few cable channels around but not the hundreds available now.  So on most evenings roughly 80% of the viewing audience was dialed into one or the other of the "big three" TV networks, ABC, NBC, and CBS.  Still, attracting an audience that size was a rare occurrence even then.  The only other event to achieve a similar or even greater level of success was the broadcast of the miniseries "Roots".

I was not a fan of "Winds" at the time.  I expected the usual slam bang war movie and I got something quite different.  So I was not one of the 80 million.  But I came across the book a few months ago for the right price (free) and found I quite liked it.  But this time around I was prepared to accept it on its own terms.  And for what it was instead of what I thought it was supposed to be it was quite good.

It was based on the 1971 book of the same name by Herman Wouk.  He was intimately involved in the production of the TV series so it was faithful to the book.  The book and the miniseries were one part of a "two parter".  The second part was called "War and Remembrance" and it too started out as a book (published in 1978) that was eventually also made into a miniseries (broadcast in 1988 using essentially the same cast as "Winds").  It too was successful but not quite as successful as "Winds".  And Wouk always considered them to be a single work.  He just had so much to tell that it wouldn't fit into one book.  So now that I have stalled around for a while what were they given that they were not yet another war story.

Together (but I am going to focus mostly on part one) they constituted a meditation on World War II.  Part one ("Winds") covered 1939 through 1941.  Part two ("Remembrance") covered 1942 through 1945.  In both cases they followed the fictional Henry family, the most important member of which was "Pug", the father.  The basic structure was a "family drama" soap opera with the war as the background.  And Pug or a member of his extended family just happened to end up present at many of the critical events of the War.  So we got to see the War through their eyes as they observed what was going on around them.

And, although the structure was a soap opera the soap aspects were not the most important thing going on.  There was enough family drama to allow us to get to know and like the various family members.  And Wouk did this aspect to the books well enough that it captured and maintained our attention.  And the fighting and dying that constitute the bulk of the typical war movie were also not the main point.  The main point was to understanding the thinking of the various groups of players involved in the War.  If you know what and how people think you can understand why they did what they did.  That was Wouk's main objective with the books and he did it very well.  This sort of thing is harder to pull off in a miniseries than in a book.  So it doesn't come through as strongly in the miniseries but it does come through there too.

Wouk did this very well and I thought that was the main point and the principal benefit of the exercise.  One or more of the extended Henry family would interact with various characters.  Various speeches or writings or musings were incorporated naturally into the action.  This allowed a representative of each of the various groups to say what was on their mind.  This "data dump", as we now call it, is very hard to pull off without boring the reader or viewer.  Wouk does a great job.

To give you an idea how hard this is to do compare how the same problem is handled in the "Game of Thrones" TV show.  They use a technique fans have dubbed "sexposition".  Beautiful people are engaged in a variety of sex acts while someone is giving a long speech explaining something the audience needs to understand.  The sex keeps the viewer engaged while they are learning what they need to know.  Wouk did not have access to that particular trick.  And that makes his achievement all the more impressive.  So what were the various groups thinking?

Wouk focuses primarily on Europe so Japan gets short shrift.  But we do get a brief look inside the minds of the Japanese.  We get a much better look inside the minds of the US, the British, the Germans, and the Russians.  Let me start with a few background remarks on the Russians.

The Russians were a case of "the enemy of my enemy is my friend".  For a number of reasons the US didn't like the Russians or, if you prefer, the Communists, or technically the Union of Soviet Socialist Republics (USSR), before the war.  And the relationship went south quickly after the war.  But the War was a close run thing particularly in the early going.  So if the Russians could be enticed to fight on our side it made it easier (and some would say possible) to defeat the Germans.  And there is a simple reason the Germans were our enemy.  They declared War on us.

The Germans, Japanese, and Italians were allied as the "Axis Powers".  The Germans declared War on us because we were at War with the Japanese as a result of Pearl Harbor and the Japanese were their ally  The Italians also declared war then later changed their minds.  (It's complicated.  Read up on World War II history if you want the details.)  Getting back to the Russians, they were at War with the Germans when we entered the War.

And the fighting on the "Eastern Front" between the Germans and the Russians was by far the fiercest of the War.  So it was a simple tactical calculation to connect up with the Russians during the War then do what we needed to to keep them in the fight.  They were suffering horrific losses but also inflicting horrific losses on the Germans.  Most people know little about the Eastern Front and Wouk does a great job of covering it.  The greatest tank battle of all time by far happened on the Eastern Front.  Battles resulting in hundreds of thousands of soldiers being taken prisoner by the winning side happened not once, not twice, but several times on the Eastern Front.

The fighting on the Eastern Front was as viscous or more viscous than at say Guadalcanal, or Iwo Jima, or anywhere else on any of the other fronts.  And the numbers of soldiers fighting on the Eastern Front was also far greater than elsewhere.  But after the War is when the books come out.  And by that time the Russians were back to being our enemy.  And on top of that the Russians were very secretive.  So the focus stayed elsewhere and anyone who isn't a history buff typically knows little about what went on there.

So what were the Russians thinking?  By not very credible contrivances Wouk gets Pug into Moscow where he meats Stalin a number of times and manages to wangle a trip out to the front where he can talk to Russian soldiers and see for himself what's going on.  And there is a clear story.  The Russians had an inferiority complex while simultaneously being full of pride.  This seeming contradiction is actually quite common and not at all confined to the Russians.

But in particular the Russians had been invaded by a western power when Napoleon invaded in the early 1800s and when the Germans invaded in World War II.  In the middle, World War I was an embarrassment for the Russians.  And they got effectively invaded shortly after the end of World War I.  The west strongly supported an effort to roll back the Russian Revolution just after World War I.  So the Russians had good and sound reasons for having little or no trust for anyone in the west.

So they did the "Poland" deal (see below for more details) with Hitler in the run up to the War.  Then they were surprised when Hitler reneged and invaded them.  Once the War was on it was on.  But the cost to Russia was horrific and it frequently crossed Stalin's mind that he might also get back stabbed at some point by the British and the US.  So he was thin skinned and always on guard.  Roosevelt countered by giving the Russians vast quantities of every kind of supply through "Lend Lease" and publicly talking them up.  This was followed on by the US State Department initiatives on Roosevelt's specific orders.

But that didn't stop various Republicans from attacking many State Department officials after the War for being "soft on Communism".  Wouk does a great job of showing how and why all this played out as the War progressed.  And he shows how these actions were the right thing to do at the time and actually had nothing to do with any love for or support of Communism.  Anyone who was knowledgeable about military or diplomatic issues of the period would know all this.  But many people who knew better ignored all this because they could gain political advantage by doing so.  On to Germany.

The conventional wisdom is that Nazi Germany was somehow special.  This resulted in the Germans being accused of doing things that "are just not done by civilized people".  But are the Germans, and especially the Germans of this period, really different from people like the French, British, or especially Americans?  Wouk spends a lot of time on this.  Here are some quotations from the books:
How come he is their leader?  Haven't they read his book [Mein Kampf]?  How come they don't put him in a padded cell?
Or:
This able and resolute homicidal maniac used modern Germany as his murder instrument, directly caused between twenty-five and thirty-five million human deaths. . .  Had the German people shut this strange individual away in an insane asylum, instead of setting him up as their adored leader and throwing their full strength behind him for twelve years, these deaths and this waste would not have occurred.
Or:
On the historical record Adolf Hitler was certainly the worst liar, double crosser, destroyer, and mass murderer in the world's annals. 
Or:
Why the Germans committed themselves to him remains a historical puzzle.  They knew what they were getting.  He had spelled it all out in Mein Kampf.  He and his National Socialist cohorts were from the street gang of recognizable and very dangerous thugs.  But the Germans by and large adored and believed in these monsters right up to the rude Stalingrad [a giant German defeat on the Eastern Front] awakening, and even long afterward.
This represents the conventional wisdom.  The Germans should have recognized what Hitler was from the beginning and rejected him.  Or they should have figured out that they had made a terrible mistake and rectified it well before the end of the War.  But is the conventional wisdom true?  I don't think so.

The historian Barbara Tuchman goes into the political and cultural climate that preceded World War I in her book "The Proud Tower".  She covers the start of World War I and the first few weeks of the fighting in her book "The Guns of August".  Her conclusion (and that of pretty much anybody else who has seriously studied the situation) was that Germany did nothing unusual nor particularly wrong in the run up to World War I.  Nor did Germany do anything particularly wrong in how she behaved during the War.

But Germany lost.  And the leading British (Lloyd George) and French (Clemenceau) politicians had made promises to their respective publics before and during the war.  And in each case the promise boiled down to "they will pay".  So when the Treaty of Versailles, the document that sealed the peace after the War, was drawn up it imposed massive "reparation" payments by Germany to France and Britain.

Germany ended up with a democratic political system after the War.  But there was no way that Germany could meet her Versailles obligations.  So she didn't.  But the effort to do what she could ravaged the German economy.  And this was during the "Roaring Twenties" when most economies were doing very well.  The Great Depression just made thing worse.  The British and French now needed the reparation money even more than before.  And the Germans were in an even worse position to deliver.  This resulted in a literally intolerable situation in Germany.

Hitler promised that if he was put into power he would repudiate Versailles and he did.  He gambled correctly that neither Britain nor France would be in a position to do anything meaningful about this.  This repudiation immediately took pressure off the German economy.  So business interests were happy because business conditions immediately improved.  And this in turn led to hiring, which in turn led to an improvement pretty much across the board for Germans at all economic levels.  Hitler was widely seen within Germany as having delivered on his promises.

Hitler then moved on to phase two.  Versailles mandated that Germany be limited to having a small military.  With the treaty repudiated Hitler was able to build up the military, which he did.  This made the military and their supporters like what we now call the defense industries very happy.  It also resulted in still more economic activity, which was good for almost everybody else  Again, Hitler was delivering on a promise.

And that led him to move on to phase three, military adventures.  He started slowly by overtly intervening militarily in the Spanish Civil War.  He gambled that the British and French would again be too weak and distracted to take effective action.  And he won his gamble again.

The loss of World War I and the subsequent penalties assessed against Germany had caused Germany to lose a tremendous amount of stature on the world stage.  The Spanish Civil War got them a small amount back.  And Hitler's gamble had worked so well there that he saw no reason not to engage in more risky military adventures.  So he did and they worked.  His calculation that there would be no effective response turned out to continue to be true.  And each adventure added to Germany's stature on world stage.  Germans now felt free to feel good about themselves and their country.

I am not going to go through all these adventures.  But there were a number of them.  They kept getting bigger and bigger but Hitler kept pulling them off.  And each adventure was often preceded by many predictions by many of Hitler's opponents that "it may have worked last time but you'll never get away with it this time".

This string continued all the way until 1939.  Hitler did a deal with Stalin to split Poland in half with the western part going to Germany and the eastern part going to Russia.  This was a key to success.  With Russia taken care of it meant that Germany could embark on yet another military adventure (invading Poland) confident that it would succeed and suffered little or no loss.  This victory, like the ones that preceded it, were cheap in terms of German blood and treasure.  And by this time Hitler had proved his detractors wrong over and over.

But Poland was the last straw for Britain and France.  They both declared War on Germany.  So Hitler is finally in trouble, right?  No!  He launched a "blitzkrieg" offensive into France that was wildly successful.  France folded up like a piece of prop furniture in a movie fight scene and the Brits were forced to live through the humiliating events portrayed in the recent movie "Dunkirk".

So where are we at this point?  The German public for the most part has every reason to be quite happy.  The economy is humming along.  Hitler has delivered victory after victory at little or no cost.  Germany now controls most of Europe and can legitimately claim to be what we would now call a superpower.  And this has all happened in less than ten years.  What's not to like?

Well, if you are a Jew there is a lot not to like.  The worst of the abuses of Jews is yet to come but things are already bad enough.  They have been blamed for everything short of dandruff and the common cold, all unfairly and with no serious justification for the accusations provided.  They have been rounded up and forced into ghettos and the bulk of their possessions have been stolen.  Civil liberties for everyone, not just the Jews, are non-existent.  So opposition political parties, newspapers, etc. no longer exist and a goodly number of political prisoners have been locked up on trumped up charges.  And the Nazi controlled media is cranking out "feel good" news and suppressing the depressing kind so why not just go along?

If you follow orders (relatively easy for most people to do) and don't make waves it's all good.  Most, say 90%, of Germans have good reason to believe that things are much better than they used to be and, given Hitler's track record, that this is likely to continue into the future.  Hitler has made all these seemingly outrageous promises.  The people who are supposed to be experts have been saying he will fail.  But he has consistently succeeded instead.  So why should any of that change now?  And what if a few Jews got roughed up and treated badly?  And what if a few rabble rousers had mysteriously disappeared or ended up in jail?  They were a bad element that we "good Germans" never liked or trusted anyhow.  "Everybody I know is doing just fine."

So the behavior of the German people is all too understandable.  And it doesn't seem abhorrent to me.  People are good at being selectively blind when it is to their advantage.  By being selectively blind the German people did very well for themselves until it was too late to easily extricate themselves.

The Germans then invaded Russia and initially it looked like it would be yet another quick and easy victory.   One contributing factor was that Stalin had systematically purged most of the senior members of the Russian military in the '30s.  This meant that when the invasion finally happened much of the best talent was dead and those that survived tended to run scared.  This is not a good recipe for producing generals who will know how to fight back effectively..

There is a theory that Stalin cynically did the Poland deal with Germany to give himself time to build Russia up so that it could better deal with a German invasion.  Wouk uses the eyes and ears of his various characters to show that if that was the plan it was implemented very badly.  Russia was only slightly better prepared to deal with Germany when they actually invaded than they had been when he signed the treaty.  So why did Russia prevail in the end?

Wouk does an excellent job of walking us through this.  First of all, Russia is a very large country measured either by land mass or by population.  It is far larger than Germany, even a Germany swollen by all its conquered territories.  Second, Stalin changed his behavior immediately after the invasion.  He immediately halted the purges and he turned out to be a good talent spotter.  He quickly identified military people like General Zhukov and supported them.

He also wrapped himself in the Russian flag even though he was actually from Georgia.  (Similarly, Hitler was Austrian, not German.)  The Russians call World War II "The Great Patriotic War" and they do because Stalin worked the "motherland" angle for all it was worth.  And finally, the US did flood vast amounts of equipment and supplies into Russia.  This made up for the poor condition of Russian industry and meant that in the later stages of the War the Russian armies were well supplied and equipped.

The Russian claim "We did it all by ourselves without any outside help" is just as hollow as others who make the same claim.  But the combination of all these factors resulted in a Russian victory.  And it is a victory that was won at horrific cost.  The Germans applied a "scorched earth" policy to western Russia the most populous and productive part of the country.  The cost to Russia in blood and treasure was only exceeded by Germany.  And remember, Russia was on the winning side.

After the early easy successes on the Eastern Front things went wrong, badly wrong, for the Germans.  Literally millions of German soldiers were lost on the Eastern Front.  Fantastic amounts of equipment was destroyed.  And in the later stages of the war Germany was subjected to horrific and eventually very effective bombing by the west.  And armies on both the Eastern and Western fronts wrecked havoc on Germany when the fighting moved onto German soil late in the War.  And it was during the late stages of the War when Germany should have had other more important things on her mind that substantial resources were diverted from the War effort and devoted to the mass extermination of Jews.

And beyond that there was the whole slave labor thing.  Remember, millions of Russian soldiers were captured in the early years on the Eastern Front.  The Germans excelled in short sighted thinking, especially late in the War.  Long term thinking tells you that you want to keep your work force in good shape through all of their working years so that they can work at peak efficiency the whole time.  But if you engage in short term thinking it is better to literally work people to death.  You can get more productivity out of them for perhaps a year that way.  And that's what they did with Russian prisoners of war.  And they deliberately removed Jews from the work force resulting in absolutely no production out of what had been a highly productive group.

They worked large segments of the populations of the countries they captured, particularly on the Eastern Front, literally to death.  Most estimates of the number of people worked to death are greater than the number of Jews they gassed.  By the end of the War Germany had very little work force left.  German men were in uniform and large populations of other men had been either gassed or worked to death.  If Germany had been able to maintain their territorial gains late into the War they would literally not had enough workers to man all their factories.

The above argument is an economic one.  I have focused on it while seemingly ignoring the moral issues to highlight that what the Germans did was awful no matter how you look at it.

I am now going to move on to bad behavior by others.   I have laid out some examples of bad behavior (a polite phrase that doesn't begin to cover the actual actions) engaged in by Hitler and Stalin.  There are lots more in both cases.  And Japan comes in for a lot of blame for their bad behavior.  So let me go into some of it.

The biggest example is one that most in the west know little or nothing about.  Japan invaded China in a naked attempt at imperialism.  They wanted China's resources.  This invasion started years before the 1939 "official" start to World War II.  And they engaged in horrific behavior.  Google "Rape of Nanking" for an example of Japanese behavior at its worst.  But this was seen in the west as a fight between two groups of non-white people so it was not considered important.  It was specifically not important enough to enable the political support necessary to make western intervention a possibility.  So it ended up a story for which details were sketchy and even those details appeared in the back pages of only a few newspapers.

The western "rules of war" say that when you are beat you surrender and you will be treated reasonably well.  This comes under the general rubric of "giving quarter".  When it came to the Chinese the Japanese gave no quarter.  But in their defense, they expected no quarter in return.  It shocked the Americans when at places like Guadalcanal and Bataan the Japanese treated their prisoners horribly.

Since they expected no quarter Japanese soldiers tended to fight to the last man.  This resulted in truly horrific events like Iwo Jima where only a few Japanese survived out of the over 30,000 present at the start of the battle.  It wasn't an unwillingness of the US to take prisoners.  It was an unwillingness of the Japanese to surrender even when their position became clearly hopeless.  US soldiers behaved better than the Japanese with respect to this sort of thing but there was a lot of bad behavior on the US side too.

The other oft quoted example of Japanese bad behavior are the Kamikazes.  Airplanes were rigged up with large bombs.  Instead of trying to drop the bomb and get away Kamikaze pilots would try to fly the whole plane into an American ship.  This was supposed to inflict maximum damage but it also meant the pilot had no chance to survive.  And it turned out to be relatively ineffective.  Very few planes were actually able to hit an American ship.   This behavior was characterized as being somehow aberrant.  But it is just an officially sanctioned version of falling on a grenade to save your buddies or suicidally charging a machine gun nest.

So the conventional wisdom is that our side was the civilized one and the other side were the uncivilized ones.  But Wouk also includes examples of our side behaving in less than civilized ways too.  The most commonly cited example of this is the bombing of Dresden Germany.  Tens of thousands of "Innocent civilians" were killed by the bombing and subsequent fire storm.  Kurt Vonnegut famously wrote a book called "Slaughterhouse Five" about Dresden.  He was a POW there and one of the few survivors.  There is also the long standing debate about using atomic bombs on Hiroshima and Nagasaki.  But lost in that debate is that the death toll from the conventional bombing of Tokyo was higher.

The idea that "we're the good guys and we are 100% good and they are the bad guys and they are 100% bad" is nonsense.  And it is nonsense even if applied to the Germans or the Japanese.  I think a case can be made that we did more good and less bad than the other guys.  But War is about winning and ultimately you do what you have to do to win.  And that always involves doing a lot of bad things like killing a lot of people.

In western society we want to make a distinction between the military and civilians.  It is somehow okay to kill military people but not civilians.  But an argument can be made and often is that civilians bear responsibility to a greater or lesser extent and, therefore, are fair game.  And inevitably civilians get killed.  Sometime a lot of civilians get killed and other times only a few do.  And whoever wins likes to pretend that they didn't kill anybody unnecessarily but the truth is different.

World War II happened three quarters of a century ago.  But it was the "last good war" and it was fought by the "greatest generation".  So there is always an interest in getting back to those days.  And people want to associate their side with the good guys and their opponents with the bad guys so they do.  The "greatest generation" screwed a lot of things up but we tend to skip over that.  Similarly, it seems like such a good idea to try to create an association between one of the principal bad guys of the period with anybody you don't like.  And in this "go negative" era that happens a lot..  So we all too frequently see an argument made that "X" (sometimes a group, other times an individual) is "just like Hitler" or "just like Stalin".

Whatever their flaws, and they were numerous and terrible, one flaw neither Hitler and Stalin had was being incompetent at their jobs.  They knew how to run a country.  They had both studied politics and the use of power extensively before either of them came to power.   Stalin was a dedicated Communist from a early age.  He had a reputation for competence when the Germans shipped him to Russia before the end of World War I.  And he succeeded in doing what the Germans wanted him to do, namely take Russia out of the War.  He became the dictator of Russia more than a decade later.  By the time World War II started he had spent a decade running the country.

Hitler's depth of experience was not quite as extensive.  He didn't become politically active until after the end of World War I.  But he was a leading influence within the Nazi party almost from the start.  And he famously wrote Mein Kampf while in jail for Nazi related political activities during this period.  So he had roughly a decade of political experience when he became chancellor of Germany in 1933.

In both cases Stalin and Hitler were part of well organized and well established political movements.  So they had a network of like minded people that they knew and could surround themselves with.  That meant they had a large pool of people they were used to working with that they could put in charge of all the things necessary to run the government of a powerful country.  Also, in both cases they were authoritarian leaders.  They were able to use extralegal methods to refashion the political system they led.  This is only somewhat true of Stalin but completely true of Hitler.

Calling someone "another Hitler" or "another Stalin" means you are associating not just the worst but also the best qualities of these people.  This is a charge frequently leveled by various Republicans against President Obama.  And they are correct to the extent that Obama was part of a well established political movement, the Democratic establishment.  Obama leaned heavily on these people.  He had a generally harmonious time in office because there was a great deal of shared values.  So he shares this attribute with Hitler and Stalin.

But another part of the calculus is the whole authoritarian thing.  Obama where possible tried to use legislative tools to achieve his objectives.  And he was successful when he commanded Democratic majorities.  When the Republicans took over he resorted to Executive Orders.  But this is also typical behavior for Presidents.  All Presidents of both parties use Executive Orders.  Some of Obama's were challenged in court.  He had some wins and some losses but that too is the norm.  So his record of authoritarian behavior is conspicuous by its absence.

Then there's the whole "remaking the system" thing.  In terms of the machinery of politics and government power Obama changed nothing.  There have, however, been a number of social changes that happened on his watch.  But the courts, a branch of government not under his control, were the most responsible for these changes.  So Obama flunks the "like Hitler/Stalin" test.

Going the other way the same charge has been leveled against President Trump.  Here too I believe it fails but for entirely different reasons.  President Trump is nominally a Republican.  But he does not have a close affinity with the party.  This means that from a practical sense he is not imbedded in a well established political movement.  So he does not have a large pool of people he trusts to draw on for appointments.  Instead he has a small circle of trusted associates, a pool that seems to number in the single digits.  This severely limits his ability to govern.  He literally can't wield the many levers of executive power because he doesn't know enough people he trusts implicitly to man the myriad levers.

Then there's the experience factor.  Both Hitler and Stalin had a great deal of experience when they attained power.  Trump has none.  So he is literally incapable of making a canny political move because he lacks the background and experience to know what the move would be and how to make it.  Now Trump is definitely an authoritarian-wanna-be.  And Republican elected officials seem ready and willing to help.  But he is just too ignorant and incompetent to be successful.  But he is a master propagandist.  And he is deploying his propaganda skills to attempt to refashion our political system.  It is an open question at this point how successful he will be.

Finally, I want to address the question of whether the Germans or the Japanese were unique in some way and, therefore, susceptible to going wrong in a way that others, particularly Americans, are not.  The easiest issue to address is the whole Kamikaze thing. This was supposed to be unique to the Japanese culture and personality.  But, ignoring the whole "heroic western soldier" thing I talked about above for the moment, we now have suicide bombers.

You can come up with any rule you want as to who they are and where they come from but there will always be exceptions.  It turns out you can find at least a few people in every culture who can be talked into becoming a suicide bomber.  It's definitely not just a Japanese thing.  And the "enhanced interrogation" techniques employed by the US, while they are supposed to differ from how the "bad people" do it, actually don't.  And we drop bombs from drones on civilians.  And people will keep fighting "to the last man" in lots of  lots of circumstances in lots of cultures.

And while I argued above that Trump is not another Stalin/Hitler there are a lot of parallels between the attitudes and ways of thinking of Germans who supported Hitler and Americans who support Trump.  Hitler's message can be paraphrased as "Make Germany Great Again".  For most Germans Hitler delivered on his promise until late in the War.  Trump's base is sticking with him so far in spite of the fact that he has failed so far to deliver on any of his major promises.

If Trump keeps failing to deliver for his supporters how long will that support continue?  If Trump's record of failure continues, the longer they stick with him the more his supporters will be indistinguishable from Germans late in the War.  And his supporters comprise a substantial portion of the US population.  If he keeps failing and they stick with him anyhow it would be wrong to say that those Germans were different than a lot of modern day Americans.

Thursday, September 14, 2017

The Carriage Trade

"The Carriage Trade" used to be how we talked about rich people, people wealthy enough to be able to afford their own carriage back in the "horse and buggy" era.  Carriages are now pretty much restricted to use by tourists and governments when they need to put on a classy public spectacle like a wedding or funeral.  But there are more rich people around than ever.  And there are lots of people who would like to feel at least a little rich at least some of the time.  And catering successfully to the actual rich or even the vicarious rich is a good way to become rich yourself.  So how does it work?

There are lots of things we just don't care about.  So whatever is cheapest is going to be the most successful.  McDonalds followed this business model very successfully for decades.  You got a drive in burger in a hurry and it was very cheap.  They were so successful at this for so long that their competitors gave up on trying to compete on price and speed.  They went to a greater or lesser extent up market.  Burger King, Wendy's, etc. all sold themselves as "a better product that costs more but is worth the additional cost".  Eventually they had some success and McDonalds is now following them up market.

And this "more expensive but worth it" is the next market tier up the ladder from the "cheapest is best" bottom tier.  Here the customer perceives that there are qualitative differences between products in a category and feels that a better product can justify a higher price.  So their may be several tiers of products.  Each higher tier is perceived to have better qualities than the next tier down but as we go up the tiers the price goes up too.

The automobile industry has operated on this multi-tier model for decades.  There are the "economy" models.  They are cheap but get the job done.  Then we move up to the "mid-price" models.  They are nicer looking, better built, and may offer features not found in the economy models.  Then there were the luxury models.  They were the most expensive but also offered the best construction and the most features.  As an example, Ford offered the economy Ford, the mid-price Mercury, and the luxury Lincoln tiers.

I used to drive a mid-price Mercury Grand Marquis.  It was bracketed by the economical Ford Crown Victoria and the luxurious Lincoln Town Car.  The body was the same.  But the trim and features differed as you moved between the models.  (I'm not sure there was any actual difference in construction quality.)  And Ford made a modest profit on each Crown Victoria, more on each Grand Marquis, and the most on each Town Car.  This was balanced from Ford's perspective by the fact that they sold the most Crown Victoria's but the least Town Cars.  Sales of the Grand Marquis ran somewhere in between.

A Lincoln used to be about as luxurious as it got in the car business.  It's market was the well off.  But we now also have the rich, the super rich, and the ultra rich.  So now a Lincoln looks pretty pedestrian.  There are literally dozens of car models that sell for more than a "fully loaded" Lincoln.  A nice Lincoln will set you back maybe $60,000.  But you can buy cars for $600,000, ten times as much.  And some cars cost far more, well into the millions of dollars.

So let's say you have decided to make your fortune by selling super (at least in terms of price) cars or anything else.  How do you go about it?  The first thing to understand is that this game can be played at many levels.  You can aim for the "Lincoln" part of the market.  Or you can aim for higher, say the $600,000 price point.  Or you can aim for the stratosphere, the car that costs a million dollars or more.  It turns out that there are commonalities whichever point you aim for.

But let's start by looking at a failure and one that happened in the most mundane of products, beer.  Anheuser-Busch set out many years ago to make a premium beer called Michelob.  They started distributing it widely in the '60s and you can still find it.  But it never really went anywhere.  This is for a simple reason.  If you are going to sell something at a premium price it has to be distinctive.  Michelob never tasted markedly different than Budweiser.

And it is important to know that it doesn't have to be better.  It just has to be different.  Look at Starbucks, a company playing at roughly the same price point as Budweiser/Michelob.  Consumer Reports panned Starbucks products because they had too much of a bitter taste.   But everybody could instantly tell the difference between a cup of coffee from Starbucks and a cup of coffee from Chock Full o' Nuts, a chain that prided itself on its good coffee.  So when they drank that "premium" Starbucks product they could tell that it was noticeably and obviously different from the "regular" Chock Full o' Nuts product.

And Starbucks is now a mega-company and Anheuser-Busch ended up being sold to a European company called InBev.  In the burger business Wendy's was smart enough to differentiate their product by going with square patties and Wendy's is still around. Car companies change the tail lights and other easily noticed features so that everyone can easily pick out the more prestigious products from the lesser ones.  That's part of what you are getting when you go up market.

And it turns out that the taste of the rich is no better and often worse than that of the rest of us.  There are a bunch of mansions built over a hundred years ago by Millionaires from New York City in the small seaport town of Newport in Rhode Island.  You can tour many of them and I have seen the interior of several.  One or two are quite nice.  But some of them are really tacky.  But they are decorated in a way that calls attention to the fact that they cost a lot of money to build.  They provided a showcase in which the rich could display tangible proof of the extent of their wealth.  So all of the mansions scream "I cost a lot of money" buy many are complete failures at saying "and I have very good taste".

So the most important thing once you get far enough up the scale is to make sure your product says in no uncertain terms "I cost a lot of money".  General Motors used to have a mid-price car line called the Oldsmobile.  (They dropped the nameplate in 2004).  The target market for Oldsmobile cars were people who were willing to pay extra for a well engineered and well constructed car.  And General Motors was able to sell enough cars for a long time to make Oldsmobile a profitable product line.

But at a certain point the accountants took over and the product quality diminished because it was cheaper to put parts from other higher volume product lines into Oldsmobile cars.  Their target market eventually figured this out and went elsewhere.  But my real point here is that relying on quality to the detriment of the "pizzazz" factor works but only up to a certain price point.  But if you move the price above that point the very rich don't value quality enough to pay super-premium prices.  Oldsmobile cars always sold for considerably less than Cadillac cars (the G. M. luxury brand).  If you want to put out a premium product at a premium price you can make that work.  But you can't charge a super-premium price no matter how well made your product is.

Now let's move on to a product with a super-premium price.  How much would you pay for a "top of the line" sound system (something you can play music on)?  For many of us the answer is nothing.  We like out smart phones with their ear buds.  The sound quality is not that good but the convenience is awesome.

Several decades ago most homes and apartments featured a "stereo" sound system.  And the price/quality model was similar to the car model of the same period.  You had the economy system featuring unfamiliar brands that got the job done.  You had the mid-price "component" systems that you could read about in a magazine like "Stereo Review".  Then you had premium brands like Bang and Olufsen or Marantz occupying the luxury niche.  But in the same way that a Lincoln might cost you twice as much as a Mercury, these luxury products cost perhaps twice as much as the mid-price brands.  At that time there really weren't any super-premium product lines.

Times change.  Meet Oswald's Mill Audio, OMA for short.  Jonathon Weiss made a bunch of money in Hollywood and retired while relatively young to rural Pennsylvania.  As a young man he worked in old movie theaters.  There he fell in love with their sound systems, many of which dated back to the '30s.  He got interested in reintegrating key components from these old systems into modern "stereo" sound systems.  He eventually turned this hobby into OMA.

You can spend ten thousand dollars or more to get a custom sound system using premium components installed in your home if you have a mind to.  But an OMA system will cost ten times that or more.  Their top of the line speaker system lists for $300,000.  Other components are priced similarly.  A complete system including installation can easily cost $700,000.  Weiss is doing a lot of things right.  He is selling as many systems as he wants to build, which turns out to be not very many.  So he is doing the important things right.  So what's he doing?

More than anything else he is selling a story.  If you peruse his web site (https://www.oswaldsmillaudio.com/) you will find a lot about OMA's "origin story".  You will find out a lot about key construction components like the slate and wood he uses.  There are nice videos and many elegant still photos of the finished equipment, individual components, and the construction of the equipment.  What is hard to find is prices and detailed specifications.  Why?

He has done the important thing.  His equipment has a very distinctive look.  Anybody can see it is very different from your run of the mill stereo components, even high end components.  But things like signal to noise ratio, dynamic range, and other technical specifications, they can't be found.  And prices, if you dig around you can find a price for some of the less expensive components like phonograph cartridges ($1,000 - $2,000, depending on the make and model).  And many of the cartridges are "mono".  They don't even do stereo.  But I couldn't find pricing for the larger and more expensive components on the web site.  It's apparently one of those "if you have to ask - you can't afford it" things.

So is his equipment worth it?  Yes and no.  First the no.

As I said technical specifications are hard to find.  There is a good reason for this.  You can buy a "professional grade" turntable from Panasonic.  It's what all the successful DJs and rappers use and they can afford the best.  That turntable does everything it is possible to do in terms of technical sound quality.  There is no "up" to go to from one of these units.  So the technical specifications for OMA's turntables will be at best the same as and more likely less than those of a professional grade turntable that costs far less.  But if you spin some vinyl on an OMA turntable is it going to sound great?  Yes.  It will just sound no better than the same piece of vinyl would sound on a far less expensive turntable.

The same it true of the rest of his components.  He uses vacuum tubes rather than solid state components in his electronics.  Modern solid state components have far better technical specifications than old vacuum tube components.  In fact vacuum tube components introduce distortion into the signal.  But this distortion, when it is great enough to be noticeable, distorts the sound in a way that makes it sound warmer.  And this is especially true of the components OMA uses.

All of their vacuum tubes are old designs, typically from the '30s.  They had poor dynamic range and other technical flaws because that was the best the limited technology of the time could do.  Modern technology, even more recent tube designs, can do a much better job.  But oh boy do OMA components look cool.  And you don't have to be any kind of expert to tell a vacuum tube from a transistor or integrated circuit.

It's the same story with his speakers.  The stars of his show are his horns.  There is a relatively small electromechanical device in the throat of the horn but the horn itself is made of wood.  And they are not perfectly round.  Instead they are made up of a number of flat segments.  This deviation from perfect circularity introduces some "high order" distortion.  But it is a small amount, an amount too small to be detected by the average ear.

And speaker systems are typically divided up into low frequency, midrange, and high frequency bands.  Each is treated separately because a single component can't do a good job with that wide a bandwidth.  OMA rightly uses this "three way split" design.  The horns handle the middle frequency band.  But this band is technically pretty easy to get right.  You don't need a big old wooden horn to do an excellent job.  The high frequency band is even easier to handle.  It is the low frequency band that is the hardest to get right.  Guess what OMA spends no time on?  The components that handle the low frequency band.

By now it sounds like I think OMA is doing a terrible job.  And they are if all you care about is how well the equipment performs.  I'm sure the equipment performs well enough to sound just fine to most people.  And that's what is important.  The OMA web site also throws in a goodly amount of  "tech talk".  There is enough of it and it sounds convincing enough to work on people who don't already have the kind of technical background necessary to know what the real story is.  And the customers OMA is selling to don't have that kind of background.  A regular reader of "Stereo Review" back in the day would know about this sort of thing.  But that kind of expertise is rarely needed in the modern world so few people now have it.

What OMA gets right is making their equipment look special and very expensive.  And that's the part they absolutely need to get right.  If you are building a thirty million dollar house you need to furnish it with stuff that looks like it belongs in a thirty million dollar house.  OMA more than fills the bill.  And they have enough of a presence on the web that anybody can quickly determine that their equipment is very unique and very expensive.  And that's the "must have" in this part of the market.  So OMA gets the unimportant stuff wrong and the important stuff right.

And did I mention that Jonathon Weiss has a legitimate Hollywood background?  He knows how to present himself well.  He knows how to "make sure every dollar of the budget shows up on the screen".  You will fail in your attempt to go upscale if your product is bad in such a way that the average person can tell.  But OMA seems to have avoided that trap.  Their equipment gets generally good (but not great) revues.    But it is also true that your product doesn't actually have to be better than other less expensive competing products.  Here I think is the path OMA has taken.  And you will definitely fail if the average person can't instantly distinguish between your product and other products that cost substantially less.  This is where OMA excels.

And an investment in making sure that people know that your brand is a premium brand (Prada anyone?) is money well spent.  That's why many high end brands spend a lot of time, effort, and money, making sure that consumers that will never be able to afford their products have a general knowledge of the company and its products.  If people don't instantly know it's expensive then it might as well be not expensive.  And in that case you are going to lose the sale to different company that has done a better job of marketing its brand.

This is a classic example of the old saw that goes "those who can do and those who can't teach".  I understand what's going on here but I couldn't pull any of this off personally to save my life.  So I actually appreciate a brand like OMA.  They do what they do well and that's to be admired.  Many efforts to operate in the super-premium market fail.  It's a tempting market because the profit margins are so high if you can pull it off.  But succeeding is way harder to do that it looks.

Sunday, August 27, 2017

A Brief History of Computers

Trust me!  This is not going to be another one of those "and then so and so invented the such and such" kind of historical pieces.  But that won't stop me from starting by mentioning a name.

Paul Allen is the other founder of Microsoft.  He doesn't get as much ink as Bill Gates but that doesn't stop him from being interesting in his own right.  Allen suffers from serious long term health issues.  They are the kind of issues that led him to conclude he was not destined to live a long and healthy life.  So after Microsoft got established and Allen found himself fabulously wealthy he decided he better start playing while he still had the time.

So he played.  Most obviously, back in 1988 he bought the Portland Trailblazers NBA basketball team.  He has an NBA regulation basketball court "out back" of his house in case his players want to shoot a few hoops when they stop by to visit.  And apparently one big time professional team was not enough so he purchased the Seattle Seahawks NFL football team in 1996.  He made an unsuccessful  run at the 31st America's Cup sailboat race in 2003.  But his investment in fun is not limited to big money competitive sports.

He built the ugliest building in Seattle.  It was designed to his specifications by the renowned architect Frank Gehry and reputedly cost $250 million to build.  The original name was the Experience Music Project and it was going to be a tribute to Jimi Hendrix, the seminal rock and roll guitarist.  But disputes with Hendrix's family scuttled that idea.  It has since morphed into something called the Museum of Pop Culture, or MoPOP for short.

If I detailed a complete list of all of Allen's interesting and varied endeavors I would never get to the point of this post.  So I am going to mention only one.  It is a smaller and even less well known museum than MoPOP.  It is the Living Computer Museum.  I'm a computer guy and I confess to having been unfamiliar with its existence until recently.  But when I was finally made aware of its existence I had to check it out so I did.  And that visit is the motivation behind this post.

I started this blog in October of 2010.  One of the first posts I published was called "Computers I have Known".  Here's the link:  http://sigma5.blogspot.com/2010/10/computers-i-have-known.html.  In it I mention several computers.  A close family relative to almost all of them can be found in the "Mainframe" section of The Living Computer Museum.  (BTW, it is called "living" because much of the computer equipment on display is in working condition and patrons can play with it.)  Here's the list (and here's where I start listing off such and such kind of computer in violation of my promise above, but it's a short violation).

The first computer I mention is the IBM 7094.  The Museum doesn't have one but it is looking for one.  The Museum was also a bust on the second machine I discussed, the Burroughs B5500.  They are looking for one of those too.  But the third computer I discussed is the CDC 6400.  They have one of it's siblings, a 6500.  The fourth computer I talked about was the XDS (Xerox Data Systems, but before that the SDS - Scientific Data Systems) Sigma 5.  Again the Museum has a sibling, a Sigma 9.  I then moved on to the IBM 360/40.  The Museum has a sibling here too, namely a 360/30.

Finally I talk about a non-Mainframe computer, the IBM PC.  Here the Museum has a number of PCs as well as non-IBM clones made at around the same time the PC came out in 1981.  The Museum also has an interesting collection of minicomputers (I'm into going to go into what a "minicomputer" is) and a great selection of pre- and post- IBM PC home computers.  And, in the case of pre-, they have various makes and models on display stretching all the way back to the Apple-I and even before.  I strongly recommend a visit if you have any interest in computers and find yourself in Seattle.

So that's the preamble.  Now on to the main subject.  I promised you brief (or at least as close to brief as I can come) so here's the outline.  I am going to divide the history of computers into three periods:  the pre-computer period, the computer period, and the post-computer period.  That last part may seem weird but stick with me.  I promise it will make sense by the time I am done.

A case can be made for starting the history of pre-computers by going all the way back to the abacus.  After all it is a mechanical device for assisting in performing addition and subtraction.  And the digit-by-digit, carry-borrow techniques used with an abacus model how addition and subtraction are done by hand.  They also model how it is done by computers.

A similar case can be made for the slide rule.  This is a device people are no longer familiar with so let me give you the flavor of how it works.  The basic trick is to use a mathematical process called logarithms to convert multiplication and division problems into problems involving only addition and subtraction.  I'm not going to go into the details but scales on a slide rule translate numbers into distances.  By properly positioning the "slide" distances can be added or subtracted in such a way that the answer to a multiplication or division problem can be read off a scale.

Both the abacus and the slide rule are generally thought of by most people as being "not a computer" devices.  The first devices that were obviously computers to our modern eye were two machines made by Charles Babbage called the Difference Engine and the Analytical Engine.  But these devices had absolutely no influence on the development of the modern computer.  That's because Babbage never got either of them to work so they were generally forgotten about shortly after his death.  Their existence and principles were only rediscovered when modern historians started rooting around when computers became a thing.

So let's move on to things that are at least computer adjacent.  And let's start with something simple:  what's a "computer"?  The answer has always been simple but it has changed drastically over time.  There have always been problems that required massive amounts of computation to handle.  Typical examples are determining the airflow across a wing and determining if a bridge is strong enough.  So there has long been an interest in some way to perform massive amounts of computation quickly, accurately, and cheaply.  But for most of history there hasn't been much of a solution.  Various people at various times have become famous for performing prodigious amounts of computation.  I'm not going to bore you with their names but trust me, they were few and far between.

But by the 1930's mechanical devices could be bought that cost roughly a thousand dollars (then a lot of money but not an immense amount of money), that fit on a desktop (they were roughly the size of the eponymous breadbox), and were capable of adding, subtracting, multiplying, and dividing.  This caused technology companies to set up "computer rooms".  These consisted of rows of desks, each equipped with one of these machines and each staffed by a person called a "computer".

These computers (actually people) would be given sheets of numbers and would perform "chains" of calculations.   "For each row add the number in column 1 to the number in column 2 and put the result in column 3.  Then multiply the number in column 3 by the number in column 4 and put the result in column 5.  Finally, add up all the numbers in column 5 and put the result in the box in the bottom right corner of the page".  That sort of thing.  So at this time a "computer" was "a person, usually a woman, who performed large quantities of chain computations".  Now that we have figured out what a "computer" is during this period we can return to the subject at hand.

Then World War II came along.  Various problems, most prominently the need to create "ballistics tables" for field artillery, made the need for large quantities of chained computations acute.  There was just too much "chain calculation" work that needed to be completed.  And all of it needed to be completed by yesterday, if not sooner.  The War was on and people were desperate for anything that looked like it could speed things up.

A number of devices were created just prior to the War or during the early days of the war.  Two of note were the Harvard Mark I and the Colossus machines used at Bletchley Park for code breaking.  I can't find much technical information about either.  But as far as I can tell the Mark I was a super duper adding machine.  And the Colossus machines (roughly a dozen were built) were custom devices used to assist in code breaking.  And as far as I can tell neither these nor other devices mentioned by others had a significant influence on the design of what we now call a "computer".  As far as I can tell neither was capable of high volume chained calculation and that's what people were looking for.

By most telling's, including my telling in the post I referred to above, the first computer was the ENIAC.  I have changed my mind.  I am going to instead characterize the ENIAC as the last pre-computer.  Here's why.  What we now think of a "computer" is what is more formally called a "stored program computer".  You programmed the ENIAC by physically plugging various "functional unit" components together using "patch" cables.  This connected up the various functional units in the proper way to perform the specific chain calculation you wanted to make.  Once everything was set up you could feed large batches of chained calculations into it as long as you only wanted to do one particular chain of calculation.  If you wanted to execute a different series of chain calculations you broke all of the functional units apart and used "patch" cables to hook then together differently.

In spite of being the last pre-computer, the ENIAC is still fantastically important because all designs for what we now think of as computers are based on the ENIAC if you go back far enough.  With the advent of stored program computers the chain of computations could be changed by simply loading a different "program" into the computer, a matter of at most a few minutes.  It took hours to rewire the ENIAC to change the how the chain of computations was interconnected.  Implementing the "stored program" capability required including two additional functional units to the ones ENIAC had.

The first additional functional unit was bulk memory.  ENIAC could, by various trickery, be given access to a couple of numbers to be plugged into the calculation chain at a specific point.  And the output of one functional unit could be shunted to another functional unit, the practical equivalent of a tiny amount of memory.  But ENIAC couldn't keep say 100 or 1,000 numbers handy.  So various schemes were devised to provide a place where numbers could be stored then later retrieved.  Early versions were very limited both but better than nothing.  One early scheme was the "Mercury delay line".  It consisted literally of a small hose filled with Mercury.

A speaker would beep into one end.  The beep would take a fixed amount of time to travel down the hose to the other end where a microphone was positioned.  A not very large (by modern standards) set of numbers could be saved and later retrieved by having them travel around in a loop.  This and other early schemes were all eventually supplanted by "Ferrite core" (often shorthanded as "core") memory.

A large number of tiny donut shaped pieces of magnetic material were employed.  Each donut was constructed so that it could be flipped between "North" and "South".  Clever logic allowed each donut to be independently flipped say to "North" to represent a binary "0", or say to "South" to represent a binary "1".  This was a big improvement over previous technologies but it was eventually replaced, for good reason, by memory based in integrated circuits, what we now call RAM.

So in the early days various schemes for implementing some amount of memory were used with more or less success.  So there was now a place to put the "program".  The second necessary component was a functional unit that could take a small chunk of memory, often referred to as a "word", decode it, and use it to on the fly set up the proper connections between the other functional units.  The addition of these two additional functional units, a memory unit, and an "instruction decode" unit resulted in the first "computer" in the modern sense of the word, "a machine that can perform large amounts of chain computations".

And the first people to do this, to build a computer that included memory and an instruction decode unit, were the British.  In 1948 they got something called the "Manchester SSEM" machine up and running.  So the computer age actually starts with this machine.  It was quickly followed by many other machines.  I want to single out only one other machine from this period, the EDVAC.  It was a fully functional stored program computer.  Why it is important is that the machine was developed in close collaboration with Eckert and Mauchly, the people behind ENIAC and the detailed design of EDVAC was made freely available to the public.  So all subsequent computers, if you follow things back far enough, trace their designs back to the EDVAC.  And the EDVAC traces its design back to the ENIAC.

Things moved at a fast and furious pace from here.  But from here on changes are primarily evolutionary rather than revolutionary.  The change from vacuum tubes to solid state (originally transistors, later integrated circuits) was big in terms of better performance but it too was an evolutionary change.  In fact the IBM 7094 I mentioned above was just a "plus" version of the 7090.  And the 7090 was literally a plug compatible transistorized version of the IBM 709, a vacuum tube machine.

There is only one change that came out of this period that I think is worth mentioning.  And that is the move to the use of microcode.

In the computer business the actual physical device is shorthanded as "hardware" and the programs we run on the hardware are shorthanded as "software".  In the early days when these terms first came into common usage they made a lot of sense.  As I pointed out with the ENIAC you had to literally rewire the functional units together a different way in order to change the specifics of the chain of computations you wanted to perform, the program, if you will.  ENIAC was a big improvement in that at least you didn't have to design and build new functional units but still.  And with the advent of stored program computers the program became even easier to change.  So it made sense to refer to the physical part as hardware because it was hard to change.  And it made sense to refer to the programs as software because they were soft, i.e. easy to change.

But that was then.  And this seemingly sensible concept that hardware is hard to change and software was easy to change has turned out to be not so sensible at all.  In a real sense the opposite is now true and has been for a long time.

Computer programmers depend on the fact that a given type of computer behaves in a certain precisely defined way.  Many details of a program are critically dependent on this being true.  And as computers got faster, cheaper, and more ubiquitous, a whole lot of computer programs got written.  It soon became common for many programs to be written for each computer.  If you wanted to change some of the details of how that computer worked changing any one program to work under the new rules was relatively quick, easy, and inexpensive.

But it was very hard to change them all and all at the same time.  So as the number of programs written for a specific machine got larger and larger it soon imposed a very rigid discipline.  The hardware had to keep behaving in exactly the way.  So in effect the software got hard.  It became harder and harder to make a mass change necessitated by some change in hardware behavior.  And if you wanted to build a new computer that would run all those programs correctly it had better behave exactly like the current one.  Collectively, this set of rules defining what the software expected of the hardware came to be called "computer architecture".

So at this point it looks like software has gotten hard and hardware has gotten even harder.  But that's where microcode comes in.

At the same time people started becoming aware of the whole "computer architecture" thing elaborate "instruction sets" came to be developed.  This meant that the functional unit that decoded the instructions and then set the various functional units up to do the actual work became quite complicated.  At some point someone (exactly who that someone was is lost to the mists of time and besides several people probably hit on the same concept at roughly the same time) said "why don't we treat this whole "instruction decode" business as a special kind of programming problem.  We'll set up the decode unit with its own instruction set that is custom designed for the task at hand and write a program to sort things out.  That way we can keep the complexity of the hardware manageable because we can now break the "decode and hand off" process down to a series of steps, each of which is relatively simple.

This sounds like a dumb idea.  This adds another layer to everything and that should slow things down.  But it turned out the extra layer made hardware design much simpler and clever tricks were found to keep things speedy in spite of the apparent additional complexity.  The hardware part of the computer could now be built up of relatively simple functional units.  And that made it easier to make the functional units blazingly fast.  Programming a "computer within the computer" handle all the quirks and peculiarities of the instruction set was hard.  But it was easier than designing the incredibly complex hardware that would otherwise have been necessary.

Microcode was so successful that it is how all computers have actually worked for more than a half century.  An early success for this idea is the IBM/360 line of computers introduced in 1964.  Models ranged from the very basic and cheap 360/20 to the "supercomputer of its day", the 360/90.  From a purely hardware standpoint none of them was actually an "IBM 360".  They are all very different sets of hardware that with the help of microcode that was customized for each model could successfully emulate an "IBM/360" computer.  As a result a computer program designed to run on an "IBM/360 architecture computer" would work properly no matter which of the 8 quite different IBM/360 model you picked to run it on.

And this was in spite of the fact that hardware setup for each model differed drastically.  Your program might run a whole lot faster on a 360/80 than it did on a 360/40 but as long as execution speed was not important if would work the same on either machine.  In fact it would run on later machines that didn't even exist when the program was written.  All that was necessary was that the machine conformed to the "IBM/360" architecture specification.

The capability of the native hardware on the smaller and less expensive models was modest.  But on that model the microcode would grind away on chunk after chunk after chunk of a particular instruction until it had the answer demanded by the architecture specification.  It may have taken hundreds or thousands of microcode instructions but in the end you had what you expected.  The faster, more complex, more expensive, models had much more capable hardware so it may have taken only a few microcode instructions to produce the same answer.  Since the hardware was faster in the first place and since far fewer microcode instructions had to be executed, from the outside the computer looked a lot faster.  But the point was both machines produced the same result.  If you had the money and the inclination you could get fast but the cost was high.  If you lacked one or the other you could get "it works".  It was just a lot slower.  But it also cost a lot less money.

This ability of microcode to permit the same architecture to be implemented at multiple cost and speed points was recognized right away.  But the other great advantage of microcode took longer to be appreciated.  The fact that microcode could allow quite different sets of hardware to be used to implement the same "architecture" freed hardware designers from the prison software had put them into.  It allowed them to make drastic changes.  IBM has since put out many "IBM 360 compatible" machines.

The hardware they are built from has changed radically in ways unimaginable to early computer designers, builders, and users.  But this idea of using microcode to implement an architecture on wildly different hardware platforms has been a key to the evolution in hardware we have seen over the decades.  And it has freed hardware people to make radical changes under the covers.  So hardware designs have turned out to be quite soft.  You can bend them and twist them in unbelievable ways and as long as the microcode implements the architecture correctly it's all good.

So for a long time we have been living in a world where hardware has become soft (changeable).  Change the hardware all you want.  As long as you come up with microcode that hews to the rules of the architecture everything will work fine when you are done.  At the same time we have long been living in a world where software has become hard.  Businesses still run software created in the '80s and '90s to run on "IBM 360 compatible" hardware even though such hardware has not existed in any practical way for a couple of decades now.  But microcode and "emulation" tricks allow that very same software to work just fine on hardware that looks nothing like the equipment IBM was selling back then.  And don't even get me started on the radical evolution of "Intel x86" hardware over the last few decades.

Let me wrap this section up by taking note of the movie "Hidden Figures".  It very nicely dramatizes the change in the definition of the word "computer".  In the early part of the movie we are introduced to a number of the members of a "computer department" at NASA.  These ladies' job consists of performing the very "chain calculations" in a "computer room" that I started this section off with.  But by the end of the movie these very same women are no longer "computers".  They are now "computer programmers" writing "programs" to run on a "computer", a machine that performs chains of mathematical calculations.  The movie even includes shots of an "IBM 7090" computer, one of the computers I discussed above.  Moving on . . .

I am going to arbitrarily date the start of the post-computer age to 1981, the year the IBM PC was introduced.  A case can be made for moving the date to a few years earlier or pegging it to a different event or moving it to a few years later.  I'm not going to argue the point because frankly my "line in the sand" is arbitrary.  There was no sharp dividing line.  The far more relevant question, however, is:  what the heck am I talking about?  I own something called a "computer" and I just bought it recently, you say.  So why aren't we still in the computer age?  That seems like a reasonable perspective because it is a reasonable perspective.  It's just not the perspective I am applying.  So let's get into the perspective I am applying.

I talked about the later days of the pre-computer age and the early days of the computer age in terms of chained computations.  And my point is that they were just that, computations.  Early computers were devoted to doing computations.  You put numbers in and you got numbers out.  And that was the point, numbers.  This was definitely true of what I call the computer age.  For instance in the early part of the computer age computer makers saw the market for computers as consisting of two segments, business computing and scientific/engineering computing.  It was so hard to build computers in the early days that manufacturers designed different machines for each segment.

Two kinds of businesses that were early adopters of business computers were banks and insurance companies.  With banks, for instance, the books had to balance to the penny.  Numbers were known with complete precision (the amount of the check is exactly $134.26).  Everybody's checking account was supposed to "balance" (be accurate to the penny).  The bank's books as a whole were supposed to "balance".  So banks needed computers that could hold numbers as exact values of moderate size.  Back in the day the bank I worked for needed to be able to handle numbers as large as a billion dollars and an interest rate that was accurate to 3 decimal places (8.683%).

But they didn't need to be able to handle truly giant numbers and they didn't need to be able to handle really tiny numbers.  They needed what I will call "abacus math".  Numbers were stored as exact quantities and arithmetic was performed on numbers consisting of digits.  Interesting enough, the ENIAC did arithmetic with digits.

Now consider the dimensions of your house.  Do you know exactly how big your house is?  Of course not.  My house has siding on it.  If you pick different places you can measure the length of my house and get an answer that differs by two inches or more.  And if we come up with exactly where and how this or that dimension is to be measured how accurate is the measurement?  Plus or minus a quarter of an inch?  Plus or minus a sixteenth?  Whatever it is you do not know exactly how big your house is.  And that sort of thinking extends generally to engineering and scientific problems.

You know what the value of some number is only to within a certain precision, often stated as a number of "significant digits".  The precision with which you know the value of various numbers varies with circumstances.  Sometimes you only have a rough idea of the actual value ("it's about ten miles to the store").  Other times the actual value is known with great precision.  The value of some physical constants are known to more than ten significant digits.

On the other hand sometimes it is important to handle very big numbers (i.e. the size of the Milky Way Galaxy) or very small ones (the diameter of a Proton).  The way that this is done is to handle the "value" of a number as one thing and where the decimal place goes as another thing.  Many of you may be familiar from a Chemistry class with Avogadro's number.  It is usually stated as 6.02 times 10 to the 23rd power.  This means we know it's value to 3 significant digits.  But the decimal point goes way over there.  This is an example of "slide rule math".  And someone who is good with a slide rule can usually get results that are accurate to three significant digits.  But the slide rule does not tell you where the decimal point goes.  You need to figure that out another way.

In the real world separating a number into a "value" part and a "where the decimal point goes" part is called Scientific Notation.  On computers it is known as Floating Point.  And interesting enough, the EDVAC was set up to do things the engineering/scientific way.  And whether a computer could handle business computations or engineering computations was important to early computer customers.  Because it was all about the numbers at that time.  And the time when it was all about the numbers is the time I'm calling the computer age.

But think of how computers are now used by most people most of the time.  The "numbers" application for the present age is the Excel spread sheet.  Excel is all about numbers.  And I am a numbers guy so I use Excel,  But I only use it a little here and a little there.  Mostly I do other things.  And the fact that most of what we now use computers for is "other things" is why I call the modern age the post-computer age.  It is no longer about the numbers.

And I arbitrarily date this change to using computer mostly for not number things to when the computer invaded the home.  That's an entirely arbitrary decision on my part.  A case can be made that the Apple II and the TRS-80 got there first.  And a case can be made that widespread home use of computers didn't happen until a few years after the PC came out.  There is no sharp line in the sand that we can use to mark the transition.  So since I am writing this post I get to pick.

Consider what I am using my computer for right now.  I am doing word processing.  Sure, under the covers all the letters and stuff are converted into numbers and then manipulated via arithmetic and such.  But in roughly 1981 the balance tilted.  People have very little use for spread sheets in their everyday lives.  They are, however, heavily invested in texting (a crude form of word processing), scanning the web (arguably a very disguised form of database manipulation), or dealing with audio and video (word processing for sounds or pictures).  All of this may involve manipulating numbers under the cover but it is mostly not about the numbers.  The numbers are just a means to a non-numerical end.

And there is a lot of number crunching still going on.  I write this as a hurricane is pasting Texas.  And the weather models that are used to predict what's going to happen are an extreme form of number crunching that was unimaginable during the computer age.  But there are literally hundreds of millions of computers that are dedicated to non-numeric uses like texting, scanning the Internet, and watching videos.  That pattern of usage completely overwhelms the computers that are primarily used for number crunching.  And that represents a change as profound as the transition from the pre-computer age to the computer age.

So okay I did fudge and throw in the names of some people and some computers.  And I did talk about some technical stuff.  What can I say?  Quoting Jessica Rabbit from "Who Framed Roger Rabbit", "I'm just drawn that way".  But I do think I have delivered a very unconventional brief history of computers.  Yes I do.

Saturday, August 12, 2017

Principia - Part 2

In part 1 (see http://sigma5.blogspot.com/2017/08/principia-part-1.html) I talked around Principia, Newton's foundational book about Celestial Mechanics and many other things.  In this post I am going to talk about what's in it.  But first a digression.  I am going to briefly discuss Analytic Geometry and Calculus.  DON"T PANIC!  The discussion will be almost entirely math free.  I just want to introduce some ideas that give you a basic feel about that each subject is about.

Starting with Analytic Geometry, imaging a piece of graph paper.  This is the common kind where it is just a piece of paper full of square boxes.  Now let's number each column along the top and each row down the side.  Now pick any box.  If we sight down the column of boxes containing our special box we can see the column number our box is in.  If we sight across the page along the row boxes we can see the row number our box is in.  If we list the row number and column number it uniquely identifies our special box.

Now imagine a flat piece of paper.  This time the paper starts out blank so there are no boxes and no row numbers and no column numbers.  But we can do a more sophisticated version of the same thing.  We draw a horizontal straight line across the page.  Then we draw a straight line that is perpendicular to the original line down the page.  It will cross our original line at a point called the Origin.  Then we use a ruler to mark a distance scale off on each of these lines.  We can now uniquely identify any single point on our piece of paper by citing it's "coordinates".  By convention the horizontal line is the "X axis" and positive distances go off to the right.  And by convention the vertical line is the "Y axis" and positive distances go up toward the top.  And assume the piece of paper is as big as we need it to be.

Now pick a point, any point, as long as it is not on either of our axes.  Now draw a straight line that is parallel to the X axis through our special point.  It will strike the Y axis at some point.  Draw a second straight line through our special point parallel to the Y axis.  It will strike the X axis at some point.  Read the distance along the X axis to the point of intersection and turn it into a number by using our scale.  Do the same thing with the Y axis.  This yields two numbers, conventionally recorded as say (3.74,-8.23), the coordinates of the point.  These coordinates uniquely identify the location of the point.  And this process can be used to determine the coordinates of any point.

Now we can turn things into algebra.  Instead of talking about the point (3.74, -8.23) we can talk about a point "at (x,y)".  And we can write algebraic equations involving x and y.  By convention, w, x, y, and z represent "variables", numbers whose values we may or may not know, and a, b, c d, represent "constants", numbers we at least in theory know the value of.  And we may allow the value of a variable to vary.  Okay, on we go.

Consider a very simple equation:  x = 0.  In Analytic Geometry we play around with equations like this.  They are always of the form (something) = (something else).  We ask the question "what are all the possible values of "y" that are consistent with our equation "x = 0" being true?".  Technically we ask "what is the locus of solutions for the equation 'x = 0'?"  A locus is just a bunch of points for which the equation in question is true.  And we can graph this particular locus by marking all the points in the locus on the paper.  It turns out to just be the Y axis.  Similarly the X axis is the locus of solutions to the equation "y = 0".  And that's the fundamental idea behind Analytic Geometry.

We can turn diagrams, the stuff Geometry has been about, into equations.  The reason we want to do this is there are a whole bunch of tricks from Algebra that we can now apply to solving problems.  Now consider the equation "x squared + y squared = 1".  It turns out if we graph the locus of solutions to this equation we get a circle around the Origin with a radius of 1.  In fact the graph of "x squared + y squared = r squared" gives us a circle with a radius of "r" (assumed to be a constant in this discussion).

And it turns out that there is an algebraic formulation for an ellipse, a parabola, etc.  And I have given the equation for a circle centered at the Origin.  There is a more complicated equation for a circle whose center is located elsewhere.  This is also true for an ellipse, etc.  But that's making things more complicated than I want to get into so I'm going to skip all that.  Because that's all I am going to say about Analytic Geometry.  See, that wasn't so hard.  On to Calculus.

Consider the equation "y = x".  If we graph its locus we get a diagonal line through the Origin going up and to the right (and also down and to the left) at a 45 degree angle.  Now let's say we want to calculate the area "under the curve" (and a straight line is a kind of curve) for "y = x" where x goes from 0 to 100.  It turns out that there is a simple way to do this that the Greeks figured out about 3,000 years ago.  But we are going to ignore that.  (We are going to do a lot of ignoring for the rest of this discussion.)  Let's divide things up into columns, one column for each inch (I am going to assume our scale is in inches to make the explanation easier to follow).  Consider the first column, the one going from x=0 to x=1.  It turns out we end up with a cute little triangle that is 0 inches high on the left (x = 0) and 1 inch high on the right (x = 1).  Let's set this triangle aside for the moment.

Now consider the next column.  It is 1 inch high on the left side and 2 inches high on the right.  This can be subdivide into a nice 1 inch by 1 inch square and another of those pesky triangles.  Let's set the triangle part aside.  We can now put the square into a bucket called "part of the solution".  Now we move on to the next column.  Using the same process we end up with a third pesky triangle and a rectangle that is two inches high and one inch wide.  It's area is obviously two square inches.  So let's add that two square inches into our "part of the solution" bucket and move on.

We keep doing this.  We end up with 100 pesky triangles and a bunch of rectangles.  What do all the rectangles add up to?  Let's just assume we have a method for figuring this out and ignore what both the method is and what the answer is.  Now consider our pesky little triangles.  The total area under the curve is what those rectangles add up to plus what those triangles add up to.  Assuming the triangles add up to something, which they obviously do, then if we preliminarily take the answer as just the sum of the rectangles then we know this answer is wrong.  It is low by just the amount that the triangles add up to.  All this seems needlessly complicated.  And for the toy problem we are considering it is.  But all will soon become clear.

What we have is a tentative answer (the sum of the rectangles) plus some amount of error (whatever the triangles add up to).  How much error?  Well, let's turn those pesky triangles into squares that completely contain the triangles.  We can add these squares together easily because there are 100 of them and each of them is 1 inch by 1 inch.  So we know that our tentative answer is within 100 square inches of the correct one.  It looks like at this point we really haven't gotten anywhere but appearances are deceiving.

Let's go through the same process again.  But instead of using 1 inch columns let's use half inch columns.  We are going to end up with a bunch of rectangles that are a half an inch wide and some number of inches high.  That should make it harder to figure out how much they add up to.  But let's assume there is some procedure for figuring this out and ignore it.  Instead let's focus on the error.  And let's again do the same thing where we turn the triangles into squares.  Now we have 200 of them.  That sounds bad.  But each of them is half an inch on a side so each of these new squares has an area of only a quarter of a square inch.  Our maximum error has gone from 100 square inches to 50 square inches (200 squares times a quarter of a square inch per).

Now let's cut the width in half again so it is a quarter inch.  The result is that our maximum error is again cut in half to 25 square inches.  Okay we are now where we need to be.  Let's keep halving the width over and over and over.  Every time we do we cut our maximum error in half.  We can keep doing this almost forever.  If we do it forever we end up with a width of zero and we run into "divide by zero" problems.  So instead let's keep doing it almost forever.  The width keeps getting smaller and smaller but we assume it never quite makes it to zero.  This "as small as we want it but never exactly zero" is called an "infinitesimal".  And Newton used the word "fluxion", a word that obviously did not catch on, for what we now call an infinitesimal.

And this business of slicing things up more and more until you get to an infinitesimal is called "taking the limit".  If we can drive the maximum error below any arbitrary number no matter how small then we can use our technique for adding together all those rectangles to get an answer that is for all intents and purposes exactly the correct answer.  And that's Integral Calculus.

Differential Calculus works along the same lines.  You find an "approximate" method for calculating the tangent along each point on the line.  We again have an unspecified way (in the sense that I am not going to specify it) of coming as close as we want to the actual value of the tangent in a manner similar to adding up all the rectangular columns.  Then you slice things finer and finer until you are down to infinitesimals (but not zero).  If there is such a method then that's the method for "differentiating" whatever equation you stared with.

There is lots of fine print, ways for this to go wrong, but mathematicians have figured out the characteristics necessary to guarantee that an equation can be integrated or differentiated.  And now I'll let you in on the other big Calculus secret.  It's all a bag of tricks.  If an equation has this certain form then this trick works.  If it has this other certain form then this other trick works.  There are lots of tricks for handling equations that have lots of forms.  And this allows Calculus to solve for areas or slopes of all kinds of curves.  And both Calculus and Analytic Geometry are easily extended to handle more than the two dimensions (i.e. "X" and "Y" and "Z" and maybe "W" and . . .).  But I am going to save you from all that by not talking about it.

This business of limits and infinitesimals preceded Newton.  But what Newton brought to the table was a bunch of new tricks that allowed this limits/infinitesimals business to be used to solve much more difficult problems than his predecessors had cracked.  He needed his Calculus, his bag of tricks, to be able to perform the calculations necessary to reach the solutions he needed.  He was a very smart man.  And scattered all through Principia are tricks for handling this, that, or the other kind of equation.  So that's one of the things that is in Principia.  But this whole Calculus business was a means to an end for Newton.  So what were some of the ends?

Well, here's another digression.  But this time it's not my digression.  It's Newton's.  The first two sections of Principia (it is divided into three main sections) were strictly mathematical.  He says in effect "let's ignore the real world for a while and for the moment just assume that a certain mathematical formulation is how the world works and use that to figure out what things would look like".

So he assumed that things worked like he thought gravity worked.  He then went on to show that planetary orbits would be ellipses (or in some cases circles or parabolas).  But then he said that things would work this other way if a different mathematical formulation was assumed to be how the world worked.  That gave him the mathematical foundation to explore alternatives to his description of how Celestial Mechanics worked. And he was very thorough.  He explored mathematically a number of different models.  He concluded in section 3 that his formulation matched how gravity worked in the real world and that the alternatives did not.

And there is a reason it is called "Newton's theory of universal gravitation".  In Newton's time conventional wisdom held that there was one set of rules for earth and things near the ground (birds, mountain tops) and a different set of rules for the heavens (the sun, moon, planets, stars, etc.)  Newton said "nope".  Gravity works the same everywhere.  He calculated what the force of gravity should be between the earth and the moon.  He showed that it was the same (except that it diminished with distance exactly as he described) gravitational force was just right to keep the moon circling the earth.  He did the same thing for the sun and the planets.  Then he did the same thing for the moons of Jupiter and Saturn and for comets.  That completely demolished the idea that there were different laws for near earth and up in the heavens.

But he went further, much further.  He calculated how much people would weigh if they traveled from the surface of the earth to the center of the earth.  Scientists has speculated that the earth was not a perfect sphere.  Newton calculated the amount the earth would be distorted as a result of the fact that it rotated once per day.  The technology of the day was not accurate enough to confirm this.  But the technology of the day was good enough to show that gravity was slightly less at the top of a mountain than it was at sea level.  Newton calculated exactly how much.

In Celestial Mechanics there is something called the "two body" problem.  What is the path of two bodies orbiting each other if only the force of gravity between the two is important.  Newton solved that.  And he tackled the "three body" problem.  Specifically he looked at a system consisting of the earth, moon, and sun.  He was able to calculate the "perturbations" caused by the effect of the sun on the orbits around each other of the earth and the moon.

As a corollary to this investigation he was able to explain the tides.  They are semi-periodic.  He showed that the moon's gravitational pull on different parts of the earth caused a "lunar" tide (the larger) and the sun's gravitational effect on different parts of the earth caused a "solar" tide (smaller but significant).  They would move in phase and out of phase resulting in the complex pattern of high tides and low tides we see.  This was the first successful theory of tides.

He also tackled the mutual perturbations of Jupiter on Saturn's orbit and Saturn on Jupiter's orbit.  Before Newton no one had even tried to do that.

He investigated the motions of pendulums.  It turns out that pendulums are a great way to accurately measure the force of gravity.  They had been used, for instance, to investigate the force of gravity on the tops of mountains (see above).  He also put forward mathematical formulations of drag, how bodies moved through fluids like air and water.  These were pioneering studies.  They were not completely successful (we now know that the situation is quite complicated).  But he was able to show by his theoretical work and also by some experimental work that a number of then current theories were wrong.

And, of course, there was the business of winning arguments.  As I mentioned in the previous post, Descartes had put forward a "vortex" theory of gravity.  Newton's work on the orbits of Jupiter, Saturn, and especially comets, knocked the theory to flinders.  But Newton was nothing if not thorough.  So he did a mathematical treatment of vortexes (that was one of the mathematical alternatives he explored) that showed that vortexes did not work for mathematical reasons.  But that was still not enough.  Destroying the vortex theory was one of the reasons he explored drag.  For vortexes to work there had to be some kind of fluid.  That is how the vortex associated with one body influenced the path of another body.  But his mathematical study of drag indicated that there was no way to get vortexes to create the right amount of drag to exert the right amount of force in the right place to make each body move in the way it was observed to move.

Then there was the "epicycle" theory, the traditional method of dealing with the orbits of planets.  Originally the idea was that the planets moved in perfect circles.  But that didn't work.  So the idea was you had a primary circle.  Then there was a secondary circle.  The planet was attached to the secondary circle which was in turn attached to the primary circle.  That didn't quite work either so eventually there were models involving large numbers of "epicycles" (these secondary circles) all connected together in a complex way.  Newton developed mathematically a celestial mechanics of epicycles.  This was yet another of the alternative mathematical systems he explored.  Then he showed that the planets just didn't move according to his epicycle mechanics system, no matter how you arranged the epicycles.

Finally let me finish up with some more general observations.  Principia is very hard to read.  That's why I skimmed most of it just deeply enough to see what was being discussed.  Besides the reasons I have already discussed there is the "terminology" problem.  A lot of what Newton was dealing with was completely new.  So he invented terminology that got replaced with other terminology in the intervening centuries.  For instance what he called fluxions we now call infinitesimals.  That's pretty straight forward as our modern term means the same thing as his term.

But Newton introduced the idea of mass.  Mass is an inherent property of matter.  It is the degree with which it resists being accelerated by a given force.  Newton never did just introduce a word like "fluxion" for this concept.  So he ends up talking around what he is at in a way that is confusing.  To a greater or lesser extent the same is true with "inertia", impulse", "momentum", energy", "work", and others.

These are terms that now have well established definitions and usages.  But in some cases Newton was dealing with the concept for the first time because he had invented it.  In other cases had an unclear or incomplete idea of what eventually ended up to be the modern concept.  This made him understandably sloppy with usage.  In some cases he didn't even know that the concept might exist.  This makes it hard to follow a lot of his arguments.  You have to go through a process of translating what Newton says into what he means.  Then you must make allowances for the fact that he did not have a clear idea of how the concept worked.  If Newton had understood these concepts the way we now do he could have laid out his logic much more quickly, more easily, and in a more understandable way.

I ended my previous post with a note on Newton and theology.  If you take the whole of his life into account theology was more important and played a bigger part than his scientific work.  The same is true of his great rival Descartes.  The scientific work we now remember Descartes for was also done in his youth.  But he too spent a much greater part of his life on theological issues.  I can't speak to Descartes's theological ideas.  But I can speak to Newton's.  He spent a little time discussing them at the very end of Principia.  But he also went into them at some length in Optics.

Newton believed there was two kinds of truth.  There was what we now call scientific truth, what was then called natural philosophy.  Then there was religious truth.  Newton's belief was that these two kinds of truth were not antagonistic but complementary.  Combined appropriately, they resulted in a kind of super-truth that was more powerful than either of them standing on its own.

That was the main theological problem he spent his time on.  He could see that "old time religion" theology just did not work.  So he tried to tweak mainstream theology to produce something that retained the important parts of mainstream religious thinking but resulted in something that was compatible with science.  I don't know to what extent he thought he succeeded.  What I do know is that Newton's scientific work survives and is hugely influential.  But his religious ideas have vanished without a trace.  And one reason I know nothing about Descartes's religious thinking even though I am familiar with his scientific work is because his work on theology vanished without a trace soon after his death too.