Technology Liberation Front: The Technology Liberation Front » Archive » TCP/IP “More or Less by Fiat?”
Tom
· 1 year ago
A great point, and more than I knew about TCP/IP's birth, to be sure. That's why I hedged my bets by referring to all web technology -- I was specifically thinking of W3C, ISO and MPEG. But you're right that I'm oversimplifying the picture. Even those bodies are influenced and improved by the chaos of the market, like with Microsoft's introduction of the nonstandard XmlHttpRequest Javascript object.
Tim Lee
· 1 year ago
Right, I think this is a case where a binary division between "the market" and "central planning" is too simple. W3C engage in central planning in roughly the same way that Jimmy Wales and Linux Torvalds do: They're widely respected and as a result have a lot of "soft power" over the direction of high-tech standards. But if W3C makes a stupid decision and everyone decides to ignore them, there isn't a whole lot the W3C can do about it. And part of the reason that W3C (and Linus and Jimbo) retain the influence they have is that they've proven themselves adept at accommodating the competing agendas of various stakeholders.
bemused
· 1 year ago
As someone who was a young network engineer in the days when TCP/IP was born, I can tell you that central planning had both more and less impact than you admit. TCP/IP ran on the ARPANET which was paid for by DOD. In that period long haul circuits were hugely expensive, as was high speed connection equipemt. Private/commercial networking, barred from using the arpanet, had to cost justify network choices, and the X.25 and proprietary protocols were optimized to work well on lower speed connections. The ARPANET designers were academics studying network design and performance, but the underlying traffic on the ARPANET was mostly email and ftp file transfer between universities.
When the ARPANET was opened to commercial traffic around 1990, the underlying hardware environment had changed. Computers were faster, the personal computer had become a platform able to run more resource intensive and capable operating systems, and many private companies had installed Ethernet infrastrucure for their private networks. The optimizations made by the telcos in X.25 were now the wrong ones to support high speed peer networking. The proprietary protocols were closed and also not designed to support networks without central administration.
Thus it came to pass that the design decisions made by the researchers and paid for by the DOD came to the fore. Without the funding that enabled the ARPANET protocols to be designed, developed, tested and improved, they wouldn't have been ready when the hardware caught up to them.
An interesting contrast: the ISO protocols developed as an alternative to the ARPANET protocols. Arguably, they had some aspects that were theoretically superior to the ARPANET protocols, and they were an international standard adopted by the telecom community. But because they didn't have battle tested implementations, they didn't catch on, and only some of the upper layer protocols still are used.
Richard Bennett
· 1 year ago
The ISO OSI suite was the only practical alternative to TCP/IP. Xerox XNS was strictly a proprietary system, and most of its structure was actually "borrowed" by Cerf and Kahn (who were just down the street from Xerox PARC, at Stanford.) IBM never wanted other people implementing SNA, and X.25 was only a data link, not a full-blown protocol suite.
As bemused mentions, ISO/OSI was technically superior to TCP/IP and was developed in a truly open process, not just by telecoms but by computer companies and users as well. General Motors and Boeing were big supporters of OSI.
The DOD process was much more a matter of giving contracts to very small groups, like Cerf and Kahn for TCP and IP, and to Jon Postel for FTP. Hence their standards were much more limited and easier to understand and implement with fewer options. There was a whole standards aftermarket for ISO called the OSI Implementors' Workshop (in which I participated) that did nothing more than choose subsets of the massive ISO protocols to implement in a series of interoperability fairs.
The government forced the adoption of TCP/IP by paying for software implementations that were given away for free, and by demanding TCP support as a condition of making sales to the federal government. The DOD didn't want to lose control of networking to a bunch of scruffy foreigners.
Had the market been allowed to work, with by ISO and TCP software competing on a level playing field, ISO would have won because it incorporated the knowledge gained from early experiments in networking carried out by computer companies with proprietary software suites.
And we wouldn't have all the problems we're having today with the transition to IPv6. But we'd have a different set of problems almost as bad, probably, so it may not end up making all that much difference. As time goes by, the IETF has simply incorporated more and more ideas from ISO anyhow.
Anyhow, that's how it looked from where I sat, at a company that was doing both TCP and ISO code at the same time.
eee_eff
· 1 year ago
It’s certainly true that the TCP/IP protocol suite was developed because some military researchers asked some really smart computer scientists to get together and write a new networking protocol. The spec was revised a few times (probably the most important being splitting things into a TCP layer and an IP layer) and then approved by the military, which proceeded to force every user of the ARPANET to switch to it in January 1983. ... TCP/IP spread like wildfire because it was well-designed, and because its open architecture made it easier to deploy and more flexible than the alternatives.
Tim:
I think there is a connection between the two statements I've repeated above. In other words, part of the reason TCP/IP was open and extendable was that it was designed by the military.
I would refer to the history of the development of the radio as a consumer appliance just after the First World War. Prior to the First World War, Radios occupied room, and were difficult to put together due to patents that different companies held, and any one company couldn't build a whole radio. The US Navy broke the patents, and made it possible to build what we know today as a radio, and the architecture was much more open than before.
This is covered in detail in the excellent book "Steal this Idea" by Michael Perelman. In general, it seems that military contributions to consumer markets are under-rated. They are fundamentally different than inputs that come from purely commercial enterprises.
Richard Bennett
· 1 year ago
ef says: "...part of the reason TCP/IP was open and extendable was that it was designed by the military."
TCP/IP wasn't "designed by the military," it was designed by a couple of computer science Ph. D.'s working at Stanford who happened to get some grant money from the military. They weren't following orders from the Pentagon, and their work product wasn't different in any substantial way from a purely private research effort at Xerox a few blocks down the street.
eee_eff
· 1 year ago
TCP/IP wasn't "designed by the military," it was designed by a couple of computer science Ph. D.'s
Richard:
My point was not that everyone who worked on the development of TCP/IP was a commissioned officer, but that the client was the military, and that the design consideration were driven by criteria was developed by the military.
From wikipedia:
"The Internet protocol suite came from work done by Defense Advanced Research Projects Agency (DARPA) in the early 1970s. After building the pioneering ARPANET in the late 1960s, DARPA started work on a number of other data transmission technologies. In 1972, Robert E. Kahn was hired at the DARPA Information Processing Technology Office, where he worked on both satellite packet networks and ground-based radio packet networks, and recognized the value of being able to communicate across them. In the spring of 1973, Vinton Cerf, the developer of the existing ARPANET Network Control Program (NCP) protocol, joined Kahn to work on open-architecture interconnection models with the goal of designing the next protocol for the ARPANET. ... In March 1982, the US Department of Defense made TCP/IP the standard for all military computer networking."
Richard Bennett
· 1 year ago
Dude, when you start throwing wikifacts at me I have to say the discussion is over.
eee_eff
· 1 year ago
Dude, when you start throwing wikifacts at me I have to say the discussion is over.
Richard: That's basically an ad hominum attack, but if you have any facts that would show that TCP/IP wasn't design by a defense agency, please post those facts...
crack
· 1 year ago
I was under the impression that IP came about because the military wanted a robust network that could withstand the loss of multiple nodes. IP being the network layer (layer 4 of the OSI model) left all the lower level stuff to the local network. That would imply that it was designed by PhDs with requirements from the military which would be in line with EF and RB.
eee_eff
· 1 year ago
crack: that's exactly right, but Richard seems incapable of admitting that anything good was every done by the govt...plus he likes calling me names ...
Danny
· 1 year ago
In relation to whether TCP/IP was designed by the military or by PhD's at Stanford, see Stuart Leslie, The Cold War and American Science: The Military-Industrial-Academic Complex at MIT and Stanford - it contains a great deal on the role of the military in shaping scientific research projects, even when not explicitly for military purposes. It also draws attention to the manner in which military funding shapes university educational curricula overall - perhaps if Xerox and Stanford were doing the same work, this is the more important insight.
All Comments
When the ARPANET was opened to commercial traffic around 1990, the underlying hardware environment had changed. Computers were faster, the personal computer had become a platform able to run more resource intensive and capable operating systems, and many private companies had installed Ethernet infrastrucure for their private networks. The optimizations made by the telcos in X.25 were now the wrong ones to support high speed peer networking. The proprietary protocols were closed and also not designed to support networks without central administration.
Thus it came to pass that the design decisions made by the researchers and paid for by the DOD came to the fore. Without the funding that enabled the ARPANET protocols to be designed, developed, tested and improved, they wouldn't have been ready when the hardware caught up to them.
An interesting contrast: the ISO protocols developed as an alternative to the ARPANET protocols. Arguably, they had some aspects that were theoretically superior to the ARPANET protocols, and they were an international standard adopted by the telecom community. But because they didn't have battle tested implementations, they didn't catch on, and only some of the upper layer protocols still are used.
As bemused mentions, ISO/OSI was technically superior to TCP/IP and was developed in a truly open process, not just by telecoms but by computer companies and users as well. General Motors and Boeing were big supporters of OSI.
The DOD process was much more a matter of giving contracts to very small groups, like Cerf and Kahn for TCP and IP, and to Jon Postel for FTP. Hence their standards were much more limited and easier to understand and implement with fewer options. There was a whole standards aftermarket for ISO called the OSI Implementors' Workshop (in which I participated) that did nothing more than choose subsets of the massive ISO protocols to implement in a series of interoperability fairs.
The government forced the adoption of TCP/IP by paying for software implementations that were given away for free, and by demanding TCP support as a condition of making sales to the federal government. The DOD didn't want to lose control of networking to a bunch of scruffy foreigners.
Had the market been allowed to work, with by ISO and TCP software competing on a level playing field, ISO would have won because it incorporated the knowledge gained from early experiments in networking carried out by computer companies with proprietary software suites.
And we wouldn't have all the problems we're having today with the transition to IPv6. But we'd have a different set of problems almost as bad, probably, so it may not end up making all that much difference. As time goes by, the IETF has simply incorporated more and more ideas from ISO anyhow.
Anyhow, that's how it looked from where I sat, at a company that was doing both TCP and ISO code at the same time.
...
TCP/IP spread like wildfire because it was well-designed, and because its open architecture made it easier to deploy and more flexible than the alternatives.
Tim:
I think there is a connection between the two statements I've repeated above. In other words,
part of the reason TCP/IP was open and extendable was that it was designed by the military.
I would refer to the history of the development of the radio as a consumer appliance just after the First World War. Prior to the First World War, Radios occupied room, and were difficult to put together due to patents that different companies held, and any one company couldn't build a whole radio. The US Navy broke the patents, and made it possible to build what we know today as a radio, and the architecture was much more open than before.
This is covered in detail in the excellent book "Steal this Idea" by Michael Perelman. In general, it seems that military contributions to consumer markets are under-rated. They are fundamentally different than inputs that come from purely commercial enterprises.
TCP/IP wasn't "designed by the military," it was designed by a couple of computer science Ph. D.'s working at Stanford who happened to get some grant money from the military. They weren't following orders from the Pentagon, and their work product wasn't different in any substantial way from a purely private research effort at Xerox a few blocks down the street.
Richard:
My point was not that everyone who worked on the development of TCP/IP was a commissioned officer, but that the client was the military, and that the design consideration were driven by criteria was developed by the military.
From wikipedia:
"The Internet protocol suite came from work done by Defense Advanced Research Projects Agency (DARPA) in the early 1970s. After building the pioneering ARPANET in the late 1960s, DARPA started work on a number of other data transmission technologies. In 1972, Robert E. Kahn was hired at the DARPA Information Processing Technology Office, where he worked on both satellite packet networks and ground-based radio packet networks, and recognized the value of being able to communicate across them. In the spring of 1973, Vinton Cerf, the developer of the existing ARPANET Network Control Program (NCP) protocol, joined Kahn to work on open-architecture interconnection models with the goal of designing the next protocol for the ARPANET.
...
In March 1982, the US Department of Defense made TCP/IP the standard for all military computer networking."
Richard:
That's basically an ad hominum attack, but if you have any facts that would show that TCP/IP wasn't design by a defense agency, please post those facts...
that's exactly right, but Richard seems incapable of admitting that anything good was every done by the govt...plus he likes calling me names ...