<<

0 10 0 1 1 0 010 10 0 1 1 0 010 10 0 1 1 0 010 10 0 1 1 0 010 10 0 1 1 0 010 10 0 1 1 0 010 10 0 111 0 111 0 111 0 111 0 111 0 111 0 111 01 1 10 0 01 1 10 0 01 1 10 0 01 1 10 0 01 1 10 0 01 1 10 0 01 011 1 0 010 1CLAUDE0 011 1 0 010 10 SHANNON011 1 0 010 10 011 1 0 010 10 011 1 0 010 10 011 1 0 010 10 011 1 0 1 1 1 1 1 1 many thanks to 0 11 0 11 0 11 0 11 0 11 0 11 Lav Varshney 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1 design0 0 1 01 1 01 1 01 1 01 1 01 1 01 alesiom.ch1 0 10 011 1 0 010 10 011 1 0 010 10 011 1 0 010 10 011 1 0 010 10 011 1 0 010 10 011 1 0 010 10 0 111 0 111 0 111 0 111 0 111 0 111 0 111 01 1 10Claude0 0Elwood1 1 1Shannon0 0 0was1 1 an 1engineer0 0 0who1 1 10 0 01 1 10 0 01 1 10 0 01 011 1 0 010 1established01011 1 0 01 mathematical0 101011 1 0 foundations010 1010 1of1 1 the0 0 10 101011 1 0 010 101011 1 0 010 101011 1 0 0 0 0 information11 1 0 0 age,0 describing11 1 0 0 basics0 11 of1 ,0 0 0 11 1 0 0 0 11 1 0 0 0 11 1 0 0 1 01computation1 and01 .1 01 1 01 1 01 1 01 1 0 101011 1 0 010 101011 1 0 010 101011 1 0 010 101011 1 0 010 101011 1 0 010 101011 1 0 010 101 0 11 1 0 0 0 11 1 0 0 0 11 1 0 0 0 11 1 0 0 0 11 1 0 0 http://afflictor.com/wp-content/uploads/2012/12/cs.jpg11 1 0 0 11 01 1 Birth 01 1 01 1 01 1 1Interests1 1 1 1 1 0 0 6 1 0 0 1 0 0 1 0 0 1 1 1 0 1 10 10 0 1 0 10 0 1 0 10 0 1 0 10 0 0 1 0 0 1 0 1 Shannon was born in1 Michigan, USA during WWI,1 the son of a judge and a teacher.1 As a child, Shannon’s1 outside interests such as1 juggling also 1 9 1 1 1 1 1 1 1 0 01 0 his11 1hero was0 inventor0 Thomas0 1 1Edison1 (a distant0 0 relative).0 He11 1built a wireless0 0 telegraph,0 1radio1 1 betrayed an active mind. He wound up building robots 1 01controlled boats,1 and model0 1planes of various1 designs. He01 later learned1 to fly, with special01 that could juggle and even proved a mathematical 0 10 011 0permission010 from10 MIT’s0 president,11 0 0who10 feared10 losing0 1his1 genius.0 010 10 011 0 010 theorem on the fundamental limits of juggling. He also 1 1 1 1 1 1 1 1 invented many devices, such as rocket-powered flying 0 11 1 0 0 0 11 1 0 0 0 11 1 0 0 0 11 1 0 0 discs, a motorized pogo stick, and a flame-throwing 01 81 Studies01 1 01 1 01 1 trumpet. During a trip to Russia, he used his entire 3 1 0 0 Shannon1 was 0an undergraduate0 student1 at 0the University0 of Michigan,1 earning0 0 degrees in both 1 honorarium to purchase musical instruments, and 0 1 910 10 0 1 10 10 0 1 10 10 0 1 10 10 0 1 1 electrical1 engineering1 and .1 He1 then worked as Vannevar1 Bush’s1 assistant at 1the during a stay in England he invented a device that 0 0 0 Massachusetts11 1 0 0 Institute of0 Technology,11 1 operating0 0 an analog0 11 .1 0 His0 1940 master’s0 11 1 would make it easy for Americans to drive on the left 1 01thesis,0 often1 said to be the 0most1 important0 1 of the century,01 pushed0 computing1 into the0 1digital0 side of the road. 0 10 011 1 0realm,1 by0 connecting10 0 the1 1mathematics1 0 10 of Boolean10 0 algebra11 1 0 with 1the0 technology10 0 of1 switching1 1 0 10 https://gandinijugglings.files.wordpress.com/2013/07/shannon.jpg 1 1 circuits. His doctoral1 1 research, completed in1 one1 summer at Cold Spring 1Harbor,1 NY would 0 1 1 0 provide0 a similar0 1 algebra1 for0 .0 0 1 1 0 0 0 1 1 0 0 01 1 Working further01 in ,1 Shannon helped01 found the1 field of artificial01 intelligence1 by 0 0 0 0 0 0 0 0 011 1 10 1co-organizing0 011 1 the 195610 Dartmouth10 0 Conference,11 1 taking10 inspiration10 0 from11 1 computers10 he 1had0 built0 1 0 for1 1 playing and for 0solving1 1 mazes. He also built 0some1 1of the earliest wearable0 1 1 ,1 with applications in1 prediction and gambling. 1 1 10 0 01 1 10 0 01 1 10 0 01 1 10 0 01 1 0 10 011 0 010 10 011 0 010 10 011 0 010 10 011 0 010 1 2 1 World war1 II 1 1 1 1 1 0 1 4 0 1 0 1 0 1 1 1 0D0uring WWII, Shannon1 1 was 0a main0 contributor1 in1 building0 the0 X that1 1allowed Franklin0 0 9 01 Roosevelt and01 Winston Churchill to securely01 communicate over the Atlantic01 about war . 1 1 1 1 1 11 0 0 0 0 11 0 0 0 0 11 0 0 0 0 11 0 0 0 0 1 0 1 1 1Securing10 the 1communication1 1 of 1the0 Allies 1was a key1 counterpoint1 10 to breaking1 1Axis codes.1 1In0 0 fact,11 Shannon came up with0 an11 encryption strategy (the0 one-time11 pad) that is provably0 11 0 0 01unbreakable,1 0 no0 matter how0 1much1 computational0 0 effort 0and1 ingenuity1 is0 brought0 to bear01 in1 1 trying to break1 it. That is, neither Alan Turing1 at the time nor modern 1intelligence agencies can 0 10 11 0 0 0 10 11 0 0 0 10 11 0 0 0 10 11 0 0 0 0 1 break1 the code. This0 is perfect1 secrecy.1 0 1 1 0 1 1 0 111 0 111 0 111 0 111 01 1 10 0 01 1 10 0 01 1 10 0 01 1 10 0 11 0 0 08 MATHEMATICAL11 0 0 0 THEORY1 1OF0 COMMUNICATION0 0 11 0 0 0 1 0 14 10 0 1 10 0 1 10 0 1 10 0 1 9 Shannon’s1 master1 work, «A Mathematical1 1Theory of Communication»,1 appeared1 in two parts1 in 0 01 0 the11 1 July and 0October0 19480 issues11 1 of the Bell0 0 System Technical0 11 1 Journal.0 Some0 have0 said1 1the1 1 01work0 «came1 as a bomb, and0 1something0 of1 a delayed action01 bomb»0 in1 that it was extremely01 0 0 10 011 0novel,1 it0 laid the10 foundations011 0 for the1 0information10 0 age,1 and1 0 its effects10 are1 still0 felt0 to11 this0 day. 10 1 1 This paper founded1 the field1 of theory,1 which1 studies the fundamental1 limits1 of 0 11 1 0 reliable0 communication0 11 1 in the0 0 presence0 of noise,11 1 and of 0data0 compression.0 11 1Shannon’s0 theory0 01 1 allows us to 0talk1 about a common1 currency01 for information,1 . As noted,01 before information1 0 0 0 0 https://funcionalismouq.files.wordpress.com/2013/03/claude-shannon.jpg 011 0 10 1theory0 0 «we11 had0 been1 dealing0 1 with0 0a commodity11 0 that10 we could10 never01 see1 0or really10 define.10 We0 1 1 were1 in the situation1 petroleum 1engineers1 would be in if they1 didn’t have1 a measuring unit1 like 0 0 0 the11 1 gallon.» Shannon0 0 developed0 11 1much of his0 0 theory at 0home11 on1 nights 0and0 weekends0 during11 1 1 011940-1945,0 1 and only after much01 urging0 from1 his supervisor,01 Hendrik0 Bode,1 and colleagues01 did0 0 101011 1 0Shannon10 finally10 publish101 his1 1 work.0 10 101011 1 0 10 101011 1 0 10 0 11 1 0 0 0 11 1 0 0 0 11 1 0 0 0 11 1 0 0 01 1 1 Information01 rate1 of english01 text1 01 1 0 5 0 0 0 11 0 0 11 0 In a0 paper that stemmed11 0 from his0 initial work on1 information1 0 0theory, 1 0 91 10 0 1 10 0 1 10 0 1 10 0 1 1 1 1 Shannon characterized1 1 the information rate1 of English1 text. Experiments1 0 0 0 11 1 0 0were done0 1by1 1playing a 0hangman-like0 0 guessing11 1 game0 with0 his wife0 Betty11 1 (a 1 01 0 1 computer0 1scientist0 at1 ) and his01 friend0 Barney1 Oliver. This 0was1 0 0 10 011 0 10 10 initially011 presented0 10 at a Macy10 Conference011 0 on ,10 10 where01 biologists,1 0 1 0 1 1 1psychologists,1 anthropologists,1 economists1 and engineers1 all came1 together 0 11 0 11 to discuss the nature0 of information.11 0 11 01 1 10 0 01 1 10 0 01 1 10 0 01 1 10 0 011 0 010 10 011 0 010 10 011 0 010 10 011 0 010 10 01 1 1 Death1 1 1 1 1 1 1 0 1 1 1 1 0 00 0 Suffering1 1 from0 0Alzheimer's0 disease1 1 in the 0last0 years of0 his life,1 1 Claude 0Shannon0 died0 at 841 1 1 2 01years old February1 24, 20010 1in Medford, 1Massachusetts.01 1 01 0 10 011 0 010 10 011 0 010 10 011 0 010 10 011 0 010 01011 1110111001011 1110111001011 1110111001011 1110111001