Information Theory- the Big Data
Information theory lies at the heart of everything – from DVD players and the genetic code of DNA to the physics of the universe at its most fundamental. it has been central to the development of the science of communication, which enables data to be sent electronically and has therefore had a major impact on our lives.
- In April 2002 an event took place which demonstrated one of the many applications of information theory. The space probe, Voyager I, launched in 1977, had sent back spectacular images of Jupiter and Saturn and then soared out of the Solar System on a one-way mission to the stars. After 25 years of exposure to the freezing temperatures of deep space, the probe was beginning to show its age, Sensors and circuits were on the brink of failing and NASA experts realized that they had to do something or lose contact with their probe forever. The solution was to get a message to Voyager I to instruct it to use spares to change the failing parts. With the probe 12 billion kilometers from Earth, this was not an easy task. By means of a radio dish belonging to NASA’s Deep Space Network, the message was sent out into the depths of space. Even travelling at the speed of light, it took over II hours to reach its target, far beyond the orbit of Pluto. Yet, incredibly, the little probe managed to hear the faint call from its home planet, and successfully made the switchover.
- It was the Ingest·distance repair job in history, and a triumph for the NASA engineers. But it also highlighted the astonishing power of the techniques developed by American communications engineer Claude Shannon, who had died just a year earlier. Born in 1916 in Petoskey, Michigart. Shannon showed an early talent for maths and for building gadgets, and made breakthroughs in the foundations of computer technology when still a student. While at Bell laboratories, Shannon developed information theory, but shunned the resulting acclaim. In the 1940s. he singlehandedly created an entire science of communication which has since inveigled its way into a host of applications, from DVDs to satellite communication to bar codes – any area, in short, where data has to be conveyed rapidly yet accurately.
- This all seems light years away from the down to-earth uses Shannon originally had for his work, which began when he was a 22-year—old graduate engineering student at the prestigious Massachusetts Institute of Technology in 1939. He set out with an apparently simple aim: to pin down the precise meaning of the concept of ‘information’. The most basic form of information, Shannon argued, is whether something is true or false – which can be captured in the binary unit, or ‘bit’, of the form 1 or 0. Having identified this fundamental unit, Shannon set about defining otherwise vague ideas about information and how to transmit it from place to place. ln the process he discovered something surprising: it is always possible to guarantee information will gel through random interference – ‘noise’ — intact.
- Noise usually means unwanted sounds which interfere with genuine information. information theory generalizes this idea via theorems that capture the effects of noise with mathematical precision. In particular, Shannon showed that noise sets a limit on the rate at which information can pass along communication channels while remaining error-free. This rate depends on the relative strengths of the signal and noise travelling down the communication channel, and on its capacity (its’ bandwidth’). The resulting limit, given in units of bits per second, is the absolute maximum rate of error-free communication given signal strength and noise level. The trick, Shannon showed, is to find ways of packaging up – ‘coding’ – information to cope with the ravages of noise, while staying within the information carrying capacity ‘bandwidth’ – of the communication system being used.
- Over the years scientists have devised many such coding methods, and they have proved crucial in many technological feats. The Voyager spacecraft transmitted data using codes which added one extra bit for every single bit of information; the result was an error rate of just one bit in 10,000 — and stunningly clear pictures of the planets. Other codes have become parts of everyday life – such as the Universal Product Code, or bar code, which uses a simple error-detecting system that ensures supermarket check-out lasers can read the price even on. say, a crumpled bag of crisps. As recently as 1993, engineers made a major breakthrough by discovering so-called turbo codes – which come very close to Shannon’s ultimate limit for the maximum rate that data can be transmitted reliably, and now play a key role in the mobile videophone revolution.
- Shannon also laid the foundations of more efficient ways of storing information, by stripping out superfluous (‘redundant’) bits from data which contributed little real information. As mobile phone text messages like ‘l CN C U’ show, it is often possible to leave out a lot of data without losing much meaning, As with error correction, however, there’s a limit beyond which messages become too ambiguous. Shannon showed how to calculate this limit, opening the way to the design of compression methods that cram maximum information into the minimum space.
INFORMATION THEORY – THE BIG IDEA
- Giải thích từ vựng
- Theory (n) /ˈθɪəri/ học thuyết, lý thuyết
Eg: Economic theory says that there is little connection between the euro’s value against the dollar or the yen and the success of monetary union itself.
Một số từ đồng nghĩa:
- idea I’ve got an idea – why don’t we ask John for help?
- plan The plan is to hire a car when we get there.
- thought Have you had any thoughts on presents for your mother?
- suggestion Have you got any suggestions for improvements?
- brainwave I wasn’t sure what to do and then I had brainwave – I could ask Anna for help.
- brainstorm She was stuck until she had a brainstorm and the solution came to her.
- Universe (n) /ˈjuː.nɪ.vɜːs/ vũ trụ, vạn vật
Eg: The universe is theoretically infinite.
There are several schools of thought about how the universe began.
Throughout history, people have been intrigued by the question of whether there is intelligent life elsewhere in the universe.
- Enable (v) /ɪˈneɪ.bəl/ làm cho có thể (làm gì), làm cho có khả năng (làm gì)
Eg: Some tests enable you to find out the sex of your baby before it’s born.
Only good team work will enable us to get the job done on time.
Saving enough money now will enable you to retire comfortably.
- Impact (n) /ˈɪm.pækt/ tác động, ảnh hưởng
Eg: The increase in the number of young people leaving to work in the cities has had a dramatic impact on the demography of the villages.
This decision will have a disastrous impact on foreign policy.
Collocation
have (an) impact on
- Application (n) /ˌæp.lɪˈkeɪ.ʃən/ sự áp dụng, ứng dụng
Eg: There are obvious practical applications for the research.
Collocation
the application of sth
- Launch (v) /lɔːntʃ/ đưa (ai) ra, giới thiệu (ai) ra (cho mọi người biết)
Eg: The programme was launched a year ago.
The airline will launch its new transatlantic service next month.
Collocation
launch into sth
- Soar (v) /sɔːr/ bay vọt lên, bay vút lên, nâng cao lên
Eg: She watched the gliders soaring effortlessly above her.
- Exposure (n) /ɪkˈspəʊ.ʒər/ sự phơi nhiễm
Eg: You should always limit your exposure to the sun.
Even a brief exposure to radiation is very dangerous.
expose (v)
Collocation
exposure to sth
- Probe (n) /prəʊb/ cuộc thăm dò, chứng minh
Eg: The probe explored allegations of corruption in the police department.
Collocation
- corruption/criminal/federal probe
- a probe into sth
- launch/conduct/open a probe
- Solution (n) /səˈluː.ʃən/ giải pháp
Eg: There’s no easy solution to this problem.
She just seems so unhappy and I don’t know what the solution is.
Một số từ đồng nghĩa :
- answer We’re still waiting for an answer.
- reply “How far?” asked Nigel. “Not far,” was the mumbled reply.
- response Thank you for your swift response.
- reaction What was her reaction when she was asked for her resignation?
- retort Alan snapped back with a witty retort.
- Instruct (v) /ɪnˈstrʌkt/ chỉ dẫn, chỉ thị cho, dạy, đào tạo
Eg: The police have been instructed to patrol the building and surrounding area.
The prime minister’s family have been instructed not to discuss his past life with the press.
The minister was instructed to accept the advice of senior civil servants.
Collocation
- instruct sb to do sth
- Orbit (n) /ˈɔː.bɪt/ quỹ đạo
Eg: The satellite is now in a stable orbit.
Collocation
go into orbit
- Triumph (n) /ˈtraɪ.əmf/ sự chiến thắng; thành tựu, thắng lợi lớn, chiến thắng, thành công lớn
Eg: The book celebrates the hostages’ remarkable triumph over appalling adversity.
The signing of the agreement was a personal triumph for the prime minister.
Collocation
- triumph for sb/sth The deal is a triumph for the company.
- triumph of sb/sth over sb/sth They see the free trade proposals as the triumph of corporate profits over individual and global well-being.
- Highlight (v) /ˈhaɪ.laɪt/ làm nổi bật, nêu bật
Eg: The report highlights the need for improved safety.
The spelling mistakes in the text had been highlighted in green.
Một số từ đồngnghĩa:
- emphasize
- exaggerate
- foreground
- overplay
- overstate
- spotlight
- Astonishing (a) /əˈstɒn.ɪ.ʃɪŋ/ ngạc nhiên, lạ lùng
Eg: Her first novel enjoyed an astonishing success.
It’s astonishing to think that only a few years ago he was a completely unknown actor.
Her writing shows astonishing depth.
Một số từ đồng nghĩa:
- amazing
- staggering
- stunning
- Gadget (n) /ˈɡædʒ.ɪt/ đồ dùng, đồ vật
Eg: Have you seen this handy little gadget – it’s for separating egg yolks from whites.
Một số từ đồng nghĩa:
- appliance
- contraption
- device (MACHINE)
- gizmo
- Foundation (n) /faʊnˈdeɪ.ʃən/ sự thành lập, sự sáng lập, sự thiết lập
Eg: I stand corrected – the date of foundation was 1411, and not 1412 as I had written.
- Inveigle (v) /ɪnˈveɪ.ɡəl/ dụ dỗ
Eg: Her son tried to inveigle her into giving him the money for a car.
Collocation
inveigle someone into doing something
Một số từ đồng nghĩa:
- persuade If she doesn’t want to do it, nothing you say will persuade her.
- convince The lawyer convinced the jury of the man’s innocence.
- talk someone into She managed to talk me into going along.
- talk someone out of I think I’ve talked him out of leaving the country.
- dissuade I tried to dissuade her from leaving.
- cajole He really knows how to cajole people into doing what he wants.
- Convey (v) /kənˈveɪ/ truyền (âm thanh, hương vị, lệnh, tin); truyền đạt, chuyển
Eg: His poetry conveys a great sense of religious devotion.
Please convey our condolences to the family.
- Precise (a) /prɪˈsaɪs/ chính xác
Eg: The bunker’s precise location is a closely guarded secret.
Một số từ đồng nghĩa:
- correct That answer is correct.
- right All his answers were right.
- accurate Her novel is an accurate reflection of life in Spain.
- exact “I still owe you £7.00, don’t I?” “Actually, it’s £7.30 to be exact.”
- Transmit (v) /trænzˈmɪt/ truyền, phát (một tín hiệu, chương trình..)
Eg: Radio Seven transmits on 201 medium wave (= uses those particular radio waves to broadcast on).
The information is transmitted electronically to the central computer.
- Guarantee (v) /ˌɡær.ənˈtiː/ hứa chắc chắn, cam đoan, bảo đảm
Eg: European Airlines guarantees its customers top-quality service.
The label on this bread says it is guaranteed free of/from preservatives.
Một số từ đồng nghĩa:
- promise I promise that I’ll be home before dark.
- give (someone) your word He gave me his word that the job would be finished on time.
- assure “Don’t worry, your car will be ready tomorrow”, the mechanic assured him.
- swear I didn’t know what happened, I swear.
- pledge We are asking people to pledge their support for our campaign.
- Genuine (a) /ˈdʒen.ju.ɪn/ thật, chính cống, xác thực
Eg: If it is a genuine Michelangelo drawing, it will sell for millions.
He has demonstrated a genuine interest in the project.
Một số từ đồng nghĩa:
- real That’s not his real hair, is it? I thought it was a bad wig!
- genuine The painting is a genuine Picasso.
- authentic The clerk certified that the documents were authentic.
- honest-to-goodness My father is an honest-to-goodness door-to-door salesman.
- Absolute (a) /ˈæb.sə.luːt/ tuyệt đối, hoàn toàn; thuần tuý, nguyên
Eg: I have absolute faith in her judgment.
There was no absolute proof of fraud.
- Cope (v) /kəʊp/ đối phó, đương đầu (+with)
Eg: It must be really hard to cope with three young children and a job.
Một số từ đồng nghĩa:
- contend
- deal
- manage
- Crucial (a) /ˈkruː.ʃəl/: quyết định; cốt yếu, chủ yếu
Eg: Her work has been crucial to the project’s success.
It is crucial that the problem is tackled immediately.
Một số từ đồng nghĩa:
- all-important
- essential (NECESSARY)
- vital
- Feat (n) /fiːt/ kỳ công, chiến công
Eg: Getting the house painted was quite a feat.
Một số từ đồng nghĩa:
- action You should take responsibility for your own actions.
- act This was considered to be an act of war.
- thing That’s the last thing you should be doing if you’re pregnant.
- activity Not all of her business activities were scrupulously clean.
- move Applying for that job was a good move.
- deed Their evil deeds must not go unpunished.
- Breakthrough (n) /ˈbreɪk.θruː/ phát minh quan trọng, bước đột phá
Eg: This drug has been heralded as a major breakthrough in the fight against breast cancer.
They had minor breakthroughs but real success eluded them.
- Revolution (n) /ˌrev.əˈluː.ʃən/ cuộc cách mạng (nhất là bằng vũ lực, lật đổ một chế độ cai trị)
Eg: It was very difficult to encapsulate the story of the revolution in a single one-hour documentary.
Tomorrow is the 30th anniversary of the revolution.
He became a national hero for his part in the revolution.
- Ambiguous (a) /æmˈbɪɡ.ju.əs/ khó hiểu, mơ hồ, nhập nhằng
Eg: His reply to my question was somewhat ambiguous.
Một số từ đồng nghĩa:
- Ambivalent
- equivocal
- Luyện tập
Bài 1: Chọn từ trong khung để hoàn thành các câu bên dưới
universe
solutions |
theory
enable |
Impact
applications |
launch
soared |
exposure
probe |
- He has a ……….…………. that the hole was caused by a meteorite.
- The Swiss Banking Commission is conducting a …………………. into possible insider dealing.
- We have advanced greatly in our knowledge of the………………..
- It is wrong to ……………..……….. or support any addict to become re-addicted to any drug.
- We know that prolonged…………….……… to vibration can weaken aircraft components.
- My spirits …………………… when I heard the good news.
- He anti-smoking campaign had had/made quite an ………..…. on young people.
- The design has many…………….….…..
- UK After working for the company for several years she decided to ………….…… out on her own and set up in business.
- They help you talk through your problems but they don’t give you any ………….
Bài 2: Chọn đáp án đúng để điền vào chỗ trống
- The government ………………….. MPs to vote in favour of the bill. A. instructed B. transmitted
- The accident …………………… the need for new safety measures. A. inveigles B. highlights
- Sound is …………..………… from the eardrum to the sound-sensitive cells in the ear by means of a bridge of three tiny bones. A. transmitted B. guaranteed
- We only need that the return maps at periodic ………..……. are diagonal on the stable and unstable manifolds. A. orbits B. triumphs
- With competition heating up, the latest …………..…….. have added features to set them apart from the competition. A. gadgets B. theories
- The eradication of smallpox by vaccination was one of medicine’s greatest ……………..……. A. triumphs B. orbits
- The ceremony will mark the anniversary of the …………..……… of the hospital. A. foundation B. variation
- Ellen’s familiarity with pop music is …………………………. A. astonishing B. precise
- You don’t want to………….……….the impression that we’re not interested. A. convey B. inveigle
- I then realized to my …………………….. horror, that I had forgotten the present. A. absolute B. genuine
- The company ……………….…. to observe any governmental regulation on taxes A. copes B. guarantees
- She performed remarkable ……………..……. of organization for the company. A. revolutions B. feats
- The leaders emphasized that a substantial ……………….. had been achieved, but there was more work to be done.. A. breakthrough B. foundation
- There is no sort of respectability about the people who are ……………… into this place to work.. A. inveigled B. conveyed
- The motif of betrayal and loss is …………..…… in all these stories.. A. crucial B. precise
- There was a good turnout for the meeting – twelve of us to be ………………….. A. precise B. absolute
- The whole period leading up to the …………..……… is an interesting chapter in British history. A. feat B. revolution
- The …………………….. has been ambiguous on this issue.. A. revolution B. government
- In an indiscreet moment, the president let his ……..…… opinions be known. A. genuine B. absolute
- He had so much pressure on him in his job that eventually he just couldn’t ……………….…………. A. cope B. guarantee
Bài 1:
1.theory 2. probe 3. universe 4. enable 5. exposure
- soared 7. impact 8. applications 9. launch 10. solutions
Bài 2:
1.A 2. B 3. A 4. A 5. A
- A 7. A 8. A 9. A 10. A
- B 12. B 13. A 14. A 15.B
- A 17. B 18. B 19. A 20. A