interacting with the physical objects around us.

和周圍物體互動的環境裡

There are an enormous number of them

有很多很多物品，

that we use every day.

是我們每天都要用到的

Unlike most of our computing devices,

和大部分電腦軟體相比，

these objects are much more fun to use.

這些實體有趣多了。

When you talk about objects,

當我們提到物品,

one other thing automatically comes attached to that thing,

會立即出現和這東西有關的另一件事 --

and that is gestures:

姿勢:

how we manipulate these objects,

也就是：我們怎麼使用這些物品,

how we use these objects in everyday life.

我們在每日生活中如何使用這些物品

We use gestures not only to interact with these objects,

我們不只運用不同姿勢來使用物體

but we also use them to interact with each other.

也用來和別人溝通。

A gesture of "Namaste!", maybe, to respect someone,

合十的姿勢，可能是表示尊敬某人

or maybe --

或者是 --

in India I don't need to teach a kid that this means

在印度，不必教，小孩都知道這是 --

"four runs" in cricket.

板球的"4"的意思

It comes as a part of our everyday learning.

這是我們的生活常識

So, I am very interested,

所以，我一開始，就很有興趣

from the beginning, that how --

想了解， --

how our knowledge

我們對於

about everyday objects and gestures,

日常用品和姿勢的認知,

and how we use these objects,

以及，如何把這些物品

can be leveraged to our interactions with the digital world.

運用在我們和數位世界的溝通上

Rather than using a keyboard and mouse,

為什麼沒有鍵盤和滑鼠,

why can I not use my computer

我就沒辦法使用電腦?

in the same way that I interact in the physical world?

為什麼和電腦溝通，不能和實體世界溝通一樣?

So, I started this exploration around eight years back,

我的探索從八年前開始

and it literally started with a mouse on my desk.

從我桌上的滑鼠開始

Rather than using it for my computer,

我不是在電腦螢幕上使用它

I actually opened it.

而是拆開它，

Most of you might be aware that, in those days,

你們都知道，在那個年代，

the mouse used to come with a ball inside,

滑鼠裡面有個球，

and there were two rollers

還有兩個滾輪，

that actually guide the computer where the ball is moving,

所以，當滑鼠移動時，

and, accordingly, where the mouse is moving.

滾輪會告訴電腦，球滾動的方向。

So, I was interested in these two rollers,

我對滾輪有興趣，

and I actually wanted more, so I borrowed another mouse from a friend --

但還需要多幾個，所以就跟朋友借他的滑鼠

never returned to him --

一直沒還他 --

and I now had four rollers.

這樣就有了四個滾輪。

Interestingly, what I did with these rollers is,

我怎麼用這些滾輪呢--

basically, I took them off of these mouses

基本上，我把它們從滑鼠裡拿出來

and then put them in one line.

放在一條線上

It had some strings and pulleys and some springs.

有線、滑帶和彈簧

What I got is basically a gesture interface device

我做出了一個偵測姿勢的介面裝置。

that actually acts as a motion-sensing device

像個動作偵測裝置，

made for two dollars.

成本只要兩塊美元。

So, here, whatever movement I do in my physical world

所以，現在，不論我在實體世界做什麼，

is actually replicated inside the digital world

在數位的世界裡就會反映出來

just using this small device that I made, around eight years back,

只要用這個我8年前做的小東西就可以,

in 2000.

那是2000年。

Because I was interested in integrating these two worlds,

我對於整合實體和數位世界有興趣,

I thought of sticky notes.

我想到便利貼。

I thought, "Why can I not connect

我想, "何不把

the normal interface of a physical sticky note

實體便利貼的介面，和

to the digital world?"

數位便利貼整合在一起?"

A message written on a sticky note to my mom

在便利貼上寫給我媽媽的留言

on paper

紙條

can come to an SMS,

可以用簡訊傳遞。

or maybe a meeting reminder

或是寫在紙上的會議通知

automatically syncs with my digital calendar --

自動和我的數位行事曆同步 --

a to-do list that automatically syncs with you.

待辦事項會自動在電腦上同步。

But you can also search in the digital world,

但你也同時可以在數位環境裡搜尋,

or maybe you can write a query, saying,

或者是,你可以寫下問題, 如,

"What is Dr. Smith's address?"

"史教授的地址?"

and this small system actually prints it out --

然後這個小系統就把地址列印出來 --

so it actually acts like a paper input-output system,

這就像是個紙做的輸出入系統,

just made out of paper.

用紙就可以做到.

In another exploration,

另一項探索是,

I thought of making a pen that can draw in three dimensions.

我想到用一枝可以畫3D效果的筆

So, I implemented this pen

所以就設計出這支筆

that can help designers and architects

幫助設計師和建築師

not only think in three dimensions,

不只以三度空間思考,

but they can actually draw

也可以畫3D圖形

so that it's more intuitive to use that way.

這樣用起來就更直覺多了。

Then I thought, "Why not make a Google Map,

我又想, "何不做一個實體世界的

but in the physical world?"

Google地圖?"

Rather than typing a keyword to find something,

不必輸入關鍵字來找東西,

I put my objects on top of it.

而是放這個東西在地圖上。

If I put a boarding pass, it will show me where the flight gate is.

如果我把登機證放在地圖上,它會顯示登機口的位置

A coffee cup will show where you can find more coffee,

放咖啡杯，它會顯示咖啡廳的位置,

or where you can trash the cup.

或垃圾筒的位置.

So, these were some of the earlier explorations I did because

這些是早期我做的實驗，

the goal was to connect these two worlds seamlessly.

我的目的是緊密銜接這兩個世界.

Among all these experiments,

在這些實驗之中,

there was one thing in common:

有一個共通點:

I was trying to bring a part of the physical world to the digital world.

我都會把實體的東西帶進數位環境裡.

I was taking some part of the objects,

我把物品,

or any of the intuitiveness of real life,

或生活中，直覺式的東西,

and bringing them to the digital world,

帶進數位世界裡,

because the goal was to make our computing interfaces more intuitive.

目的是讓電腦介面更人性化

But then I realized that we humans

但是後來我了解到

are not actually interested in computing.

人們對電腦沒有興趣

What we are interested in is information.

人們有興趣的是資訊。

We want to know about things.

我們想知道更多事情.

We want to know about dynamic things going around.

我們想知道周圍的各種動態

So I thought, around last year -- in the beginning of the last year --

所以，大約在去年，去年年初的時候--

I started thinking, "Why can I not take this approach in the reverse way?"

我開始想, "我何不顛倒我的研究方向呢?"

Maybe, "How about I take my digital world

或許, "把數位世界的數位資訊，

and paint the physical world with that digital information?"

描畫在實體世界裡??"

Because pixels are actually, right now, confined in these rectangular devices

因為這些影像，都被包在這些方方的裝置裡

that fit in our pockets.

然後放進口袋裡.

Why can I not remove this confine

我何不把這個形體打破

and take that to my everyday objects, everyday life

把資訊放進日常生活中?

so that I don't need to learn the new language

這樣我也不必學新的、

for interacting with those pixels?

和這些象素溝通的語言?

So, in order to realize this dream,

為了實現這個夢想,

I actually thought of putting a big-size projector on my head.

我真的想過把一個投影機放在我的頭上

I think that's why this is called a head-mounted projector, isn't it?

這就是所謂「投(頭)影機」的意思，對吧?!

I took it very literally,

我照著字面意思做了

and took my bike helmet,

我把自行車的頭盔

put a little cut over there so that the projector actually fits nicely.

割掉一點,讓投影機可以放得進去.

So now, what I can do --

這樣，我可以 --

I can augment the world around me with this digital information.

在真實世界中用數位訊息環繞我

But later,

但是,後來

I realized that I actually wanted to interact with those digital pixels, also.

我想到 我也要和這些電腦像素溝通.

So I put a small camera over there,

所以我加了一個小攝影機,

that acts as a digital eye.

當作數位眼睛.

Later, we moved to a much better,

之後, 我們進一步,做成--

consumer-oriented pendant version of that,

使用者導向的頸掛式,

that many of you now know as the SixthSense device.

就是很多人知道的「第六感計算裝置」.

But the most interesting thing about this particular technology

這技術最有趣的地方是

is that you can carry your digital world with you

你可以把數位世界帶著走

wherever you go.

到任何地方都可以.

You can start using any surface, any wall around you,

你可以用任何表面或牆壁，

as an interface.

當成介面.

The camera is actually tracking all your gestures.

這錄影機隨時都在偵測你的動作.

Whatever you're doing with your hands,

不論雙手在做什麼,

it's understanding that gesture.

它都知道.

And, actually, if you see, there are some color markers

還有，你看那些色筆

that in the beginning version we are using with it.

那是我們早期用的.

You can start painting on any wall.

可以在任何牆壁上畫畫.

You stop by a wall, and start painting on that wall.

可以停在牆壁前面，開始在牆上作畫.

But we are not only tracking one finger, here.

而且我們不只偵測一根手指.

We are giving you the freedom of using all of both of your hands,

我們讓你可以用兩隻手全部,

so you can actually use both of your hands to zoom into or zoom out

所以可以用兩隻手去放大縮小--

of a map just by pinching all present.

地圖，用捏的.

The camera is actually doing --

錄影機 --

just, getting all the images --

收集所有影像 --

is doing the edge recognition and also the color recognition

執行動作辨識和顏色辨識

and so many other small algorithms are going on inside.

有很多小程式在裡面跑

So, technically, it's a little bit complex,

技術上有點複雜,

but it gives you an output which is more intuitive to use, in some sense.

但是讓人可以用的很自然

But I'm more excited that you can actually take it outside.

我更興奮的是，可以帶到戶外去用

Rather than getting your camera out of your pocket,

不必掏出口袋裡的照相機,

you can just do the gesture of taking a photo

只要一個照相的姿勢

and it takes a photo for you.

它就替你照相了.

(Applause)

(掌聲)

Thank you.

謝謝.

And later I can find a wall, anywhere,

拍完之後，我隨便找一面牆,

and start browsing those photos

就開始瀏覽這些照片

or maybe, "OK, I want to modify this photo a little bit

或, "我想修改一下這些照片

and send it as an email to a friend."

然後用電子郵件寄給朋友."

So, we are looking for an era where

我們面對的世代是 --

computing will actually merge with the physical world.

與實體世界融合在一起的運算

And, of course, if you don't have any surface,

如果你沒有平面可用，

you can start using your palm for simple operations.

手掌也可以處理簡單的功能.

Here, I'm dialing a phone number just using my hand.

我在這裡只用我的手，撥電話號碼.

The camera is actually not only understanding your hand movements,

攝影機不只了解你手部的動作,

but, interestingly,

而且,

is also able to understand what objects you are holding in your hand.

它還知道在你手裡拿著的是什麼東西.

What we're doing here is actually --

我們現在正在做的是 --

for example, in this case,

舉個例, 在這裡,

the book cover is matched

這本書的封面

with so many thousands, or maybe millions of books online,

正在和線上的數以百萬計的書封面比對,

and checking out which book it is.

找尋這是哪一本書.

Once it has that information,

一旦找到資料,

it finds out more reviews about that,

它會找到書評,

or maybe New York Times has a sound overview on that,

或者，可能紐約時報有個有聲的簡介,

so you can actually hear, on a physical book,

你就可以, 在實體書上，聽到

a review as sound.

有聲的書評.

("famous talk at Harvard University ...")

("哈佛大學的著名演講 ...")

This was Obama's visit last week to MIT.

這是歐巴瑪總統上週來MIT的演講.

("... and particularly I want to thank two outstanding MIT ...")

("... 我特別要感謝2位MIT ...")

So, I was seeing the live [video] of his talk, outside, on just a newspaper.

我從報紙上,看到他演講的實況錄影.

Your newspaper will show you live weather information

你的報紙會給你看動態天氣報導

rather than having it updated -- like, you have to check your computer

不必去更新資料 – 這原本，要上電腦

in order to do that, right?

才找得到, 是嗎?

(Applause)

(掌聲)

When I'm going back, I can just use my boarding pass

我回印度時, 我只要拿出我的登機證

to check how much my flight has been delayed,

就可以知道我的班機延誤多久,

because at that particular time,

因為在這種時候,

I'm not feeling like opening my iPhone,

我不想打開iPhone,

and checking out a particular icon.

點選某個功能圖案.

And I think this technology will not only change the way --

我相信這個技術不只改變--

yes. (Laughter)

是的. (笑聲)

It will change the way we interact with people, also,

也會改變我們和別人的交流

not only the physical world.

不只在實體世界裡.

The fun part is, I'm going to the Boston metro,

好玩的是，我在波士頓的捷運上

and playing a pong game inside the train

玩踢毽子遊戲

on the ground, right?

在地上玩, 不錯吧?

(Laughter)

(笑聲)

And I think the imagination is the only limit

我相信，當這種技術和實體生活混在一起時

of what you can think of

想像力是唯一能限制--

when this kind of technology merges with real life.

我們的東西。

But many of you argue, actually, that

但很多人會說--

all of our work is not only about physical objects.

我的工作和實體物品沒什麼關係.

We actually do lots of accounting and paper editing

我們做的大多是會計、編輯這類的事

and all those kinds of things; what about that?

對於這些,你怎麼處理?

And many of you are excited about the next generation tablet computers

很多人很期待新一代的平板電腦

to come out in the market.

上市

So, rather than waiting for that,

與其等待

I actually made my own, just using a piece of paper.

,我乾脆自己做一個﹐只用了一張紙

So, what I did here is remove the camera --

我把錄影機上的--

All the webcam cameras have a microphone inside the camera.

所有網路度影機上都有個麥克風 .

I removed the microphone from that,

我把麥克風拿下來

and then just pinched that --

夾在--

like I just made a clip out of the microphone --

就像是做了個夾式麥克風 --

and clipped that to a piece of paper, any paper that you found around.

夾在紙上, 隨便的一張紙.

So now the sound of the touch

每當我碰到紙的時候，

is getting me when exactly I'm touching the paper.

這在紙上接觸的聲音就會通知電腦.

But the camera is actually tracking where my fingers are moving.

錄影機還在追蹤我的手指的移動

You can of course watch movies.

你當然也可以看電影

("Good afternoon. My name is Russell ...

("午安，我叫羅素 ...")

and I am a Wilderness Explorer in Tribe 54.")

("... 我是第54團的荒野探險者.")

And you can of course play games.

也可以玩遊戲.

(Car engine)

(汽車引擎聲)

Here, the camera is actually understanding how you're holding the paper

攝影機知道你拿紙的方向

and playing a car-racing game.

就可以玩賽車遊戲

(Applause)

(掌聲)

Many of you already must have thought, OK, you can browse.

很多人早又想到了，可以瀏覽

Yeah. Of course you can browse to any websites

對，當然可以瀏覽任何網站

or you can do all sorts of computing on a piece of paper

甚至在紙上做各種運算

wherever you need it.

在任何你需要的地方

So, more interestingly,

更有趣的是

I'm interested in how we can take that in a more dynamic way.

我想把這個功能變得更強大一點

When I come back to my desk I can just pinch that information

當我回到桌上，我可以捏住那個資訊，--

back to my desktop

然後放到我的電腦螢幕上

so I can use my full-size computer.

這樣我就可以用我的桌上電腦

(Applause)

(掌聲)

And why only computers? We can just play with papers.

為什麼要電腦? 用紙也很好玩.

Paper world is interesting to play with.

紙的世界很好玩.

Here, I'm taking a part of a document

我把文章的一部分

and putting over here a second part from a second place --

放在這裡, 當成第二部份 --

and I'm actually modifying the information

然後調整--

that I have over there.

這裡的資訊.

Yeah. And I say, "OK, this looks nice,

好，然後我說, "OK, 這樣很好,

let me print it out, that thing."

我要列印出來."

So I now have a print-out of that thing, and now --