playing with blocks.

我想這樣開始演說，首先請你回想起童年時，

As you figured out how to reach out and grasp,

玩樍木的情境。

pick them up and move them around,

當你學會伸手、抓握、

you were actually learning how to think and solve problems

拿起和移動樍木，

by understanding and manipulating spatial relationships.

事實上，你正在透過了解及操縱物品間的空間關係，

Spatial reasoning is deeply connected

來學習如何思考和解決問題。

to how we understand a lot of the world around us.

空間推理和我們如何理解身邊事物

So, as a computer scientist

有着極大關連。

inspired by this utility of our interactions with physical objects --

因此，身為電腦科學家，

along with my adviser Pattie, and my collaborator Jeevan Kalanithi --

從這種與實物互動的應用當中得到啟發 —

I started to wonder -- what if when we used a computer,

連同我的顧問 Pattie，跟事業夥伴 Jeevan Kalanithi —

instead of having this one mouse cursor that was a like a digital fingertip

我開始想知道 — 假如我們使用電腦時，

moving around a flat desktop,

所使用的不是那像數位指頭般的滑鼠指標，

what if we could reach in with both hands and grasp information physically,

在平面的電腦桌面上移動，

arranging it the way we wanted?

假如我們能以自己雙手，像掌握實物般掌控資訊，

This question was so compelling that we decided to explore the answer,

以我們喜歡的方式操控它？

by building Siftables.

這問題引發起我們的興趣，所以我們決定

In a nutshell, a Siftable is an interactive computer

通過研發 Siftables 去探求答案。

the size of a cookie.

簡單而言，Siftable 就像個

They're able to be moved around by hand,

餅乾般大小的互動電腦。

they can sense each other, they can sense their motion,

你可隨意用手移動它們，

and they have a screen and a wireless radio.

它們會自動感應到其他單元，它們能感測到動作，

Most importantly, they're physical,

且每個單元都有螢幕及無線電收發器。

so like the blocks, you can move them just by reaching out and grasping.

最重要的是，它們是實物，

And Siftables are an example of a new ecosystem

所以能像積木般，透過伸手抓握，即可拿起和移動它們。

of tools for manipulating digital information.

Siftables 是一系列嶄新的

And as these tools become more physical,

數位資訊操控工具的其中一個例子。

more aware of their motion, aware of each other,

當這些工具變得更實物化，

and aware of the nuance of how we move them,

更能感應到動作，感應彼此的存在，

we can start to explore some new and fun interaction styles.

感應到我們如何移動它們，

So, I'm going to start with some simple examples.

我們就能夠開始探索一些新奇有趣的互動方式。

This Siftable is configured to show video,

那麼，我將會展示一些簡單的例子。

and if I tilt it in one direction, it'll roll the video this way;

這些 Siftable 被設定為視訊放映模式，

if I tilt it the other way it rolls it backwards.

如果將它往一邊傾斜，視訊會這樣播放、

And these interactive portraits are aware of each other.

將它傾斜到另一邊，則會倒帶。

So if I put them next to each other, they get interested.

這些互動肖像能感知彼此的存在。

If they get surrounded, they notice that too,

如我將它們放在一起，它們會對彼此產生興趣。

they might get a little flustered.

如果被包圍的話，它們一樣會察覺得到，

And they can also sense their motion and tilt.

然後會顯得有點慌張。

One of the interesting implications on interaction, we started to realize,

它們也以可感應到動作和傾斜度。

was that we could use everyday gestures on data,

我們漸漸發現，在互動之中有一個有趣的蘊含，

like pouring a color the way we might pour a liquid.

就是我們可以將日常用的手勢應用在資訊操控上，

So in this case, we've got three Siftables configured to be paint buckets

比如像灌注液體般灌注顏色，

and I can use them to pour color into that central one,

在這個例子，我們有三顆 Siftables 被設定成油漆桶。

where they get mixed.

而我可以用它們把顏色灌注到中間的那一顆，

If we overshoot, we can pour a little bit back.

混合成新顏色。

There are also some neat possibilities for education,

假如灌多了，我們可以倒一點回來。

like language, math and logic games

還有些能應用在教育上的妙用，

where we want to give people the ability to try things quickly,

例如語言、數學與邏輯推理的遊戲。

and view the results immediately.

我們希望能給人們快速嘗試事物的能力，

So here I'm --

且能即時看到成果。

(Applause)

因此我就…

This is a Fibonacci sequence that I'm making with a simple equation program.

（掌聲）

Here we have a word game that's kind of like a mash-up between Scrabble and Boggle.

這是我用簡單的數學程式作的斐波納契數列。

Basically, in every round

這是個有點像混合了拼字與 Boggle 的文字遊戲。

you get a randomly assigned letter on each Siftable,

基本上，每個回合

and as you try to make words it checks against a dictionary.

每塊 Siftable 會被隨機分配到一個字母。

Then, after about 30 seconds, it reshuffles,

當你嘗試以這些字母拼字時，它會自動檢查字典。

and you have a new set of letters and new possibilities to try.

然後，30 秒後它會重新洗牌，

(Applause)

你會得到新的字母，以嘗試新的可能性。

Thank you.

（掌聲）

(Applause)

謝謝

So these are some kids that came on a field trip to the Media Lab,

（掌聲）

and I managed to get them to try it out, and shoot a video.

這裡有些來參觀媒體實驗室的小朋友，

They really loved it.

我讓他們嘗試這玩意，並拍了短片。

And, one of the interesting things about this kind of application

他們非常喜歡。

is that you don't have to give people many instructions.

而關於這種應用的一件有趣的事是，

All you have to say is, "Make words,"

你不必給人們太多提示。

and they know exactly what to do.

你只需要講一句「去拼字吧！」

So here's another few people trying it out.

他們就知道該怎麼做。

That's our youngest beta tester, down there on the right.

這裡有另一群人正在試玩。

Turns out, all he wanted to do was to stack the Siftables up.

這是當中年紀最小的測試員，他在畫面右方。

So to him, they were just blocks.

結果是，他只想將 Siftables 疊起來。

Now, this is an interactive cartoon application.

對他來說，它們只是玩具樍木而已。

And we wanted to build a learning tool for language learners.

現在，這是個互動式卡通的應用。

And this is Felix, actually.

我們還想為學語言的人建立學習的工具。

And he can bring new characters into the scene,

事實上，這位是 Felix。

just by lifting the Siftables off the table that have that character shown on them.

他能將新的角色置於場景中，

Here, he's bringing the sun out.

只需把印有不同角色的 Siftables 從桌面上拿起來。

Video: The sun is rising.

這樣，他讓太陽出來。

David Merrill: Now he's brought a tractor into the scene.

影片：太陽正在升起。

Video: The orange tractor.

David Merrill：現在他將拖拉機加入場景中。

Good job! Yeah!

影片：橙色的拖拉機。

DM: So by shaking the Siftables and putting them next to each other

做得好！很好！

he can make the characters interact --

搖動 Siftables 並將它們排在一起

Video: Woof!

他可以讓裡面的人物互動…

DM: inventing his own narrative.

影片：汪！汪！

Video: Hello!

DM：創作屬於自己的故事。

DM: It's an open-ended story,

影片：哈嘍！

and he gets to decide how it unfolds.

DM：這是個自由發揮的故事，

Video: Fly away, cat.

他可以自己決定故事的發展。

DM: So, the last example I have time to show you today

影片：飛走的小猫

is a music sequencing and live performance tool

DM：今天最後展示的例子

that we've built recently,

是個編曲和現場即時表演的工具

in which Siftables act as sounds

這是我們最近才完成的，

like lead, bass and drums.

Siftables 能用來當作樂器

Each of these has four different variations,

像主音，低音和鼓聲。

you get to choose which one you want to use.

每一個都有四種不同的變化，

And you can inject these sounds into a sequence

你可以選喜愛的來使用。

that you can assemble into the pattern that you want.

而你能把這些聲音加入編曲中

And you inject it by just bumping up the sound Siftable against a sequence Siftable.

自由組合想要的形式。

There are effects that you can control live, like reverb and filter.

你還可以將聲音 Siftable 輕輕碰上編曲 Siftable 來加入樂聲。

You attach it to a particular sound and then tilt to adjust it.

這裡有些效果你能即時控制的，像混響和過濾器。

And then, overall effects like tempo and volume

你可以將效果指定到特定的聲音，然後以傾斜來調整它。

that apply to the entire sequence.

然後，像拍子和音量等整體效果

So let's have a look.

能應用到整個編曲上。

Video: (Music)

讓我們一起來看。

DM: We'll start by putting a lead

影片：（音樂）

into two sequence Siftables, arrange them into a series,

DM：我們首先加進主音

extend it, add a little more lead.

到兩個編曲 Siftables，排列成一個序列，

Now I put a bass line in.

延長它，再多加一點主音。

Video: (Music)

現在加上低音。

DM: Now I'll put some percussion in.

影片：（音樂）

Video: (Music)

DM：現在我會加入打擊樂器。

DM: And now I'll attach the filter to the drums, so I can control the effect live.

影片：（音樂）

Video: (Music)

DM：現在我將過濾器用在鼓聲上，然後即時控制效果。

DM: I can speed up the whole sequence

影片：（音樂）

by tilting the tempo one way or the other.

DM：我可以加快整個編曲

Video: (Music)

只要任意傾斜拍子單元的一邊。

DM: And now I'll attach the filter to the bass for some more expression.

影片：（音樂）

Video: (Music)

DM：現在我在低音樂器部份加上過濾器以強化聲調。

DM: I can rearrange the sequence while it plays.

影片：（音樂）

So I don't have to plan it out in advance, but I can improvise,

DM：我可以在播放途中重新排列編曲。

making it longer or shorter as I go.

我不用預先設計好，而能夠即興創作，

And now, finally, I can fade the whole sequence out

即時把它加長或減短。

using the volume Siftable, tilted to the left.

最後，我能將整個編曲淡出

(Applause)

利用音量 Siftable，把它傾斜到左邊。

Thank you.

（掌聲）

So, as you can see,

謝謝。

my passion is for making new human-computer interfaces

如你所見，

that are a better match to the ways our brains and bodies work.

我熱衷於研制全新的人機界面，

And today, I had time to show you one point in this new design space,

更有效地配合我們的大腦跟身體的運作。

and a few of the possibilities that we're working to bring out of the laboratory.

而今天，我為大家展示了，這全新設計領域的冰山一角，

So the thought I want to leave you with

一些我們正努力帶離實驗室，並加以推廣應用的可能。

is that we're on the cusp of this new generation of tools

而我希望能給大家一個想法，

for interacting with digital media

就是我們正處於新一代

that are going to bring information into our world

數位媒體互動工具的尖端，

on our terms.

它們能用我們可以理解的詞彙

Thank you very much.

將資訊帶到我們的世界。

I look forward to talking with all of you.

非常謝謝大家。

(Applause)

希望有機會再與各位談話。