Dr. Haritaoglu has come up with a wireless solution to these translation blues: a cellphone or palmtop containing a color digital camera that takes a snapshot of the mysterious text and sends it along to a server. Software on the server identifies and translates the text, sends the English words back, and superimposes them on the screen.
So Dr. Haritaoglu can point and click with his hand-held device at a sign in a grocery store window containing the Chinese characters for ginseng, shark fin and herbs, as he did recently in San Francisco's Chinatown, and, 10 or 15 seconds later, see the words in English on the screen.
The technology is not intended for lengthy translations; rather, it is designed for quick hits -- three or four lines of text.
Dr. Haritaoglu built a prototype by attaching an off-the-shelf digital camera to a hand-held organizer with a cellphone plugged into it. Cellphones with embedded cameras are not yet sold in the United States, although they are available abroad, and Nokia will be offering a model here shortly, he said.
The device is an example of augmented reality -- presenting the real world of a Chinese shop sign, for instance, with virtual information like a translation of the sign added as an overlay. Augmented reality can offer information other than translations. For instance, with the addition of a Global Positioning System device, Dr. Haritaoglu can point his camera at a building and overlay not only text translations but also a street map of the area where he is standing.