CYC-ology - Using AI to Organize Knowledge

Doug Lenat, an artificial intelligence researcher and CEO of Cycorp, a company that aims to build general artificial intelligence, gave a talk at the Center For Inquiry Austin. He examined why AI is so difficult to create, and how CYC is approaching this task.

Why haven't we been able to create a program that would pass the Turing test, i.e. be able to converse in such a way as to be indistinguishable from a human? For a large part it's because human thinking is faulty in ways that are very hard to approximate in software. Doug Lenat calls these idiosyncracies of human thinking translogical behaviors. Those are illogical but predictable decisions that most people make; incorrect but predictable answers to queries. Lenat listed some of those behaviors in his talk. He also addressed them in his article, "The Voice of the Turtle: Whatever Happened to AI?" (PDF). Here are some examples, compiled from both the article and the talk.

Flawed memory and arithmetic ability: while a human will correctly tell you what day of the week was yesterday, he or she will most likely be wrong if asked what day of the week was April 7, 1996. For the same reason, humans are likely to give wrong answers to math problems, but certain answers are more "human" than others. 93 - 25 = 78 is more understandable than 0 or 9998.

Conjunction Fallacy: Most people will say "A and B" more likely than A. For example, asked to decide which is more likely, "Fred S. just got lung cancer" or "Fred S. smokes and just got lung cancer," most people say the latter.

Incorrectly estimating probabilities of various events. People worry more about dying in a hijacked flight than the drive to the airport.

Failure to discount sunk cost; also, skewed perception of risk and reward. People estimate risks and rewards very differently if it means losing something they already had, as opposed to investing into something they don't yet have.

Reflection framing effect. Let's say, before adopting a certain public health program (e.g. medical screening), 500 people a year used to die from whatever this program is supposed to prevent. If you market it to the public as saving 200 lives a year, many more people will vote for it than if you say "300 people per year will die".

Another example. In two neighboring countries organ donor rates are 85% and 15%. Lenat asked us to guess the cause of this drastic difference, considering that the two countries are very similar in their socio-political and economic situation. It turns out, the only difference is that when you get a driver's license in the country A, you have to opt-in to be an organ donor by checking a box on a form; in country B, you have to opt OUT of it, also by checking a box. When opt-in is the default, 85% people opt-in; the reverse is also true. 85% of people just don't bother to check the checkbox either way. Who would have thought?

Failure to understand regression to the mean. That's a kind of translogical thinking I found the most poignant. Many parents punish their child after he or she gets an abnormally bad grade, and reward them after getting a good grade. However, after an unusually bad grade, the next one is statistically likely to be better without any punishment or reward. Similarly, after a good grade, the next one is likely to be worse. So parents who react to grades with punishments or rewards, get an idea that punishment works, but rewards don't. Historically it explains a lot of cruelty among humans, says Lennat. In reality, he believes, nothing really has any effect on human beings.



Doug Lenat (right), Steve Bratteng (center) and an unidentified guy chat after Doug Lenat's lecture "CYC-ology - Using AI to Organize Knowledge" at the CFI Austin.

Despite these uniquely human weaknesses, people can easily make inferences about the world that computers can't. Even the best search engines today are falling short of putting together simplest facts about the world, and drawing conclusions from them. If you ask Google "Is the Space Needle taller than the Eiffel tower?", you'll get tons of pages that give the heights of theose objects, but no page that tells you which one is taller. You also won't get an answer to "who was U.S. president when Barack Obama was born?", because search engines still can't string together two facts: Obama's year of birth, and the identity of the president that year (John Kennedy). Today's search engines only handle syntactic search, while these queries represent examples of semantic search.

As we saw, human reasoning strengths and weaknesses are not the same as AI reasoning strengths and weaknesses. There is an opportunity for synergy here, says Lenat. What is the missing piece to bridge that chasm? CYC is ready to bridge it with their (a) ontology of terms, which includes over 1 million of general terms and proper names, (b) knowledge base of general knowledge, which is 10x size of the ontology, and includes such facts as unsupported objects fall; once you're dead, you stay dead; people sleep at night; wheeled vehicles slow down in mud, and (3) a fast inference engine. So for example, if you query CYC system for an image of "someone smiling", it will retrieve a picture with a caption "A man helping his daughter take her first step". The system achieves this by putting together the fact that when you are happy, you smile, with the fact that you become happy when someone you love accomplishes a milestone.

(As an aside, I think this level of sophistication is easy to foil. Human emotions are more complicated than this example describes, and someone watching their child take first steps could easily have tears in their eyes. So an AI would have to know that there is such a thing as "tears of joy". But how would it tell between those, and tears of sadness? An AI would have a long, long way to go before it could recognize similar emotional nuances.)

So are we making any progress towards AI? Doug Lenat believes that the current semantic web "craze, fad, or trend" (his words) is moving us in the right direction. Instead of syntactic searching like Google is doing now, in a small number of years we might be able to see semantic searching. What would be the signs that our software is becoming more intelligent? Look for speech understanding systems, like Dragon Naturally Speaking, to stop making dumb mistakes, says Lenat. When they no longer garble your words in ways that a human would never misunderstand, that would be the sign that speech recognition programs have some semantic awareness.

Are we on the road to Singularity, then? Nobody in the audience asked Lenat this question outright, but he admitted he believes it's only a matter of time until artificial intelligence crosses human intelligence.

Ambivalent towards Google Wave

Apropos my previous post): I got a Google Wave invite, but after logging in I haven't done anything with it. I don't know anyone I could "wave" at, and am not very motivated to find such people -- or to wave at them. It's hard enough just to keep up with email, Facebook and Twitter. I communicate with most of my real-life friends over Facebook, so Wave would be duplication of that functionality. If, however, I started "waving" at a completely different set of people, that would double the time I spend on my virtual social life, and I can't afford that. So I haven't been doing anything with Google Wave.

But I saw this great article, What problems does Google Wave solve? by Daniel Tenner, where he argues Google Wave is not so much an enhancement of your social life, as a corporate collaboration tool. This ties back to what Tristan Slominski said in his Innotech presentation (see my previous post). I can see how a Wave-like IDE plugin might enable programmers to work on shared pieces of code. Then again, many if not most companies would not let their code past corporate walls and firewalls. To route confidential information, or even source code, through third-party servers is considered unthinkable in most companies.

But if Google Wave is so great for collaboration, I can think of some uses for it. Perhaps it could help me and my friends to work on our fanzine more efficiently. (I spoke about our fanzine in this post.) Preparing each issue of the fanzine involves bouncing documents back-and-forth multiple times between authors, translators, copyeditors, and illustrators. So if Google Wave really works as advertised in Daniel Tenner's article, it could be useful for that. The only problem is I would have to convince my friends to use it. For all I know, they might feel the same kind of resistance to it as I do.

Innotech 2009

Still cursing Austin's prehistoric self-pay parking lots, I walked into the Innotech Beta Summit panel, a showcase of select Austin startups. To my surprise, parking meters were mentioned there. A representative of Infochimps, a company that specializes in "making large data sets sexy", said a collection of locations of parking spots in downtown Austin is an example of those sexy data sets. (Another example is TAKS scores.) Anyone can put a data set on Infochimps web site, and if some organization or person is interested in it, they can buy it. Well, I'm sure glad some company is interested in locations of parking meters in Austin downtown. Whatever they are up to might make parking easier one day, who knows?

Wouldn't it be nice to have an application that showed all parking spots within a certain radius? It could direct me to a nearest free spot as I wind my way through downtown, looking for parking. But maybe such an app for iPhone already exists? I don't have an iPhone (and now that I've been laid off I don't anticipate buying one soon), so I don't know.

I expected Beta Summit to be the most interesting Innotech panel, and it was. It featured 6 or 7 Austin startups. The first one, BuzzStream, did not impress me all that much, perhaps because I came to the talk late. The only impression I got from it was that it did some kind of fancy contact management, integrating your contacts with social management sites. Or perhaps it was yet another social media aggregator, the kind that gathers all the content your friends have posted on various other sites, into one news feed. We all have seen social media applications that claimed to be the aggregator to end all aggregators, and then a few months later no one remembers them. Plurk comes to mind.

The next presenter was Gendai Games. Their product lets you create an iPhone game in minutes, even if you are not a programmer. As a demo, Nestor Hernandez recreated the game Labyrinth in front of the audience. He did that he dragged widgets, such as Accelerate and Collide, on the screen. Those widgets made a ball accelerate when iPhone is tilted, or bounce off the "walls", i.e. the sides of the screen. Pretty neat.

Eric Moujaes from Gendai Games	Tristan Slominski speaking on Operational Transformation: The Key to Understanding Google Wave

One web application everybody could relate to was Gelato, a dating site that works differently than most dating sites. On an ordinary dating site members have static profiles that are often misleading or uninformative. People often post younger and thinner pictures of themselves. Steve Odom, the founder of Gelato, believes that people's social media data streams reveals much more about them than their self-proclaimed love of "long walks on the beach and candlelight dinners". Their Tweets, Flickr photos, YouTube videos or Netflix queues, or soundtracks on internet radio stations they listen to, reflect a much fuller, dynamic picture of their tastes and their preferred ways to spend time. So Gelato aggregates all that into a user's profile. Is that a bit too stalkerish? Users can opt out of whichever feeds they prefer others not to see.

As a demo, Steve Odom pulled up a woman's profile on Gelato. "Would I want to date her?" he asked the audience. Her Twitter word cloud (another neat feature of Gelato) showed that her most commonly used word was LOL. "Hmm, maybe not," Odom concluded.

Another web application of broad appeal was PetMD. It's analogous to medical information sites, only about pet health. It also helps you find a veterinarian, even an emergency vet if need be.

There may have been other startups, but I left early.

This conference was a mix of technical and soft presentations. It's always hard to know which ones to choose; an appealing tile can be misleading. So there was some kind of "work/life balance for entrepreneurs" panel, where a self-proclaimed work/life balance coach did nothing but slung cliches about success like "you are your own worst enemy"; I spent half an hour before concluding it was BS. But by then I missed the first half of "Operational Transformation: The Key to Understanding Google Wave" presentation by Tristan Slominski. When I came in, he and the audience were up to their eyeballs in the APIs. Operational Transformation is kind of like a platform on which Google Wave is written. Knowing its API, you can write your own clients that will be able to communicate with other Operational Transform clients. For example, Slominski says, those could be plug-ins for IDEs (i.e. development environments -- tools in which programmers write, compile, build and test their code.

Innotech, or a digression about parking spots in downtown Austin

Innotech is an annual one-day technology conference in Austin, TX. This year it took place on October 29. Before I can speak about it, I should talk about getting there, and the most complicated part of getting there is finding a parking spot in downtown Austin. The process of searching for one also provides the greatest thrill you are likely to have at Innotech, if by thrill we mean a nervous rush. I used to think of it as my personal deficiency that finding parking in downtown Austin (or most other cities, for that matter) stresses me out so much. But here's an article "Why Speakers Earn $30,000 an Hour - Confessions of a Public Speaker"> by Scott Berkun, where he says finding the right address and parking in unfamiliar places is stressful! Ah, I feel so validated. :-)

The parking garage at the Austin Convention Center was full at last year's Innotech; this year I didn't even bother to check it. And street parking often has 3 hour limit, and costs $1 an hour. A bit steep for the whole day. I thought I'd park in a public parking garage, but they seem to be on every corner when you're NOT looking for one, and damn hard to find when you are. Every garage appears to be reserved for employees of that particular office building, or if they are open to the public, they charge thereabouts of $20 a day. Steep.

Downtown Austin also has a scattering of paid parking lots; it's been a bit of a mystery to me why those parking lots aren't used by offices or restaurants attached to it. Maybe I haven't been paying attention, and there is nothing attached to them, or whatever it was has closed or was torn down. Often those parking lots don't have attendants. What they have instead are kind of vertical boxes with slots you should stuff money into. They take coins and bills. There is also a piece of metal hanging from a string that you should use to stuff coins and bills into the slot, should they get stuck just inside the slot.








Fortunately, parking at one of those lots costs only $5 a day, so it's a good deal. This year I stuffed my $5 bill into my slot without difficulty, but last year was a different matter. I didn't have enough bills, but I had a purse full of quarters back from the days when I used a paid laundromat at an apartment complex. I don't have much use for those quarters, so I stuffed 20 of them, one after another, into the slot, and I had to wiggle that metallic stuffer really hard. A guy who parked in the same lot at the same time, asked if I was going to Innotech. He was going there too. However, he didn't have enough $1-$5 bills or coins. So I fed quarters into his slot too (as I said, I don't have much use for them). He was thankful and said it must be true what they say about people being friendly in Austin. (He had moved here from California.)

Just as last year, I wondered how ironic it was that I had to use such an outmoded, awkward way to pay for parking before I could get to a conference on all things high-tech. Besides established tech companies, this conference also features selected Austin startups. I wished any of those startups that gave 8-minute talks on the Beta Summit panel had poured its energies into technologies that would let you pay for parking with your cell phone. That has to be possible, right? I've heard it's already possible in some parts of the world. And you don't necessarily have to install fancy, expensive parking meters that would interface with your phone directly. You could simply pay by a text-messaging the company that owns the parking lot.

But now that I thought about it, I'm not sure companies who own parking lots would want such a thing. They don't have to care about convenience for customers, because they don't have to compete for customers. Parking is very hard to find downtown. Space is limited and it won't grow magically. People will put up with inconvenience just to get a parking spot, because what choice do they have? So probably nothing will happen, unless it could be somehow demonstrated that companies would save expenses by adopting a more efficient way of collecting payments for parking.

From here I can seque to Innotech. That will be my next post.

Conventions, cliquishness, barcamps

I haven't blogged for a while (have been writing mostly fiction lately), and it's been even longer since I've actually posted anything controversial. So maybe I should put aside my impartial observer blogger-voice, and indulge in some personal opinion.

I liked this review of Atheist Alliance International (AAI) convention by Santi Tafarella. It's snarky, but it has a truthful ring. Even though I haven't been to an AAI convention, this review mirrors what happens in so many science fiction cons. The cliquishness, hierarchical structure, the constant "schmoozing up" to the pro writers, editors and agents. I especially liked this quote:

By the average age, affluence, ethnic, and gender makeup of the conference (more men than women), you might well have imagined that you had stumbled upon a conference of Republican activists. I thought it was ironic that the nearly all white and affluent crowd mouthing off about the evils of religion were being catered to all weekend by a coterie of working class Hispanics who, on Sunday, would no doubt be at Catholic Mass or in attendance at one of the local Protestant megachurches.

and

And as you approached the screen, it was like entering the theater of Dionysus, with all the chief priests of atheism gathered at the front and center tables closest to the stage, and sitting together in a clubby way. The best tables were reserved for VIPs. Some people had VIP on their name cards. Perhaps they made big contributions to the event. The rest of us were losers. We were not very important people. This two-tier system was at work throughout the day (or you might think of it as a three tier system if you count the virtually all Hispanic conference staff). Whatever else atheism is, it's not a critique of hierarchy. Hierarchical religion may be bad, but hierarchical irreligion is, well, natural. Every train needs a caboose.

[...]

Atheism is great! Just like high school. At supper time, when all the nonwhite hotel workers were moving around vigorously, I noticed that Michael Shermer and PZ Myers were sitting together also, chuckling it up. Seeing all this front and center social bonding, I couldn't help but think of George Orwell's Animal Farm. (Oh, so this is what the victorious revolution will look like!)

It always made me wonder: we, atheists and/or science fiction writers, are presumably working towards a better world, or at least would like to think that we are -- so is *this* what our better world would look like? Indistinguishable from the old world?

By now I guess you'd be asking the obvious -- so why do I go to conventions at all? Well, as a writer, I need to know what speculative fiction readers think of the genre, so I go where the readers congregate. Lately, though, I have been inspired by the concept of BarCamp. A BarCamp is an "unconference" where everybody is, or can be, a presenter. People give 15-30 minute presentations on any subject they like (that's relevant to the conference topic), and they break out into discussion sessions as they see fit. I've written about Barcamps I attended in these blog posts.

BarCamps have been gaining popularity in the tech world, which I think speaks volumes for the credibility of this format. After all, technical world is highly meritocratic; they have little patience for people who talk the talk and can't walk the walk. If technical professionals think hierarchy-free structure is a good enough way to organize presentations, in the sense that people who don't have much to say will weed themselves out, then it may also be good format for a SF convention. Or maybe I'm naive, because the liberal arts mafia that runs conventions will reject meritocracy. :-) Still I've been thinking of organizing science fiction BarCamp. I casually mentioned this to one guy who used to organize science fiction and Linux conventions, and he thought it was a good idea. I probably won't get around to it in the next few years, as I don't want to distract myself from other pursuits, for which I already don't have enough time. Besides, I would probably get stuck in the analysis-paralysis stage.

I don't even know whether I would want to do it in the middle of a science fiction convention, or as a separate event altogether. It's quite likely that the organizers of a SF convention would not let me attach a BarCamp to it anyway. Why do I think they wouldn't let me? Because in the past I had submitted programming ideas to a convention program chair, and those ideas differed in style and formatting from the usual SF convention panel items. I got no response except some form of "your suggestions were noted". It is clear that at most conventions the programming committee wants to keep giving the attendees the same old with slight variations (e.g., one year there's a panel on vampires, next year it's on werevolves. Oh well, maybe that's not a good example: vampires have been de rigueur at any genre convention, any recent year. :-)) So I haven't felt much encouraged. In any case I won't try to do this any time soon. But if someone else wanted to run with my idea, I'd come to their camp.

Fake friends, or being someone's spam cannon fodder

This rant was prompted by people's comments on my Facebook status update today. It said:

"Defriended a Facebook "friend". It was one of those people who friend you for no good reason. He doesn't know me, lives in a different country, posts in Spanish (which I can't read), never comments on my posts, and keeps inviting me to events in another continent. I asked him to stop, but he kept doing that. I guess when you have over 1500 "friends", you don't have time to show special consideration to any one of them."

I got a range of responses to that. Some said they refuse friend requests from strangers, others said the whole point of Facebook is to meet new interesting people. Generally I agree with the latter, though I mostly use Facebook to keep in touch with people I know in real life. Nonetheless I used to accept friend requests from strangers mostly because I'm "too nice" (read spineless) to say no.

That's not to say I dislike reading strangers' updates. Not at all. I like them, if the author's personality comes through in them. This includes people's personal opinions, and observations about their life. However, there is a type of people -- unfortunately this is fairly common among atheists on Facebook -- who friend pretty much everyone with vaguely similar interests or views. Those people have 1000 - 2000+ "friends". They can't possibly read everyone's posts. And if they don't, what's the point of being "friends"? What's worse, people with the greatest number of impersonal friends are also the noisiest posters. They post 10-15 items every day. If those were updates on their personal life, it wouldn't be so bad. It could even be interesting. But they usually post news headlines, and those are typically headlines I've already seen elsewhere. I read the internet as avidly as anyone else, so I don't need news to be pushed on me. It's like those people have decided that I don't pay enough attention to the news, so they've taken it upon themselves to educate me and thousands of others. I resent that attitude.

Some of those people have admitted they have hooked up their Google Reader to automatically dump all their feeds into Facebook. So they don't even hand-pick their news! They don't even need to login into Facebook to set up this kind of automatic broadcasting. They can fill up your stream with their newsfeed crap without ever logging in and reading other people's posts!

Is that a "friend" relationship? No. If those folks think everyone should use them as a news portal, they should set up a fan page for themselves on Facebook. A fan page is the right model for broadcasting *at* people, as opposed to having conversations *with* people.

Funny thing is, I might be alone in my distaste for this kind of fake friendship. Many people actually comment on those posts, and get involved in long debates. Myself, I usually hide those hyper-logorrheic posters from my friends' stream. And if they pester me with invites to irrelevant events, I might even unfriend them, as I did today.

That said, I like reading updates, strangers' or not, if I can tell their author has put thought into them. It's impersonal broadcasting that I dislike.

ArmadilloCon: Stump the Panel

Panelists at this event are supposed to come up with mundane and science-fictional uses for objects supplied by the audience. They can also use objects they brought themselves. This year's team is C. J. Mills, Steve Wilson, and Chris Roberson.

Below, left-to-right, are:

1. A pez dispenser in the shape of a character from Ratatouille. Chris Roberson thinks it's an oracle. You ask it a question, and its head tilts back to reveal an answer comes from its neck. The answer will be yes, no, or pez. So you have to formulate the question really carefully.

2. Chris Roberson thinks this neti pot may play a role in fertility rituals. Steve Wilson thinks it extracts something from your brain through your nose.

3. A metallic squirrel that cracks nuts with its tail. Someone in the audience thinks this is a robotic squirrel designed to teach aliens not to molest the local wildlife.









4. Munchkin game pieces. C. J. Mills thinks they are lumberjacks that you rehydrate when you come to the forest. A woman from the audience says they are snacks for a gnome-eating alien.

5. This ethernet hub... You'll just have to click on the image to find out what Chris Roberson thought it was. Beware of a gross-out factor. :-)

6. A cell phone with an cute / evil face on it. It is unanimously decided that this phone isn't really evil, it's just charmingly possessed. It loses your messages, and texts your boyfriend at inappropriate times. C. J. Mills thinks it's a psychic phone that lets you know exactly when opportunity is.









7. C. J. Mills and Steve Wilson hold a cable reel, which, as someone suggested, might be a prayer box for an orthodox giant.



Here is an article about a "Stump the Panel" from the ArmadilloCon 2008, with Rhonda Eudaly, S. Andrew Swann, and Lou Antonelli. And here is an article about a "Stump the Panel" from the ArmadilloCon 2006, with James P. Hogan on it.

Pictures from ArmadilloCon 2009 are in my photo gallery.