Should I try to use 401k, 403b money to buy a 2nd House?

[Microman]

Wife thinks that home prices are at a low.

She would like to buy a 2nd place, and possibly have our son rent.

We have some cash, but not enough even for 20 percent down.

We see all that money that is in 401k, Ira's, and 403b's.. and think if there was someway to use that money, that we would use it to put big down payment on a place here in Southern California.

We are up there in age....And since this money has never had tax paid, I am sure it would put us in a 35% tax or higher tax bracker on the year we get the money.

Question: is this a stupid idea? Is there any reason I should consider this?

Thanks..