The first and second pigs didn't find their fortune because they built their houses out of straw and sticks, respectively. These materials were not strong enough to withstand the wolf's huffing and puffing, and their houses were easily destroyed. Thus, they failed to secure a safe home and fortune.