After a full week of compiling, changing options, and recompiling, I finally have solved my embedded linux kernel issues.
Now to check through my notes and make sure that they are complete if I ever have to do something like this again.