Ok well after a little testing with a PC Engines cf adapter and a normal PC (tested with livecd first to ensure it worked), I ran into the exact same problem (using the CF image, non wrap). Tommorow I will pickup a new Kingston CF to ensure its not a card issue.
Digging on the forums I found another person having the same problem and they switched to Lilo, I may try that also.