Does your kernel has support for framebuffer with your Nvidia??? If it's a powermac try benh kernel. Don't select support for VGA console. And configure then the Xfree86 4.2.1-3 (from unstable) for using the framebuffer as driver.
Nvidia doesn't makes drivers or sources for linux with ppc architectures.
