Should Christian parents pull their kids out of public school?

I believe Christian parents make a terrible mistake when they turn their children over to the state for education for the majority of their formative years.

“Pure religion and undefiled before God and the Father is this, To visit the fatherless and widows in their affliction…”