Such things actually make up a fairly small portion of government spending.

http://usgovernmentspending.com/piechart_2009_US_total

Further, ask yourself who makes a profit on public service - the child who is poorly educated by a failing school, or the teacher who is overpaid to provide that service?