Noise would be an issue, if it’s an issue at all for you. Many people (including my family) don’t mind kid noises at all.
The only thing that’s a bigger deal, IMHO, is people coming into the schoolyard at night. They might simply be annoying teenagers who’re looking for a place to smoke pot and get loud, or vandals, etc. who might be more of a concern. Basically, it’s like living next to a park.