I work full-time with children and have brought up two of my own, so I actually love kids of all ages, but I must admit that I would not like my quilting activities, that take place in my very scarce free time, to be interrupted by noisy and bored children. If, on the other hand, they are old enough to participate, then that's fine with me.
There is the possibility to get together with a few other young mothers and meet socially on a regular basis, including quilting activities.
When my sons were little I had an arrangement for several years with a neighbour who had children of a similar age. She went to slimming club meetings on a Tuesday, and I was teaching a German class on a Thursday night. We looked after eachother little ones. It worked really well.
I hope you'll find a solution.
Lorchen