The company who makes the Frixion Pens confirms that they were not intended to be used on fabric, and that the chemicals in them can only be removed by professionals using even more chemicals. So, if you use these pens, the chemicals stay in the fabric, even if you wash the fabric several times. That's why the markings can come back, even years later. The pens have not been around long enough to know what their longterm effect on fabric is.
BUT........ I love using them on paper when taking notes, because I can correct my frequent spelling errors quick and easily.