Maternal bacteria are shared with infants via breastfeeding. Prebiotics modulate the gut microbiota, promoting health benefits. We investigated whether the maternal diet supplementation with a prebiotic (fructooligosaccharides, FOS) could influence the milk microbiota. Twenty-eight lactating women received 4.5 g of fructooligosaccharides + 2 g of maltodextrin (FOS group) and twenty-five received 2 g of maltodextrin (placebo group) for 20 days. Breast-milk samples were taken before and after the intervention. The DNA from samples was used for 16S rRNA sequencing. No statistical differences between the groups were found for the bacterial genera after the intervention. However, the distances of the trajectories covered by paired samples from the beginning to the end of the supplementation were higher for the FOS group (p = 0.0007) indicating greater changes in milk microbiota compared to the control group. Linear regression models suggested that the maternal age influenced the response for FOS supplementation (p = 0.02). Interestingly, the pattern of changes to genus abundance upon supplementation was not shared between mothers. We demonstrated that manipulating the human milk microbiota through prebiotics is possible, and the maternal age can affect this response.